Adam Charles Clark, Family