Robert Blinn Maxwell, Family