Donovan D. Fleming, Family