David Lloyd Pfaff, Family