Edward Lloyd Somogyi, Family