Matthew G. Goodwin, Family