Sarah E. Boger, Family