Phoebe S. Sadler, Family