Mary Harriet Redfield, Family