Elizabeth H. Hall, Family