Judith Ellen Harding, Family