Charlotte Leigh Keeley, Family