Mary Ellen Waller, Family