Elizabeth D. Goodley, Family