Virginia L. Taylor, Family