Olivia Emlene Olson, Family