Caroline Sue Sternberg, Family