Susan Agay Rothschild, Family