Alison Coren Brown, Family