Lorrina Monique Duffy, Family