James Robert Eliaser, Family