Michael Henry Casey, Family