Edward Joseph Kaigh, Family