Paul Francis Moore, Family