Rory Allan Hanson, Family