Victor Augustus Mordey, Family