Matthew Stephen DeArmey, Family