Thomas Oliver Nakano, Family