Nathan A. Roselin, Family