Carl Jacob Hoppes, Family