Charles Eugene Weber, Family