Stephen James Wagner, Family