James A. Jackson, Family