Kenneth Ray Hart, Family