John Hanna Sibbison III, Family