Lawrence William Thorpe, Family