Bruce Cameron Stuart, Family