Brian Douglas Carroll, Family