R. Morgan Holland, Family