Clayton Stephan Grant, Family