B Scott Silverman, Family