Kevin James Ramey, Family