Joseph R. Manning, Civil rights