Joshua Neal Osborn, Immigration