Perelman wasn't an academic nobody. He was a Miller fellow at Berkeley, and had visiting positions at the Courant Institute and Stony Brook. When he left the academic system, he had job offers at Princeton and Stanford.

TL;DR People who work on geometry knew Perelman pretty well.