I like this idea very much. Is this similar to human moderation of training data?

Sure. I suspect it might be hard to actually recruit people like this considering how the people who got sampled are hugely pissed off at AI firms rn, but money will go a long way here.

Royalty agreement could make this work, every time their data gets used, they get a cut, it would be the only way i could see people agreeing to this.