That's not the argument. The "contribution" is through taxes to the society that enabled them to get rich in the first place. Sure, some people are upset about obscene displays of wealth (though in today's America, those people don't seem to have much of a voice), but by and large, no one begrudges rich people from enjoying themselves (this is America, after all. We love our rich people as a rule, even when some of them are terrible people individually.)

We do begrudge people avoiding taxes, buying legislation and legislators, funding think tanks that support only the interests of the wealthy, and blowing up the financial system and/or economy.