The problem is that poor people spend all (or almost all) their income. Flat taxes impact the poor negatively.

What you can do instead is just tax net worth as a flat tax (or a slightly graded tax), instead of taxing income. This impacts only those with a large positive net worth, and that makes more sense.

That solves the estate tax problem as well.