most implementations do, like https://github.com/oobabooga/text-generation-webui

this might be a hallucinated answer, due to the very small model size of 7b. try the 13b-4bit, it's much better!