Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

just run the 13b model 4bit quantized locally, it's already better than the 7b-8bit and you can turn down the temperature to 0 to get repeatable results.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: