Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Get a Mac Studio with however much memory you need, and ideally an Ultra chip (for max memory bandwidth), and there's your workstation. I regularly run quantized 100b+ models on my M1 Ultra with 128Gb RAM.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: