Possibly. Might need to be further optimized in size and 4-bit quantisation, perhaps and then you have a scaleable and fast self-hosted AI model.
Lets just hope that there won’t be any embarrassing vulnerabilities coming out of this when someone could prompt the model to reveal its own environment variables or API keys or the internal prompt that it is using.
But it seems the $0 free AI models are eating OpenAI’s lunch and Meta so far is winning the race to zero.
Lets just hope that there won’t be any embarrassing vulnerabilities coming out of this when someone could prompt the model to reveal its own environment variables or API keys or the internal prompt that it is using.
But it seems the $0 free AI models are eating OpenAI’s lunch and Meta so far is winning the race to zero.