I find it hard to believe that it’s seen that exact code online along with the output. It’s quite an unusual expression.
Also, it does not matter that the code takes 30 seconds to execute — I’m not claiming that the model is executing the code. I’m suggesting that the model could be understanding what the code is meant to do, and producing the output from that understanding. The code’s inefficiency is irrelevant in that process.
Exactly! It seems to understand enough about what the commands mean and is able to carry the context forward even if it isn't exactly executing them.
Sure someone must have posted online about ls and rm, but a jumbled combination of those where the model is able to keep track of files listed, created and deleted in the specific context of the chat? Mindblowing!
Also, it does not matter that the code takes 30 seconds to execute — I’m not claiming that the model is executing the code. I’m suggesting that the model could be understanding what the code is meant to do, and producing the output from that understanding. The code’s inefficiency is irrelevant in that process.