First it says that if you ask a logic problem without any system prompt it will not get it. But if you add a system prompt that "You are a logic bot designed to answer complex logic problems.", it will get it right.
It gets "a married person (Jack) is looking at an unmarried person (George)" which is simply incorrect!
They also add "Although notably not for all the right reasons", is it to justify the logic?
https://docs.google.com/spreadsheets/d/1jIxjzUWG-6xBVIa2ay6y...
First it says that if you ask a logic problem without any system prompt it will not get it. But if you add a system prompt that "You are a logic bot designed to answer complex logic problems.", it will get it right.
It gets "a married person (Jack) is looking at an unmarried person (George)" which is simply incorrect!
They also add "Although notably not for all the right reasons", is it to justify the logic?