While ChatGPT can correctly answer that 3307 is prime in most of the cases, I think the post still makes a point. Try putting the word 'No' in its mouth at the beginning. It has no power to self ...

From François Chollet a nice definition of what is an LLM: We can see LLMs working as a repository of vector programs. When prompted, they will fetch the program that your prompt maps to and "execute" ...