In a surprising turn of events, Microsoft's search engine, Bing, recently made a perplexing mistake by informing some users that the country of Australia does not exist. This unusual response by Bing was about a long-standing conspiracy theory that has circulated online since 2017, originating from the Flat Earth Society forum.
I can kinda see how this might happen, I bet statements affirming “Australia doesn’t exist” are more common on the internet than ones stating “Australia exists”.
Frightening to think of the all the data fed to these LLMs, a lot of it has to be incoherent ramblings or straight-up trolling.