In a recent test, Siri showed it still has trouble with basic facts. One Foot Tsunami’s Paul Kafasis checked how well Siri knew Super Bowl history, and the results were not great. Siri only got it right 34% of the time, correctly naming just 20 winners out of 58 Super Bowls.
The most surprising mistake was Siri saying the Philadelphia Eagles won 33 Super Bowls. In reality, the Eagles have only won one. Siri’s answers were all over the place, sometimes talking about the wrong Super Bowl or giving unrelated football info.
Siri did okay for a little while, correctly answering for Super Bowls V to VII, but then it went off track, getting 15 answers wrong in a row from XVII to XXXII. When asked about Super Bowl XVI, Siri even suggested asking ChatGPT, which gave the right answer, showing Siri’s knowledge isn’t up to par.
This test was done on iOS 18.2.1 with Apple’s new smart tech, and the same problems were seen on the latest iOS beta and macOS. Kafasis put all the results into a spreadsheet you can look at.
Daring Fireball’s John Gruber also tested Siri with sports questions and found it did worse than other search engines and AI like ChatGPT, Kagi, DuckDuckGo, and Google. Interestingly, the old version of Siri was better at admitting when it didn’t know the answer by showing web links, which at least gave a chance at finding the right answer.
Gruber was quite critical, saying:
“New Siri, with Apple’s smart tech and ChatGPT help, gives answers that are completely but believably wrong, which is the worst kind of mistake. It’s also inconsistent in its errors — I asked the same thing four times and got four different wrong answers.”
Siri’s performance has been criticized before, but these tests show how it can confidently give wrong information. Apple is working on a smarter Siri using advanced language models, hoping to make it as good as other chatbots like ChatGPT. They plan to show off this new Siri in 2025 but won’t release it until spring 2026 with iOS 19.