Google, Microsoft chatbots generate fictional Super Bowl stats, highlighting GenAI's limitations

Recent reports reveal that Google's Gemini and Microsoft's Copilot chatbots, both powered by GenAI models, are providing fictional statistics and claiming that the 2024 Super Bowl has already taken place, Tech Crunch reported.

Gemini, formerly Bard, has been answering questions as if the event occurred recently, with imaginative player stats, favouring the Chiefs over the 49ers. Copilot, reflecting a possible San Francisco bias, insists the 49ers won with a final score of 24-21.

While the situation may have been resolved, it underscores the significant limitations of current GenAI models. These models lack genuine intelligence, operating on a probability-based approach learned from vast datasets, often sourced from the web. 

The generated text might appear grammatically correct but can be nonsensical or contain inaccuracies, as seen with the Super Bowl misinformation.

Google and Microsoft acknowledge the imperfections of their GenAI apps, emphasising the likelihood of mistakes. 

Despite the humorous nature of the Super Bowl misinformation, it serves as a reminder to critically assess statements from GenAI bots, as they can inadvertently produce false or misleading information due to the associations learned during training.