Major AI companies including Anthropic and OpenAI regularly publish reports about how users interact with their products like Claude and ChatGPT, but researchers are raising concerns about the lack of independent verification for this data, according to MIT Technology Review.
“There is no independent source to corroborate it,” says Anka Reuel, a computer science PhD candidate, as reported by MIT Technology Review. The concern centers on the fact that these companies only release usage data selectively, controlling what information becomes public about how their AI systems are actually being deployed and used in practice.
This lack of independent verification represents a significant gap in understanding the real-world applications and impacts of AI systems that have become widely adopted across various sectors. While companies provide their own reports and statistics, researchers have no way to independently confirm these claims or access comprehensive data about user behavior and AI system usage patterns.