This year's DEF CON AI Village has invited hackers to show up, dive in, and find bugs and biases in large language models built by OpenAI, Google, Anthropic, and others.
The collaborative event, which AI Village organizers describe as"the largest red teaming exercise ever for any group of AI models," will host"thousands" of people, including"hundreds of students from overlooked institutions and communities," all of whom will be tasked with finding flaws in LLMs that power today's chat bots and generative AI.
Think: traditional bugs in code, but also problems more specific to machine learning, such as bias, hallucinations, and jailbreaks — all of which ethical and security professionals are now having to grapple with as these technologies scale.The diverse issues with these models will not be resolved until more people know how to red team and assess them
"Traditionally, companies have solved this problem with specialized red teams. However this work has largely happened in private," said Sven Cattell, the founder of AI Village, in a."The diverse issues with these models will not be resolved until more people know how to red team and assess them." The data scientist wants to see bug bounties and live hacking events modified in general to fit in ML model-based systems."These fill two needs with one deed, addressing the harms and growing the community of researchers that know how to help," Cattell said.