Current and former OpenAI employees warn of AI's 'serious risk' and lack of oversight

A group of current and former OpenAI employees published an open letter Tuesday describing concerns about the artificial intelligence industry's rapid advancement despite a lack of oversight, and a lack of whistleblower protections for those who wish to speak up.

"AI companies have strong financial incentives to avoid effective oversight, and we do not believe bespoke structures of corporate governance are sufficient to change this," the employeesin revenue within a decade — as companies in seemingly every industry rush to add AI-powered chatbots and agents to avoid

The letter also details the current and former employees' concerns about insufficient whistleblower protections for the AI industry, stating that without effective government oversight, employees are in a relatively unique position to hold companies accountable. Four anonymous OpenAI employees and seven former ones, including Daniel Kokotajlo, Jacob Hilton, William Saunders, Carroll Wainwright and Daniel Ziegler, signed the letter. Signatories also included Ramana Kumar, who formerly worked at Google DeepMind, and Neel Nanda, who currently works at Google DeepMind and formerly worked at Anthropic.

"We're incredibly sorry that we're only changing this language now; it doesn't reflect our values or the company we want to be," an OpenAI spokesperson told CNBC at the time.The person, who spoke on condition of anonymity, said some of the team members are being reassigned to multiple other teams within the company.from the startup last month. Leike wrote in a post on X that OpenAI's "safety culture and processes have taken a backseat to shiny products.

Leike wrote he believes much more of the company's bandwidth should be focused on security, monitoring, preparedness, safety and societal impact.

Ai Ai Latest News, Ai Ai Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

How to Tailor Content Filtering with Azure OpenAI Service in Azure OpenAI StudioLearn to adjust Azure OpenAI content filters for better AI outputs. Step-by-step guide based on firsthand experience.
Source: hackernoon - 🏆 532. / 51 Read more »

Exclusive: The Atlantic, Vox Media ink licensing, product deals with OpenAIThe publishers will let OpenAI use their data while OpenAI will let them use its tech.
Source: axios - 🏆 302. / 63 Read more »

Current and former OpenAI employees warn of AI's ‘serious risk' and lack of oversightA group of current and former OpenAI employees published an open letter Tuesday describing concerns about the AI industry’s rapid advancement.
Source: NBCLA - 🏆 319. / 59 Read more »

OpenAI co-founder Ilya Sutskever says he will leave the startupOpenAI co-founder Ilya Sutskever said Tuesday that he’s leaving the Microsoft-backed startup.
Source: NBCLA - 🏆 319. / 59 Read more »

OpenAI executive is out after key role in CEO Sam Altman’s ousterOpenAI’s chief scientist and cofounder, who played an instrumental role in CEO Sam Altman’s short-lived ouster from OpenAI in November, announced that he was leaving company on Tuesday.
Source: CNN - 🏆 4. / 95 Read more »

Former OpenAI, Anthropic employees call for 'right to warn' on AI risksFormer employees of OpenAI, Anthropic, and DeepMind, along with leading AI experts, are advocating for enhanced whistleblower protections to raise public awareness about the risks associated with advanced AI systems.
Source: Cointelegraph - 🏆 562. / 51 Read more »