David Vance

when

Former employees of leading artificial intelligence (AI) developers are urging these pioneering AI companies to enhance their whistleblower protections. This would enable them to voice “risk-related concerns” to the public regarding the advancement of sophisticated AI systems.
On June 4, 13 former and current employees at OpenAI (ChatGPT), Anthropic (Claude) and DeepMind (Google), along with the “Godfathers of AI” — Yoshua Bengio and Geoffrey Hinton — and renowned AI scientist Stuart Russell started the “Right to Warn AI” petition. 
The statement aims to establish a commitment from frontier AI companies to allow employees to raise risk-related concerns about AI internally and with the public. 
William Saunders, a former OpenAI employee and supporter of the movement, commented that, when dealing with potentially dangerous new technologies, there should be ways to share information about risks with independent experts, governments and the public.
<blockquote data-ct-non-breakable="true">
 “Today, the people with the most knowledge about how frontier AI systems work and the risks related to their deployment are not fully free to speak because of possible retaliation and overly broad confidentiality agreements.”
</blockquote>
<h2 data-ct-non-breakable="true" id="right-to-warn-principles">Right-to-warn principles</h2>
The proposal has four primary propositions to the AI developers, the first of which is to eliminate non-disparagement about risks so that companies won’t silence employees with agreements that prevent them from raising concerns about the risks of AI or punishing them for doing so.
They also aim to establish anonymous reporting channels for individuals to raise concerns regarding AI risks, thereby cultivating an environment conducive to open criticism surrounding such risks.
Lastly, the petition is asking for the protection of whistleblowers, in which companies will not retaliate against employees who disclose information to expose serious AI risks. 
Saunders said the proposed principles are a “proactive way” to engage with AI companies to achieve safe and beneficial AI that is needed. 
<h2 id="growing-ai-safety-concerns">Growing AI safety concerns</h2>
The petition comes as concerns mount over the “deprioritization” by AI labs regarding the safety of their latest models, especially in the face of artificial general intelligence (AGI), which attempts to create software with humanlike intelligence and the ability to self-teach.
Former OpenAI employee Daniel Kokotajlo said he decided to leave the company because he “lost hope that they would act responsibly,” specifically regarding AGI creation. 
<blockquote data-ct-non-breakable="true">
 “They and others have bought into the ‘move fast and break things’ approach and that is the opposite of what is needed for technology this powerful and this poorly understood.”
</blockquote>
On May 28, Helen Toner, a former board member at OpenAI, said during a Ted AI podcast that&nbsp;OpenAI CEO Sam Altman was <a href="https://cointelegraph.com/news/sam-altman-fired-openai-board-allegations">reportedly dismissed from the company</a> for allegedly withholding information from the board. 
Magazine: <a href="https://cointelegraph.com/magazine/sic-ais-on-each-other-artificial-intelligence-threat-alignment-david-brin-author/">‘Sic AIs on each other’ to prevent AI apocalypse: David Brin, sci-fi author</a>

Former OpenAI, Anthropic employees call for ‘right to warn’ on AI risks

Table of Contents

Cointelegraph

Other articles published on Jun 4, 2024

Wodo Gaming’s $XWGT Pre-Sale Reached $550,000 Target in Record Time

Crypto: +500 million people own it in 2024!

SEC’s War On Crypto Is Over: Ethereum ETFs Stepped In

Polygon Labs acquires ZK builder Toposware for unified web3

Dormant Bitcoin from Half a Decade Ago Resurfaces in Latest Distribution Wave

Polkadot Becomes The Most Decentralized Blockchain, But DOT Price Remain Bearish

Join our free newsletter for daily crypto updates!