Safe

ELON Coin

Co-founder and former chief scientist of OpenAI, Ilya Sutskever, and former OpenAI engineer Daniel Levy have joined forces with Daniel Gross, an investor and former partner in startup accelerator Y Combinator, to create Safe Superintelligence, Inc. (SSI). The new company’s goal and product are evident from its name.
SSI is a United States company with offices in Palo Alto and Tel Aviv. It will advance artificial intelligence (AI) by developing safety and capabilities in tandem, the trio of founders <a href="https://ssi.inc/" target="_blank" rel="noopener noreferrer nofollow">said</a> in an online announcement on June 19. They added:
<blockquote>
 “Our singular focus means no distraction by management overhead or product cycles, and our business model means safety, security, and progress are all insulated from short-term commercial pressures.”
</blockquote>
<h2 id="sustkever-and-gross-were-already-worried-about-ai-safety">Sustkever and Gross were already worried about AI safety</h2>
Sutskever <a href="https://cointelegraph.com/news/openai-chief-scientist-ilya-sutskever-depart-firm" rel="noopener noreferrer nofollow">left OpenAI on May 14</a>. He <a href="https://cointelegraph.com/news/sam-altman-fired-from-openai-timeline" rel="noopener noreferrer nofollow">was involved in</a> the firing of CEO Sam Altman and played an ambiguous role at the company after stepping down from the board after Altman returned. Daniel Levy was <a href="https://techcrunch.com/2024/06/19/ilya-sutskever-openais-former-chief-scientist-launches-new-ai-company/?guccounter=1&amp;guce_referrer=aHR0cHM6Ly90LmNvLw&amp;guce_referrer_sig=AQAAAGltiS50llHbkbZzmfKCGSIM0dPpryeG01bunxRx5nN0lCDrvwZK6yXp6q_JBgoli7UbPVVbqPlIqcy8VP0BEapZhnQqjQZQ2fmQOB4HMVVUyWkc0islZAghmmKQwcaXVBQ_IBdBLIoWtxQHLbQhhY2EmWOTFZvb51yb71o-4_tC" target="_blank" rel="noopener noreferrer nofollow">among</a> the researchers who <a href="https://cointelegraph.com/news/openai-ai-safety-team-disbanded-amid-priority-disagreements" rel="noopener noreferrer nofollow">left OpenAI a few days</a> after Sutskever.
Related: OpenAI makes ChatGPT ‘less verbose,’ blurring writer-AI distinction
Sutskever and Jan Leike were the leaders of OpenAI’s Superalignment team <a href="https://cointelegraph.com/news/openai-creates-a-new-team-to-tackle-superintelligent-ai-systems" rel="noopener noreferrer nofollow">created in July 2023</a> to consider how to “steer and control AI systems much smarter than us.” Such systems are referred to as artificial general intelligence (AGI). OpenAI allotted 20% of its computing power to the Superalignment team at the time of its creation.
Leike also left OpenAI in May and is now the head of a team at <a href="https://cointelegraph.com/news/amazon-minority-share-chat-gpt-rival-anthropic-ai" rel="noopener noreferrer nofollow">Amazon-backed AI startup</a> Anthropic. OpenAI <a href="https://cointelegraph.com/news/open-ai-artificial-intelligence-sam-altman-employee-safety-allegations" rel="noopener noreferrer nofollow">defended its safety-related</a> precautions in a long X post by company president Greg Brockman but dissolved the Superalignment team after the May departure of its researchers.
<h3 id="other-top-tech-figures-worry-too">Other top tech figures worry too</h3>
The former OpenAI researchers are among many scientists concerned about the future direction of AI. Ethereum co-founder Vitalik Butertin <a href="https://cointelegraph.com/news/vitalik-buterin-warns-superintelligent-ai-risks-openai-turmoil" rel="noopener noreferrer nofollow">called AGI “risky”</a> in the midst of the staff turnover at OpenAI. He added, however, that “such models are also much lower in terms of doom risk than both corporate megalomania and militaries.”
<figure><img src="https://s3.cointelegraph.com/uploads/2024-06/e2fb3ac3-a299-454e-974a-6c10a1fccbcc.png">
 <figcaption style="text-align: center;">
 Source: Ilya Sutskever
 </figcaption>
</figure>
Tesla CEO Elon Musk, once an OpenAI supporter, and Apple co-founder Steve Wozniak were among more than 2,600 tech leaders and researchers who urged that the training of AI systems be paused for six months while humanity pondered the “profound risk” they represented.
The SSI announcement noted that the company is hiring engineers and researchers.
Magazine: <a href="https://cointelegraph.com/magazine/chatgpt-predict-crypto-prices-ai-humane-ai-pin-slammed-knowledge-collapse-ai-eye/" rel="noopener noreferrer nofollow">How to get better crypto predictions from ChatGPT, Humane AI pin slammed: AI Eye</a>

Ex-OpenAI chief scientist Ilya Sutskever launches SSI to focus on AI safety

Table of Contents

Cointelegraph

Other articles published on Jun 19, 2024

aSOPR and Binary CDD Indicate Potential Market Bottom for Bitcoin

Bull Run Bets is Leveraging AI to Revolutionize Online Casino Gaming

Brazil summons top crypto exchanges to clarify their services

Bitget and Uniswap Show Spike in OI Amid Crypto Market Turbulence

The Qubetics Whitelist Amazes Investors With Early Bird Perks; Bitcoin And Cardano Face Backlash ...

Step-by-Step Guide: How to Buy $WOOT Token

Join our free newsletter for daily crypto updates!