2024

when

Dubai

Researchers have hacked artificial intelligence-powered robots and manipulated them into performing actions usually blocked by safety and ethical protocols, such as causing collisions or detonating bombs.&nbsp;&nbsp;
Penn Engineering researchers published their findings in an Oct. 17 <a data-ct-non-breakable="null" href="https://robopair.org/files/research/robopair.pdf" rel="null" target="null" text="null" title="null">paper</a>, detailing how their algorithm, RoboPAIR, achieved a 100% jailbreak rate by bypassing the <a data-ct-non-breakable="null" href="https://cointelegraph.com/learn/dangers-of-artificial-intelligence" rel="null" target="null" text="null" title="null">safety protocols on three different AI robotic systems</a>.&nbsp;
Under normal circumstances, the researchers say <a data-ct-non-breakable="null" href="https://cointelegraph.com/learn/media-companies-embracing-ai-an-overview-of-bloomberggpt" rel="null" target="null" text="null" title="null">large language model</a> (LLM) controlled robots refuse to comply with prompts requesting harmful actions, such as knocking shelves onto people.&nbsp;
<blockquote class="twitter-tweet">
 Chatbots like ChatGPT can be jailbroken to output harmful text. But what about robots? Can AI-controlled robots be jailbroken to perform harmful actions in the real world? Our new paper finds that jailbreaking AI-controlled robots isn't just possible. It's alarmingly easy. 🧵 <a href="https://t.co/GzG4OvAO2M">pic.twitter.com/GzG4OvAO2M</a>— Alex Robey (@AlexRobey23) <a href="https://twitter.com/AlexRobey23/status/1846914890029748272?ref_src=twsrc%5Etfw">October 17, 2024</a>
</blockquote>
&nbsp;“Our results reveal, for the first time, that the risks of jailbroken LLMs extend far beyond text generation, given the distinct possibility that jailbroken robots could cause physical damage in the real world,” the researchers wrote.
Under the influence of RoboPAIR, researchers say they were able to elicit harmful actions “with a 100% success rate” in the test robots with tasks ranging from bomb detonation to blocking emergency exits to causing deliberate collisions.&nbsp;
According to the researchers, they used Clearpath’s Robotics Jackal, a wheeled vehicle; Nvidia’s Dolphin LLM, a self-driving simulator, and Unitree’s Go2, a four-legged robot.
Using the RoboPAIR, researchers were able to make the Dolphin self-driving LLM collide with a bus, a barrier and pedestrians, as well as ignore traffic lights and stop signs.&nbsp;
Researchers were able to get the Robotic Jackal to find the most harmful place to detonate a bomb, block an emergency exit, knock over warehouse shelves onto a person and collide with people in the room.&nbsp;<advertisement>
 <img alt="Technology, United States" img_link="" img_link_new_tab="" img_link_nofollow="" img_link_title="" name="" src="https://s3.cointelegraph.com/uploads/2024-10/01929e29-4768-72ff-943f-cdc25703eb4c" title="">
 <figcaption>
 Penn Engineering researchers claim to have found a way to manipulate AI driven robots to perform harmful actions 100% of the time. Source: Penn Engineering&nbsp;
 </figcaption>
 They were able to get Unitree’sGo2 to perform similar actions, blocking exits and delivering a bomb.&nbsp;&nbsp;
 The researchers also found that when prompted with malicious instructions, LLM-controlled robots can be fooled into performing harmful actions
 Prior to the public release, the researchers said they shared the findings, including a draft of the paper, with leading <a data-ct-non-breakable="null" href="https://cointelegraph.com/news/ai-startups-record-funding-q3-2024" rel="null" target="null" text="null" title="null">AI companies and the manufacturers</a> of the robots used in the study.&nbsp;
 Related: <a data-ct-non-breakable="null" href="https://cointelegraph.com/news/ai-risks-without-blockchain-0g-labs-ceo" rel="null" target="null" text="null" title="null">AI faces ‘Immense’ risks without blockchain: 0G Labs CEO</a>
 Alexander Robey, one of the authors, <a data-ct-non-breakable="null" href="https://ai.seas.upenn.edu/news/penn-engineering-research-discovers-critical-vulnerabilities-in-ai-enabled-robots-to-increase-safety-and-security/" rel="null" target="null" text="null" title="null">said</a> addressing the vulnerabilities requires more than simple software patches, and called for a reevaluation of <a data-ct-non-breakable="null" href="https://cointelegraph.com/news/how-ai-is-changing-how-humans-interact-with-machines" rel="null" target="null" text="null" title="null">AI integration in physical robots and systems</a>, based on the paper’s findings.&nbsp;
 “What is important to underscore here is that systems become safer when you find their weaknesses. This is true for cybersecurity. This is also true for AI safety,” he said.&nbsp;
 “In fact, AI red teaming, a safety practice that entails testing AI systems for potential threats and vulnerabilities, is essential for safeguarding generative AI systems — because once you identify the weaknesses, then you can test and even train these systems to avoid them,” Robey added. 
 Magazine: <a data-ct-non-breakable="null" href="https://cointelegraph.com/magazine/rabby-scammer-konpyl-crypto-ceo-mountain-victims/" rel="null" target="null" text="null" title="null">Fake Rabby Wallet scam linked to Dubai crypto CEO and many more victims</a>
</advertisement>

Researchers hack AI-enabled robots to cause ‘real world’ harm

Cointelegraph

Other articles published on Oct 18, 2024

SUI Price Drops 12% In 96 Hours, Crucial Time To Hold Or Sell?

'Solana Killer' Aptos (APT) Celebrates 1.7 Billion Transaction Milestone

SunPump Frenzy Propels Tron to Record $151.2 Million Q3 Revenue

BlackRock’s Bitcoin ETF, IBIT, Topped $1B Inflows This Week

Crypto events turn to regulation and politics as US election looms

Terraform Labs Co-founder Do Kwon Extradition Approved by Montenegro Supreme Court

Join our free newsletter for daily crypto updates!