Gemini

Universal Basic Income

Safety

AI chatbots such as ChatGPT or Gemini can be tricked with ease into complying with queries that generate harmful responses, according to a new study by the UK’s AI Safety Institute (AISI). 
The government researchers tested the integrity of large language models (LLMs) – the technology behind the artificial intelligence chatbots – against national security attacks. 
The findings come ahead of the AI Seoul Summit, which will be co-chaired by UK prime minister, <a href="https://www.cryptopolitan.com/global-leaders-tech-titans-ai-safety-summit/">Rishi Sunak</a>, in South Korea on May 21-22. 
Also read: <a href="https://www.cryptopolitan.com/safety-a-top-agenda-seoul-ai-summit/">Safety Will be a Top Agenda Item at the Seoul AI Summit&nbsp;&nbsp;</a> 
<h2 id="ai-chatbots-prone-to-toxic-replies">AI Chatbots Prone to Toxic Replies</h2> 
AISI tested basic ‘jailbreaks’ – text prompts meant to override protections against illegal, toxic or explicit output – against five top LLMs. The Institute did not name the AI systems, but it found all of them “highly vulnerable.” 
<blockquote>
 “All tested LLMs remain highly vulnerable to basic jailbreaks, and some will provide harmful outputs even without dedicated attempts to circumvent their safeguards,” the study said.
</blockquote> 
According to the <a href="https://arxiv.org/pdf/2402.04249" rel="nofollow noopener" target="_blank">report</a>, ‘relatively simple’ attacks like prompting the chatbot to include, “Sure, I’m happy to help,” can deceive large language models into providing content that it is harmful in many ways. 
The content can aid self-harm, dangerous chemical solutions, sexism or Holocaust denial, it said. AISI used publicly available prompts and privately engineered other jailbreaks for the study. 
The Institute also tested the quality of responses to biologically and chemically themed queries. 
While expert-level knowledge in the fields can be used for good, researchers wanted to know if AI chatbots can be used for harmful purposes like compromising critical national infrastructure. 
“Several LLMs demonstrated expert-level knowledge of chemistry and biology. Models answered over 600 private expert-written chemistry and biology questions at similar levels to humans with PhD-level training,” researchers found. 
<figure id="attachment_522299" aria-describedby="caption-attachment-522299" style="width: 100%" class="wp-caption alignnone">
 <img loading="lazy" decoding="async" class="size-large wp-image-522299" src="https://www.cryptopolitan.com/wp-content/uploads/2024/05/Default_Poloniex_hacker_transfers_308000_ethereum_0-1-1200x904.jpg" alt="AI chatbots " width="800" height="603" srcset="https://www.cryptopolitan.com/wp-content/uploads/2024/05/Default_Poloniex_hacker_transfers_308000_ethereum_0-1-1200x904.jpg 1200w, https://www.cryptopolitan.com/wp-content/uploads/2024/05/Default_Poloniex_hacker_transfers_308000_ethereum_0-1-300x226.jpg 300w, https://www.cryptopolitan.com/wp-content/uploads/2024/05/Default_Poloniex_hacker_transfers_308000_ethereum_0-1-768x578.jpg 768w, https://www.cryptopolitan.com/wp-content/uploads/2024/05/Default_Poloniex_hacker_transfers_308000_ethereum_0-1.jpg 1232w" sizes="(max-width: 800px) 100vw, 800px">
 <figcaption id="caption-attachment-522299" class="wp-caption-text">
 AI chatbots can be bypassed with prompts
 </figcaption>
</figure> 
<h2 id="ai-poses-limited-cyber-security-threat">AI Poses Limited Cyber-security Threat</h2> 
With respect to AI chatbots being potentially weaponized to perform cyber-attacks, the study said the LLMs aced simple cyber security tasks built for high-school students. 
However, the chatbots struggled with tasks aimed at university students, suggesting limited malign potential. 
Another area of concern was whether the chatbots can be deployed as agents to autonomously undertake a series of actions in ways that “may be difficult for humans to control.” 
“Two LLMs completed short-horizon agent tasks (such as simple software engineering problems) but were unable to plan and execute sequences of actions for more complex tasks,” noted the study. 
Also read: ‘<a href="https://www.cryptopolitan.com/ai-godfather-wants-universal-basic-income/">AI Godfather’ Wants Universal Basic Income for Job Losses&nbsp;&nbsp;</a> 
UK’s Under-secretary of State for the Department of Science, Innovation and Technology, Saqib Bhatti MP, was recently <a href="https://www.theguardian.com/technology/article/2024/may/20/ai-chatbots-safeguards-can-be-easily-bypassed-say-uk-researchers" rel="nofollow noopener" target="_blank">quoted</a> saying legislation will take shape in due course and will be informed by testing. 
<h2 id="firms-claim-to-filter-bad-content">Firms Claim to Filter Bad Content</h2> 
Companies such as Claude creator Anthropic, Meta, which made Llama, and <a href="https://www.cryptopolitan.com/has-safety-taken-a-back-seat-at-openai/">OpenAI</a>, the ChatGPT developer, have emphasized the in-built security mechanisms of their respective models. 
OpenAI <a href="https://openai.com/index/our-approach-to-ai-safety/" rel="nofollow noopener" target="_blank">says</a> it does not allow its technology to be “used to generate hateful, harassing, violent or adult content.” Anthropic <a href="https://claudeai.uk/claude-2-artificial-intelligence/" rel="nofollow noopener" target="_blank">stated</a> that it prioritizes “avoiding harmful, illegal, or unethical responses before they occur”. 
The <a href="https://www.gov.uk/government/organisations/ai-safety-institute" rel="nofollow noopener" target="_blank">AI Safety Institute’s</a> findings are expected to be tabled before tech executives, government leaders and artificial intelligence experts at the Seoul summit. 
Cryptopolitan Reporting By Jeffrey Gogo

Top AI Chatbots ‘Highly Vulnerable’ to Simple ‘Jaibreaks’ – Study

Table of Contents

Cryptopolitan_News

Other articles published on May 21, 2024

SEC contacted exchanges to update spot Ether ETF applications: Report

Discover the Potential of Meme Coins for Lucrative Returns in 2024

Binance Announces Investment In Decentralized Derivatives Trading Platform

Ethena’s 15% price surge sparks attention, Here’s Why?

Eagle Materials (EXP) Reports Q4: EPS and Revenue Fail to Meet Expectations

BEFE Coin: A Promising Addition to the Top 100 Meme Coin Pantheon

Join our free newsletter for daily crypto updates!