GPT-4o

when

Dubai

Nvidia unceremoniously launched a new artificial intelligence model on Oct. 15 that’s purported to outperform state-of-the-art AI systems including GPT-4o and Claude-3.&nbsp;
According to a post on X from the Nvidia AI Developer account, the new model, dubbed Llama-3.1-Nemotron-70B-Instruct, “is a leading model” on lmarena.AI’s Chatbot Arena.&nbsp;
<figure>
 <img alt="NVidia, Technology, Meta, ChatGPT, OpenAI" src="https://s3.cointelegraph.com/uploads/2024-10/01929b69-d07a-7967-a771-93eb74d16b37" title="">
 <figcaption style="text-align: center;">
 Source: <a data-ct-non-breakable="null" href="https://x.com/NVIDIAAIDev/status/1846227767333212622" rel="null" target="null" text="null" title="https://x.com/NVIDIAAIDev/status/1846227767333212622">Nvidia AI</a>
 </figcaption>
</figure>
<h2 id="nemotron">Nemotron</h2>
Llama-3.1-Nemotron-70B-Instruct is, essentially, a modified version of Meta’s open-source Llama-3.1-70B-Instruct. The “Nemotron” portion of the model’s name encapsulates Nvidia’s contribution to the end result.&nbsp;
The Llama “herd” of AI models, as Meta refers to them, are meant to be used as open-source foundations for developers to build on. 
In the case of Nemotron, Nvidia took up the challenge and developed a system designed to be more “helpful” than popular models such as OpenAI’s ChatGPT and Anthropic’s Claude-3.&nbsp;
Nvidia <a data-ct-non-breakable="null" href="https://build.nvidia.com/nvidia/llama-3_1-nemotron-70b-instruct/modelcard" rel="nofollow noopener" target="_blank" text="null" title="https://build.nvidia.com/nvidia/llama-3_1-nemotron-70b-instruct/modelcard">used</a> specially curated data sets, advanced fine-tuning methods and its own state-of-the-art AI hardware to turn Meta’s vanilla model into what might be the most “helpful” AI model on the planet.&nbsp;
<figure>
 <img alt="NVidia, Technology, Meta, ChatGPT, OpenAI" src="https://s3.cointelegraph.com/uploads/2024-10/01929b6c-1097-71dc-ac8d-2ab8792ac926" title="">
 <figcaption style="text-align: center;">
 An engineer’s post on X.com expressing excitement for Nemotron’s capabilities. Source: <a data-ct-non-breakable="null" href="https://x.com/ImSh4yy/status/1846589157721715086" rel="null" target="null" text="null" title="null">Shayan Taslim</a>
 </figcaption>
</figure>
<h2 id="benchmarking">Benchmarking</h2>
When it comes to determining which AI model is “the best,” there’s no clear-cut methodology. Unlike, for example, measuring the ambient temperature with a mercury thermometer, there isn’t a single “truth” that exists when it comes to AI model performance.&nbsp;
Developers and researchers have to determine how well an AI model performs the same as humans are evaluated — through comparative testing.&nbsp;
Related: <a data-ct-non-breakable="null" href="https://cointelegraph.com/news/ai-mind-uploads-could-allow-dead-trade-forever" rel="null" target="null" text="null" title="null">AI ‘mind uploads’ could allow the dead to trade forever</a>
AI benchmarking involves giving different AI models the same queries, tasks, questions or problems and then comparing the usefulness of the results. Often, due to the subjectivity of what is and isn’t considered useful, human proctors are used to determine a machine’s performance through blind evaluations.&nbsp;
In Nemotron’s case, it appears that Nvidia is claiming the new model outperforms existing state-of-the-art models such as GPT-4o and Claude-3 by a fairly wide margin.
<figure>
 <img alt="NVidia, Technology, Meta, ChatGPT, OpenAI" src="https://s3.cointelegraph.com/uploads/2024-10/01929b6c-a24a-7bdf-81a0-5f3abb846afa" title="">
 <figcaption style="text-align: center;">
 The top of the Chatbot Arena leaderboards. Source: LLMArena
 </figcaption>
</figure>
The image above depicts the ratings on the automated “Hard” test on the Chatbot Arena Leaderboards. While Nvidia’s Llama-3.1-Nemotron-70B-Instruct doesn’t appear to be listed anywhere on the boards, if the developer’s claim that it scored an 85 on this test is valid, it would be the de facto top model in this particular section.&nbsp;
What makes the achievement perhaps even more interesting is that Llama-3.1-70B is Meta’s middle-tier open-source AI model. There’s a much larger version of Llama-3.1, the 405B version (where the number refers to how many billion parameters the model was tuned with). 
By comparison, GPT-4o is <a data-ct-non-breakable="null" href="https://arxiv.org/pdf/2407.09519" rel="null" target="null" text="null" title="null">estimated</a> to have been developed with over 1 trillion parameters.
Magazine: <a data-ct-non-breakable="null" href="https://cointelegraph.com/magazine/rabby-scammer-konpyl-crypto-ceo-mountain-victims/" rel="null" target="null" text="null" title="null">Fake Rabby Wallet scam linked to Dubai crypto CEO and many more victims</a>

Nvidia’s new open-source AI model beats GPT-4o on benchmarks

Table of Contents

Cointelegraph

Other articles published on Oct 17, 2024

Montenegro Finalizes Do Kwon’s Extradition Decision

GOAT Coin Captivates Cryptocurrency Enthusiasts

Hong Kong’s 2024 Policy Address Focuses on Financial Innovation and Growth

Nishad Singh’s re-appeal sparks FTT price rally: volume grew 250%

“WazirX Hack serves as a wakeup call for exchanges”: CIFDAQ COO Jay Hao

Ireland Prepares to Strengthen Crypto Framework Before EU Rules

Join our free newsletter for daily crypto updates!