Bitcoin

Artificial intelligence developer OpenAI entered October with several updates to its AI models, helping them engage in better conversations and improve image recognition.
On Oct. 1, OpenAI unveiled four updates that introduce new tools designed to make it easier for developers to build on its models.
<h2 id="it-speaks">It speaks!</h2>
One major <a data-ct-non-breakable="null" href="https://openai.com/index/introducing-the-realtime-api/" rel="nofollow noopener" target="_blank" text="null" title="https://openai.com/index/introducing-the-realtime-api/">update</a> is the Realtime API, which allows developers to create AI-generated voice applications using a single prompt.&nbsp;&nbsp;
The tool, available for testing, supports low-latency, multimodal experiences by streaming audio inputs and outputs, enabling natural conversations similar to ChatGPT’s Advanced Voice Mode.&nbsp;
Previously, developers had to “stitch together” multiple models to create these experiences. Audio input would typically need to be fully uploaded and processed before receiving a response, which meant higher latency for real-time applications like speech-to-speech conversations.&nbsp;
Related: <a data-ct-non-breakable="null" href="https://cointelegraph.com/news/apple-google-ai-dominance-cathie-wood-ark" rel="null" target="null" text="null" title="null">Apple, Google to use AI to maintain dominance — Cathie Wood’s ARK Invest</a>
With Realtime API’s streaming capability, developers can now enable immediate, natural interactions, much like voice assistants. The API runs on GPT-4, <a data-ct-non-breakable="null" href="https://cointelegraph.com/explained/what-is-gpt-4o-and-how-is-it-different-from-gpt-3-gpt-35-and-gpt-4" rel="" target="_self" text="null" title="https://cointelegraph.com/explained/what-is-gpt-4o-and-how-is-it-different-from-gpt-3-gpt-35-and-gpt-4">released in May 2024</a>, which can reason across audio, vision and text in real time.
<h2 id="ai-can-see-clearly-now">AI can see clearly now</h2>
Another <a data-ct-non-breakable="null" href="https://openai.com/index/introducing-vision-to-the-fine-tuning-api/" rel="nofollow noopener" target="_blank" text="null" title="https://openai.com/index/introducing-vision-to-the-fine-tuning-api/">update</a> includes a fine-tuning tool for developers, allowing them to improve AI responses generated from images and text inputs.&nbsp;
The image-based fine tuners enable the <a data-ct-non-breakable="null" href="https://cointelegraph.com/learn/ai" rel="" target="_self" text="null" title="https://cointelegraph.com/learn/ai">artificial intelligence</a> to have a better capacity to understand images, in turn enhancing visual search and object detection capabilities, according to the developer. The process includes feedback from humans who provide examples of good and bad responses.
In addition to its voice and vision updates, OpenAI also <a data-ct-non-breakable="null" href="https://openai.com/index/api-prompt-caching/" rel="null" target="null" text="null" title="null">rolled</a> out “model distillation” and “prompt caching,” which allow smaller models to learn from larger ones and reduce development costs and time by reusing already processed text.&nbsp;
The advanced capabilities of its models are a key selling point, as a major chunk of revenue for OpenAI comes from businesses building their own applications on top of OpenAI’s technology.&nbsp;
According to Reuters, OpenAI <a data-ct-non-breakable="null" href="https://www.reuters.com/technology/artificial-intelligence/openai-sees-116-billion-revenue-next-year-offers-thrive-chance-invest-again-2025-2024-09-28/" rel="nofollow noopener" target="_blank" text="null" title="https://www.reuters.com/technology/artificial-intelligence/openai-sees-116-billion-revenue-next-year-offers-thrive-chance-invest-again-2025-2024-09-28/">projects</a> its revenue to rise to $11.6 billion next year, up from an estimated $3.7 billion in 2024.
Magazine: <a data-ct-non-breakable="null" href="https://cointelegraph.com/magazine/ai-more-power-hungry-bitcoin-profits-pose-risks-bitcoin-miners/" rel="" target="_self" text="null" title="https://cointelegraph.com/magazine/ai-more-power-hungry-bitcoin-profits-pose-risks-bitcoin-miners/">AI may already use more power than Bitcoin — and it threatens Bitcoin mining</a>

OpenAI’s new updates enhance voice and vision capabilities of AI

Table of Contents

Cointelegraph

Other articles published on Oct 2, 2024

Shiba Inu Investor Predicts Surge for $0.035 Altcoin by 2025

Token Ekosistem TON Seperti DOGS dan CATI Turun Drastis, Peluang atau Bencana?

Solana (SOL) Drops, but Strong Network Usage Points to a Bullish Future

Uptober Terancam: BTC dan ETH Terkoreksi, Kekhawatiran Perang Dunia Meningkat

Binance Labs’ Recent Investment: What is OpenEden?

Sui Integrates SCION as a First-of-its-Kind Security Protocol for Network Validators (2 Oct)

Join our free newsletter for daily crypto updates!