Artificial intelligence (AI) firm OpenAI unveiled its first-ever text-to-video model to a strong reception on Thursday, though the firm admits the model still has a ways to go.&nbsp;
OpenAI unveiled the new generative AI model, dubbed Sora, on Feb. 15, which is said to create detailed videos from simple text prompts, continue existing videos, and even generate scenes based on a still image. 
<blockquote class="twitter-tweet">
 Introducing Sora, our text-to-video model. Sora can create videos of up to 60 seconds featuring highly detailed scenes, complex camera motion, and multiple characters with vibrant emotions. <a href="https://t.co/7j2JN27M3W">https://t.co/7j2JN27M3W</a> Prompt: “Beautiful, snowy… <a href="https://t.co/ruTEWn87vf">pic.twitter.com/ruTEWn87vf</a>— OpenAI (@OpenAI) <a href="https://twitter.com/OpenAI/status/1758192957386342435?ref_src=twsrc%5Etfw">February 15, 2024</a>
</blockquote> 
<a href="https://openai.com/sora" target="_blank" rel="noopener nofollow">According</a> to a Feb. 15 blog post, OpenAI claimed the AI model can generate movie-like scenes in resolutions up to 1080p. These scenes can include multiple characters, specific types of motion and accurate details of the subject and background.
<h2 id="how-sora-works">How Sora works</h2>
Much like OpenAI’s image-based predecessor, Dall-E 3, Sora operates on what’s known as a diffusion model. 
Diffusion refers to a generative AI model creating its output by generating a video or an image with something that looks more like “static noise” and gradually transforming it by “removing the noise” over several steps.
<blockquote class="twitter-tweet">
 Announcing Sora — our model which creates minute-long videos from a text prompt: <a href="https://t.co/SZ3OxPnxwz">https://t.co/SZ3OxPnxwz</a> <a href="https://t.co/0kzXTqK9bG">pic.twitter.com/0kzXTqK9bG</a>— Greg Brockman (@gdb) <a href="https://twitter.com/gdb/status/1758193811489243408?ref_src=twsrc%5Etfw">February 15, 2024</a>
</blockquote> 
The AI firm wrote that Sora has been built on past research from ChatGPT and Dall-E 3 models, which the firm claims makes the model better at more faithfully representing user inputs. 
OpenAI admitted that Sora still contained several weaknesses and could struggle to simulate the physics of a complex scene accurately, namely by muddling up the nature of cause and effect. 
<blockquote data-ct-non-breakable="true">
 “For example, a person might take a bite out of a cookie, but afterward, the cookie may not have a bite mark.”
</blockquote>
The firm said the new tool could also confuse the “spatial details” of a given prompt by mixing up lefts and rights or failing to follow precise descriptions of directions.
<figure data-ct-non-breakable="true">
 <img src="https://s3.cointelegraph.com/uploads/2024-02/8fe978ee-b6d0-49fb-89f1-b41b1995bd73.png" alt="" title="">
 <figcaption style="text-align: center;">
 Sora can accidentally generate physically implausible motion. Source: OpenAI
 </figcaption>
</figure>
OpenAI said the new generative model is only available for now to “red teamers” — tech parlance for cybersecurity researchers — to assess “critical areas for harms or risks,” as well as select designers, visual artists and filmmakers to gather feedback on how to advance the model. 
In December 2023, a <a href="https://purl.stanford.edu/kh752sm9123" target="_blank" rel="noopener nofollow">report</a> from Stanford University revealed that AI-powered image-generation tools using the AI database <a href="https://laion.ai/" target="_blank" rel="noopener nofollow">Laion</a>&nbsp;were being trained on thousands of images of illegal child abuse material, something that raises serious ethical and legal concerns for text-to-image or video models.
<h2 data-ct-non-breakable="true" id="users-on-x-left-speechless">Users on X left speechless</h2>
Dozens of video demos have been circulating on X showing examples of Sora in action, while Sora is now trending on X with over 173,000 posts. 
In a bid to show off what the new generative model is capable of, OpenAI CEO Sam Altman opened himself up to custom video-generation requests from users on X, with the AI chief sharing a total of seven Sora-generated videos, varying from a duck on dragon back to golden retrievers recording a podcast on a mountain top. 
<blockquote class="twitter-tweet">
 <a href="https://t.co/uCuhUPv51N">https://t.co/uCuhUPv51N</a> <a href="https://t.co/nej4TIwgaP">pic.twitter.com/nej4TIwgaP</a>— Sam Altman (@sama) <a href="https://twitter.com/sama/status/1758218820542763012?ref_src=twsrc%5Etfw">February 15, 2024</a>
</blockquote> 
AI commentator Mckay Wrigley — along with many others — <a href="https://twitter.com/mckaywrigley/status/1758237675847565328" target="_blank" rel="noopener nofollow">wrote</a> that the video generated by Sora had left him speechless.
In a Feb. 15 post to X, Nvidia senior researcher Jim Fan declared that anyone who believed Sora to be just another “creative toy,” like Dall-E 3, would be dead wrong.
<blockquote class="twitter-tweet">
 If you think OpenAI Sora is a creative toy like DALLE, ... think again. Sora is a data-driven physics engine. It is a simulation of many worlds, real or fantastical. The simulator learns intricate rendering, "intuitive" physics, long-horizon reasoning, and semantic grounding, all… <a href="https://t.co/pRuiXhUqYR">pic.twitter.com/pRuiXhUqYR</a>— Jim Fan (@DrJimFan) <a href="https://twitter.com/DrJimFan/status/1758210245799920123?ref_src=twsrc%5Etfw">February 15, 2024</a>
</blockquote> 
In Fan’s view, Sora is less a video-generation tool and more a “data-driven physics engine,” as the AI model isn’t just generating abstract video but also deterministically creating the physics of objects in the scene itself.
Magazine: ‘<a href="https://cointelegraph.com/magazine/crypto-inevitable-all-in-meet-vance-spencer/">Crypto is inevitable’ so we went ‘all in’ — Meet Vance Spencer, permabull</a>

OpenAI text-to-video model Sora wows X but still has weaknesses

Table of Contents

Cointelegraph

Other articles published on Feb 16, 2024

AI blockchain sector nears $14 billion cap with Bittensor’s surge

XRP ETP Blocked in Jupiter’s UCITS Fund Due To Irish Regulations

Mad Lads’ Backpack Exchange surpasses $300M trading volume in 24 hours

4 Surprising Insights From Coinbase’s Earnings, COIN Sees Bullish Surge

Here’s Why the XRP Price Can Increase by Another 25% in February

Here’s Why VeChain (VET) Price Rally Has More Room to Grow

Join our free newsletter for daily crypto updates!