Sora: Creating video from text (2024)

We’re teaching AI to understand and simulate the physical world in motion, with the goal of training models that help people solve problems that require real-world interaction.

Introducing Sora, our text-to-video model. Sora can generate videos up to a minute long while maintaining visual quality and adherence to the user’s prompt.

1 of 9

Prompt: A stylish woman walks down a Tokyo street filled with warm glowing neon and animated city signage. She wears a black leather jacket, a long red dress, and black boots, and carries a black purse. She wears sunglasses and red lipstick. She walks confidently and casually. The street is damp and reflective, creating a mirror effect of the colorful lights. Many pedestrians walk about.Prompt: A stylish woman walks down a Tokyo street filled with warm glowing neon and animated city signage. She wears a black leather jacket, a long red dress, and black boots, and carries a black purse. She wears sunglasses and red lipstick. She walks confidently and casually. The street is damp and reflective, creating a mirror effect of the colorful lights. Many pedestrians walk about.

0:00 / 0:00

Prompt: Several giant wooly mammoths approach treading through a snowy meadow, their long wooly fur lightly blows in the wind as they walk, snow covered trees and dramatic snow capped mountains in the distance, mid afternoon light with wispy clouds and a sun high in the distance creates a warm glow, the low camera view is stunning capturing the large furry mammal with beautiful photography, depth of field.Prompt: Several giant wooly mammoths approach treading through a snowy meadow, their long wooly fur lightly blows in the wind as they walk, snow covered trees and dramatic snow capped mountains in the distance, mid afternoon light with wispy clouds and a sun high in the distance creates a warm glow, the low camera view is stunning capturing the large furry mammal with beautiful photography, depth of field.

0:00 / 0:00

Prompt: A movie trailer featuring the adventures of the 30 year old space man wearing a red wool knitted motorcycle helmet, blue sky, salt desert, cinematic style, shot on 35mm film, vivid colors.Prompt: A movie trailer featuring the adventures of the 30 year old space man wearing a red wool knitted motorcycle helmet, blue sky, salt desert, cinematic style, shot on 35mm film, vivid colors.

0:00 / 0:00

Prompt: Drone view of waves crashing against the rugged cliffs along Big Sur’s garay point beach. The crashing blue waters create white-tipped waves, while the golden light of the setting sun illuminates the rocky shore. A small island with a lighthouse sits in the distance, and green shrubbery covers the cliff’s edge. The steep drop from the road down to the beach is a dramatic feat, with the cliff’s edges jutting out over the sea. This is a view that captures the raw beauty of the coast and the rugged landscape of the Pacific Coast Highway.Prompt: Drone view of waves crashing against the rugged cliffs along Big Sur’s garay point beach. The crashing blue waters create white-tipped waves, while the golden light of the setting sun illuminates the rocky shore. A small island with a lighthouse sits in the distance, and green shrubbery covers the cliff’s edge. The steep drop from the road down to the beach is a dramatic feat, with the cliff’s edges jutting out over the sea. This is a view that captures the raw beauty of the coast and the rugged landscape of the Pacific Coast Highway.

0:00 / 0:00

Prompt: Animated scene features a close-up of a short fluffy monster kneeling beside a melting red candle. The art style is 3D and realistic, with a focus on lighting and texture. The mood of the painting is one of wonder and curiosity, as the monster gazes at the flame with wide eyes and open mouth. Its pose and expression convey a sense of innocence and playfulness, as if it is exploring the world around it for the first time. The use of warm colors and dramatic lighting further enhances the cozy atmosphere of the image.Prompt: Animated scene features a close-up of a short fluffy monster kneeling beside a melting red candle. The art style is 3D and realistic, with a focus on lighting and texture. The mood of the painting is one of wonder and curiosity, as the monster gazes at the flame with wide eyes and open mouth. Its pose and expression convey a sense of innocence and playfulness, as if it is exploring the world around it for the first time. The use of warm colors and dramatic lighting further enhances the cozy atmosphere of the image.

0:00 / 0:00

Prompt: A gorgeously rendered papercraft world of a coral reef, rife with colorful fish and sea creatures.Prompt: A gorgeously rendered papercraft world of a coral reef, rife with colorful fish and sea creatures.

0:00 / 0:00

Prompt: This close-up shot of a Victoria crowned pigeon showcases its striking blue plumage and red chest. Its crest is made of delicate, lacy feathers, while its eye is a striking red color. The bird’s head is tilted slightly to the side, giving the impression of it looking regal and majestic. The background is blurred, drawing attention to the bird’s striking appearance.Prompt: This close-up shot of a Victoria crowned pigeon showcases its striking blue plumage and red chest. Its crest is made of delicate, lacy feathers, while its eye is a striking red color. The bird’s head is tilted slightly to the side, giving the impression of it looking regal and majestic. The background is blurred, drawing attention to the bird’s striking appearance.

0:00 / 0:00

Prompt: Photorealistic closeup video of two pirate ships battling each other as they sail inside a cup of coffee.Prompt: Photorealistic closeup video of two pirate ships battling each other as they sail inside a cup of coffee.

0:00 / 0:00

Prompt: A young man at his 20s is sitting on a piece of cloud in the sky, reading a book.Prompt: A young man at his 20s is sitting on a piece of cloud in the sky, reading a book.

0:00 / 0:00

Today, Sora is becoming available to red teamers to assess critical areas for harms or risks. We are also granting access to a number of visual artists, designers, and filmmakers to gain feedback on how to advance the model to be most helpful for creative professionals.

We’re sharing our research progress early to start working with and getting feedback from people outside of OpenAI and to give the public a sense of what AI capabilities are on the horizon.

1 of 8

Prompt: Historical footage of California during the gold rush.Prompt: Historical footage of California during the gold rush.

0:00 / 0:00

Prompt: A close up view of a glass sphere that has a zen garden within it. There is a small dwarf in the sphere who is raking the zen garden and creating patterns in the sand.Prompt: A close up view of a glass sphere that has a zen garden within it. There is a small dwarf in the sphere who is raking the zen garden and creating patterns in the sand.

0:00 / 0:00

Prompt: Extreme close up of a 24 year old woman’s eye blinking, standing in Marrakech during magic hour, cinematic film shot in 70mm, depth of field, vivid colors, cinematicPrompt: Extreme close up of a 24 year old woman’s eye blinking, standing in Marrakech during magic hour, cinematic film shot in 70mm, depth of field, vivid colors, cinematic

0:00 / 0:00

Prompt: A cartoon kangaroo disco dances.Prompt: A cartoon kangaroo disco dances.

0:00 / 0:00

Prompt: A beautiful homemade video showing the people of Lagos, Nigeria in the year 2056. Shot with a mobile phone camera.Prompt: A beautiful homemade video showing the people of Lagos, Nigeria in the year 2056. Shot with a mobile phone camera.

0:00 / 0:00

Prompt: A petri dish with a bamboo forest growing within it that has tiny red pandas running around.Prompt: A petri dish with a bamboo forest growing within it that has tiny red pandas running around.

0:00 / 0:00

Prompt: The camera rotates around a large stack of vintage televisions all showing different programs — 1950s sci-fi movies, horror movies, news, static, a 1970s sitcom, etc, set inside a large New York museum gallery.Prompt: The camera rotates around a large stack of vintage televisions all showing different programs — 1950s sci-fi movies, horror movies, news, static, a 1970s sitcom, etc, set inside a large New York museum gallery.

0:00 / 0:00

Prompt: 3D animation of a small, round, fluffy creature with big, expressive eyes explores a vibrant, enchanted forest. The creature, a whimsical blend of a rabbit and a squirrel, has soft blue fur and a bushy, striped tail. It hops along a sparkling stream, its eyes wide with wonder. The forest is alive with magical elements: flowers that glow and change colors, trees with leaves in shades of purple and silver, and small floating lights that resemble fireflies. The creature stops to interact playfully with a group of tiny, fairy-like beings dancing around a mushroom ring. The creature looks up in awe at a large, glowing tree that seems to be the heart of the forest.Prompt: 3D animation of a small, round, fluffy creature with big, expressive eyes explores a vibrant, enchanted forest. The creature, a whimsical blend of a rabbit and a squirrel, has soft blue fur and a bushy, striped tail. It hops along a sparkling stream, its eyes wide with wonder. The forest is alive with magical elements: flowers that glow and change colors, trees with leaves in shades of purple and silver, and small floating lights that resemble fireflies. The creature stops to interact playfully with a group of tiny, fairy-like beings dancing around a mushroom ring. The creature looks up in awe at a large, glowing tree that seems to be the heart of the forest.

0:00 / 0:00

Sora is able to generate complex scenes with multiple characters, specific types of motion, and accurate details of the subject and background. The model understands not only what the user has asked for in the prompt, but also how those things exist in the physical world.

1 of 8

Prompt: The camera follows behind a white vintage SUV with a black roof rack as it speeds up a steep dirt road surrounded by pine trees on a steep mountain slope, dust kicks up from it’s tires, the sunlight shines on the SUV as it speeds along the dirt road, casting a warm glow over the scene. The dirt road curves gently into the distance, with no other cars or vehicles in sight. The trees on either side of the road are redwoods, with patches of greenery scattered throughout. The car is seen from the rear following the curve with ease, making it seem as if it is on a rugged drive through the rugged terrain. The dirt road itself is surrounded by steep hills and mountains, with a clear blue sky above with wispy clouds.Prompt: The camera follows behind a white vintage SUV with a black roof rack as it speeds up a steep dirt road surrounded by pine trees on a steep mountain slope, dust kicks up from it’s tires, the sunlight shines on the SUV as it speeds along the dirt road, casting a warm glow over the scene. The dirt road curves gently into the distance, with no other cars or vehicles in sight. The trees on either side of the road are redwoods, with patches of greenery scattered throughout. The car is seen from the rear following the curve with ease, making it seem as if it is on a rugged drive through the rugged terrain. The dirt road itself is surrounded by steep hills and mountains, with a clear blue sky above with wispy clouds.

0:00 / 0:00

Prompt: Reflections in the window of a train traveling through the Tokyo suburbs.Prompt: Reflections in the window of a train traveling through the Tokyo suburbs.

0:00 / 0:00

Prompt: A drone camera circles around a beautiful historic church built on a rocky outcropping along the Amalfi Coast, the view showcases historic and magnificent architectural details and tiered pathways and patios, waves are seen crashing against the rocks below as the view overlooks the horizon of the coastal waters and hilly landscapes of the Amalfi Coast Italy, several distant people are seen walking and enjoying vistas on patios of the dramatic ocean views, the warm glow of the afternoon sun creates a magical and romantic feeling to the scene, the view is stunning captured with beautiful photography.Prompt: A drone camera circles around a beautiful historic church built on a rocky outcropping along the Amalfi Coast, the view showcases historic and magnificent architectural details and tiered pathways and patios, waves are seen crashing against the rocks below as the view overlooks the horizon of the coastal waters and hilly landscapes of the Amalfi Coast Italy, several distant people are seen walking and enjoying vistas on patios of the dramatic ocean views, the warm glow of the afternoon sun creates a magical and romantic feeling to the scene, the view is stunning captured with beautiful photography.

0:00 / 0:00

Prompt: A large orange octopus is seen resting on the bottom of the ocean floor, blending in with the sandy and rocky terrain. Its tentacles are spread out around its body, and its eyes are closed. The octopus is unaware of a king crab that is crawling towards it from behind a rock, its claws raised and ready to attack. The crab is brown and spiny, with long legs and antennae. The scene is captured from a wide angle, showing the vastness and depth of the ocean. The water is clear and blue, with rays of sunlight filtering through. The shot is sharp and crisp, with a high dynamic range. The octopus and the crab are in focus, while the background is slightly blurred, creating a depth of field effect.Prompt: A large orange octopus is seen resting on the bottom of the ocean floor, blending in with the sandy and rocky terrain. Its tentacles are spread out around its body, and its eyes are closed. The octopus is unaware of a king crab that is crawling towards it from behind a rock, its claws raised and ready to attack. The crab is brown and spiny, with long legs and antennae. The scene is captured from a wide angle, showing the vastness and depth of the ocean. The water is clear and blue, with rays of sunlight filtering through. The shot is sharp and crisp, with a high dynamic range. The octopus and the crab are in focus, while the background is slightly blurred, creating a depth of field effect.

0:00 / 0:00

Prompt: A flock of paper airplanes flutters through a dense jungle, weaving around trees as if they were migrating birds.Prompt: A flock of paper airplanes flutters through a dense jungle, weaving around trees as if they were migrating birds.

0:00 / 0:00

Prompt: A cat waking up its sleeping owner demanding breakfast. The owner tries to ignore the cat, but the cat tries new tactics and finally the owner pulls out a secret stash of treats from under the pillow to hold the cat off a little longer.Prompt: A cat waking up its sleeping owner demanding breakfast. The owner tries to ignore the cat, but the cat tries new tactics and finally the owner pulls out a secret stash of treats from under the pillow to hold the cat off a little longer.

0:00 / 0:00

Prompt: Borneo wildlife on the Kinabatangan RiverPrompt: Borneo wildlife on the Kinabatangan River

0:00 / 0:00

Prompt: A Chinese Lunar New Year celebration video with Chinese Dragon.Prompt: A Chinese Lunar New Year celebration video with Chinese Dragon.

0:00 / 0:00

The model has a deep understanding of language, enabling it to accurately interpret prompts and generate compelling characters that express vibrant emotions. Sora can also create multiple shots within a single generated video that accurately persist characters and visual style.

1 of 8

Prompt: Tour of an art gallery with many beautiful works of art in different styles.Prompt: Tour of an art gallery with many beautiful works of art in different styles.

0:00 / 0:00

Prompt: Beautiful, snowy Tokyo city is bustling. The camera moves through the bustling city street, following several people enjoying the beautiful snowy weather and shopping at nearby stalls. Gorgeous sakura petals are flying through the wind along with snowflakes.Prompt: Beautiful, snowy Tokyo city is bustling. The camera moves through the bustling city street, following several people enjoying the beautiful snowy weather and shopping at nearby stalls. Gorgeous sakura petals are flying through the wind along with snowflakes.

0:00 / 0:00

Prompt: A stop motion animation of a flower growing out of the windowsill of a suburban house.Prompt: A stop motion animation of a flower growing out of the windowsill of a suburban house.

0:00 / 0:00

Prompt: The story of a robot’s life in a cyberpunk setting.Prompt: The story of a robot’s life in a cyberpunk setting.

0:00 / 0:00

Prompt: An extreme close-up of an gray-haired man with a beard in his 60s, he is deep in thought pondering the history of the universe as he sits at a cafe in Paris, his eyes focus on people offscreen as they walk as he sits mostly motionless, he is dressed in a wool coat suit coat with a button-down shirt , he wears a brown beret and glasses and has a very professorial appearance, and the end he offers a subtle closed-mouth smile as if he found the answer to the mystery of life, the lighting is very cinematic with the golden light and the Parisian streets and city in the background, depth of field, cinematic 35mm film.Prompt: An extreme close-up of an gray-haired man with a beard in his 60s, he is deep in thought pondering the history of the universe as he sits at a cafe in Paris, his eyes focus on people offscreen as they walk as he sits mostly motionless, he is dressed in a wool coat suit coat with a button-down shirt , he wears a brown beret and glasses and has a very professorial appearance, and the end he offers a subtle closed-mouth smile as if he found the answer to the mystery of life, the lighting is very cinematic with the golden light and the Parisian streets and city in the background, depth of field, cinematic 35mm film.

0:00 / 0:00

Prompt: A beautiful silhouette animation shows a wolf howling at the moon, feeling lonely, until it finds its pack.Prompt: A beautiful silhouette animation shows a wolf howling at the moon, feeling lonely, until it finds its pack.

0:00 / 0:00

Prompt: New York City submerged like Atlantis. Fish, whales, sea turtles and sharks swim through the streets of New York.Prompt: New York City submerged like Atlantis. Fish, whales, sea turtles and sharks swim through the streets of New York.

0:00 / 0:00

Prompt: A litter of golden retriever puppies playing in the snow. Their heads pop out of the snow, covered in.Prompt: A litter of golden retriever puppies playing in the snow. Their heads pop out of the snow, covered in.

0:00 / 0:00

The current model has weaknesses. It may struggle with accurately simulating the physics of a complex scene, and may not understand specific instances of cause and effect. For example, a person might take a bite out of a cookie, but afterward, the cookie may not have a bite mark.

The model may also confuse spatial details of a prompt, for example, mixing up left and right, and may struggle with precise descriptions of events that take place over time, like following a specific camera trajectory.

1 of 5

Prompt: Step-printing scene of a person running, cinematic film shot in 35mm.Prompt: Step-printing scene of a person running, cinematic film shot in 35mm.

Weakness: Sora sometimes creates physically implausible motion.

0:00 / 0:00

Prompt: Five gray wolf pups frolicking and chasing each other around a remote gravel road, surrounded by grass. The pups run and leap, chasing each other, and nipping at each other, playing.Prompt: Five gray wolf pups frolicking and chasing each other around a remote gravel road, surrounded by grass. The pups run and leap, chasing each other, and nipping at each other, playing.

Weakness: Animals or people can spontaneously appear, especially in scenes containing many entities.

0:00 / 0:00

Prompt: Basketball through hoop then explodes.Prompt: Basketball through hoop then explodes.

Weakness: An example of inaccurate physical modeling and unnatural object “morphing.”

0:00 / 0:00

Prompt: Archeologists discover a generic plastic chair in the desert, excavating and dusting it with great care.Prompt: Archeologists discover a generic plastic chair in the desert, excavating and dusting it with great care.

Weakness: In this example, Sora fails to model the chair as a rigid object, leading to inaccurate physical interactions.

0:00 / 0:00

Prompt: A grandmother with neatly combed grey hair stands behind a colorful birthday cake with numerous candles at a wood dining room table, expression is one of pure joy and happiness, with a happy glow in her eye. She leans forward and blows out the candles with a gentle puff, the cake has pink frosting and sprinkles and the candles cease to flicker, the grandmother wears a light blue blouse adorned with floral patterns, several happy friends and family sitting at the table can be seen celebrating, out of focus. The scene is beautifully captured, cinematic, showing a 3/4 view of the grandmother and the dining room. Warm color tones and soft lighting enhance the mood..Prompt: A grandmother with neatly combed grey hair stands behind a colorful birthday cake with numerous candles at a wood dining room table, expression is one of pure joy and happiness, with a happy glow in her eye. She leans forward and blows out the candles with a gentle puff, the cake has pink frosting and sprinkles and the candles cease to flicker, the grandmother wears a light blue blouse adorned with floral patterns, several happy friends and family sitting at the table can be seen celebrating, out of focus. The scene is beautifully captured, cinematic, showing a 3/4 view of the grandmother and the dining room. Warm color tones and soft lighting enhance the mood..

Weakness: Simulating complex interactions between objects and multiple characters is often challenging for the model, sometimes resulting in humorous generations.

0:00 / 0:00

Sora: Creating video from text (2024)

FAQs

How to use Sora AI text to video? ›

To create videos, users must input detailed text descriptions into Sora AI. The platform then generates videos based on these prompts, with options for customization and editing.

How to create a video from text? ›

How to make AI-generated video
  1. Launch Canva. Open Canva to access the AI text-to-video generator. ...
  2. Access the AI video generator app. Click Apps on the editor side panel, and select Magic Media to begin the AI video creation process.
  3. Create AI video. ...
  4. Customize your AI-generated video. ...
  5. Present, download, or share.

How to generate video on Sora? ›

How to Create Videos on Sora AI?
  1. Logging into the OpenAI dashboard and accessing Sora AI.
  2. Entering text descriptions for the video you want to create.
  3. Utilizing customization options to tailor the video.
  4. Generating and editing the video to achieve the desired outcome.

What is the AI that creates videos based on text? ›

Synthesia is an AI video generator that allows you to convert text to video in a matter of minutes.

What are the limitations of Sora AI? ›

Limitations may include initial setup complexity and potential constraints in handling complex editing tasks. Not addressed in the paper. Sora AI offers potential benefits for content creation like deepfake videos but also poses risks due to misuse, highlighting the opportunities and threats of AI-generated content.

Can I use Sora AI for free? ›

While Sora itself isn't available publicly yet, there are some cool alternatives out there that let you dive into AI-generated videos without spending a dime. Sure, they may not reach Sora's cinematic heights, but they're still fun to play with.

What is the best AI movie generator from text? ›

11 Best AI Video Generators of 2024
  • D-ID.
  • Elai.
  • HeyGen.
  • Runway.
  • Pictory.
  • Deepbrain AI.
  • InVideo.
  • Fliki.
Feb 9, 2024

Which AI tool generates video from text free? ›

Synthesia's free demo video generator can convert text to video for free. Simply go to Synthesia.io and click on 'Create a free AI video'. There, choose a template, type in your script, and generate your AI video for free.

Can AI create a video from a script? ›

Can AI make a video from a script? You can make videos from scripts using Synthesia's AI video generator. Simply paste your video script, or use the built-in AI script generator to create a narrated video in minutes.

What is Sora AI video generator? ›

AI Video Generator - Text to Video By Sora - Google Workspace Marketplace. Generate videos from text prompts with our Text-to-Video tool base on OpenAI Sora. Our AI Video Generator enables everyone to create professional videos without mics, cameras, actors or studios.

Can I use Sora AI? ›

No. Currently, Sora is only available to a select group of expert testers who will explore the model for any problems.

How does Sora AI work? ›

To generate videos, Sora uses the same diffusion method as DALL·E, with a transformer architecture similar to GPT, enabling it to generate long, detailed, multi-composition clips. Diffusion starts with a random field of noise, and the AI repeatedly edits it so that it gets closer and closer to the target prompt.

What is the best free AI video generator? ›

10 Best AI Video Generators 2024
  • Synthesia: Best for AI Avatars.
  • AI Studios: Best for Text-to-Speech Quality.
  • InVideo: Best for Social Media and Content Marketing Videos.
  • Pictory: Best for AI Video Summaries and Highlights.
  • Lumen5: Best for Ease of Use.
  • Elai: Best for API-Driven Scalability.
Feb 22, 2024

How to make video from text free? ›

How do I convert text to video? With Wave.video's text-to-video generator, you can make video from text within minutes. First, upload or insert a link to your text and pick the desired duration, audio mood, and text length. Then, choose a format and visual style for your video.

What is the free AI text to video generator without watermark? ›

Best free ai video generator without watermark 2024
  • Synthesia. Synthesia is an AI-powered video creation platform that allows users to add lifelike text-to-speech narration to their movies. ...
  • Lumen5. ...
  • Renderforest. ...
  • Promo. ...
  • Animaker. ...
  • Viddyoze. ...
  • Flexclip. ...
  • InVideo.
1 day ago

How do I convert text to animation video? ›

Simply upload your content/script in Steve.AI's dashboard. Choose a template. Customize your design, use the cartoon avatar maker to create the perfect animated character. The rest will be taken care of by Steve!

How do I convert text to audio video? ›

Text to Speech Video Integration in 6 Easy Steps
  1. Write your script. ...
  2. Choose your TTS voice. ...
  3. Enter your text into a TTS production tool. ...
  4. Adjust pronunciation. ...
  5. Download completed files. ...
  6. Import audio files into your video production software.

How to make an AI video? ›

How can I create videos with AI?
  1. Select a video template or start from scratch.
  2. Type or paste your video script.
  3. Edit video by adding a free AI presenter, photos, images, videos, shapes, transitions, animations, music and more.
  4. Generate video.

How to convert text into audio using AI? ›

VEED lets you automatically convert text to speech using AI. Just click Text-to-Speech from the Audio menu and type or paste your text. Select a voice profile, and an AI voice will read it aloud for you. You can add the audio file to your project and create a video or download the audio as an MP3 file.

Top Articles
Latest Posts
Article information

Author: Jeremiah Abshire

Last Updated:

Views: 6085

Rating: 4.3 / 5 (54 voted)

Reviews: 93% of readers found this page helpful

Author information

Name: Jeremiah Abshire

Birthday: 1993-09-14

Address: Apt. 425 92748 Jannie Centers, Port Nikitaville, VT 82110

Phone: +8096210939894

Job: Lead Healthcare Manager

Hobby: Watching movies, Watching movies, Knapping, LARPing, Coffee roasting, Lacemaking, Gaming

Introduction: My name is Jeremiah Abshire, I am a outstanding, kind, clever, hilarious, curious, hilarious, outstanding person who loves writing and wants to share my knowledge and understanding with you.