Be a part of our every day and weekly newsletters for the most recent updates and unique content material on industry-leading AI protection. Be taught Extra
Luma AI made waves with the launch of its Dream Machine generative AI video creation platform final summer time.
In fact, whereas that was solely seven brief months in the past, the AI video house has superior quickly with the discharge of many new AI video creation fashions from rival startups within the U.S. and China, together with Runway, Kling, Pika 2.0, OpenAI’s Sora, Google’s Veo 2, MiniMax’s Hailuo and open supply alternate options equivalent to Hotshot and Genmo’s Mochi 1, to call however a number of. Even Luma itself just lately up to date its Dream Machine platform to incorporate new nonetheless picture technology and brainstorming boards, and likewise debuted an iOS app.
However the updates proceed: At this time, the San Francisco-based Luma launched Ray2, its latest video AI technology mannequin, accessible now by means of its Dream Machine web site and cell apps for paying subscribers (to start out).
The mannequin presents “quick, pure coherent movement and physics,” based on Luma AI co-founder and CEO Amit Jain on his X account, and was educated with 10 instances extra compute than the unique Luma AI video mannequin, Ray1.
“This skyrockets the success price of usable production-ready generations and makes video storytelling accessible to much more folks,” Jain added.
Luma’s Dream Machine internet platform presents a free tier with 720 pixel generations capped at a variable quantity every month: Paid plans start at $6.99 per 30 days: From “Lite,” which presents 1080p visuals, to Plus ($20.99/month), to Limitless ($66.49/month) and Enterprise ($1,672.92/12 months).
A leap ahead in video gen
Proper now, Luma’s Ray2 is proscribed to tex-to-video, permitting customers to sort in descriptions which are remodeled into 5 or 10 second video clips.
The mannequin can generate new movies in a matter of seconds, though proper now it will probably take minutes at a time because of a crush of demand from new customers.
Examples shared by Luma and early testers in its Creators program showcase the mannequin’s versatility, together with a person working by means of an Antarctic snowstorm surrounded by explosions, and a ballerina acting on an ice floe within the Arctic.
Impressively, all of the motions within the instance movies seem lifelike and fluid — and sometimes, with topics shifting a lot quicker and extra naturally than movies from rival AI turbines, which frequently seem to generate in sluggish movement.
The mannequin may even create practical variations of surreal concepts equivalent to a giraffe browsing, as X consumer @JeffSynthesized demonstrated. “Ray 2 is the true deal,” he wrote on X.
Different AI video creators who’ve tried the brand new mannequin appear to largely agree, with Jerrod Lew posting on X: “Improved cinematography, lighting and realism has arrived and it’s superior.”
“…it’s so good!” AI video artist Heather Cooper chimed in.
My very own checks have been a combined bag, with some extra complicated prompts creating unnatural and glitchy outcomes. However when it did produce clips that resembled extra of what I had in thoughts in my prompts — equivalent to fencers crossing swords aboard an area station orbiting Jupiter — it was undeniably spectacular.
Jain stated Luma can even add image-to-video, video-to-video and enhancing capabilities to Ray2 sooner or later, additional increasing the software’s inventive potentialities.
To rejoice the launch of Ray2, Luma Labs is internet hosting the Ray2 Awards, providing creators the possibility to win as much as $7,000 in prizes. These embody:
- A big scale award: The creator whose Ray2 content material garners essentially the most views on a single platform throughout the first week of launch will win $5,000. Submissions are due by January 22, 2025.
- A raffle for $3,000: Creators can enter by sharing Ray2 content material on social media and interesting with Luma AI’s launch video. The deadline for participation can also be January 22.
Winners of each awards might be introduced on January 27. Submissions might be uploaded by way of kinds offered by Luma Labs, and creators are inspired to make use of hashtags #Ray2 and #DreamMachine when sharing their work.
Moreover, Luma Labs has launched an associates program, permitting contributors to earn commissions by selling its instruments.
