Amazing, especially for $500 - but this feels like Fiverr Pixar to me, even in this advancing state of the art.
On the other hand, it is also challenging to accurately describe an AAA movie scene in any terms where the AI won't then connect the dots to a familiar scene from an AAA movie and incorporate those details.
This video is a great example. Looks great, sounds great, but also looks like a really good amateur found a bunch of clips on a stock video site and edited them together, probably because stock video is a really plentiful source of learning data. The interviews look the best, but again, lots of interviews in the training data.
When you combine the skill it takes to generate good prompts, with the lack of sufficient training data, I’ll just say I don’t think Christopher Nolan has anything to worry about just yet. Maybe Wes Anderson does though.
Still seems like early days on this tech. We're nowhere near the limits.
Just a year ago we could only create the distorted video of Will Smith eating spaghetti. A year from now this is going to be even more flawless.
The gum just doesn't work for me. A black and white mega popular white female jazz singer doesn't really make sense. Maybe a Judy Garland type singer would work but she is singing a style that I don't think makes sense. Like someone making what they think jazz vocals should sound like but they don't really listen to much jazz. Billie Holiday wasn't even that popular.
Just like the black and white part doesn't work for me because you can tell it is just the same color clips but desaturated. While real black and white would be on film and look shot on film.
I think the AI stuff is actually pretty good but the director/human creativity here is actually what is not that good. The sound design and music are pretty bad.
I am waiting to see what Aronofsky can do with these tools since the studios won't let him set 30 million dollars on fire again like with The Fountain.
I think that these are all limitations that can be improved with scale and iterative improvements. Image and video generation models are not affected as much by the problems that plague LLMs, so it should be possible to improve them by brute force alone.
I'm frankly impressed with this short film. They managed to maintain the appearance of characters across scenes, the sound and lip syncing are well done, the music is great. I could see myself enjoying this type of content in a few years, especially if I can generate it myself.
> I’ll just say I don’t think Christopher Nolan has anything to worry about just yet.
The transition will happen gradually. We'll start seeing more and more generated video in mainstream movies, and traditional directors will get more comfortable with using it. I think we'll still need human directors for a long time to come. They will just use their talents in very different ways.
AI tools used to make this short film:
Image Generation: Whisk, Runway, Midjourney, Dreamina, Sora
Video Generation: FLOW & Veo 3, Dreamina, HIGGSFIELD, Kling AI
Voice Generation: ElevenLabs
Lip Sync: FLOW & Veo 3, Dreamina, HeyGen
Music Generation: Suno AI
Sound FX Generation: MMAudio, ElevenLabs
Prompt Optimization: ChatGPTYou can see it here: https://www.youtube.com/watch?v=US2gO7UYEfY
In their case, they interspersed live actors with AI-generated imagery.
Bluestein•6mo ago
"Pinned by @hashemalghailiofficialchannel @philipashane 4 days ago (edited)
I’ve been wondering when this day would come, when we’d see an AI film that was just a damn good film, without the distraction of AI blemishes. This is well written, well directed, well edited, just about everything is top notch. The “acting” isn’t stellar but nor is it bad. This is very impressive and a landmark achievement, kudos to you."
leakycap•6mo ago
Maybe I'm just detail oriented, but "police" wasn't even spelled right on the officer's sparse uniform. That isn't even half way into the movie, and by then I'd spotted dozens of other weird AI details.
Bluestein•6mo ago
I think the point being not "no blemishes" but "story and execution good enough for blemishes not to be distracting" still stands.-
leakycap•6mo ago
The common word "POLICE" misspelled with non-letters on an otherwise empty uniform was an obvious one, but so was the historical singer's face changing in just the first few cuts.
dragonwriter•6mo ago
Even though the mockumentary format is an excellent choice for minimizing the impact of several of those problems, they are still pretty glaring there, even if less so than if you tried to make literally any other style of film with the same techniques.
Bluestein•6mo ago
PS. We might be a tad beyond "train arriving at the station" territory, at least - that much can be granted methinks.-
stubish•6mo ago
vannevar•6mo ago