subject: generative ai
date: AUG 2024
news
You know, I know, everybody knows: Artificial intelligence is everywhere, especially in creative fields like art, music, and now, video production. Generative video AI is one of the hottest trends, allowing creators to bring their imaginations to life with just a few clicks.
But as with any early-stage-cutting-edge technology, things don’t always go as planned. Sometimes, the results are more “unexpected” than you might hope.
Here I want to share and briefly discuss my studies using two of the major platforms today for generative videos: Runway Ml and Krea.ai
Take a look at this generated image by Midjourney.
The prompt was pretty simple: a young beautiful secretary smiling in a modern office.
Now, take a look at the generated videos below. The given prompt was the same, but sadly ignored: zoom out.
Technology: RunWay ML
Technology: Krea.ai
Altough RunWay ML’s result seems more appropriate and close to reality, still looks artificial enough for us to spot right on it was generated and not really captured.
Given the same base image to generate results, both platforms generated unwanted results.
But why does this happen?
Generative AIs rely on the data they’ve been trained on, and sometimes they overinterpret the input given. For example, when you provide a vague or abstract prompt, the AI might pull in unrelated concepts from its training data, leading to results that are unpredictable, thus, generating chaotic results. Ask for a video of a “dog playing in the park,” and you might end up with a video of a dog playing poker at a picnic table.
AI doesn’t always grasp context as a human would. It’s great at recognizing patterns and generating content based on them, but it might miss the subtle nuances of a request. For example, if you’re creating a video about a “cool breeze on a summer day,” the AI might focus too much on the word “cool” and give you snowy landscapes instead. Not exactly what you were going for.
AI, at the end of the day, is still software. And like all software, it can, and will, have bugs.
These technical glitches can manifest as weird visual distortions, mismatched audio, or even completely nonsensical outputs.
While unwanted results can be frustrating, they’re also part of the fun of working with generative video AI. These surprises can inspire new ideas, push creative boundaries, and even lead to happy accidents that can become the highlight of your project.
Plus, they remind us that while AI is incredibly powerful, it’s still a long way from replacing human creativity. Human imagination is, still, something that was not yet deciphered nor programmed into machines. Yet.
Her eare more examples of unwanted results. Sorry, but these are hedious!
Woman looses her arms completely and there is no way the bike would stand up without any support or driver’s feet.
Here the background and camera movements change so much that gives the viewer labyrinthine.
Unrealistic hair movent in wind, plus her left hand has erratic behavior.
