it MIGHT change animation as soon as AI can fix the variation change and keep a very good consistency.
@roverdrammen3977
Жыл бұрын
Hahahahahahaha!
@yoongichi9557
Жыл бұрын
Even then it wouldn’t look like traditional animation…. Traditional animation has those deformed looking in-between frames that don’t occur in reality but they add that extra punch and oomf to the resulting animation. An ai would have to be trained on all the various types of contexts for super deformed comedic moments, chibi moments, crazy foreshortening during motion etc
@DannyRndm
Жыл бұрын
1:53 no need to screenshot. You can export the frame as a jpg or png file. In the Program Monitor, click the Export Frame button on the lower right. Click to view larger image In the Export Frame dialog, choose the desired filename, still-image format, and path, clicking the Browse button to open the Browse for Folder dialog. NOTE ... In Windows, you can export to the BMP, DPX, GIF, JPEG, PNG, TGA, and TIFF formats. On the Mac, you can export to the DPX, JPG, PNG, TGA, and TIFF formats. Click OK to export the frame. Great content. Keep up the good work!
@optimoos
Жыл бұрын
wow. game changer! thanks for keeping us in the loop with the latest, Sebastian!
@sebastiankamph
Жыл бұрын
You bet! Glad to have you around. Keep working on those animations 🌟
@ShawnFumo
Жыл бұрын
Clever way around the limit! Another option might be to leave a bit of overlap in the videos sent to Gen-1 and then crossfade them.
@AvantiMusicNJ
Жыл бұрын
Damn getting consistency like this is insane. Doing it on a green screen would be clutch
@Modioman69
Жыл бұрын
Nice job bypassing the current limitations with a nice work flow. I can foresee background renders composited with green screen actors each being separately passed through the Gen-1 as a common workflow once consistency is better. Might not even need the green screen if the AI can ever differentiate between subjects real-time. Now what is really going to blow people’s minds is when Imagen text to video gets fully ironed out. Then the sky is the limit for content creation. Make your own movies in any style, everyone then uploads to a Imagenhub full of user content. I’m just spitballing but time will tell. Keep up the great content Sebastian. 👍
@sebastiankamph
Жыл бұрын
I think you're on to something there. User generated content will be the future more than it is today. Thank you! 😊🌟
@ixiTimmyixi
Жыл бұрын
Processing foreground and background seperatley will work even better. ( i haven't finished the video yet, so you may have already done that lol)
@sebastiankamph
Жыл бұрын
That surely sounds like the best way. I need to test it further to see if it can be improved.
@ixiTimmyixi
Жыл бұрын
@@sebastiankamph batch processing your masks is insanely powerful. You can work with 4k video and retain the resolution without upscaling. Give the AI much more pixels to work with and providing impressive amounts of detail. Let me know if you need help. I can't find time to make a guide. You can if you want
@human_shaped
Жыл бұрын
We need this as an extension to Stable Diffusion.
@sebastiankamph
Жыл бұрын
For sure!
@peterxyz3541
Жыл бұрын
I seen the Corridor Digital attempt at this “anime rock paper scissor”. I’m working on doing something similar
@sebastiankamph
Жыл бұрын
Very cool! They got a whole team working, but with the right tools you can get pretty far solo as well.
@Gerard_V
Жыл бұрын
How cool! let's see if I have access soon! I would like to try it!
@bernhard.design
Жыл бұрын
yeah. Just let us know when an unlimited release goes public. I guess that’s about it. Creative people can start producing their own cool cartoon or anime shows. Thx for sharing, cheers 🍻
@sebastiankamph
Жыл бұрын
Thanks! I'm waiting for that too 🌟
@BooooClips
Жыл бұрын
Let’s hope an open source paper comes out for this and it can be added to automatic, I feel like this is very rudimentary
@ekmauka-Inqalab
Жыл бұрын
This is crazyyy
@EmanueleDelFio
Жыл бұрын
uhhh this stuff is fire ! thanks Seb !
@sebastiankamph
Жыл бұрын
I'm expecting some new stuff with this on your Tiktok soon! Don't forget where you saw it first 🔥
@nilmoraes-w2q
Жыл бұрын
This is amazing, but could you make a tutorial explaining better how to do the edits in Premiere so that we, who are laypeople, can do it too
@TheAiConqueror
Жыл бұрын
Really cool workflow! 😬👍
@sebastiankamph
Жыл бұрын
Thanks! Just waiting for you to make something cool now once you get in 🌟
@madcolors4013
Жыл бұрын
What about green screen? so you can generate a background and or the video separately so it won't change as much?
@classichungamatv7012
Жыл бұрын
How do you get the access????
@sebastiankamph
Жыл бұрын
It's open access for all now. Check their site
@classichungamatv7012
Жыл бұрын
@@sebastiankamph thanks
@judgeworks3687
Жыл бұрын
I wonder if you ran the gen-1 videos thru with 'Only_foreground: True) if you could render just the figure, then either composite the Ai animated figure with a still of the SD bricks, or do two renders of the gen-1 videos, first run is only foreground and the 2nd group of renders is only background?
@sebastiankamph
Жыл бұрын
That'd be something! I tried to AI mask the character out and put him in front of a scene. It was kinda meh, but with more work it could be really cool.
@judgeworks3687
Жыл бұрын
@@sebastiankamph Btw your tuts are great. And you have a very calm delivery style which is refreshing, especially as AI is somewhat frenetic in that it updates almost everyday 🙂 Thanks so much for your generous tutorials and walk thrus.
@scetchmonkey007
Жыл бұрын
It's not changing animation unless you can do it from scratch, this is just another version of motion capture.
@ChrisPiciullo
Жыл бұрын
This is amazing, considering Corridor Crew just did it by hand the hard way using Stable DIffusion. One weird thing though... Why'd it make the actor "white?" Is there a way to keep it closer to the source material?
@sebastiankamph
Жыл бұрын
With a team their size, they have the luxury to make it really detailed by hand 😅 The change was from Stable diffusions style prompt. Since I wrote martial arts master and had lots of anime prompts, it generally turned towards the region of Asia. I could just as easily have another style (like any of the thumbnail images).
@ChrisPiciullo
Жыл бұрын
@@sebastiankamph Oh, totally. That was my point about Corridor. This makes it so that anyone can do essentially what they did which is so amazing. These tools are advancing so far, so fast. Regarding the prompts, I honestly hadn't considered that they would be smart enough to do that without specifics. Maybe its the "old person" in me but I'm continuously amazed by what these tools can do. Thanks for clarifying!
@GameManCZ2000
Жыл бұрын
How do i get private discord
@bigdaveproduction168
Жыл бұрын
And do you have an idea to keep the same background ?
@ireincarnatedasacontentcreator
Жыл бұрын
may i know the download source of your checkpoint and style pls
@asterlofts1565
Жыл бұрын
And this is only Gen 1... and now is out ModelScope!
@sebastiankamph
Жыл бұрын
For sure! Got a video on that one too.
@federicogonzalezgalicia3041
Жыл бұрын
Hi, i get this everytime I try to generate an image from text: RuntimeError: "LayerNormKernelImpl" not implemented for 'Half' any solutions? (I have a imac 64GB RAM btw) Thank you very much
@rayamc607
Жыл бұрын
Great tech but good for some things and not others. It is basically a rotoscoping filter - it changes video but it still looks like video with a filter. Great for the animation tool box or a quick shot like you used. Corridor crew's animation is epic but still required an epic amount of work and man hours to put together... and still looks like rotoscoping.... Would be good to see any animation work you have done apart from playing around with AI - I mean do you understand the topic you are talking about? Not being funny just interested to know :-)
@11305205219
Жыл бұрын
*I use macOS system, How can I get Flow frames*
@sebastiankamph
Жыл бұрын
I'm afraid I don't know
@michaelli7000
Жыл бұрын
i find when i try to combine different clips togethr into a long one, there are couple frames missing in each of the gen1 output clip which makes the clips transition not aligned, how do you solve this missing frames problems? thanks a lot.
@sebastiankamph
Жыл бұрын
I literally show this in the video 😅
@dekompose
Жыл бұрын
Amazing
@sebastiankamph
Жыл бұрын
Thank you! Cheers!
@wilderness-19
Жыл бұрын
Do you have to use discord or is there a stable diffusion addon?
@sebastiankamph
Жыл бұрын
Sadly, it's Discord only at this invite only stage. But I expect it to move out of Discord when their testing is finished.
@studio85amsterdam
Жыл бұрын
Runway just announced something for 20/03. Likely text to video. 😮😮😮
Now its free. They announced it on discord 1,5 hours ago.
@bilrockstar80
Жыл бұрын
my future is at risk
@워크-f2p
Жыл бұрын
으메이징!! 뷰티풀 어썸 갓
@Zombitopia
Жыл бұрын
Can 4gb ram handle that work?
@sebastiankamph
Жыл бұрын
Yes, Gen-1 handles all the calculations, so no hardware is needed for you individually.
@nikhilprasanth829
Жыл бұрын
❤
@timmygilbert4102
Жыл бұрын
I have the same problem where the ai is turning all my black character white 😂
@androidgamerxc
Жыл бұрын
not only we cant afford it we cant even get to play it
@sebastiankamph
Жыл бұрын
Soon! I see new testers get invited every day.
@alexgold1700
Жыл бұрын
The film "The Little Mermaid" will be run through the neural network and then the film will have a chance!
@desertwolfskin2148
Жыл бұрын
This is essentially just a filter. Not animation.
@Framehacker
Жыл бұрын
meh, more discord bot sh!t.... guess i have to wait for a stable diffusion version of this.
@theultimateartist4153
Жыл бұрын
Why is that character face so bloated, I highly doubt anyone wants that
@ilovemagenta
Жыл бұрын
dude got whitewashed
@blender_wiki
Жыл бұрын
I love you chanel but sorry to say it that this time this is a poor example. Old info + Low creativity level + poor workflow.
@emmasnow29
Жыл бұрын
Having to use discord is a shame.
@sebastiankamph
Жыл бұрын
Agreed!
@bikurifacebook4553
Жыл бұрын
free?
@sebastiankamph
Жыл бұрын
Free, at least for now. (But beta access only for now)
@ixiTimmyixi
Жыл бұрын
I was just watching another KZitemr play with Gen1 and I kept saying to my wife "why isn't anyone styling Frames from the input video? That would give much more consistent results" lol. Leave it to Sebastian. Thanks for sharing, I can't wait to get access for myself. I wonder if they're using the Alt IMG2IMG method for heir processing. It's a HUGE game changer for SD animations
@sebastiankamph
Жыл бұрын
Hah, great minds think alike. I first tried to style each video input as well, having 5 style frames. But I didn't notice much improvement in the little testing I did.
@nilmoraes-w2q
Жыл бұрын
This is amazing, but could you make a tutorial explaining better how to do the edits in Premiere so that we, who are laypeople, can do it too
@skattyopt
Жыл бұрын
I have just got access to runway cant wait to have a go so this video has come at the right time for me.
@sebastiankamph
Жыл бұрын
Excellent, have fun with it!
@timandersen8030
Жыл бұрын
Where is the open source version of Gen 1 ???
@innovanimations
Жыл бұрын
I transform videos into cartoon from almost a year ago but this AI has changed it all
@char_art
Жыл бұрын
As you show us very well, the result generated by an AI is really ugly, very far from what a real artist could bring who has spent years acquiring solid skills. Even if you spend hundreds of hours there, it won't change anything. And unfortunately we risk seeing more and more "artists" like you appearing trying to make it easy with these new tools (which can be very useful for certain tasks I'm not against at all, such as coupling chat gtp with a 3d software to make motion design). Only to make beautiful animation, you should already try to be less lazy and get to work to develop your artistic eye. So for now there is still a bright future for REAL artists
@sebastiankamph
Жыл бұрын
Thank you, I am a designer and animator by trade, working 20 years.
@char_art
Жыл бұрын
@@sebastiankamph 🤣
@new-bp6ix
Жыл бұрын
XD This type of animation has existed since the 1940's All people are doing now is pushing companies to produce bad quality animation
@BenCaesar
Жыл бұрын
Guys this is rotoscoping with a filter. Let’s not disrespect animators or rotoscoping.
@DD-nk4fb
Жыл бұрын
There's a huge difference between Animation and Rotoscope. Please do understand this fundamental principles.
@niatro
Жыл бұрын
Hi, how can I join the Runway Discord? Is it free?
@thegoldensmith
Жыл бұрын
Amazing stuff! I'm blown away with how fast this tech is progressing. Crazy to think Stable Diffusion has only been available for 6 months. This next year is going to be incredible!
@sebastiankamph
Жыл бұрын
I can't wait! 🤩
@JohnDoe-cb9ep
Жыл бұрын
I hate it when you can't do something locally on your PC, I don't want to register, access, share data, etc. That's why Stable Diffusion blows my mind with its features available at any time, without registration and without limitation
@sebastiankamph
Жыл бұрын
Agreed! But I'll take what I can get with new tech 😊
@MAKARUTV
Жыл бұрын
Thank you. 🎉🎉🎉🎉🎉
@arwatayeb6386
Жыл бұрын
To add the anime affects, is it free??
@TheAiConqueror
Жыл бұрын
🫡
@sebastiankamph
Жыл бұрын
What is this, a tip for ants!? Just kidding my friend, thank you! Biggest supporter as always 😘🌟
@TheAiConqueror
Жыл бұрын
@@sebastiankamphMany ants also give a fortune at some point 🐜🐜🐜💰 Then they can carry your sacks full of money 😜👍
@dingdongchingchong8659
Жыл бұрын
Where's the chick?
@ishirnmehta1753
Жыл бұрын
Any idea how to upscale the 512*512 footage to a 4k?
@sebastiankamph
Жыл бұрын
You could try an AI video upscaler. Check out Topaz for example. It's not free however. Thank you very much for your continued support 🌟🤩
@oussamael7304
Жыл бұрын
their discord doesn't work anymore
@sebastiankamph
Жыл бұрын
Runway.ml now
@MonologueMusicals
Жыл бұрын
I've searched for the aspect ratio extension and don't see anything. Anyone got a link?
@creativeleodaily
Жыл бұрын
This is so cool, The youtube series I am working on, can definitely use this 😮😮😮
@sebastiankamph
Жыл бұрын
Go for it! Show me the results when you're finished 🌟
@WoWKeila
Жыл бұрын
Hi ! Do you think reducing the video frame rate and asking GEN1 to do something with it could be a viable solution? I mean, you could switch to 10FPS for example, generate your result, and use Flowframes to make it smoother in the end. This would allow you to generate 3 times more images with the same exact seed/background/whatever. Thank you in advance for your response.
@sebastiankamph
Жыл бұрын
Hey, probably yes. I played around a bit with it, trying different settings.
@jodus
Жыл бұрын
that's really cool
@KJIgravitypwns
Жыл бұрын
hey, kinda unrelated but what is the extension at the top of your txt2img tab that allows quicking switching of vaes and loras?
@sebastiankamph
Жыл бұрын
It's just a setting in settings. Come ask in Discord for details.
@DanielPartzsch
Жыл бұрын
Thanks. I'd be very curious if this also works for driving realistic character images with an input video...? Did you maybe have chance to test this or saw something like this somewhere?
@sebastiankamph
Жыл бұрын
I haven't seen any good examples yet. But I'm sure someone will manage it!
@mischamim744
Жыл бұрын
I wonder if runway can be pumped into stable diffusion? Is this also a model or? This is already a real animation that anyone can use. Thank you for the video.
@sebastiankamph
Жыл бұрын
I don't see a way yet, I think their api is closed. But maybe in time.
@vidalsomohano2414
Жыл бұрын
Me gustaría en español. Haces maravillas. Intento adaptarme.
@sebastiankamph
Жыл бұрын
No sé español, espero que KZitem traduzca los subtítulos, ¿está bien?
@KDawg5000
Жыл бұрын
This technology will obsolete a lot of the work that Corridor Crew did for their anime video.
@sebastiankamph
Жыл бұрын
For sure! It's still very rough this, but it's getting there.
@JohnVanderbeck
Жыл бұрын
Let me know when it is something I can do offline on my own machines.
@sebastiankamph
Жыл бұрын
You can do what Corridor Crew did on your own machines, but that takes a loooooot more effort. This will have to wait a bit 😊
@blackvx
Жыл бұрын
Amazing work! The ski slope is the best. Thanks!
@sebastiankamph
Жыл бұрын
Glad you liked it! And thank you :)
@satishpillaigamedev
Жыл бұрын
each gen using different seed might be a reason for bg change ?
@sebastiankamph
Жыл бұрын
I did same seed for this tutorial but I'm sure there are ways around it working with foreground and background separately.
@satishpillaigamedev
Жыл бұрын
@@sebastiankamph ya that should be possible with control net and plain bg
Пікірлер: 129