absolutely mindblowing!! getting 6fps on my laptop 3070, thank you so much ❤
@mecherodriguez5114
8 ай бұрын
me too
@dullat700
2 ай бұрын
What about 2gb v ram?
@TouchDesignerOfficial
9 ай бұрын
Amazing work and great tutorial. A small tip for your callbacks DAT, on the Common page of parameters if you switch 'Content Language' to Python then the DAT will use python syntax highlighting.
@FunctionStore
9 ай бұрын
Dotsimulate InSession when?
@blankensmithing
9 ай бұрын
Yessssss 100 %@@FunctionStore
@dotsimulate
9 ай бұрын
❤Thank you !! I will make sure to set that when callbacks are created.
@engard
9 ай бұрын
❤
@gleix_
9 ай бұрын
Lyell you've got a voice ready for public access. ALSO this looks amazing! For people who know TD and already have a competent workflow, but are lacking in knowledge of SD, tools like this immediately open the door and make it more accessible than it has any right to be. I think seeing SD generating images in real-time, within TD in a format I can immediately wrap my head around to a better degree, is a pull I haven't had with SD until now. Awesome work!
@blankensmithing
9 ай бұрын
Yesssss Lyell! Amazing work and tutorial!! Would love to see you create more tutorials in the future!!
@ChyaBra
5 ай бұрын
Super excited to try this! The tutorial starts out with the Stream Diffusion operator on the screen but I'm not sure how to get that operator. Do I install the repo somewhere and point to the directory in the parameters box?
@FunctionStore
9 ай бұрын
he's done it! I know what I'll be doing tomorrow...
@jakoblacour
9 ай бұрын
Really great! Got 1.5 fps with my GTX 1070 😅
@teodoricoteodorico
9 ай бұрын
same setup, confirming drop to 0.7/0.8 with live image segmentation running parallel
@nothingrhymeswithferg3744
9 ай бұрын
this is actually just the craziest thing i've ever seen
@nicsnutzius6305
8 ай бұрын
Thanks a lot for this amazing work on StreamDiffusion! Regarding the NDI source name issue: I had similiar issues with the refresh on another project and realized that using 'Bind' instead of 'Reference' fixes the issue.
@dotsimulate
8 ай бұрын
Will investigate. Thank you.
@ChristianBrinkmannLive
9 ай бұрын
Yeees finally! 😍 You‘re the best for putting this out! And the tutorial is well made made too 🖤
@Jonny11299
6 ай бұрын
Guys this is frickin insane. Amazing work!
@cristianpenas
7 ай бұрын
This is super inspiring, it gives a clear visual image of the fundamentals of diffusion models
@InOneArt
5 ай бұрын
And now. Imagine an AI chatbot, when communicating with which you are accompanied by a visual series that displays your adventures in real time. Impressive
@freivonstil
8 ай бұрын
Thank you so much for sharing! I'm a big fan even after the first minute already! Sub
@brvoigt
9 ай бұрын
Nice use of those new sequential parameters! 🔥
@dotsimulate
9 ай бұрын
Thanks ! They are quite handy. definitely a great addition for 2023.
@Adellovisuals
9 ай бұрын
Thanks a lot for this! Running at 8 FPS with 4070
@MrJgrez
5 ай бұрын
Nice job bro. Appreciate the information.
@xavierg_music
9 ай бұрын
Thank you so much for sharing this!! ❤ My dreams just came true..
@RetropunkAI
5 ай бұрын
This is EXACTLY what I needed this weekend. Thank you so much for this.
@jaysonwall434
8 ай бұрын
Whoa! That was cool. Thanks for the breakdown. Downloading stream diffusion now. :)
@thiagojosebraganca8704
5 ай бұрын
hello. I was enchanted by the possibilities of stream diffusion. I'm a complete newbie and I don't know how to do the installations prior to the tutorial. How can I access this operator? Do I need to subscribe to your Patreon to have access or would I be able to use this tutorial? tanks
@gregderivative2647
9 ай бұрын
fabulous tool design and great explanation in the video.
@datsmabowl
8 ай бұрын
Incredible work and very accessible tools. Thanks so much!
@manu.vision
9 ай бұрын
Proud of you Lyell! ❤
@MarkDrMindsetChavez
8 ай бұрын
Whoa! Now this is what I needed! Thanks for the great work and generosity.
@SilentMediaLab
9 ай бұрын
nice nice! super nice! thank you for your work, it's amazing the opportunity to create and work with these tools. cheers
@kiksu1
9 ай бұрын
Fantastic work!
@LANworldArchive
9 ай бұрын
That's amazing gonna try if for sure!!! Thank u for sharing this 🙏🌀
@osamajamil4804
7 ай бұрын
Amazing work. A quick question, can we connect this diffusion model in touch designer to depth camera, so the changes are done according to human motion?
@Kaijufruit
7 ай бұрын
Wen Mac version? :) is there compatibility issues?
@iloveallvideos
8 ай бұрын
AMAZING!!! FROM THE CREATUVES AROUND THE WORLD, THANK YOU
@rafaroeder
7 ай бұрын
Hey! Thank you very much! Just became a patreon. I'm really excited. Does this work with python 3.12? or only 3.10.. I struggled to find the install file for 3.10 version.. had to change it directly on the url.
@zpacetree
5 ай бұрын
did you ever find out if it works on 3.12?
@ANGELDISENY
5 ай бұрын
@@zpacetree in case it helps you: I have tried all versions and it only worked to me with 3.10
@swadedenimproduction
6 ай бұрын
Incredible! Can this run on A Mac Studio with an M2 Max/ultra?
@diogomarques8
9 ай бұрын
Amazing! I would really like a toturial (or get in touch with) about the fireball clip. Looks impressive, and i'm working on a project with similar aesthetic, but im having trouble on generating the refrence image part before the SD tox.
@teodoricoteodorico
9 ай бұрын
Seems from his video he is using hand tracking (possibly to move a circle and then generate from there) i'm currently experimenting with mediapipe live segmentation tool as a starting generation point
@mecherodriguez5114
8 ай бұрын
beautiful work, great tutorial, I'm running on average at 6 FPS . If I wanted to ask how to load new MODEL IDs?
@콘트라베이스치는황보
6 ай бұрын
you are best!!!! thanks!!!!
@antialias8588
9 ай бұрын
Amazing. Thank you for this !
@menguzar
8 ай бұрын
Great tutorial and great asset man, thanks! What's the OP that uyou use for the prompt list? is that a table dat or something else?
@v.rtx_void
9 ай бұрын
Awesome as usual, thank you so much for this!! Just 2 questions: Will it work with 2022 Touchdesigner Versions? And do you, by any chance, also have a Gumroad page for purchasing, instead of Patreon?
@gregderivative2647
9 ай бұрын
nom it uses Custom Sequential Parameters (see wiki, opens a lot of doors!), which is in 2023.Official only.
@v.rtx_void
9 ай бұрын
thanks, when I ayked it was not in the description yet
@antoniaangel6384
9 ай бұрын
Hey! I tried and it seems not to work with 2022 TD.
@folders_apries
8 ай бұрын
amazing stuff!
@tiwonku
9 ай бұрын
i think im in love..
@elekktronaut
9 ай бұрын
❤
@_geom
8 ай бұрын
Wow thanks for sharing
@unveil7762
9 ай бұрын
You my new best friend!!! ❤❤❤❤
@KaleidoKurt
5 ай бұрын
Amazing! Thank you for sharing. Would this work on a Mac? Specifically MBP M2 Max 64 GB
@АлександрАбдулов-э5д
7 ай бұрын
Hello, it's cool work. Does your plugin support tensorrt acceleration?
@dotsimulate
7 ай бұрын
Yep! I’ve got an improved installation process with a separate step for tensorrt.
@jasmine8182
6 ай бұрын
Is there any way to integrate your own LoRa/safetensor into this ??
@Kirmm
8 ай бұрын
Awesome stuff! That 4090 really helps.
@jarydfarah2
3 ай бұрын
this is so sick! any indication when it will work on Mac? does it already work on Mac?
@R0n7n
5 ай бұрын
You start the Tutorial by adding the StreamDiffusionTD Operator in TD, however I don't have this in my TD installation what do I do?
@TheSGTJamie
3 ай бұрын
Get it from their patron
@lee_sung_studio
8 ай бұрын
Thank you.
@santiago15608
8 ай бұрын
Thanks for the video! Is it a must to download the Python v 3.10.9 + cuda 11.8?
@louisfievet9341
5 ай бұрын
Heyyy Mate ! Great tut and infos !! Thanks for sharing ! Does this work on Mac ?
@dotsimulate
5 ай бұрын
As of a few days ago, yes ! On Apple silicon macs and definitely is slower than nvidia graphics cards though.
@amiiineh
5 ай бұрын
This is pretty cool! any advice on getting it running on a mac?
@teodoricoteodorico
9 ай бұрын
simply wonderful, any insight on how to extract the live fps from streamdiffusion in order to set a time comp?
@dotsimulate
8 ай бұрын
Ive got CHOPs exposed as out2 for both fps and framecount (frame total since stream began)
@georgiaharrison1572
6 ай бұрын
Hey when I start stream with the pulse and my cmd comes up, it get to the end of the code but doesn't get past 'preparing stream...' Any idea why not? I've left it for over an hour and still the same. Have a good computer and high vram nvida card. Really appreciate any help - thanks!!!
@moritzmaas2011
7 ай бұрын
looks amazing. is there another way without an nvidia card?
@alphapyro360
9 ай бұрын
amazing!
@resonanceytv
8 ай бұрын
May I ask how did you load the operator in the network at 1:16 ? ❤❤❤
@krenarferizi3587
6 ай бұрын
yeah we need a even more clear tutorial on this plzzz
@Flor-ly5cg
6 ай бұрын
You need to go to his patron pay 5$ and then download the Operator
@leono5122
6 ай бұрын
Thank you for the video! Is an image-to-image generation also possible? For example, a jpg file as input and stream diffusion creates similar looking images in real time?
@X3itis
8 ай бұрын
How do you load up the operator in the first place ?
@defaultname0001
7 ай бұрын
Thank god I'm not alone here. I have no idea how to even begin this process cuz he skipped right over step 1 as if TD is intuitive lol
@rec-trick
9 ай бұрын
amazing
@symbiothika
3 ай бұрын
Thanks for sharing. It is only possible with an nvidia card. I have a hp probook laptop with raedon card
@P-oj7iq
5 ай бұрын
Is there any guide of how ot add the StreamdiffusionTD operator to the Touchdesigner? Sorry I'm newbie
@dotsimulate
5 ай бұрын
Drag it from location on disk after downloading. Just released a new version! (available on my Patreon)
@MrPlasmo
9 ай бұрын
great tutorial and will try this out. Is there a way to easily save the output generations to mp4 file or other format?
@dotsimulate
9 ай бұрын
Definitely ! moviefileout TOP (Touchdesigner can do everything)
@yashasv.doodles
9 ай бұрын
Truly awesome. Just became a patron on Patreon haha. I'm having a slight trouble once i start stream. After the Triton error thing , i get a message saying : OSError: [WinError 10048] Only one usage of each socket address (protocol/network address/port) is normally permitted Fetching 12 files: 0%| | 0/12 [00:00
@dotsimulate
8 ай бұрын
close all other instances of the operator in TD and also close all old cmd windows. Seems like you are running into the osc server not being able to start up.
@yashasv.doodles
8 ай бұрын
My stream keeps turning on and off ( starts and stops) and i'm getting like 0.96 fps whenever it comes on for a fraction of a second. Can you guide me as to how i can maintain my FPS and keep the stream active ? Thank you! I'm so close to this, can feeeeel it
@yashasv.doodles
8 ай бұрын
How can i maintain a steady fps with no intermittent stops on stream?
@dotsimulate
8 ай бұрын
@@yashasv.doodles might be a limitation of your graphics card. To stop the start/stop stream, there is a timer inside that loops/checks for active stream. Called osctimer. If you change the length of that timer to like a few seconds, the stream should stay on once on. You can toggle the stream active toggle if it gets stuck in the on position as well.
@yashasv.doodles
8 ай бұрын
Okay start/stop issue is resolved. But i don't see any latent space / morphing take place on my null to the tox. Could you guide on how to connect hugging face model path/id to TD please!
@dosu5064
6 ай бұрын
1:17 How did you get this Node StreamDiffusionTD
@lukaspetersen6087
6 ай бұрын
Seems like you have to be a Patron
@dosu5064
6 ай бұрын
@@lukaspetersen6087 (((
@dosu5064
6 ай бұрын
@@lukaspetersen6087 Thanks
@dvdgoldberg
7 ай бұрын
great work !! would it be possible to use IPA adapters ?
@dotsimulate
7 ай бұрын
I absolutely want to add this.
@dr0mp507
8 ай бұрын
any chance to use control net? or masks on the inputs to control some shapes in the generation?
@dotsimulate
8 ай бұрын
Can definitely give it a sense of the shape with input image. Not quite fast enough to run with controlnet at this point for realtime. But definitely possible non realtime with ComfyUI.
@dr0mp507
8 ай бұрын
Comfy ui is in itself a whole process, I saw in their demos that they were using photoshop as an input for the generation, drawing a base shape and sent it to generation.
@M4Pxls
8 ай бұрын
Looks amazing! Is it possible to make it portable with anaconda venv instead of installing directly on system?
@dotsimulate
8 ай бұрын
It is using venv so it isn't installing to system python. A few people are using it with conda env as well, as the script can be run from cmd line. I plan to add option to support launch with conda in future.
@M4Pxls
8 ай бұрын
@@dotsimulate sounds great!
@infernall_blessfree_waghun8377
7 ай бұрын
Hey :) would it be possible to do a turial of this tipic on Mac :) kind regards
@ithamardimarco9082
7 ай бұрын
Amazing 🔥🔥🔥 does it run offline?
@ysy69
9 ай бұрын
Wow, this is amazing. Do I gain access to this Operator as your Start SD Patreon ?
@dotsimulate
9 ай бұрын
Yes ! thank you !
@ysy69
9 ай бұрын
@@dotsimulateI will join.
@nicotritschler675
6 ай бұрын
Thank you so much for this! I may be lost right now but how do I write the path to a local safetensor model? I can't seam to get it working
@mishavanrooij6065
9 ай бұрын
Does this also work with MacOS? m1
@ChichisGermany
7 ай бұрын
no, you need an nvida graphic card
@gnanny
6 ай бұрын
How do you load the operator, its not showing in the tab menu. im very new to td.
@jennnital
8 ай бұрын
Hi there! i've previously gotten streamdiffusion to work locally with conda instead of venv - whats the best way to mod this TOP? :) or should i still use the venv process?
@excido7107
8 ай бұрын
I know this might be a no brainer but I've tried to get a couple SDXL models working, like FenrisXL and DreamshaperXL turbo and they dont work, do I need to be using the Stabilityai huggingface models? or can I use my own comfyUI?
@dotsimulate
8 ай бұрын
sd-turbo is a 2.1 based model. It is not sdxl-turbo. Models supported are 1.5 based, because of the 1.5 LCM lora and also sd-turbo. You can use local model from safetensors file if you use the full file path instead of a hugging face id.
@excido7107
8 ай бұрын
@@dotsimulate Awesome I got 1.5 models going, starting up the stream is way faster now. I have a 4090 and can get pretty fast generations with SDXL especially utilising the turbo Loras and such, is there a way to do it with StreanDuffusion Tox or do I need to try connecting it to ComfyTD? :)
@hoole3796
6 ай бұрын
very cool video. I have a problem for the installation I have an error for cuda python How can i resolve ?
@Flor-ly5cg
Ай бұрын
It works great but the resolution and details are very poor, you don't get good faces
@marshalldestro
6 ай бұрын
wait, so the only way to do this is to subscribe to the patreon? i went through the trouble of installing all the stuff only to realize the TD base featured in this clip doesnt exist in TD :(
@gabrielecella
7 ай бұрын
wow
@gabrielecella
7 ай бұрын
wht is for you the best way to record the stream? thx in advance
@daddouuuu
4 ай бұрын
Thisi is incredible! Why wouldn’t it work on Mac?
@unijascha3005
5 ай бұрын
i am super unexperienced so how do I add the operator into touchdesginer network?
@jeonsewon.__
8 ай бұрын
Hi I want to ask you one thing about this awesome tutorial I bought your patreon and I did what you taught me but the fps came out around 0.272 and the stream kept turning off and on and off. It doesn't work properly over and over again. What's wrong with this?
@dotsimulate
8 ай бұрын
The fps is likely due to computer hardware speeds Easy fix but for the start/stop. Send me a message on discord/Patreon and I will explain.
@rudolf_II
8 ай бұрын
since i work on a mac pro (win 11 is installed) with a vega 56, i question is will the amd GPU gets a support for this?
@tianlianyang
5 ай бұрын
Can you tell me how to use controlnet? Are there any tutorials? Thank you very much
@olenatrifan7852
8 ай бұрын
this looks sooo amazing! I'm trying to run it on my side. Everything seems to go right, but then it stops after "The config attributes {'skip_prk_steps': True} were passed to LCMScheduler, but are not expected and will be ignored. Please verify your scheduler_config.json configuration file." the streaming just never happens:( anyone had the same issue? I can't wait to test this! 😍
@olenatrifan7852
8 ай бұрын
thanks for your help on discord! if anyone has the same issue, a simple TD restart solved it for me
@TheGladScientist
8 ай бұрын
@@olenatrifan7852 quick note if other are stuck here, you have to save your current TD project and open it again. restarting TD and then trying with a new TOX did not get any further than that point.
@creaturefromtheblack
2 ай бұрын
amazing !! how to load new different model ?
@Neomu_Joah
3 ай бұрын
I need a tutorial on how to change the model ID using the Hugging Face or Civitai website
@santobosco5008
9 ай бұрын
Thanks for this! I am currently unable to run it, after the Intializing NDI streaming etc, it runs into: D:\StreamDiffusion\StreamDiffusion\venv\lib\site-packages\diffusers\configuration_utils.py:135: FutureWarning: Accessing config attribute requires_safety_checker directly via 'StableDiffusionPipeline' object attribute is deprecated. Please access 'requires_safety_checker' over 'StableDiffusionPipeline's config object instead, e.g. 'scheduler.config.requires_safety_checker'. deprecate("direct config name access", "1.0.0", deprecation_message, standard_warn=False) Process Process-4: and goes on and on..what should i do? thankssss🙏🙏🙏🙏🙏🙏
@eventservice8511
8 ай бұрын
How did you make a photoshop generation in examples on github?
@anjiraj2899
7 ай бұрын
@dotsimulate bro where can i find or install the StreamdiffusionTD operator new to touch designer
@pixelnation5384
4 ай бұрын
gooday brother did u figure it out yet, also facing the same thing
@ashleighhewitt3399
Ай бұрын
Will this ever be available for AMD graphic card users? :)
@susankosti
8 ай бұрын
Wow thanks so much! Amazing tool, I love it! Can I connect it to my webcam by any chance? I would like to make interactive! :)
@dotsimulate
8 ай бұрын
of course. videodeviceinTOP. TouchDesigner can do anything !
@susankosti
8 ай бұрын
awesome!! I just found it but where should I insert in the StreamDiffusion setting? Sorry I just started TD today! :) @@dotsimulate
@susankosti
8 ай бұрын
Thanks its working flawless! Now I wanted to add LORA models and crank up the weight to 1 but nothing is happening. Is there another setting I have to change maybe? Thanks:)@@dotsimulate
@sbfhhhsbfhhh9986
4 ай бұрын
I encountered an issue during installation. When I click the install/download button, a window prompts me that there is no network connection, even though my network is actually work fine. What could be the reason? My version is 0.1.9.
@danielrubinstein6714
4 ай бұрын
Hey, there is a way to use this with inpainting to select to afect only a determined area of the image?
@adistu
2 ай бұрын
How come at the beginning of the video we see almost 25 fps but during the main video tutorial is 18 fps?
@borisdesgeyl666
7 ай бұрын
Great! How do I get/create the Container nvidia_smi in TD?
@datsmabowl
2 ай бұрын
Help Please! I'm getting this error on venv install(I have python 3.1 installed to path, CUDA 12.1 and pytorch 2.1): ERROR: Could not find a version that satisfies the requirement torch==2.1.0 (from versions: none) ERROR: No matching distribution found for torch==2.1.0'
@drew9555
7 ай бұрын
is anything out of pocket aside from becoming a patreon?
Пікірлер: 223