A very comprehensive and thorough guide. It definitely shows how much research you have done. Thank you for this amazing video! Also tensorflow is stopping support for TensorRT in the next update so if you are installing a newer version don't bother installing TensorRT To the people who are facing issues when installing a different version of CUDA or cuDNN please make sure that in whichever command you run to make sure the version number is of the version of your installation . For example I installed version 12.3 of CUDA so in commands like: sudo cp include/cudnn*.h /usr/local/cuda-12.1/include I had to change it to: sudo cp include/cudnn*.h /usr/local/cuda-12.3/include Thoroughly check each command for version number or else you will face issues. Just follow the steps mentioned in the video and you should be fine.
@Natanael_c137
3 ай бұрын
In more than three weeks of watching tutorials and looking for amazing solutions, you were the only one who could help me. Thank you very much.
@TechJotters24
3 ай бұрын
You are welcome!! Really happy it works for you!!!
@ebrar5339
Ай бұрын
@@TechJotters24 @arandomguy3526 1 ay önce Hi, is this error normal "E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered. E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
@mmehrose
12 күн бұрын
Very detailed video, Thumbs up for that. One suggestion though , plz zoom on to the specific point for better visibility
@TechJotters24
5 күн бұрын
Noted
@codex4336
24 күн бұрын
Bro you're GOATED. The only tutorial that worked for me after searching everywhere. Subscribed and Liked
@TechJotters24
5 күн бұрын
Appreciate it
@jedi4z
Ай бұрын
This helped me a looooot! thank you so much! now I can use all my GPU 🙌🏼
@AboElWes
3 ай бұрын
You Are a LEGEND man!!! After all that searching you are the one who's done it for me. Keep Going. CHEERS!!!
@TechJotters24
3 ай бұрын
Glad I could help
@kirannchelak
Ай бұрын
Thank you so much for helping us in a detailed manner, thank you so much ! ❤
@1hecuteangel
26 күн бұрын
wow, you have really helped me to set up my machine learning environment on my windows. Thank you!!
@eymericchauchat
2 ай бұрын
You're the software wizard I needed, thank you very much
@TechJotters24
2 ай бұрын
:D you are welcome
@bxyz
3 ай бұрын
Thank you so much! The only tutorial that has worked so far end-to-end. Thanks again!
@TechJotters24
2 ай бұрын
You are welcome.
@bxyz
2 ай бұрын
@@TechJotters24 I tried to run the same instructions but after installing tensorflow @ [python -c "import tensorflow as tf; print(tf.config.list_physical_devices('GPU'))"] , I got: 2024-07-25 22:47:21.340568: I tensorflow/core/util/port.cc:153] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. 2024-07-25 22:47:21.616111: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered 2024-07-25 22:47:21.706543: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered 2024-07-25 22:47:21.727644: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered 2024-07-25 22:47:21.870530: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. Would you happen to know what happened?
@bxyz
2 ай бұрын
I was able to fix it with this code: python3 -m pip uninstall tensorflow[and-cuda] python3 -m pip install "tensorflow[and-cuda]==2.16.1"
@anandharsh
3 ай бұрын
Thank you so much. Please keep uploading. Learned a lot from you. Respect.
@TechJotters24
3 ай бұрын
Thank you, I will
@nikitsbozenko3396
3 ай бұрын
Lol bro, I've been trying to find a solution to this problem for almost a week, I've read many gigabytes of information and visited every possible page on Nvidia's website, and somehow I can't solve this problem, you're my superman, thank you very much)❤❤❤
@TechJotters24
3 ай бұрын
You are welcome!!!
@_fl3x_up_
3 ай бұрын
Thanks a lot man, this is the best video. I was trying to install for more than a day and couldn't. U r a saviour 🙏. One thing i want to ask is ur GitHub link u provided has some extra lines of code to execute at the end like sudo rm and few other lines that you don't talk about in the video, should I run them?
@TechJotters24
3 ай бұрын
Glad I could help
@FocusedLoop
10 күн бұрын
Works perfect as of 19/09/2024, amazing video!
@TechJotters24
5 күн бұрын
Glad it helped!
@nonameastold8352
Ай бұрын
Awesome video. Thanks a lot. Till now I was using Ubuntu and windows separately using dual boot and has tf gpu install at both place. Both has its benefit. With windows it allowed me to open large models because some how in windows my gpu was able access my system ram too. But Ubuntu supported many features of torch which doesn’t work on windows. No I am getting a new laptop and wanted to try this wsl. I want to know from your experience is your gpu able to access system memory?
@AKN96
Ай бұрын
Thanks, Man. This really helps.
@iihyder
3 ай бұрын
Thank you my brother! Very Useful video
@TechJotters24
3 ай бұрын
You are welcome!!!
@WWinsWotV
3 ай бұрын
Thank you!! Guide worked perfectly.
@TechJotters24
3 ай бұрын
You are welcome!!!
@ricardorise
3 ай бұрын
You are de Guy. Thankyou very much
@TechJotters24
3 ай бұрын
Happy to help
@Hatim14031879
Ай бұрын
Thank you a lot for this 🙏🙏
@surajkumar-vd6xl
3 ай бұрын
Thank you so much. Great tutorial! 👍👍👍👍👍👍👍
@TechJotters24
3 ай бұрын
You are welcome!!!
@itsamitnitrkl5199
3 ай бұрын
true legend to solve the problem
@TechJotters24
3 ай бұрын
Thank you!!
@henkiespenkie4414
2 ай бұрын
on 17:11 i do get nvcc: command not found error but i could not solve it even with your tutorial :(
@HarrisonNguyen-z7m
2 ай бұрын
If I install the latest version of tensorflow without tensorrt, would I later be able to use the downgraded versions of cuda and tensorflow for tensorrt? Also, the latest version of tensorflow uses cuda 12.3 while pytorch is 12.1 or 12.4, so can I have multiple cuda versions? I'm unfamiliar with these technologies because I'm just starting out.
@ShahidulAbir
3 ай бұрын
Great tutorial! Thank you so much.
@TechJotters24
3 ай бұрын
You're very welcome!
@furkanakin25
3 ай бұрын
Hello, very useful video. Thank you. I want to run Spyder, can you help me with this? Also I get a segmentation fault error when running the model, do you have any idea about this?
@TechJotters24
3 ай бұрын
Hi, sorry I don’t know about segmentation error. I’ll test spyder and let you know.
@HarnsHwong
3 ай бұрын
Can I use this method on the actual Ubuntu 24.04 instead of the WSL? Also, may I know how can I link the installed tensorflow to the jupyter notebook in VS code instead of the actual jupyter notebook?
@TechJotters24
3 ай бұрын
Hi, I made one. kzitem.info/news/bejne/koqol52croWZaaQ
@HarnsHwong
3 ай бұрын
@@TechJotters24 You're a legend man. Appreciate it alot!
@lowkeyleanin
3 ай бұрын
Thank you for this comment. Because of this, he made a new video. You are such a LEGEND
@hantornado7888
2 ай бұрын
hello, i followed every procedures of yours, but im installing cuda 11.8 and cudnn 8.6, coz based on tensorflow's website, they should be compatible with my rtx3060. however, i reached an issue in initializing cudnn. after running "./test_cudnn", this error pops out, when i use "ls" i can see the file, but coudnlt open, do you know how to solve this? ./test_cudnn: error while loading shared libraries: libcudnn.so.8: cannot open shared object file: No such file or directory thank you sir
@TechJotters24
2 ай бұрын
I tried to figure it out, but I don't have this GPU available to test. I am really sorry.
@hantornado7888
2 ай бұрын
@@TechJotters24 no problem, although that thing didnt work out, but eventually i got it done. However, as gpu was able to be used, i couldnt import any other python libraries like cv2 or mediapipe (pip installed, pip list also shows). So i guess i just decided to give up lol. But your videos are great, keep it up.
@charliesj0129
3 ай бұрын
After those installation ,How to use tensorflow in VScode ?
@TechJotters24
2 ай бұрын
Hi @charliesj0129, please check this video - kzitem.info/news/bejne/o4Kg24aVnnOaeaw
@joacosolbes9283
3 ай бұрын
Hello mister, I want to run some AI programs like stable diffusion and LLM locally, but my GPU is very low i have Nvidia Geforce GTX 1650 with only 4 gb of ram Can this nvidia drivers thing installed with WSL help me to run this kind of AI software? into a windows 11? or what is the real benefit to implement this? thanks a lot for your help
@TechJotters24
3 ай бұрын
Hi, I don’t think you need to do wsl. Try lm studio on windows. Smaller models will run perfectly and it’ll also suggest you which models are compatible with your system.
@meaningbread15
3 ай бұрын
you're the best!
@TechJotters24
3 ай бұрын
Thank you !!!
@TechJotters24
3 ай бұрын
Thank you!!!
@matthewhu5017
3 ай бұрын
Having a little trouble installing cudnn. I used the same cudnn tar and followed the commands exactly, but cudnn initialization keeps on failing :/ Do you have any idea what could be going wrong?
@TechJotters24
3 ай бұрын
What type of error you are getting?
@matthewhu5017
3 ай бұрын
@@TechJotters24 Running `import torch` and `torch.cuda.is_available()` creates: UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 2: out of memory (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:108.) Fixed it by removing one of three GPUs. Not sure why cudnn & the python commands above failed with 3 GPUs but runs with 2 GPUs. Could be a problem with Windows or WSL2 or a hardware limitation, since I've seen some Linux servers with 4+ GPUs Would love to hear if you have any thoughts as to why :)
@matthewhu5017
3 ай бұрын
@@TechJotters24 Running `import torch` and `torch.cuda.is_available()` creates the following error: "UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 2: out of memory" Fixed the error by removing 1 of 3 GPUs. Curious why cudnn fails with 3 GPUs but works with 2 GPUs. Could be a hardware limitation or an issue with WSL2/Windows. I've noticed that my model auto-loader (exl2 running on Win11) can never utilize all 3 GPUs simultaneously for large models, while I've seen Linux servers handle 4+ GPUs before. Wondering if you have any idea what the root cause is! I'd love to figure it out 😃
@matthewhu5017
3 ай бұрын
@@TechJotters24 Was getting "Error 2: out of memory" using torch.cuda.is_available(). I removed the 3rd GPU and it worked with 2 GPUs. Probably a limitation on Windows/WSL, since I've noticed loading large models on Windows can't leverage all 3 of my GPUs using exl2 model loader.
@matthewhu5017
3 ай бұрын
@@TechJotters24 Was getting "Error 2: out of memory" using torch.cuda.is_available(). I removed the 3rd GPU and it worked with 2 GPUs. Probably a limitation on Windows/WSL, since I've noticed loading large models on Windows can't leverage all 3 of my GPUs using exl2 model loader.
@waqarkai
3 ай бұрын
Great job! Does Tensorflow 2.16.1 support Cuda 12.1, or does it require Cuda 12.3?
@TechJotters24
3 ай бұрын
The latest cuda toolkit you can use for tensorflow 2.16.1 is 12.3. But in that case you can’t use TensorRt. If you want tensorrt support, the latest cuda toolkit you can use it 12.1 because tensorflow support only tensorrt 8.6 and tensorrt 8.6 can only work with Cuda Toolkit 12.1. It’s a chain reaction :D
@waqarkai
3 ай бұрын
@@TechJotters24 sir i follow the procedure with tf 2.16.1 with cude 12.1 unfortunately it isn’t identify gpu device. I switch to tf 2.15 with new env. It identify the device with many missing dependencies like cublas etc
@waqarkai
3 ай бұрын
@@TechJotters24 sir it works I don’t know the reason i just restart my system and make new conda env and just install tf and pytorch thank you soo much sir 😊
@TravelJotter24
3 ай бұрын
@@waqarkaigreat!!!
@kushaldudipala6285
3 ай бұрын
thank you
@TechJotters24
3 ай бұрын
You are welcome!!!
@abdubaghdad
Ай бұрын
I wish that I have 1M account so I make 1M like to your video
@arandomguy3526
2 ай бұрын
Hi, is this error normal "E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered. E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
@omartamer3274
2 ай бұрын
same
@shashankpericherla3399
2 ай бұрын
Thank you so much bro , I wasted hours and days trying to figure whats wrong. you deserve more support and subscribers.
@TechJotters24
2 ай бұрын
You are welcome. Really happy to help!!!
@bertjansen1811
2 ай бұрын
Brilliant, Thank You! Been trying to do this for at least 6 month now and finally got it to work!!!😁
@inclinedadarsh
3 ай бұрын
I have been trying to do this for so long. Finally a video that showed me exactly how to do that and solved all my queries. Thank you so much!
@TechJotters24
3 ай бұрын
You are welcome.
@neelg235
3 ай бұрын
Thank you SO MUCH! All other resources are sooo behind that I wasted way too much time trying to get TensorRT to show up.
@TechJotters24
3 ай бұрын
You are most welcome
@multifanblinks3674
Ай бұрын
somehow i still get the cudnn error:) but the tensorrt have been solved so thank you
@kuleenthejas8382
2 ай бұрын
i pray that u r reserved a seat in heaven bro ,u saved me a ton :)
@ankursingh4617
2 ай бұрын
its showing bad subsitutuion after i added tensor path....this is the error -bash: :${LD_ LIBRARY_PATH}: bad substitution
@TechJotters24
2 ай бұрын
Hi, i believe the best solution is to check the directory first and remove all the bashrc/Path entries related to this and configure again.
@farhaanjamal33
3 ай бұрын
Thank you soooo much, It's clear and sharp to the point Can you help me how to use the tf environment for local windows folder in vs code
@TechJotters24
3 ай бұрын
You are welcome. Sure I’ll help you.
@yudhitanasa728
3 ай бұрын
Thank you so much. It works, really save the time. GOD BLESS YOU.
@TechJotters24
3 ай бұрын
You are welcome!!!
@abhijitmustafi
3 ай бұрын
You are the new Buddha ...because you are the only one who shows the "right way" !!
@TechJotters24
3 ай бұрын
Thank you!!!!
@halilkaya4503
3 ай бұрын
Thank you for preparing this guide, it was very helpful
@TechJotters24
3 ай бұрын
You are welcome
@shanicedoesdata9837
Ай бұрын
Thanks for the great tutorial! I have tried a few but this is the only one I got to work!! My MSc project thanks you!!!
@898guitarist898
Ай бұрын
Man, I don't know how it's possible but it's working. You did such a great tutorial for a noob as me that started 3 days ago learning Deep Learning. And it worked at the first try! Great job
@SuzyQuimble
3 ай бұрын
Thank you so much for the video. I have a question--I have followed your guide exactly, but I get one extra warning message when I import tensorflow in jupyter: oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Is this a cause for concern?
@TechJotters24
3 ай бұрын
Hi, it's generally not a cause for concern. You might see slightly different numerical results due to floating-point round-off errors from different computation orders. This is typical in many high-performance computing scenarios and usually not significant. Temporarily within Jupyter Notebook: import os os.environ['TF_ENABLE_ONEDNN_OPTS'] = '0' import tensorflow as tf Permanently in Your Environment: Add the below to .bashrc and after adding it, run source ~/.bashrc export TF_ENABLE_ONEDNN_OPTS=0
@nilutpaldas8336
3 ай бұрын
**THIS VIDEO CAN HELP YOU TO INSTALL ANY VERSION OF CUDA, CUDNN, TENSORRT, AND TENSORFLOW IN YOUR WSL2** Thank you again for creating an updated video on this topic. feedback: kindly fix the chapter's timing it is not in sync.
Пікірлер: 109