TorchChat LLM Loader - FREE INSTALL SCRIPT
Added 2024-08-02 17:01:41 +0000 UTCBad doesn’t even begin to cover the mess of this new PyTorch software. Unreasonable, unnecessary, unseemly—those words come closer. All making you ask the question, why did they even bother? But here we go, diving into PyTorch’s bold new world of CLI Llama loaders and breaking down what you can expect.
This is an EXTREMELY challenging and lengthy install that 99% of people will struggle with. Therefore, instead of walking you through the install steps in this video, I’m offering the install script for free on my Patreon site if you still want to give it a shot. (Just sign up as a free member.)
To use the free script, you’ll need to run it in WSL but make sure to install CUDA and CuDNN first.
You can find tutorials and instructions here:
I also offer a full CUDA and CuDNN install script for paying members here:
https://www.patreon.com/posts/cuda-cudnn-11-8-109149793
------ Helpful Video Tutorials -----
Installing Cuda (Windows): https://youtu.be/_GpyoEbs3Hs
Installing CuDNN (Windows) : https://youtu.be/RY2mEbi7PJc
Installing Cuda (WSL): https://youtu.be/IDplTnTQ_XY
Fresh AI Setup (Windows): https://youtu.be/4aCtOVcvcj4
Installing Miniconda: https://youtu.be/ULAVtKBOKXE
Installing Python: https://youtu.be/1CdeBbk9A2k
Installing Git: https://youtu.be/xxVOm3ndeSU
Installing WSL: https://youtu.be/3GNqg3GdEKA
Installing Llama.cpp: https://youtu.be/r-05yuXTEPE
