In this video we walk you through how to install KoboldCPP on your Windows machine! KCP is a user interface for the Lama.cpp inference engine.
The process involves downloading the following:
the KCPP software
LLM Model
Imaging Model
Llava Model
Background Image
You will be required to register with huggingface.co and civitai.com
NOTE : In the video we did not add the Image model. See the image below.
Links:
https://huggingface.co/TheBloke/CapybaraHermes-2.5-Mistral-7B-GGUF/tree/main
https://huggingface.co/ChaoticNeutrals/LLaVA-Llama-3-8B-mmproj-Updated/tree/main/llava-v1.5-8B-Updated-Stop-Token
https://civitai.com/models/243556?modelVersionId=274807
https://www.cognibuild.ai/chatbots/sound
---
For a faster get start method (w/out account creation), check out our one-click install
here: https://www.patreon.com/posts/104400394