Setting up Ollama with mistral:7b-instruct-q4_K_M on Hetzner was smooth.

Apr 24, 2025 · 1:44 PM UTC

1
2
144
Sort replies: Relevant Recent Liked
Replying to @rishudc119
What is the GPU configuration for it?
1
34
I don’t require GPU because for extracting info from the parsed data CPU is enough also I am using quantised model which consumes very less memory. GPU I would be needing if I want to train the model which I won’t be doing now.
26