basically ollama/llama.cpp/gguf is the mysql/php of AI itβs extremely easy to get started but sacrifices correctness and quality all over
Replies
What's the Postgres of AI? It's not Oracle, but it's the next step up from the thing everybody gets into first?
sep 1, 2025, 1:57 pm β’ 2 0 β’ view
vLLM? sglang?
sep 1, 2025, 2:07 pm β’ 3 0 β’ view
Never heard of either one! Neat! π
sep 1, 2025, 2:08 pm β’ 1 0 β’ view
yeah, theyβre what youβd use in production. you only do it on a dev box if youβre either masochistic or a fan of Arch Linux
sep 1, 2025, 2:14 pm β’ 3 0 β’ view
But sir, you repeat yourself.
sep 1, 2025, 2:15 pm β’ 2 0 β’ view