Initial import: bare-metal stacks, Server UI, GPU fan, tutorials.

Infrastructure configs for GMKtec K11 (Docker, vLLM, LocalAI, ComfyUI,
control-plane, gpu-fan agent, Server UI with CLI/file explorer/GPU fan curve).

Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
tomasz-syn-grzegorza
2026-07-05 12:02:04 +00:00
commit 359afb3a59
153 changed files with 18169 additions and 0 deletions
+18
View File
@@ -0,0 +1,18 @@
# Template for a new vLLM profile
# Copy: cp profiles/_template.env profiles/my-model.env
# GGUF files from lmstudio-community require stacks/llamacpp (future), not vLLM.
DATA_ROOT=/data
VLLM_MODEL=
SERVED_MODEL_NAME=my-model
QUANTIZATION=awq
VLLM_EXTRA_ARGS=--language-model-only --enforce-eager
MAX_MODEL_LEN=131072
MAX_NUM_SEQS=1
GPU_MEMORY_UTILIZATION=0.95
KV_CACHE_DTYPE=fp8
HF_TOKEN=
VLLM_PORT=8000