tomasz-syn-grzegorza
359afb3a59
Infrastructure configs for GMKtec K11 (Docker, vLLM, LocalAI, ComfyUI, control-plane, gpu-fan agent, Server UI with CLI/file explorer/GPU fan curve). Co-authored-by: Cursor <cursoragent@cursor.com>
17 lines
455 B
Plaintext
17 lines
455 B
Plaintext
# BGE-M3 embedding model for LocalAI (llama-cpp backend).
|
|
# Copy to /data/apps/localai/models/bge-m3-FP16.gguf.yaml after gallery import.
|
|
#
|
|
# GGUF: bge-m3-FP16.gguf (~1.1 GB) in same directory as this YAML.
|
|
# API id: bge-m3-FP16.gguf
|
|
# Vector dimensions: 1024
|
|
|
|
name: bge-m3-FP16.gguf
|
|
backend: llama-cpp
|
|
embeddings: true
|
|
description: BGE-M3 embedding model (1024 dims)
|
|
known_usecases:
|
|
- embedding
|
|
parameters:
|
|
model: bge-m3-FP16.gguf
|
|
context_size: 8192
|