sglang
πPluginair-gapped/skills
Installation
/plugin marketplace add air-gapped/skills/plugin install sglang@air-gapped-marketplaceSGLang operator reference suite β HiCache (three-tier hierarchical prefix cache: GPU HBM β host DRAM β distributed L3 via Mooncake/3FS/NIXL/AIBrix/EIC/SiMM/file/LMCache) and the SGLang Model Gateway (`sgl-model-gateway`, formerly `sgl-router`) β Rust router fronting vLLM/SGLang inference workers on Kubernetes with cache-aware/prefix-hash/consistent-hash routing, K8s label-selector service discovery, PD-disaggregation, and `--enable-mesh` CRDT sync between gateway replicas. Pairs with the `vllm` suite for vLLM-side reference and `inference-cache` for engine-agnostic KV-cache transport.
Part of
air-gapped/skills
More from this repository10
Skill
Skill
Skill
Skill
Skill
Skill
Skill
Harvester HCI operator suite β controlled, community-edition Harvester upgrades off an EOL line up to latest stable: the no-skip minor ladder (1.5β1.6β1.7β1.8 carrying embedded RKE2 / KubeVirt / Longhorn / SLE-Micro together), external-Rancher + Harvester UI-extension pairing and ordering, air-gapped version detection, controlling the node-by-node upgrade flow (serial interlock, the v1.7+ pause-map, and the PodDisruptionBudget + VMI-readinessProbe native gate for 1.5/1.6), keeping VM-hosted self-managed RKE2 control planes quorate via anti-affinity spread and live-migration-vs-clean-shutdown tradeoffs (busy-etcd non-convergence, auto-converge, dedicated migration network), per-hop breaking changes (wickedβNetworkManager, Intel NIC rename, DHCP churn), the enforced pre-flight health gates, and the no-downgrade backup/rollback reality. Companion to the k8s suite's k8s-components-checker (HarvesterβRancherβRKE2 pairing registry) and rancher-upgrade (the external Rancher's own chain).
Observability suite β Prometheus, Grafana Mimir, and Grafana reference for agents querying metrics, writing PromQL, building and fixing dashboards, and reasoning about SLOs, KPIs, and burn-rate alerting.
Skill