LLMKube

github.com
On the map Visit site

Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, PersonaPlex/Moshi, generic), multi-GPU sharding, NVIDIA CUDA and Apple Silicon Metal support, and GGUF/MLX/SafeTensors model formats.

Description

Specs

Type Repository
SectionGitHub projects
Pricing open source
GitHubdefilantech/LLMKube

Source code

defilantech/LLMKube

Found in sources

github-lists

Similar in «GitHub projects»

anthropics/claude-code
Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands.
comfyanonymous/ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. - Comfy-Org/ComfyUI
ossu/computer-science
🎓 Path to a free self-taught education in Computer Science!
openai/whisper
Robust Speech Recognition via Large-Scale Weak Supervision
Transformers
A deep learning library containing thousands of pre-trained models on different tasks. The goto place for anything related to Large Language Models.
hiyouga/LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) - hiyouga/LlamaFactory

Submit a site to the catalog

Just send the link — we will work out the rest.

We will review what you send and add it to the catalog if it fits.

Not sure how to implement it? We can help

Tell us about your task — we will pick the tools and suggest where to start.

0 / 5000
Verification code

Fields marked with an asterisk are required. Your data is used only to reply.