Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

huggingface.co
Visit site

Installation

from transformers import pipeline; pipeline(model="Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF")
Installs intotransformers, python
Not sure where to start — ask an assistant to walk you through:

Specs

Type Model
SectionModels & platforms
Pricing open source
Platform Web only
Hostingcloud
Installpackage
Installs intotransformers, python
Site languageen
VendorJanvitos
Views2 055
Launched2026-06-06

Tags

endpoints_compatible conversational gguf llama.cpp mtp speculative-decoding gemma Gemma 4 draft-model qat assistant

Found in sources

huggingface

Similar in «Models & platforms»

DeepSeek V3
Cost-efficient open-source MoE model rivaling GPT-4o in reasoning and math tasks
DeepSeek
Open reasoning and coding models on par with the top closed ones.
Mistral AI
European open and commercial models, Le Chat and Codestral.
sider.ai
Research faster with Sider AI—summarize web pages, take notes, generate reports, and chat with leading AI models. Powered by ChatGPT, Gemini, Claude, Grok, Deepseek, etc. Try the best AI sidebar now!
Hugging Face
The hub of models and datasets: millions of weights, Spaces, Transformers.
doubao.com
Передовая мультимодальная AI-платформа от ByteDance с современными языковыми, визуальными и речевыми моделями, а также интегрированными возможностями рассуждения и поиска.

Submit a site to the catalog

Just send the link — we will work out the rest.

We will review what you send and add it to the catalog if it fits.

Not sure how to implement it? We can help

Tell us about your task — we will pick the tools and suggest where to start.

0 / 5000
Verification code

Fields marked with an asterisk are required. Your data is used only to reply.