nm-testing/Llama-3.2-1B-Instruct-FP8-KV

huggingface.co

Installation

from transformers import pipeline; pipeline(model="nm-testing/Llama-3.2-1B-Instruct-FP8-KV")

Installs into

transformers, python

Not sure where to start — ask an assistant to walk you through:

Specs

Type	Model
Section	Models & platforms
Pricing	open source
Platform	Self-hosted
Systems	api, python, self-hosted
Hosting	cloud
Install	package
Installs into	transformers, python
Site language	en
Vendor	nm-testing
Views	16 184
Launched	2024-11-01

Platforms

api python self-hosted

Tags

safetensors Llama compressed-tensors

Found in sources

Similar in «Models & platforms»

Cost-efficient open-source MoE model rivaling GPT-4o in reasoning and math tasks

Open reasoning and coding models on par with the top closed ones.

European open and commercial models, Le Chat and Codestral.

Research faster with Sider AI—summarize web pages, take notes, generate reports, and chat with leading AI models. Powered by ChatGPT, Gemini, Claude, Grok, Deepseek, etc. Try the best AI sidebar now!

The hub of models and datasets: millions of weights, Spaces, Transformers.

Передовая мультимодальная AI-платформа от ByteDance с современными языковыми, визуальными и речевыми моделями, а также интегрированными возможностями рассуждения и поиска.