RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8

huggingface.co
Visit site

Модель text-generation · лицензия apache-2.0

Installation

from transformers import pipeline; pipeline(model="RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8")
Installs intotransformers, python
Not sure where to start — ask an assistant to walk you through:

Specs

Type Model
SectionModels & platforms / text-generation
Pricing open source
Platform Self-hosted
Systems api, python, self-hosted
Hostingcloud
Installpackage
Installs intotransformers, python
Site languageen
VendorRedHatAI
Views789
Launched2024-10-09

Can do

text-generation

Platforms

api python self-hosted

Tags

safetensors conversational en text-generation text-generation-inference zh de es fr ja it pt ko ar qwen ru vllm compressed-tensors qwen2 th vi int8 qwen2.5 w8a8 qwen2_5_instruct

Found in sources

huggingface

Similar in «Models & platforms»

DeepSeek V3
Cost-efficient open-source MoE model rivaling GPT-4o in reasoning and math tasks
DeepSeek
Open reasoning and coding models on par with the top closed ones.
Mistral AI
European open and commercial models, Le Chat and Codestral.
sider.ai
Research faster with Sider AI—summarize web pages, take notes, generate reports, and chat with leading AI models. Powered by ChatGPT, Gemini, Claude, Grok, Deepseek, etc. Try the best AI sidebar now!
Hugging Face
The hub of models and datasets: millions of weights, Spaces, Transformers.
doubao.com
Передовая мультимодальная AI-платформа от ByteDance с современными языковыми, визуальными и речевыми моделями, а также интегрированными возможностями рассуждения и поиска.

Submit a site to the catalog

Just send the link — we will work out the rest.

We will review what you send and add it to the catalog if it fits.

Not sure how to implement it? We can help

Tell us about your task — we will pick the tools and suggest where to start.

0 / 5000
Verification code

Fields marked with an asterisk are required. Your data is used only to reply.