Hugging Face's logo

inference-optimization
/
Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head

Safetensors
llama
compressed-tensors
Model card Files
xet
Community
Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
9.1 GB
  • 1 contributor
 History: 3 commits
krishnateja95's picture
krishnateja95
Upload folder using huggingface_hub
9650a5e verified