Update README.md
Browse files
README.md
CHANGED
|
@@ -102,6 +102,17 @@ print(outputs[0]["generated_text"][-1])
|
|
| 102 |
|
| 103 |
`EZ-PoC-Llama3.1-8B` is fine-tuned using historical EZ PoC data, which has been carefully selected and preprocessed to ensure that the generated YAML PoCs meet the standards of the EZ scanner.
|
| 104 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 105 |
## Performance Metrics
|
| 106 |
|
| 107 |
N/A
|
|
|
|
| 102 |
|
| 103 |
`EZ-PoC-Llama3.1-8B` is fine-tuned using historical EZ PoC data, which has been carefully selected and preprocessed to ensure that the generated YAML PoCs meet the standards of the EZ scanner.
|
| 104 |
|
| 105 |
+
## Providing Quantized Versions
|
| 106 |
+
|
| 107 |
+
Address: [EZTEAM/EZ-PoC-Llama-3.1-8B-GGUF](https://huggingface.co/EZTEAM/EZ-PoC-Llama-3.1-8B-GGUF/tree/main)
|
| 108 |
+
|
| 109 |
+
| Parameters | Quantization | Size |
|
| 110 |
+
| ---------- | ------------ | ------ |
|
| 111 |
+
| 8B | f16 | 16.1GB |
|
| 112 |
+
| 8B | Q8_0 | 8.54GB |
|
| 113 |
+
| 8B | Q5_K_M | 5.73GB |
|
| 114 |
+
| 8B | Q4_K_M | 4.92GB |
|
| 115 |
+
|
| 116 |
## Performance Metrics
|
| 117 |
|
| 118 |
N/A
|