GF

GPTQ-for-LLaMa

Model Optimization·infrastructure·open·#808 of 884·+108·Rising·Breakout #3

57.5

Low

High confidence
GitHub

4 bits quantization of LLaMA using GPTQ

Pillar Breakdown

Adoption

35%

46.7

Maintenance

30%

61.5

Friction

20%

95.4

Ecosystem

15%

38.5

Momentum

0.50Rising
7d change -0.25
High confidence

In Model Optimization

Ranked #16 of 17

1onnx
87.8
2Safetensors
83.6
3ONNX Runtime
82.7
4bitsandbytes
82.7
5DeepSpeed
78.4
6TensorRT
75.9
7Optimum
75.6
8numba
74.8
See all 17 in Model Optimization →

Similar Tools

AU

AutoAWQ

Model Optimization

57.5

OQ

optimum-quanto

Model Optimization

58.1

BI

BitBLAS

Model Optimization

56.0

LL

lit-llama

Model Optimization

59.3