Quantizes LLMs to GGUF, GPTQ or AWQ, recommends settings, evaluates quality and pushes results to the Hugging Face Hub.
Setup
This project documents no single launch command; follow its repository instructions.
ShipItAndPray
Quantizes LLMs to GGUF, GPTQ or AWQ, recommends settings, evaluates quality and pushes results to the Hugging Face Hub.
This project documents no single launch command; follow its repository instructions.