mirror of https://github.com/leafspark/AutoGGUF
|
||
---|---|---|
src | ||
LICENSE | ||
README.md | ||
requirements.txt | ||
run.bat |
README.md
AutoGGUF - Automated GGUF Model Quantizer
This application provides a graphical user interface for quantizing GGUF models using the llama.cpp library. It allows users to download different versions of llama.cpp, manage multiple backends, and perform quantization tasks with various options.
Main features:
- Download and manage llama.cpp backends
- Select and quantize GGUF models
- Configure quantization parameters
- Monitor system resources during quantization
Usage: Run the main.py script to start the application.
Dependencies:
- PyQt6
- requests
- psutil
Author: leafspark Version: 1.0.0 License: apache-2.0