mirror of https://github.com/leafspark/AutoGGUF
24 lines
646 B
Markdown
24 lines
646 B
Markdown
AutoGGUF - Automated GGUF Model Quantizer
|
|
|
|
This application provides a graphical user interface for quantizing GGUF models
|
|
using the llama.cpp library. It allows users to download different versions of
|
|
llama.cpp, manage multiple backends, and perform quantization tasks with various
|
|
options.
|
|
|
|
Main features:
|
|
1. Download and manage llama.cpp backends
|
|
2. Select and quantize GGUF models
|
|
3. Configure quantization parameters
|
|
4. Monitor system resources during quantization
|
|
|
|
Usage:
|
|
Run the main.py script to start the application.
|
|
|
|
Dependencies:
|
|
- PyQt6
|
|
- requests
|
|
- psutil
|
|
|
|
Author: leafspark
|
|
Version: 1.0.0
|
|
License: apache-2.0 |