leafspark
/
AutoGGUF
mirror of https://github.com/leafspark/AutoGGUF
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update README.md

This commit is contained in:
leafspark 2024-08-02 21:13:59 -07:00 committed by GitHub
parent b3721e75f0
commit 9707ec1b9c
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 10 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

18
README.md
View File

@ -1,24 +1,26 @@
AutoGGUF - Automated GGUF Model Quantizer # AutoGGUF - automated GGUF model quantizer
This application provides a graphical user interface for quantizing GGUF models This application provides a graphical user interface for quantizing GGUF models
using the llama.cpp library. It allows users to download different versions of using the llama.cpp library. It allows users to download different versions of
llama.cpp, manage multiple backends, and perform quantization tasks with various llama.cpp, manage multiple backends, and perform quantization tasks with various
options. options.
Main features: **Main features**:
1. Download and manage llama.cpp backends 1. Download and manage llama.cpp backends
2. Select and quantize GGUF models 2. Select and quantize GGUF models
3. Configure quantization parameters 3. Configure quantization parameters
4. Monitor system resources during quantization 4. Monitor system resources during quantization
Usage: **Usage**:
Run the main.py script to start the application. 1. Install dependencies, either using the `requirements.txt` file or `pip install PyQt6 requests psutil`.
2. Run the `run.bat` script to start the application, or run the command `python src/main.py`.
Dependencies: **Dependencies**:
- PyQt6 - PyQt6
- requests - requests
- psutil - psutil
Author: leafspark **To be implemented:**
Version: 1.0.0 - Actual progress bar tracking
License: apache-2.0 - Download safetensors from HF and convert to unquanted GGUF
- Specify multiple KV overrides