Update README.md

This commit is contained in:
leafspark 2024-08-02 21:56:24 -07:00 committed by GitHub
parent c6ae2e319c
commit 042777c9b5
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 13 additions and 8 deletions

View File

@ -1,24 +1,29 @@
AutoGGUF - Automated GGUF Model Quantizer
# AutoGGUF - automated GGUF model quantizer
This application provides a graphical user interface for quantizing GGUF models
using the llama.cpp library. It allows users to download different versions of
llama.cpp, manage multiple backends, and perform quantization tasks with various
options.
Main features:
**Main features**:
1. Download and manage llama.cpp backends
2. Select and quantize GGUF models
3. Configure quantization parameters
4. Monitor system resources during quantization
Usage:
Run the main.py script to start the application.
**Usage**:
1. Install dependencies, either using the `requirements.txt` file or `pip install PyQt6 requests psutil`.
2. Run the `run.bat` script to start the application, or run the command `python src/main.py`.
Dependencies:
**Dependencies**:
- PyQt6
- requests
- psutil
Author: leafspark
Version: 1.0.0
License: apache-2.0
**To be implemented:**
- Actual progress bar tracking
- Download safetensors from HF and convert to unquanted GGUF
- Specify multiple KV overrides
**User interface:**
![image](https://github.com/user-attachments/assets/b1b58cba-4314-479d-a1d8-21ca0b5a8935)