mirror of https://github.com/leafspark/AutoGGUF
Update README.md
This commit is contained in:
parent
c6ae2e319c
commit
042777c9b5
21
README.md
21
README.md
|
@ -1,24 +1,29 @@
|
|||
AutoGGUF - Automated GGUF Model Quantizer
|
||||
# AutoGGUF - automated GGUF model quantizer
|
||||
|
||||
This application provides a graphical user interface for quantizing GGUF models
|
||||
using the llama.cpp library. It allows users to download different versions of
|
||||
llama.cpp, manage multiple backends, and perform quantization tasks with various
|
||||
options.
|
||||
|
||||
Main features:
|
||||
**Main features**:
|
||||
1. Download and manage llama.cpp backends
|
||||
2. Select and quantize GGUF models
|
||||
3. Configure quantization parameters
|
||||
4. Monitor system resources during quantization
|
||||
|
||||
Usage:
|
||||
Run the main.py script to start the application.
|
||||
**Usage**:
|
||||
1. Install dependencies, either using the `requirements.txt` file or `pip install PyQt6 requests psutil`.
|
||||
2. Run the `run.bat` script to start the application, or run the command `python src/main.py`.
|
||||
|
||||
Dependencies:
|
||||
**Dependencies**:
|
||||
- PyQt6
|
||||
- requests
|
||||
- psutil
|
||||
|
||||
Author: leafspark
|
||||
Version: 1.0.0
|
||||
License: apache-2.0
|
||||
**To be implemented:**
|
||||
- Actual progress bar tracking
|
||||
- Download safetensors from HF and convert to unquanted GGUF
|
||||
- Specify multiple KV overrides
|
||||
|
||||
**User interface:**
|
||||

|
||||
|
|
Loading…
Reference in New Issue