leafspark
/
AutoGGUF
mirror of https://github.com/leafspark/AutoGGUF
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

docs: update to v1.4.3

This commit is contained in:
leafspark 2024-08-05 12:22:02 -07:00 committed by GitHub
parent aaacba491d
commit 51c3de4995
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
README.md
View File

@ -31,6 +31,8 @@ ## Features
- Select and quantize GGUF models - Select and quantize GGUF models
- Configure quantization parameters - Configure quantization parameters
- Monitor system resources during quantization - Monitor system resources during quantization
- Parallel quantization + imatrix generation
- LoRA conversion and merging
## Usage ## Usage
@ -41,7 +43,7 @@ ### Cross-platform
``` ```
or or
``` ```
pip install PyQt6 requests psutil shutil pip install PyQt6 requests psutil shutil numpy torch safetensors gguf
``` ```
2. Run the application: 2. Run the application:
``` ```
@ -91,17 +93,16 @@ ## Known Issues
- Saving preset while quantizing causes UI thread crash (planned fix: remove this feature) - Saving preset while quantizing causes UI thread crash (planned fix: remove this feature)
- Cannot delete task while processing (planned fix: disallow deletion before cancelling or cancel automatically) - Cannot delete task while processing (planned fix: disallow deletion before cancelling or cancel automatically)
- ~~Base Model text still shows when GGML is selected as LoRA type (fix: include text in show/hide Qt layout)~~ (fixed in v1.4.2)
## Planned Features ## Planned Features
- Actual progress bar tracking - Actual progress bar tracking
- Download safetensors from HF and convert to unquantized GGUF - Download safetensors from HF and convert to unquantized GGUF
- Perplexity testing - Perplexity testing
- Managing shards (coming in the next release) - ~~Managing shards (coming in the next release)~~ (added in v1.4.3)
- Time estimation for quantization - Time estimation for quantization
- Dynamic values for KV cache (coming in the next release) - ~~Dynamic values for KV cache (coming in the next release)~~ (added in v1.4.3)
- Ability to select and start multiple quants at once (saved in presets, coming in the next release) - ~~Ability to select and start multiple quants at once (saved in presets, coming in the next release)~~ (added in v1.4.3)
## Troubleshooting ## Troubleshooting