leafspark
/
AutoGGUF
mirror of https://github.com/leafspark/AutoGGUF
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Updated Introduction (markdown)

leafspark 2024-08-31 14:59:41 -07:00
parent c579d8c0e1
commit f318891e1e
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
Introduction.md

@ -1,6 +1,6 @@
### Overview of AutoGGUF
AutoGGUF is an automated graphical interface designed for GGUF model quantization. Made with PyQt6 and llama.cpp, AutoGGUF simplifies the process of quantizing large language models (LLMs) for efficient local inference.
AutoGGUF is an automated graphical interface designed for GGUF model quantization. Made with PySide6 and llama.cpp, AutoGGUF simplifies the process of quantizing large language models (LLMs) for efficient local inference.
### Purpose and Features
@ -10,4 +10,5 @@ The primary purpose of AutoGGUF is to democratize access to LLMs by making quant
2. Easy model selection and quantization
3. Support for various quantization types
4. User-friendly graphical interface
5. Compatibility with popular AI models
6. Parallel quantization
7. LoRA conversion