a7f2dec852
feat(ui): add AutoFP8 quantization window
...
- add AutoFP8 quantization window (currently broken)
- add more dynamic KV parameters
2024-09-02 18:17:29 -07:00
79deff70ed
feat(window): add minimize/maximize button
...
- add minimize and maximize button to title bar
- improve smoothness of window moving
- prevent moving window below taskbar
2024-09-01 21:10:13 -07:00
81b2d4137b
feat(core): add AutoFP8 quantization classes
...
- add AutoFP8 quantization classes
- minor fixes based on IDE recommendations
2024-09-01 20:35:35 -07:00
22bd74b399
feat(server): replace Flask with FastAPI and Uvicorn
...
- replace Flask with FastAPI and Uvicorn
- fix web page not found error
- port is now defaulted to 7001
- bind to localhost (127.0.0.1) instead of 0.0.0.0
- improve performance by using Uvicorn
- add OpenAPI docs for endpoints
2024-08-31 15:34:47 -07:00
db1733b4ed
refactor: allow specifying output path in lora conversion subprocess
...
- remove the shutil.move operation
- allow specifying the output path in arguments in convert_lora_to_ggml.py utility
- bump max number of LoRA layers
2024-08-31 14:54:08 -07:00
a59b49fd97
chore: update llama.cpp convert scripts
2024-08-31 14:01:41 -07:00
fb9addb8c0
feat(models): add HF upload/download class
2024-08-31 13:54:24 -07:00
6583412b76
refactor: move functions out of AutoGGUF.py
...
- relocate functions into utils.py and TaskListItem.py
2024-08-29 15:01:13 -07:00
e307a4d3b5
chore: bump version to v1.8.0
2024-08-26 14:53:16 -07:00
fec22adc58
feat(config): add configuration options
...
- add more configuration options for AUTOGGUF_MODEL_DIR_NAME, AUTOGGUF_OUTPUT_DIR_NAME, and AUTOGGUF_RESIZE_FACTOR (these get created on startup)
- move some UI helper funtions out of AutoGGUF.py and into ui_update and Ta
- optimize imports for utility classes
- fix some missing imports
2024-08-25 15:11:36 -07:00
86d7bbba2d
style: reformat TaskListItem.py
2024-08-22 21:59:22 -07:00
ca9f9a4a76
fix: import missing modules
2024-08-22 21:59:01 -07:00
6e424462ab
refactor: add type hints
2024-08-22 21:56:37 -07:00
d4be39a22c
feat(core): implement plugins
...
- add plugins feature using importlib
- edit .gitignore
- change enabled state of AUTOGGUF_SERVER to "enabled" from "true" for consistency
2024-08-22 20:08:02 -07:00
53ab6a688e
fix: only count valid backends
...
- use valid_backends variable instead of backend_combo length, as the "No backends found" message is incorrectly counted as a single backend
2024-08-22 18:50:30 -07:00
e8026892e9
chore: fix Arabic and French localizations
2024-08-22 17:52:28 -07:00
a97a545a28
refactor: move get helper functions to utils.py
...
- move get_models_data and get_tasks_data to utils.py from AutoGGUF.py
2024-08-22 17:08:45 -07:00
4f2c8057e1
feat(core): add verification to manual import + concatenated file support
...
- verify GGUFs on manual import
- show warning when dealing with concatenated files such as mradermacher's split GGUFs (partXofX)
2024-08-22 15:57:21 -07:00
88875e3d67
feat(core): add manual model import
...
- allow importing models from any directory on the system
- add args as AutoGGUF class parameter
2024-08-22 15:39:08 -07:00
32f29b9f7c
fix: update regex for progress tracking
...
- update regex for progress tracking
- add .env.example file
- update .gitignore
2024-08-20 17:15:55 -07:00
c8babbd6e1
feat(core): add update checking support
...
- add update checking support with AUTOGGUF_CHECK_UPDATE (enabled) env variable
- fix setup.py
- add localization keys for update checking
- update version to v1.7.2 in Localizations.py
- formatting changes
2024-08-18 13:30:45 -07:00
a1650bba07
chore: add missing requirements
...
- add missing requirements
- add dotenv file loading
2024-08-17 13:27:18 -07:00
03c8a23e07
feat(ui): use Unicode for X button
...
- use Unicode for X button in KV Overrides box
- move CustomTitleBar to separate file
2024-08-17 13:24:37 -07:00
b62e8fc47c
feat(monitor): add smoother usage bar changes
2024-08-17 13:07:48 -07:00
adc8f4bd02
refactor: move functions out of AutoGGUF.py
...
- move functions out of AutoGGUF.py
- add live update support to GPU monitor graphs
2024-08-17 12:47:01 -07:00
f02fcb28de
ci: add inno setup build file
...
- add inno setup build file
- align localizations definitions
- update .gitignore
2024-08-16 21:04:32 -07:00
52c789e374
chore: update localizations to v1.7.1
2024-08-16 20:26:09 -07:00
77790613db
fix: add missing imports
2024-08-16 20:17:43 -07:00
a7e8bf673e
refactor: adapt gguf library to project
...
- remove comments
- remove argparse help text
2024-08-16 19:58:29 -07:00
f7f9a457ea
feat(models): add support for EXAONE model type
...
- updated llama.cpp convert_hf_to_gguf.py file to support EXAONE models by LG
2024-08-16 19:52:36 -07:00
c02df3005e
docs: update docstrings and small code fixes
...
- update docstrings for AutoGGUF.py and add for lora_conversion.py and Logger.py
- fix IDE detected code typos and errors
2024-08-16 19:43:48 -07:00
4cf03281ed
feat(ui): add window resizing shortcuts
...
- add Ctrl+ (increase by 10%), Ctrl- (reduce by 10%), Ctrl+0 (reset)
2024-08-16 19:17:33 -07:00
3a434865bc
feat(ui): add theming support and CPU usage bar
...
- add theming support
- add CPU usage bar
- add Save Preset and Load Preset menu bar options under File tab
2024-08-16 18:59:37 -07:00
66e7e3977f
refactor: make window scrollable
...
- make window scrollable
- move save/load preset logic to presets.py
- add Alt+F4 keybind to Close action
2024-08-16 18:45:22 -07:00
97378b0009
style: reformat file
2024-08-16 17:29:48 -07:00
9c2346baec
feat(config): allow setting window size through env
...
- allow setting window size through env
- update version to v1.7.0
2024-08-16 17:29:23 -07:00
432306d2ba
feat(ui): add seamless title bar
2024-08-16 17:16:15 -07:00
27a53a5b2b
fix: revert imports change
...
- revert absolute imports change
2024-08-16 16:28:24 -07:00
d2c83efebb
refactor: change filenames to follow PEP 8
2024-08-16 16:08:08 -07:00
9d939151de
refactor: move functions to helper modules
...
- move functions to helper modules
- set radon to lenient (E)
- disable pre-commit workflow
- adjust module importing
2024-08-16 15:50:39 -07:00
000ca6bb1f
ci: support 32-bit builds
...
- support 32-bit builds
- fix pre-commit formatting issues
2024-08-16 15:22:48 -07:00
c5e1313e9c
feat(ui): add menubar
...
- add basic menu bar showing Close and About areas
- add program version in localizations.py
- refactor functions out of AutoGGUF.py and move to ui_update.py
2024-08-16 15:15:29 -07:00
25b4a76ec9
refactor: fix pre commit issues and update radon workflow
...
- run pre commits
- exclude quantize_model from radon
2024-08-15 19:08:21 -07:00
034bbbb3b9
ci: add radon, dependabot, and pre-commit workflows
...
- add radon, dependabot, and pre-commit workflows
- optimize imports in AutoGGUF.py
2024-08-15 19:02:36 -07:00
f3257bfa69
feat: support env variables as server config
...
- add AUTOGGUF_SERVER=true/false and AUTOGGUF_SERVER_PORT=int configuration options
- update AutoGGUF docstrings
2024-08-15 17:25:33 -07:00
2e90c91eb8
feat(server): add read only flask server
...
- added the following endpoints:
/v1/backends (lists all backends and path)
/v1/health (heartbeat)
/v1/tasks (gets current task info, includes name, status, progress, and log file)
/v1/models (gets name, model type, path, and shard status)
2024-08-15 17:15:21 -07:00
79eeb02694
fix: set GGML types to lowercase in command builder
2024-08-13 20:07:50 -07:00
a8ed4a87b1
ci: add optimized build scripts using Nuitka
2024-08-12 20:59:01 -07:00
f089aa264d
fix: cancel first before deleting task
2024-08-11 18:45:40 -07:00
7e61f6b3d3
refactor: Switch from PyQt6 to PySide6 for license compatibility
...
- Replaced all PyQt6 imports with PySide6
- Updated signal syntax (pyqtSignal to Signal)
- Modified requirements.txt to use PySide6
- Ensured compatibility with Apache-2.0 license
2024-08-08 13:04:30 -07:00
BuildTools