BuildTools
747aa7b9a8
refactor: optimize GGUF imports
...
- optimize imports in GGUF conversion utilities
- rename gguf library modules
- update .gitignore and build workflow
2024-09-14 10:11:43 -07:00
BuildTools
3804da0a3f
feat(ui): add RAM and CPU usage graphs
...
- add RAM and CPU usage graphs
- add input validation using wraps
- reduce strictness of iMatrix status checking
- add right click context menu to models list
2024-09-10 15:58:17 -07:00
BuildTools
e5e18f9966
feat(core): add GGUF splitting feature
...
- add ability to split GGUFs
2024-09-09 20:46:53 -07:00
BuildTools
cee4294ecf
feat(parallel): add support for iMatrix generation tracking
...
- add support for iMatrix generation tracking
- don't adjust progress bar when indeterminate
2024-09-09 19:26:56 -07:00
BuildTools
fb092f8701
refactor: adjust logging and localizations
...
- adjust logging strings
- update French and Dutch localizations
- add minimal .env file loader in Localizations.py
2024-09-09 15:42:09 -07:00
BuildTools
be38e35d99
refactor: move functions into classes
...
- move functions into existing classes and files
- move AutoFP8 dialog out of a function and into __init__
2024-09-09 15:11:03 -07:00
BuildTools
e46c6260ee
fix: set progress to zero when indeterminate
2024-09-07 10:16:59 -07:00
BuildTools
454fb193f9
perf(startup): improve startup time by optimizing default configuration
...
- improve startup time by optimizing default configuration (disable network fetches for backends and updates)
- add startup time measuring
- use localizations for .env loader
2024-09-04 21:50:00 -07:00
BuildTools
8fb500a27d
refactor: remove requests and python-dotenv to reduce size
2024-09-04 21:18:49 -07:00
BuildTools
f8651ef19f
fix: reorganize imports and remove pytz
...
- reorganize imports and remove pytz from KVOverrideEntry.py
2024-09-04 17:53:32 -07:00
BuildTools
24ae0066ed
feat: support key shortcuts for AutoFP8 window
...
- update README.md for v1.8.1
- remove aliased quant types
- update .env.example with all configuration parameters
2024-09-04 17:31:39 -07:00
BuildTools
d55cb9ea9b
refactor: prepare repo for v1.8.1
...
- add localizations for AutoFP8
- remove unnecessary assets
- update CHANGELOG.md
- add DownloadThread.py docs
2024-09-04 17:19:54 -07:00
BuildTools
3adee266ca
feat(server): support API key authentication
...
- support authenticating via API key for the local server
- update Spanish localizations
2024-09-02 19:21:39 -07:00
BuildTools
a91f804ec1
fix: use proper status in TaskListItem
...
- use proper status in TaskListItem
- make sure to pass quant_threads and Logger to TaskListItem
- remove unnecessary logging in quantize_to_fp8_dynamic.py and optimize imports
2024-09-02 18:43:22 -07:00
BuildTools
a7f2dec852
feat(ui): add AutoFP8 quantization window
...
- add AutoFP8 quantization window (currently broken)
- add more dynamic KV parameters
2024-09-02 18:17:29 -07:00
BuildTools
79deff70ed
feat(window): add minimize/maximize button
...
- add minimize and maximize button to title bar
- improve smoothness of window moving
- prevent moving window below taskbar
2024-09-01 21:10:13 -07:00
BuildTools
81b2d4137b
feat(core): add AutoFP8 quantization classes
...
- add AutoFP8 quantization classes
- minor fixes based on IDE recommendations
2024-09-01 20:35:35 -07:00
BuildTools
22bd74b399
feat(server): replace Flask with FastAPI and Uvicorn
...
- replace Flask with FastAPI and Uvicorn
- fix web page not found error
- port is now defaulted to 7001
- bind to localhost (127.0.0.1) instead of 0.0.0.0
- improve performance by using Uvicorn
- add OpenAPI docs for endpoints
2024-08-31 15:34:47 -07:00
BuildTools
db1733b4ed
refactor: allow specifying output path in lora conversion subprocess
...
- remove the shutil.move operation
- allow specifying the output path in arguments in convert_lora_to_ggml.py utility
- bump max number of LoRA layers
2024-08-31 14:54:08 -07:00
BuildTools
a59b49fd97
chore: update llama.cpp convert scripts
2024-08-31 14:01:41 -07:00
BuildTools
fb9addb8c0
feat(models): add HF upload/download class
2024-08-31 13:54:24 -07:00
BuildTools
6583412b76
refactor: move functions out of AutoGGUF.py
...
- relocate functions into utils.py and TaskListItem.py
2024-08-29 15:01:13 -07:00
BuildTools
e307a4d3b5
chore: bump version to v1.8.0
2024-08-26 14:53:16 -07:00
BuildTools
fec22adc58
feat(config): add configuration options
...
- add more configuration options for AUTOGGUF_MODEL_DIR_NAME, AUTOGGUF_OUTPUT_DIR_NAME, and AUTOGGUF_RESIZE_FACTOR (these get created on startup)
- move some UI helper funtions out of AutoGGUF.py and into ui_update and Ta
- optimize imports for utility classes
- fix some missing imports
2024-08-25 15:11:36 -07:00
BuildTools
86d7bbba2d
style: reformat TaskListItem.py
2024-08-22 21:59:22 -07:00
BuildTools
ca9f9a4a76
fix: import missing modules
2024-08-22 21:59:01 -07:00
BuildTools
6e424462ab
refactor: add type hints
2024-08-22 21:56:37 -07:00
BuildTools
d4be39a22c
feat(core): implement plugins
...
- add plugins feature using importlib
- edit .gitignore
- change enabled state of AUTOGGUF_SERVER to "enabled" from "true" for consistency
2024-08-22 20:08:02 -07:00
BuildTools
53ab6a688e
fix: only count valid backends
...
- use valid_backends variable instead of backend_combo length, as the "No backends found" message is incorrectly counted as a single backend
2024-08-22 18:50:30 -07:00
BuildTools
e8026892e9
chore: fix Arabic and French localizations
2024-08-22 17:52:28 -07:00
BuildTools
a97a545a28
refactor: move get helper functions to utils.py
...
- move get_models_data and get_tasks_data to utils.py from AutoGGUF.py
2024-08-22 17:08:45 -07:00
BuildTools
4f2c8057e1
feat(core): add verification to manual import + concatenated file support
...
- verify GGUFs on manual import
- show warning when dealing with concatenated files such as mradermacher's split GGUFs (partXofX)
2024-08-22 15:57:21 -07:00
BuildTools
88875e3d67
feat(core): add manual model import
...
- allow importing models from any directory on the system
- add args as AutoGGUF class parameter
2024-08-22 15:39:08 -07:00
BuildTools
32f29b9f7c
fix: update regex for progress tracking
...
- update regex for progress tracking
- add .env.example file
- update .gitignore
2024-08-20 17:15:55 -07:00
BuildTools
c8babbd6e1
feat(core): add update checking support
...
- add update checking support with AUTOGGUF_CHECK_UPDATE (enabled) env variable
- fix setup.py
- add localization keys for update checking
- update version to v1.7.2 in Localizations.py
- formatting changes
2024-08-18 13:30:45 -07:00
BuildTools
a1650bba07
chore: add missing requirements
...
- add missing requirements
- add dotenv file loading
2024-08-17 13:27:18 -07:00
BuildTools
03c8a23e07
feat(ui): use Unicode for X button
...
- use Unicode for X button in KV Overrides box
- move CustomTitleBar to separate file
2024-08-17 13:24:37 -07:00
BuildTools
b62e8fc47c
feat(monitor): add smoother usage bar changes
2024-08-17 13:07:48 -07:00
BuildTools
adc8f4bd02
refactor: move functions out of AutoGGUF.py
...
- move functions out of AutoGGUF.py
- add live update support to GPU monitor graphs
2024-08-17 12:47:01 -07:00
BuildTools
f02fcb28de
ci: add inno setup build file
...
- add inno setup build file
- align localizations definitions
- update .gitignore
2024-08-16 21:04:32 -07:00
BuildTools
52c789e374
chore: update localizations to v1.7.1
2024-08-16 20:26:09 -07:00
BuildTools
77790613db
fix: add missing imports
2024-08-16 20:17:43 -07:00
BuildTools
a7e8bf673e
refactor: adapt gguf library to project
...
- remove comments
- remove argparse help text
2024-08-16 19:58:29 -07:00
BuildTools
f7f9a457ea
feat(models): add support for EXAONE model type
...
- updated llama.cpp convert_hf_to_gguf.py file to support EXAONE models by LG
2024-08-16 19:52:36 -07:00
BuildTools
c02df3005e
docs: update docstrings and small code fixes
...
- update docstrings for AutoGGUF.py and add for lora_conversion.py and Logger.py
- fix IDE detected code typos and errors
2024-08-16 19:43:48 -07:00
BuildTools
4cf03281ed
feat(ui): add window resizing shortcuts
...
- add Ctrl+ (increase by 10%), Ctrl- (reduce by 10%), Ctrl+0 (reset)
2024-08-16 19:17:33 -07:00
BuildTools
3a434865bc
feat(ui): add theming support and CPU usage bar
...
- add theming support
- add CPU usage bar
- add Save Preset and Load Preset menu bar options under File tab
2024-08-16 18:59:37 -07:00
BuildTools
66e7e3977f
refactor: make window scrollable
...
- make window scrollable
- move save/load preset logic to presets.py
- add Alt+F4 keybind to Close action
2024-08-16 18:45:22 -07:00
BuildTools
97378b0009
style: reformat file
2024-08-16 17:29:48 -07:00
BuildTools
9c2346baec
feat(config): allow setting window size through env
...
- allow setting window size through env
- update version to v1.7.0
2024-08-16 17:29:23 -07:00