BuildTools
034bbbb3b9
ci: add radon, dependabot, and pre-commit workflows
...
- add radon, dependabot, and pre-commit workflows
- optimize imports in AutoGGUF.py
2024-08-15 19:02:36 -07:00
BuildTools
f3257bfa69
feat: support env variables as server config
...
- add AUTOGGUF_SERVER=true/false and AUTOGGUF_SERVER_PORT=int configuration options
- update AutoGGUF docstrings
2024-08-15 17:25:33 -07:00
BuildTools
2e90c91eb8
feat(server): add read only flask server
...
- added the following endpoints:
/v1/backends (lists all backends and path)
/v1/health (heartbeat)
/v1/tasks (gets current task info, includes name, status, progress, and log file)
/v1/models (gets name, model type, path, and shard status)
2024-08-15 17:15:21 -07:00
BuildTools
79eeb02694
fix: set GGML types to lowercase in command builder
2024-08-13 20:07:50 -07:00
BuildTools
a8ed4a87b1
ci: add optimized build scripts using Nuitka
2024-08-12 20:59:01 -07:00
BuildTools
f089aa264d
fix: cancel first before deleting task
2024-08-11 18:45:40 -07:00
BuildTools
7e61f6b3d3
refactor: Switch from PyQt6 to PySide6 for license compatibility
...
- Replaced all PyQt6 imports with PySide6
- Updated signal syntax (pyqtSignal to Signal)
- Modified requirements.txt to use PySide6
- Ensured compatibility with Apache-2.0 license
2024-08-08 13:04:30 -07:00
BuildTools
b2d4fd06a4
feat: add GPU monitoring for NVIDIA GPUs
...
- add GPU monitoring for NVIDIA GPUs
2024-08-08 12:51:41 -07:00
BuildTools
f5b3b43d01
fix: load preset error and LoRA loading
...
- support loading *.gguf file types
- update FAILED_TO_LOAD_PRESET localization key
- remove Save Preset context menu action
2024-08-08 10:32:12 -07:00
BuildTools
cb51a22d2f
refactor: Implement QScrollArea for universal scrolling
2024-08-06 16:08:32 -07:00
BuildTools
6070aac200
refactor: use localization keys for HF conversion
...
- reduce base class length
- reorganize English, French, and Simplified Chinese
2024-08-05 19:21:30 -07:00
BuildTools
c0635936cc
refactor: allow more tensor types
2024-08-05 17:51:54 -07:00
BuildTools
eca2ecc785
refactor: move some strings to localizations
2024-08-05 17:41:12 -07:00
BuildTools
ab7ffb0ad3
refactor: optimize imports
2024-08-05 17:29:01 -07:00
BuildTools
1feab011e4
refactor: move error handling to separate module
2024-08-05 16:52:33 -07:00
BuildTools
4ced884a0d
feat(conversion): add HF to GGUF conversion + refactor localization
...
- refactor localization and split into sections
- add HF safetensors conversion support
- add run.sh script for Linux
2024-08-05 13:29:30 -07:00
BuildTools
dc9a1c8971
feat: support multiple quantization types
...
This commit adds the ability to select and run multiple quantization types simultaneously. It includes:
- Replacing the quantization type dropdown with a multi-select list
- Updating preset saving and loading to handle multiple quantization types
- Modifying the quantize_model function to process all selected types
- fix formatting issue with previous commit
- use error and in progress messages from localizations in QuantizationThread
2024-08-05 12:11:08 -07:00
BuildTools
e69237b7b9
docs: enhance class and method documentation
...
- fix formatting issues from last commit
- add docstrings for important classes
2024-08-05 11:37:20 -07:00
BuildTools
c9167a7ac4
feat(model): implement model sharding management
...
- Add sharding functionality to improve performance
- Update documentation to make reading code easier
- Modify .gitignore for stricter file management
2024-08-05 11:26:29 -07:00
BuildTools
444475fb3f
style: reformat localizations file
2024-08-04 21:11:52 -07:00
BuildTools
868b15b61f
ci: add pre commit config and report template
2024-08-04 20:59:02 -07:00
BuildTools
fa51f7cdb8
style: format code with Black
2024-08-04 19:50:34 -07:00
BuildTools
2dc5bd9e8a
fix: Hide Base Model label when GGML type selected
2024-08-04 19:32:07 -07:00
BuildTools
70f9db166d
print out quant command and log, dynamic kv
2024-08-04 18:01:17 -07:00
BuildTools
315fb7f03c
edit favicon
2024-08-04 16:04:04 -07:00
BuildTools
10911b71a0
add assets fix, code format, progress bar fix
2024-08-04 15:07:24 -07:00
BuildTools
3e8d7b1415
adjust window size and code formatting
2024-08-04 14:44:39 -07:00
BuildTools
8aedb5fc3f
add localizations support for LoRA and model features
2024-08-04 14:24:29 -07:00
BuildTools
5843b51c0c
add lora convert feature
2024-08-04 14:13:20 -07:00
BuildTools
a2fce58423
modify backend check logic
2024-08-04 09:12:07 -07:00
BuildTools
294fe6ea5b
fix kv load bug+input validaton, add imatrix options
...
imatrix and ui changes, bugfix code
2024-08-03 21:59:59 -07:00
BuildTools
37a060aee5
add refresh models function and fix iostream
2024-08-03 18:09:04 -07:00
leafspark
be3e44a6fa
add robust logging and localization
2024-08-03 17:27:38 -07:00
leafspark
a0bd57cd70
add kv override and cuda backend bugfix
2024-08-03 14:29:04 -07:00
leafspark
c6ae2e319c
Add files via upload
2024-08-02 21:55:57 -07:00
leafspark
108e30f1f9
delete temp file
2024-08-02 21:28:40 -07:00
leafspark
b8fccb2559
hotfix for AutoGGUF
2024-08-02 21:27:05 -07:00
leafspark
b3721e75f0
add code
2024-08-02 21:10:32 -07:00