Commit Graph

2 Commits

Author SHA1 Message Date
BuildTools a91f804ec1
fix: use proper status in TaskListItem
- use proper status in TaskListItem
- make sure to pass quant_threads and Logger to TaskListItem
- remove unnecessary logging in quantize_to_fp8_dynamic.py and optimize imports
2024-09-02 18:43:22 -07:00
BuildTools a7f2dec852
feat(ui): add AutoFP8 quantization window
- add AutoFP8 quantization window (currently broken)
- add more dynamic KV parameters
2024-09-02 18:17:29 -07:00