Updates the requirements on [uvicorn](https://github.com/encode/uvicorn) to permit the latest version. - [Release notes](https://github.com/encode/uvicorn/releases) - [Changelog](https://github.com/encode/uvicorn/blob/master/CHANGELOG.md) - [Commits](https://github.com/encode/uvicorn/compare/0.30.6...0.32.1) --- updated-dependencies: - dependency-name: uvicorn dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> |
||
|---|---|---|
| .github | ||
| .idea | ||
| src | ||
| templates | ||
| .env.example | ||
| .gitignore | ||
| .pre-commit-config.yaml | ||
| CHANGELOG.md | ||
| CODE_OF_CONDUCT.md | ||
| CONTRIBUTING.md | ||
| LICENSE | ||
| README.md | ||
| SECURITY.md | ||
| models.json.example | ||
| requirements.txt | ||
| run.bat | ||
| setup.py | ||
README.md
vAnalytics - time series analytics for vLLM
vAnalytics provides a web interface to help easily monitor vLLM instance metrics. It allows users to easily monitor multiple vLLM instances, as well as being easy to setup and configure.
Features
- Specify vLLM backends easily using name and host configuration
- Uses SQLite for easy database management
- Intuitive and includes error handling
- Flexible schemas and data plotting using Plotly
Usage
Configure your instances in monitor.py, then use python src/monitor.py. This will start monitoring in a /data folder, where it will store SQLite databases with your model name.
To start the web interface, execute python src/graph.py. The web interface is avaliable at localhost:4412.