38 lines
2.4 KiB
Markdown
38 lines
2.4 KiB
Markdown
# vAnalytics - time series analytics for vLLM
|
|
|
|
<!-- Project Status -->
|
|
[](https://github.com/leafspark/vAnalytics/releases)
|
|
[](https://github.com/leafspark/vAnalytics/commits)
|
|
[]()
|
|
|
|
<!-- Project Info -->
|
|
[](https://github.com/ggerganov/llama.cpp)
|
|
|
|
[]()
|
|
[](https://github.com/leafspark/vAnalytics/blob/main/LICENSE)
|
|
|
|
<!-- Repository Stats -->
|
|
|
|
|
|
|
|
|
|
|
|
|
|
<!-- Contribution -->
|
|
[](https://github.com/psf/black)
|
|
[](https://github.com/leafspark/vAnalytics/issues)
|
|
[](https://github.com/leafspark/vAnalytics/pulls)
|
|
|
|
vAnalytics provides a web interface to help easily monitor vLLM instance metrics. It allows users to easily monitor multiple vLLM instances, as well as being easy to setup and configure.
|
|
|
|
## Features
|
|
- Specify vLLM backends easily using name and host configuration
|
|
- Uses SQLite for easy database management
|
|
- Intuitive and includes error handling
|
|
- Flexible schemas and data plotting using Plotly
|
|
|
|
## Usage
|
|
Configure your instances in monitor.py, then use `python src/monitor.py`. This will start monitoring in a `/data` folder, where it will store SQLite databases with your model name.
|
|
|
|
To start the web interface, execute `python src/graph.py`. The web interface is avaliable at `localhost:4412`.
|