chore(docs): Improved docs and added Example output
This commit is contained in:
3
.gitignore
vendored
3
.gitignore
vendored
@@ -1,3 +1,2 @@
|
|||||||
.venv/
|
.venv/
|
||||||
.csv
|
*.csv
|
||||||
.png
|
|
||||||
10
README.md
10
README.md
@@ -9,7 +9,7 @@ To generate the required CSV file, use [llama-benchy](https://github.com/eugr/ll
|
|||||||
Example command to generate the CSV:
|
Example command to generate the CSV:
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
uvx llama-benchy --base-url http://127.0.0.1:8000/v1 --model Qwen/Qwen3.6-27B --served-model-name unsloth/Qwen3.6-27B-GGUF --concurrency 1 2 4 8 16 32 --pp 128 --tg 128 --format csv
|
uvx llama-benchy --base-url http://127.0.0.1:8000/v1 --model Qwen/Qwen3-0.6B --served-model-name Qwen/Qwen3-0.6B --concurrency 1 2 4 8 16 32 --pp 128 --tg 128 --format csv
|
||||||
```
|
```
|
||||||
|
|
||||||
This will produce a CSV file with benchmark results that can be used as input for Benchy-Graph.
|
This will produce a CSV file with benchmark results that can be used as input for Benchy-Graph.
|
||||||
@@ -25,4 +25,10 @@ Replace `<input.csv>` with the path to your llama-benchy CSV file and `<output.p
|
|||||||
|
|
||||||
## Running the Notebook
|
## Running the Notebook
|
||||||
|
|
||||||
For an interactive experience, open `notebook.ipynb` in Jupyter Notebook or JupyterLab and execute the cells. The notebook contains all the necessary code and explanations for generating visualizations.
|
For an interactive experience, open `notebook.ipynb` in Jupyter Notebook or JupyterLab and execute the cells. The notebook contains all the necessary code and explanations for generating visualizations.
|
||||||
|
|
||||||
|
## Example output
|
||||||
|
|
||||||
|
> This example has been made with [mixa3607/ML-gfx906](https://github.com/mixa3607/ML-gfx906/tree/master/vllm) custom vLLM docker image
|
||||||
|
|
||||||
|

|
||||||
BIN
docs/img/demo.png
Normal file
BIN
docs/img/demo.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 748 KiB |
Reference in New Issue
Block a user