Update README.md
Browse files
README.md
CHANGED
|
@@ -335,7 +335,7 @@ VLLM_DISABLE_COMPILE_CACHE=1 vllm serve pytorch/Phi-4-mini-instruct-float8dq --t
|
|
| 335 |
|
| 336 |
Client:
|
| 337 |
```Shell
|
| 338 |
-
python benchmarks/benchmark_serving.py --backend vllm --dataset-name sharegpt --tokenizer microsoft/Phi-4-mini-instruct --dataset-path ./ShareGPT_V3_unfiltered_cleaned_split.json --model
|
| 339 |
```
|
| 340 |
|
| 341 |
|
|
|
|
| 335 |
|
| 336 |
Client:
|
| 337 |
```Shell
|
| 338 |
+
python benchmarks/benchmark_serving.py --backend vllm --dataset-name sharegpt --tokenizer microsoft/Phi-4-mini-instruct --dataset-path ./ShareGPT_V3_unfiltered_cleaned_split.json --model pytorch/Phi-4-mini-instruct-float8dq --num-prompts 1
|
| 339 |
```
|
| 340 |
|
| 341 |
|