Benchmark speed between OpenAI and OpenLLM

[louis030195]

Curious, are there benchmarks comparing speed between OpenAI and OpenLLM in terms of token/s?

[aarnphm]

I'm not sure if I understand the questions, but this is more like comparing apples to oranges. Are you comparing gpt4 against llama running with vllm?

If you want to compare pure tps then I don't have a number on my hands atm.