Skip to content
This repository was archived by the owner on Dec 17, 2025. It is now read-only.

Fixed URL by adding version V1 prefix to OpenAI LLMPerf client#25

Open
drelu wants to merge 1 commit into
ray-project:mainfrom
drelu:url-fix
Open

Fixed URL by adding version V1 prefix to OpenAI LLMPerf client#25
drelu wants to merge 1 commit into
ray-project:mainfrom
drelu:url-fix

Conversation

@drelu

@drelu drelu commented Dec 26, 2023

Copy link
Copy Markdown

* Added v1 to URL
* Example: https://x.x.x.x/v1/chat/completions
* Complies now with OpenAI and vLLM OpenAI server
* See https://platform.openai.com/docs/api-reference/authentication
@xieus xieus requested review from avnishn and rickyyx and removed request for avnishn February 24, 2024 21:54
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant