How to use OpenAI-compatible endpoint?

[QishuoBai]

In DSPy, I can use an openai-compatible endpoint like this:
lm = dspy.LM("openai/your-model-name", api_key="PROVIDER_API_KEY", api_base="YOUR_PROVIDER_URL")

Can I use it within Ax?

[dosco]

Tons of docs and examples that answer this.

const ai = new AxAI({
  name: 'openai',
  apiKey: process.env.OPENAI_APIKEY as string,
});

[QishuoBai]

Sorry, I didn't express myself clearly earlier. The model I intend to use is not provided by OpenAI — I plan to use the Qwen model, which is OpenAI-compatible and can be accessed by specifying the API base.

Here is how I intend to use it in DSPy:

dspy.lm('openai/qwen-max-latest', apiKey='sk-xxx', apiBase:'https://xxxurl/xx')

[neoromantic]

Came to ask same question.

Seems I can't use vercel ai gateway, which is absolute deal-breaker :(

[neoromantic]

I did simple PR, maybe it'll help? #423