OpenAI Compatible Models

[jstrimpel]

I have configured an OpenAI compatible model in settings.json under ai-features.openAiCustom.customOpenAiModels per the documentation. How do I configure chat and other features to default to this model? I keep getting the error, "Please provide OPENAI_API_KEY in preferences or via environment variable", when I try to use the chat.

[sdirix]

Hi @jstrimpel, the AI settings can be configured in the "AI Configuration View". It's the entry point for model configurations and prompt management.

[JonasHelming]

(click the menu "view" => "Ai configuration view"), see also: https://theia-ide.org/docs/user_ai/#ai-configuration

[jstrimpel]

Thanks. I was able to assign my custom model, but it is throwing a 404 error. I am fairly certain the URL, key, and version are correct - I am using them elsewhere. How do I debug this?

[sdirix]

If you're able to debug you can check openai-language-model. Your settings will end up in there and be used in the official Open AI SDK.