Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: <Feature name> will deekseek /openrouter llm interface be supported? #441

Open
Wang-Yong2018 opened this issue Feb 6, 2025 · 3 comments

Comments

@Wang-Yong2018
Copy link
Contributor

What problem does the new feature solve?

At this moment, pgai is only support limited LLM interface. Some popular LLM interfaces has not supported yet. Request for the features.

Deep seek showed strong performance in R1 version. Openrouter provide wide range of large language model support.

Will pgai consider support the two api be supported in recent future?

Best regards,
WangYong

What does the feature do?

As it mentioned, the new featuer will support more interfaces and gain popularity.

Implementation challenges

I think the main challenge is framework struction. Add more interfaces to let use choice or have a uniform interface which can support all present and recent new interfaces.

Reference for think about it.

  1. ellmer. a R language multiLLM interface. the frame work could be take as reference.
  2. openrouter. A multi llm interface api /chat business. It provided a uniform api for all LLM interfaces.

Are you going to work on this feature?

None

@alejandrodnm
Copy link
Contributor

alejandrodnm commented Feb 6, 2025

Hey @Wang-Yong2018 thanks for the issue.

We support LiteLLM, and LiteLLM it has support for deepseek and several other providers and models

https://github.com/timescale/pgai/blob/main/docs/litellm.md

https://docs.litellm.ai/docs/providers/deepseek

@Askir
Copy link
Contributor

Askir commented Feb 6, 2025

OpenRouter is also openai api compatible so by setting the base_url to https://openrouter.ai/api/v1 you can use our openai functions to interact with any model through it.

@Wang-Yong2018
Copy link
Contributor Author

thanks for answer the question. glad have approach could have the two interface be supported

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants