AI models self-hosted by PostHog

[Twixes]

Feature request

Is your feature request related to a problem?

Some users are blocked from enabling AI features due to security concerns around OpenAI APIs – e.g. ZEN-24513.

Describe the solution you'd like

Seems like the easiest way to eliminate the concerns would be self-hosting a model for most tasks, which could replace OpenAI. The data would stay within PostHog's control, removing a subprocessor. The experience would still be seamless for users.

Of course, proprietary models tend to be more powerful, and self-hosting is an effort.

Describe alternatives you've considered

A user also proposed the ability to provide a path to a custom model self-hosted by that company. I'm afraid that would be a minefield though, with lots of ways for things to go wrong, and no quality assurances from us.

Debug info

[pauldambra]

would love this for replay
we'll like want to process embeddings on top of sessions and skipping the network call for those would be 💯