Workers AI LLM/Chat calls via binding #5805
demosjarco
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Checked
Feature request
In the constructor options for
CloudflareWorkersAI
andChatCloudflareWorkersAI
, to allow passing in worker binding instead of using REST apiMotivation
Bindings provide latency and TTFT, and are not beholden to cf global api rate limits. Also it has already been done with
CloudflareWorkersAIEmbeddings
.Proposal (If applicable)
Provide a
binding
option likeCloudflareWorkersAIEmbeddings
. Also support passing in gateway options for the new native gateway bindingsBeta Was this translation helpful? Give feedback.
All reactions