Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support multiple present background worker implementations #90

Open
plasticine opened this issue May 17, 2021 · 0 comments
Open

Support multiple present background worker implementations #90

plasticine opened this issue May 17, 2021 · 0 comments

Comments

@plasticine
Copy link
Contributor

plasticine commented May 17, 2021

For various reasons we support several background job implementations in production — namely Que and Faktory.

We’re very interested in job-iteration, however an immediate issue we face (other than support being added #88 & #89, which I’m happy to do) was the fact that the gem attempts to discover and configure the interruption adapter up-front for a given worker — here. Unfortunately for us given our multiple queue implementations in play that share a codebase/monorepo, it means that we’d hit this branch, and be stuck.

I think supporting multiple background job implementations, while perhaps a little unusual, is a very useful use-case to support. Supporting multiple implementations allows for a lot more flexibility around migrating from system to system, or in cases where multiple background systems are desirable in order to place jobs on background systems with differing characteristics.

I would propose that instead of configuring the interruption adapter once during init for a given worker we just discover it around the execution of each iteration, I think this would be fairly achievable and am happy to take a look if this is a patch that would be of interest. 😃

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant