Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slow shutdown due to initial replication #99

Open
nojima opened this issue Dec 16, 2024 · 0 comments
Open

Slow shutdown due to initial replication #99

nojima opened this issue Dec 16, 2024 · 0 comments

Comments

@nojima
Copy link
Collaborator

nojima commented Dec 16, 2024

The shutdown process of yrmcds waits for the gc_thread to finish after stopping the reactor. Sometimes, the gc_thread is performing initial replication, which can take a long time.

As soon as the master’s reactor stops, the slave detects the master’s failure and tries to become the new master. However, the master process is not completely terminated until the gc_thread finishes, so the VIP does not move to the slave. If the slave cannot become the master within 5 seconds, it discards its own data. This leads to data loss in the cluster.

I am not sure what the best solution is, but I believe some kind of countermeasure is necessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant