Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

最近出现的 remote or network error: conn closed #1689

Open
rogerjxl opened this issue Feb 8, 2025 · 1 comment
Open

最近出现的 remote or network error: conn closed #1689

rogerjxl opened this issue Feb 8, 2025 · 1 comment
Assignees

Comments

@rogerjxl
Copy link

rogerjxl commented Feb 8, 2025

  1. 服务最近突然发现出现 error=remote or network error: recv wait timeout 2m0.005s, seqID=2907 后大量出现 remote or network error: conn closed的情况,后续就恢复了
  2. 业务代码+负载都没有看出来问题,为了预防这类情况。 日常设置为1的 client.WithMuxConnection(), 如果我们设置为2的情况,多开一个连接,有没有可能缓解这类情况,这方面介绍不多,主要看下有没有什么说明。

大体情况:

  1. github.com/cloudwego/kitex v0.11.3
  2. client和server都开了多路复用。
@jayantxie
Copy link
Member

初步看是网络抖动导致连接读包超时和连接关闭,从而导致上述现象。可以观察下网络丢包率确认下这个问题。

因为不太可能是软件实现层面的bug,多开几个连接不一定能缓解这个问题。如果本身流量较大,可以通过设置多个连接来降低单个连接的负载。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants