Platform sluggish with many timeouts555
Pages:
1
|
MikeMills private msg quote post Address this user | |
| The GroveStreams platform has been sluggish and sometimes non-responsive for the last day. Other symptoms include many timeouts. We're working on this issue. |
||
| Post 1 • IP flag post | ||
|
|
MikeMills private msg quote post Address this user | |
| A few corrupt streams are/were causing the performance issues. We are scanning through all stream data identifying and fixing them, without data loss. Scanning and fixing takes a lot of resources. GS has close to two million data streams, most with a lot of data. We're going to leave Job processing disabled so that all resources can be used for fixing to get it done quickly over the weekend. Hoping to have things back to normal, probably better than normal, by tonight (Sunday, Mar 9th, 2025). |
||
| Post 2 • IP flag post | ||
|
|
MikeMills private msg quote post Address this user | |
| Most of this has been resolved. We still see a .5s to 2s increase to response times for a few minutes every hour. Usually around the hour's 41 minute mark. This is causing a lot of 5s timeouts within organization notifications during that time. We're working on that issue. |
||
| Post 3 • IP flag post | ||
|
|
MikeMills private msg quote post Address this user | |
| Platform experienced issues from 8:00 am to 8:50 am today, Mar 28 2025. Many requests were dropped during that time frame. One store server was having issues and we've restarted it. Still investigating the issue. We will be rebooting several servers today as we adjust configuration settings to improve services. Should be non-impacting. |
||
| Post 4 • IP flag post | ||
Pages:
1