Actions
Bug #15092
openQueries to fetch changes are too big
Status:
New
Priority:
N/A
Assignee:
-
Category:
Performance and scalability
Target version:
Pull Request:
Severity:
Major - prevents use of part of Rudder | no simple workaround
UX impact:
User visibility:
Operational - other Techniques | Rudder settings | Plugins
Effort required:
Priority:
0
Name check:
Fix check:
Regression:
No
Description
We are fetching changes by chunk of 6 hours, which is quite slow on large database
On same database, loaded, tests show that:- fetching by 6 hours chunks take 324s
- fetching by 3 hours take 122s * 2
- fetching by one hours take 28s * 6
Actions