Project

General

Profile

Actions
Copy link

User story #4451

closed

Rudder agents run times should be splayed a maximum to ensure maximum scalability

Added by Jonathan CLARKE almost 11 years ago. Updated over 10 years ago.

Status:
Released
Priority:
3
Assignee:
Jonathan CLARKE
Category:
Performance and scalability
Target version:
2.10.0~beta1
Pull Request:
UX impact:
Suggestion strength:
User visibility:
Effort required:
Name check:
Fix check:
Regression:

Description

Currently, the agent execution schedule is to run every 5 minutes. The "splaytime" is set to 1 minute, which means that each agent will choose a random interval between -60 and +60 seconds and run at the planned time + the random interval. This means agents will actually run at any time between 10:04 and 10:06 and not at exactly 10:05 (for example).

This mechanism allows to "smooth" the load over the network (traffic) and on the server (max connections and simultaneous logs).

We should increase this to 2 minutes, to benefit from this at the maximum. Anything more than 2 minutes is not possible, because then intervals would overlap.

Subtasks 2 (0 open — 2 closed)

User story #4452: Change splaytime to 5 minutes to ensure maximum scalabilityReleasedNicolas CHARLES2014-02-07Actions
User story #4453: Document splay time mechanismReleasedNicolas CHARLES2014-02-07Actions
Actions
Copy link

Also available in: Atom PDF