Project

General

Profile

Actions

Architecture #15864

open

Add an option to remove the backup of node policy at the end of policy generation

Added by Nicolas CHARLES about 5 years ago. Updated 14 days ago.

Status:
New
Priority:
N/A
Category:
Performance and scalability
Target version:
Effort required:
Name check:
Fix check:
To do
Regression:

Description

When we generate policies, we are deleting previous backup, moving previous policies to backup folder, and moving new policies to final position. This can be really long (if it's on a different mount point, it can take up to a 1/3 of the policy generation time, for instance with 10 000 nodes, it took 1200 seconds), but we need to move the previous policies out of the way to have unitary changes - ticket #16072 takes care of documenting that they should be on the same FS.
Ultimately, these backup are rarely used, so we could simply drop them async at the end of generation, so that we don't have to delete them during next policy generation, and save some disk space, time and IO - this could be done via a post generation hook

  1. remove the backup of previous policies at the end generation
    curl -k -H "X-API-Token: xxx" -X POST 'https://.../rudder/api/latest/settings/rudder_remove_previous_policies' -d "value=true"

Related issues 1 (0 open1 closed)

Related to Rudder - Bug #16072: Improve documentation in rudder-web.properties about backup folderReleasedFrançois ARMANDActions
Actions

Also available in: Atom PDF