Project

General

Profile

Actions
Copy link

Bug #12730

closed

Moving policies to their final position (last step of policies writing) could be improved

Added by Nicolas CHARLES almost 6 years ago. Updated over 5 years ago.

Status:
Released
Priority:
N/A
Assignee:
François ARMAND
Category:
Performance and scalability
Target version:
4.1.13
Pull Request:
https://github.com/Normation/rudder/p...
Severity:
UX impact:
User visibility:
Effort required:
Priority:
0
Name check:
Fix check:
Regression:

Description

On a small test with 428 nodes, stats of policies generation are:

[2018-05-31 23:04:20] DEBUG policy.generation - Paths computed and templates read in 48 ms
[2018-05-31 23:04:21] DEBUG policy.generation - Promises prepared in 502 ms
[2018-05-31 23:04:28] DEBUG policy.generation - Promises written in 7424 ms
[2018-05-31 23:04:28] DEBUG policy.generation - Properties written in 10 ms
[2018-05-31 23:04:28] DEBUG policy.generation - Parameters written in 12 ms
[2018-05-31 23:04:28] DEBUG policy.generation - Licenses copied in 0 ms
[2018-05-31 23:04:30] DEBUG policy.generation - Policies moved to their final position in 1948 ms
[2018-05-31 23:04:30] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Node configuration written on filesystem in 10287 ms
[2018-05-31 23:04:31] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Node configuration cached in LDAP in 383 ms
[2018-05-31 23:04:31] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Node configuration written in 10921 ms, start to update expected reports.
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Reports updated in 2072 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Post-policy-generation hooks ran in 2 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Timing summary:
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Run pre-gen scripts hooks :          0 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Run pre-gen modules hooks :          0 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Fetch all information     :        319 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Historize names           :        400 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Build current rule values :          2 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Build target configuration:       2302 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Update rule vals          :        130 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Increment rule serials    :        946 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Write node configurations :      10921 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Save expected reports     :       2072 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Run post generation hooks :          2 ms
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Number of nodes updated   :        428   
[2018-05-31 23:04:33] DEBUG com.normation.rudder.services.policies.PromiseGenerationServiceImpl - Policy generation completed in 17725 ms

Moving policies takes 1 948 out of 10 921ms of write node configuration (20%)
this is surprisingly slow: this in only renaming of 428 folder

Actions
Copy link

Also available in: Atom PDF