Project

General

Profile

Actions

Architecture #18092

open

Improve compliance performance and reliability

Added by Nicolas CHARLES over 4 years ago. Updated 6 months ago.

Status:
New
Priority:
N/A
Assignee:
-
Category:
Web - Compliance & node report
Target version:
Effort required:
Name check:
To do
Fix check:
To do
Regression:

Description

Compliance computation has evolved over time, improving through minimal changes and small big bangs.
It does work great for most uses cases, but it has some shortcomings:
  • we don't historize missing runs. If a node doesn't answer for 2 hours, we don't track that in database
  • when we catch up reports that haven't been sent in time, chaos in compliance follows
  • I finally succedded into having bottleneck in compliance computation on the load platform system (sending hundreds of inventories every 5 seconds), showing the sensitivity of postgresql to I/O for our usage.
  • there are a lot of back and forth between rudder and the database to list runs and save them, get the runs we just wrote and their nodeconfigid, getting the nodeconfigurations, and getting the reports for theses runs. Now that we have rudder-relayd that save runs in database, first part should be outsourced to rudder-relayd who knows exactly the runs it saves

This ticket is a meta ticket, and reporting improvement will happen in sub ticket, hopefully fixing all these issues


Subtasks 6 (0 open6 closed)

Architecture #18093: Simplify queries to detects runs in database, as all runs are completeReleasedElaad FURREEDANActions
Architecture #18910: Simpifying agent run request breaks testReleasedNicolas CHARLESActions
Architecture #18255: Don't compute runs information, but use data from rudder-relaydReleasedFrançois ARMANDActions
Bug #19117: Remove call to executions.complete attribute which was removedReleasedFrançois ARMANDActions
Architecture #19151: add caching for NodeExpectedReportsReleasedFrançois ARMANDActions
Architecture #19633: deletenode is used by scaleoutrelayReleasedAlexis MoussetActions
Actions #1

Updated by Nicolas CHARLES about 4 years ago

  • Target version changed from 6.2.0~beta1 to 7.0.0~beta1
Actions #2

Updated by Vincent MEMBRÉ over 3 years ago

  • Target version changed from 7.0.0~beta1 to 7.0.0~beta2
Actions #3

Updated by Vincent MEMBRÉ about 3 years ago

  • Target version changed from 7.0.0~beta2 to 7.0.0~beta3
Actions #4

Updated by Alexis Mousset about 3 years ago

  • Target version changed from 7.0.0~beta3 to 7.1.0~beta1
Actions #5

Updated by Vincent MEMBRÉ almost 3 years ago

  • Target version changed from 7.1.0~beta1 to 7.1.0~beta2
Actions #6

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 7.1.0~beta2 to 7.1.0~rc1
Actions #7

Updated by Alexis Mousset over 2 years ago

  • Target version changed from 7.1.0~rc1 to 7.2.0~beta1
Actions #8

Updated by Alexis Mousset over 2 years ago

  • Target version changed from 7.2.0~beta1 to 7.3.0~beta1
Actions #9

Updated by Vincent MEMBRÉ almost 2 years ago

  • Target version changed from 7.3.0~beta1 to 7.3.0~rc1
Actions #10

Updated by Vincent MEMBRÉ almost 2 years ago

  • Target version changed from 7.3.0~rc1 to 7.3.0
Actions #11

Updated by Vincent MEMBRÉ over 1 year ago

  • Target version changed from 7.3.0 to 7.3.1
Actions #12

Updated by Vincent MEMBRÉ over 1 year ago

  • Target version changed from 7.3.1 to 7.3.2
Actions #13

Updated by Vincent MEMBRÉ over 1 year ago

  • Target version changed from 7.3.2 to 7.3.3
Actions #14

Updated by Vincent MEMBRÉ over 1 year ago

  • Target version changed from 7.3.3 to 7.3.4
Actions #15

Updated by Vincent MEMBRÉ over 1 year ago

  • Target version changed from 7.3.4 to 7.3.5
Actions #16

Updated by Alexis Mousset over 1 year ago

  • Target version changed from 7.3.5 to 7.3.6
Actions #17

Updated by Vincent MEMBRÉ over 1 year ago

  • Target version changed from 7.3.6 to 7.3.7
Actions #18

Updated by Vincent MEMBRÉ over 1 year ago

  • Target version changed from 7.3.7 to 7.3.8
Actions #19

Updated by Vincent MEMBRÉ about 1 year ago

  • Target version changed from 7.3.8 to 7.3.9
Actions #20

Updated by Vincent MEMBRÉ about 1 year ago

  • Target version changed from 7.3.9 to 7.3.10
Actions #21

Updated by Vincent MEMBRÉ about 1 year ago

  • Target version changed from 7.3.10 to 7.3.11
Actions #22

Updated by Vincent MEMBRÉ 11 months ago

  • Target version changed from 7.3.11 to 7.3.12
Actions #23

Updated by Vincent MEMBRÉ 10 months ago

  • Target version changed from 7.3.12 to 7.3.13
Actions #24

Updated by Vincent MEMBRÉ 10 months ago

  • Target version changed from 7.3.13 to 7.3.14
Actions #25

Updated by Vincent MEMBRÉ 8 months ago

  • Target version changed from 7.3.14 to 7.3.15
Actions #26

Updated by Vincent MEMBRÉ 7 months ago

  • Target version changed from 7.3.15 to 7.3.16
Actions #27

Updated by Vincent MEMBRÉ 6 months ago

  • Target version changed from 7.3.16 to 7.3.17
Actions

Also available in: Atom PDF