Project

General

Profile

Actions

Bug #8195

closed

Bug #7735: OOM in Rudder when there are too many repaired reports

Correct memory profile and efficiency of non-compliant-reports logger

Added by François ARMAND almost 8 years ago. Updated almost 8 years ago.

Status:
Released
Priority:
1
Category:
Performance and scalability
Target version:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
Name check:
Fix check:
Regression:

Description

As defined in the parent task #7735, some of the OOM are not due to the repaired report cache, but to the code that logs error rerports.

This ticket address that subpart which is quite self-contained.

The process is a batch, so the optimisation are easy (main idea: cut a big batch in lots of little ones)

Actions #1

Updated by François ARMAND almost 8 years ago

With the proposed modification, we have:

- a bounded memory consumption around 30Mo for the processus
- writting 250 000 non-compliant-reports take ~10s in place of >15 minutes before

Actions #2

Updated by François ARMAND almost 8 years ago

  • Status changed from In progress to Pending technical review
  • Assignee changed from François ARMAND to Vincent MEMBRÉ
  • Pull Request set to https://github.com/Normation/rudder/pull/1079
Actions #3

Updated by François ARMAND almost 8 years ago

  • Subject changed from Correct memory profile and efficiency of error report logger to Correct memory profile and efficiency of non-compliant-reports logger
  • Assignee changed from Vincent MEMBRÉ to François ARMAND
Actions #4

Updated by François ARMAND almost 8 years ago

  • Assignee changed from François ARMAND to Vincent MEMBRÉ
Actions #5

Updated by François ARMAND almost 8 years ago

  • Status changed from Pending technical review to Pending release
  • % Done changed from 0 to 100
Actions #6

Updated by Vincent MEMBRÉ almost 8 years ago

  • Status changed from Pending release to Released

This bug has been fixed in Rudder 3.0.16, 3.1.10 and 3.2.3 which were released on 2016-06-01, but not announced.

Actions

Also available in: Atom PDF