Project

General

Profile

Actions

Bug #15177

closed

Catching up on reports can be extremelly long and prevent compliance to display

Added by Nicolas CHARLES over 5 years ago. Updated over 4 years ago.

Status:
Rejected
Priority:
N/A
Category:
Web - Config management
Target version:
Severity:
Critical - prevents main use of Rudder | no workaround | data loss | security
UX impact:
User visibility:
Operational - other Techniques | Rudder settings | Plugins
Effort required:
Priority:
67
Name check:
To do
Fix check:
To do
Regression:

Description

When rudder is restarted after some times, it catches back old reports based on configuration parameters.
But the catching can be extremelly long (in our case: 5 days to catch up at a rate of 5 minutes every 5s...).
And during all that time, we don't have compliance (because recent runs with recent reports are not registered yet).

This an extermelly bad source of mileading bugs and it totally brokes Rudder expected behavior ("display compliance") or any app behavior ("restart == clean state").

So, we should change the strategy for getting back old reports (hard because we rely of last ckecked position), or at least make sure the convergence is much quicker (for ex, if we are catching up, don't limit the number of runs, or don't wait between each catch up...).

Edit: the culprit was misidentified as (see comment for why it wasn't):

[2019-07-09 11:54:41] ERROR report - Could not correctly retrieve from were to retrieve report processing, fallbacking to default value, error is is Failure(Could not fetch the highest id before date 2019-07-04T11:54:41.481Z in the databa
se,Empty,Full(Failure(SQL `NULL` read at column 1 (JDBC type BigInt) but mapping is to a non-Option type; use Option here. Note that JDBC column indexing is 1-based.,Full(doobie.util.invariant$NonNullableColumnRead: SQL `NULL` read at col
umn 1 (JDBC type BigInt) but mapping is to a non-Option type; use Option here. Note that JDBC column indexing is 1-based.),Empty)))

Actions #1

Updated by Nicolas CHARLES over 5 years ago

this is with rudder-webapp-5.0.12.rc1.git201907030103-1.SLES.12.noarch

Actions #2

Updated by Nicolas CHARLES over 5 years ago

  • Subject changed from No reporting in fresh install to Error on reporting in 5.0

I was not a fresh install
I got no report, because it was catching up 5 days at the rate of 5minutes every 5 seconds ....

Actions #3

Updated by François ARMAND over 5 years ago

  • Subject changed from Error on reporting in 5.0 to Catching up on reports can be extremelly long and prevent compliance to display
  • Description updated (diff)
  • Assignee set to Nicolas CHARLES
  • Severity set to Critical - prevents main use of Rudder | no workaround | data loss | security
  • User visibility set to Operational - other Techniques | Rudder settings | Plugins
  • Priority changed from 0 to 76
Actions #4

Updated by Vincent MEMBRÉ about 5 years ago

  • Target version changed from 5.0.13 to 5.0.14
  • Priority changed from 76 to 75
Actions #5

Updated by Vincent MEMBRÉ about 5 years ago

  • Target version changed from 5.0.14 to 5.0.15
  • Priority changed from 75 to 73
Actions #6

Updated by Vincent MEMBRÉ almost 5 years ago

  • Target version changed from 5.0.15 to 5.0.16
  • Priority changed from 73 to 71
Actions #7

Updated by Alexis Mousset almost 5 years ago

  • Target version changed from 5.0.16 to 5.0.17
  • Priority changed from 71 to 68
Actions #8

Updated by Nicolas CHARLES over 4 years ago

  • Status changed from New to Rejected
  • Priority changed from 68 to 67

default are sane 30 minutes rather than 5 days now

Actions

Also available in: Atom PDF