Project

General

Profile

Actions

Bug #4831

closed

Reports cannot be inserted into postgresql due to a limit on ids

Added by Vincent MEMBRÉ over 10 years ago. Updated over 10 years ago.

Status:
Released
Priority:
1 (highest)
Category:
Web - Compliance & node report
Target version:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
Name check:
Fix check:
Regression:

Description

All our ids in reports database are based on integer which limits to 2147483647 the number of entries. That can be reached in a 18 month period for a ~250 node installation with around 50 rules, 2 or 3 directives by rules. So we need to use a 64 bits int to not hit that rather low limit.

Since it's a big change, we will not fix it in our stable version but in a latest one (2.10), and give workaound with manual validation for other version.

More precissely, we are going to:

  • Fix Scala code and database schema in 2.10.x (#4831)
    • So new installations will not have the problem anymore
    • That will have no impact on existing installation
  • Add two scripts (#4832):
    • One that will only warn the user that their table is still using int if it's the case, and pointing to possible workaround
    • One that should be ran manually to migrate the database

This scripts will be provided with Rudder 2.10.1, but for other people, we need to have information to guide them toward the workarounds:

  • Add an entry in the FAQ that will explain how to detect it, analyse it, fix the issue.

Note:

command used to get type of column:

psql -U rudder -h localhost -p 15432 -Atc "select data_type from information_schema.columns where table_name='archivedruddersysevents' and column_name='id';"


Subtasks 4 (0 open4 closed)

Bug #4832: Add migration script about table idsReleasedJonathan CLARKE2014-05-07Actions
Bug #4849: Add an entry in the FAQ about limit on idReleasedNicolas CHARLES2014-05-13Actions
Bug #4871: Migration SQL script to change the format of the ids from integer to bigintReleasedFrançois ARMAND2014-05-19Actions
Bug #4887: Reports cannot be inserted due to a limit on ids - change serial sizeRejectedNicolas CHARLES2014-05-23Actions

Related issues 3 (0 open3 closed)

Related to Rudder - Bug #4847: Reports cannot be inserted due to a limit on ids (branch 2.9)RejectedNicolas CHARLES2014-05-13Actions
Related to Rudder - Bug #5235: An error occurs during upgrade because variable OPT_RUDDER is missing in rudder-upgrade-database scriptReleasedJonathan CLARKE2014-07-07Actions
Related to Rudder - Bug #5125: Migration script 'rudder-upgrade-database' displays unwanted logsReleasedNicolas CHARLES2014-06-24Actions
Actions

Also available in: Atom PDF