Project

General

Profile

Actions

Bug #21653

closed

when we receive a lot of inventories at once, not all are processed

Added by Nicolas CHARLES 5 months ago. Updated 5 months ago.

Status:
Released
Priority:
N/A
Category:
Web - Nodes & inventories
Target version:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
0
Regression:
No

Description

I've put 1000 inventories in /var/rudder/inventories/incoming
They got all gunziped, but I end up having only 200 inventories processed (I recopied the inventories once, so it sounds like twice 100 )

no error messages


Subtasks 1 (0 open1 closed)

User story #21665: When we receive a lot of inventories, inotify "OVERFLOW" is not handled ReleasedNicolas CHARLESActions
Actions #1

Updated by Nicolas CHARLES 5 months ago

it restart after 3 minutes with following message

[2022-08-29 11:39:32+0000] INFO  inventory-processing - Deleting file 'RUDDERTEST302-6a3ec4ef-b7f3-4b1c-bdde-bde119c3ae91.ocs.gz': Inventory file 'RUDDERTEST302-6a3ec4ef-b7f3-4b1c-bdde-bde119c3ae91.ocs.gz' is not an (inventory, signature) pair, cleaning

but there wan't any .gz files

Actions #2

Updated by Nicolas CHARLES 5 months ago

I have 833 times messages about not being a pair

[2022-08-29 11:34:32+0000] INFO  inventory-processing - Deleting file 'RUDDERTEST185-7bdec630-1fa7-4662-b83d-b16781f893b4.ocs': Inventory file 'RUDDERTEST185-7bdec630-1fa7-4662-b83d-b16781f893b4.ocs' is not an (inventory, signature) pair, cleaning
[2022-08-29 11:34:32+0000] INFO  inventory-processing - Deleting file 'RUDDERTEST657-f297c816-9fd4-4228-bd4f-17e30d811336.ocs': Inventory file 'RUDDERTEST657-f297c816-9fd4-4228-bd4f-17e30d811336.ocs' is not an (inventory, signature) pair, cleaning
[2022-08-29 11:34:32+0000] INFO  inventory-processing - Deleting file 'RUDDERTEST760-78efa216-28ab-4d5f-91ab-86d7fa081084.ocs': Inventory file 'RUDDERTEST760-78efa216-28ab-4d5f-91ab-86d7fa081084.ocs' is not an (inventory, signature) pair, cleaning
[2022-08-29 11:39:32+0000] INFO  inventory-processing - Deleting file 'RUDDERTEST302-6a3ec4ef-b7f3-4b1c-bdde-bde119c3ae91.ocs.gz': Inventory file 'RUDDERTEST302-6a3ec4ef-b7f3-4b1c-bdde-bde119c3ae91.ocs.gz' is not an (inventory, signature) pair, cleaning

Actions #3

Updated by François ARMAND 5 months ago

  • Status changed from New to In progress
  • Assignee set to François ARMAND
Actions #4

Updated by François ARMAND 5 months ago

  • Status changed from In progress to Pending technical review
  • Assignee changed from François ARMAND to Nicolas CHARLES
  • Pull Request set to https://github.com/Normation/rudder/pull/4450
Actions #5

Updated by Anonymous 5 months ago

  • Status changed from Pending technical review to Pending release
Actions #6

Updated by François ARMAND 5 months ago

  • Subtask #21665 added
Actions #7

Updated by Vincent MEMBRÉ 5 months ago

  • Status changed from Pending release to Released

This bug has been fixed in Rudder 7.2.0~rc1 which was released today.

Actions

Also available in: Atom PDF