Rudder

Hi Janos,

Thank you for this ticket
Tag POLICY_SERVER_UUID is empty. In 2.11, it is read from /var/rudder/tmp/uuid.txt
However, message is about tag POLICY_SERVER, added by promises in add_information_to_inventory, only if class uuiddefined is defined, so only if command /usr/sbin/dmidecode -s system-uuid could be run
Do you have dmidecode on the system ?

Also, do you have a non empty file in /var/rudder/cfengine-community/rudder-server-uuid.txt ?
Do you have the TAG POLICY_SERVER in the inventory file ?

As seen on IRC: this is a xen DomU system, so the UUID is computed differently.
Could you check that the following command returns something
/bin/xenstore-read vm

inventory checks that it returns something like /vm/(.*), and extract the uuid based on what is captured. If something is captured, it will add the data in the inventory, otherwith, tag POLICY_SERVER won't be created

As discussed on IRC, error is:

09:46:02 < matya> ** was marked for editing but could not be opened
09:46:10 < matya> File '...' is bigger than the limit edit.max_file_size = 2159680 > 1024000 bytes

Ok as we have just found out, it's because we have so many processes running on the system, the inventory exceeds the allowed max_file_size in the edit promise:

2016-12-22T09:45:35+0100     info: /default/doInventory/methods/'any'/default/addInformationsToInventory/files/'/var/rudder/tmp/inventory/badserver-150a61ba-4ed5-11e5-a7c9-xxxxxxxx.ocs'[0]: File '/var/rudder/tmp/inventory/badserver-150a61ba-4ed5-11e5-a7c9-xxxxxxxx.ocs' is bigger than the limit edit.max_file_size = 2159680 > 1024000 bytes
2016-12-22T09:45:35+0100    error: /default/doInventory/methods/'any'/default/addInformationsToInventory/files/'/var/rudder/tmp/inventory/badserver-150a61ba-4ed5-11e5-a7c9-xxxxxxxx.ocs'[0]: File '/var/rudder/tmp/inventory/badserver-150a61ba-4ed5-11e5-a7c9-xxxxxxxx.ocs' was marked for editing but could not be opened
2016-12-22T09:45:35+0100     info: /default/doInventory/methods/'any'/default/addInformationsToInventory/files/'/var/rudder/tmp/inventory/badserver-150a61ba-4ed5-11e5-a7c9-xxxxxxxx.ocs'[0]: File '/var/rudder/tmp/inventory/badserver-150a61ba-4ed5-11e5-a7c9-xxxxxxxx.ocs' is bigger than the limit edit.max_file_size = 2159680 > 1024000 bytes
2016-12-22T09:45:35+0100    error: /default/doInventory/methods/'any'/default/addInformationsToInventory/files/'/var/rudder/tmp/inventory/badserver-150a61ba-4ed5-11e5-a7c9-xxxxxxxx.ocs'[0]: File '/var/rudder/tmp/inventory/badserver-150a61ba-4ed5-11e5-a7c9-xxxxxxxx.ocs' was marked for editing but could not be opened
2016-12-22T09:45:35+0100    error: /default/doInventory/methods/'any'[0]: Method 'addInformationsToInventory' failed in some repairs

I have applied a local patch to the fusionAgent.cf, and now it works like a charm:

# diff -u fusionAgent.cf.orig fusionAgent.cf
--- fusionAgent.cf.orig 2016-12-22 09:54:31.000000000 +0100
+++ fusionAgent.cf 2016-12-22 09:54:52.000000000 +0100
@@ -429,18 +429,18 @@
       "${fusionAgent.inventory_path_edition}" 
         edit_line => add_information_to_inventory(${RUDDERUUID}, ${CFKEY}, ${USER}, ${polserv_uuid}),
         comment => "Adding basic informations to Rudder Inventory",
-        edit_defaults => def_no_backup;
+        edit_defaults => def_no_backup_size("10M");

       "${fusionAgent.inventory_path_edition}" 
         edit_line => add_users_information_to_inventory(@{addInformationsToInventory.users}),
         comment => "Adding user informations to Rudder Inventory",
-        edit_defaults => def_no_backup;
+        edit_defaults => def_no_backup_size("10M");

     uuiddefined.rudder_server_roles_dir_exists::
       "${fusionAgent.inventory_path_edition}" 
         edit_line  => add_server_roles_information_to_inventory("@{addInformationsToInventory.rudder_roles}"),
         comment => "Adding server roles informations to Rudder Inventory",
-        edit_defaults => def_no_backup;
+        edit_defaults => def_no_backup_size("10M");

     android::
       "${g.rudder_var_tmp}/inventory/.*.ocs" 

I have just checked, the biggest inventory (which I've found in the inventories/failed dir) is about ~6MB big. I'd recommend using 25MB as size.
As you've mentioned, we are on the edge of 2017, so opening 25MB for editing should be reasonably safe (I mean, it's probably a much safer decision than all distros going to systemd :-} )