Project

General

Profile

Actions

Bug #9651

closed

Sometimes, no root server inventory after a fresh install

Added by Nicolas CHARLES over 7 years ago. Updated about 1 year ago.

Status:
Resolved
Priority:
N/A
Assignee:
-
Category:
Packaging
Severity:
Minor - inconvenience | misleading | easy workaround
UX impact:
User visibility:
Operational - other Techniques | Technique editor | Rudder settings
Effort required:
Medium
Priority:
0
Name check:
Fix check:
Regression:
No

Description

After a fresh install, i sometimes have no server inventory.
It is most likely a race condition, as the inventory is sent when the webapp is up an running, but with wrong ldap/postgres credential, so we have

[2016-11-09 15:05:12] INFO  com.normation.inventory.provisioning.endpoint.FusionReportEndpoint - New input inventory: 'ubuntu-root.ocs'
[2016-11-09 15:05:13] INFO  com.normation.inventory.provisioning.endpoint.FusionReportEndpoint - New input inventory: 'ubuntu-root.ocs'
[2016-11-09 15:05:14] INFO  com.normation.inventory.provisioning.endpoint.FusionReportEndpoint - Inventory 'ubuntu-root.ocs' parsed in 1 second and 570 milliseconds ms, now checking signature
[2016-11-09 15:05:14] INFO  com.normation.inventory.provisioning.endpoint.FusionReportEndpoint - Inventory 'ubuntu-root.ocs' parsed in 566 milliseconds ms, now checking signature
[2016-11-09 15:05:14] ERROR com.normation.ldap.sdk.RWPooledSimpleAuthConnectionProvider - Can't get a new LDAP connection
com.unboundid.ldap.sdk.LDAPException: invalid credentials
        at com.unboundid.ldap.sdk.LDAPConnection.bind(LDAPConnection.java:1937)
        at com.unboundid.ldap.sdk.LDAPConnectionPool.createConnection(LDAPConnectionPool.java:1138)

simultaneous agent run says:

Nov  9 15:05:06 ubuntu rudder[13726]: CFEngine(agent) rudder R: @@server-roles@@result_repaired@@server-roles@@server-roles-directive@@0@@Check LDAP in rudder-webapp.properties@@None@@2016-11-09 14:04:57+00:00##root@#The Rudder Webapp configuration files were updated with a new LDAP password
Nov  9 15:05:06 ubuntu rudder[13726]: CFEngine(agent) rudder R: @@server-roles@@result_repaired@@server-roles@@server-roles-directive@@0@@Check LDAP credentials@@None@@2016-11-09 14:04:57+00:00##root@#The OpenLDAP configuration file was updated with a new rootdn password
Nov  9 15:05:06 ubuntu rudder[13726]: CFEngine(agent) rudder R: @@server-roles@@log_info@@server-roles@@server-roles-directive@@0@@Check rudder-passwords.conf file@@None@@2016-11-09 14:04:57+00:00##root@#rudder-slapd has been restarted
Nov  9 15:05:06 ubuntu rudder[13726]: CFEngine(agent) rudder Method 'root_password_check_ldap' failed in some repairs
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder R: @@server-roles@@result_repaired@@server-roles@@server-roles-directive@@0@@Check SQL in rudder-webapp.properties@@None@@2016-11-09 14:04:57+00:00##root@#The Rudder Webapp configuration files were updated with a new SQL password
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder R: @@server-roles@@result_repaired@@server-roles@@server-roles-directive@@0@@Check SQL credentials@@None@@2016-11-09 14:04:57+00:00##root@#The Rudder PostgreSQL user account's password has been changed
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder R: @@server-roles@@result_repaired@@server-roles@@server-roles-directive@@0@@Check rudder-passwords.conf and pgpass files@@None@@2016-11-09 14:04:57+00:00##root@#The Rudder passwords file permissions were fixed
Nov  9 15:05:07 ubuntu systemd[1]: Stopped LSB: Jetty 7 webserver.
Nov  9 15:05:07 ubuntu systemd[1]: Starting LSB: Jetty 7 webserver...
Nov  9 15:05:07 ubuntu rudder-jetty[15810]: Setting umask to 0007
Nov  9 15:05:07 ubuntu rudder-jetty[15810]: Starting Jetty: already running.
Nov  9 15:05:07 ubuntu systemd[1]: Started LSB: Jetty 7 webserver.
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder Q: ".../systemctl rest": Failed to open /dev/tty: No such device or address
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder A variable seems to have been used for the name of the method. In this case, the promiser also needs to contain the unique name of the method
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder A method attempted to use a bundle '${configuration.enabled_loggers}' that was apparently not defined
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder Method '_log' failed in some repairs
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder Method 'command_execution' failed in some repairs
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder A variable seems to have been used for the name of the method. In this case, the promiser also needs to contain the unique name of the method
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder A method attempted to use a bundle '${configuration.enabled_loggers}' that was apparently not defined
Nov  9 15:05:07 ubuntu rudder[13726]: CFEngine(agent) rudder Method '_log' failed in some repairs
Nov  9 15:05:07 ubuntu systemd[1]: Stopping LSB: Jetty 7 webserver...
Nov  9 15:05:08 ubuntu rudder[15306]: CFEngine(agent) rudder Q: "...-inventory --lo": [info] FusionInventory instance: builtin
Q: "...-inventory --lo": [info] running task Inventory
Q: "...-inventory --lo": [info] Inventory saved in /var/rudder/tmp/inventory/ubuntu-root.ocs
Nov  9 15:05:08 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@Inventory@@log_debug@@inventory-all@@inventory-all@@00@@inventory@@None@@2016-11-09 14:05:04+00:00##root@#Running inventory
Nov  9 15:05:08 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@Inventory@@log_info@@inventory-all@@inventory-all@@00@@inventory@@None@@2016-11-09 14:05:04+00:00##root@#Curl installed
(snip)
ov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@server-roles@@result_success@@server-roles@@server-roles-directive@@0@@Check configuration-repository GIT lock@@None@@2016-11-09 14:05:04+00:00##root@#The /var/rudder/configuration-repository GIT lock file is not present or not older than 5 minutes
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder Finished command related to promiser '/usr/bin/curl --proxy '' --max-time 240 -s http://localhost:8080/rudder/api/status |/bin/grep -q OK' -- an error occurred, returned 1
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@server-roles@@result_error@@server-roles@@server-roles-directive@@0@@Check rudder status@@None@@2016-11-09 14:05:04+00:00##root@#This is the first time the http://localhost:8080/rudder/api/status web application failed to respond. Deferring the restart.
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder Method 'generic_alive_check' failed in some repairs
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@server-roles@@result_success@@server-roles@@server-roles-directive@@0@@Check endpoint status@@None@@2016-11-09 14:05:04+00:00##root@#The http://localhost:8080/endpoint/api/status web application is running
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@server-roles@@result_success@@server-roles@@server-roles-directive@@0@@Check slapd process@@None@@2016-11-09 14:05:04+00:00##root@#Check slapd process running was correct
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@server-roles@@result_success@@server-roles@@server-roles-directive@@0@@Check PostgreSQL configuration@@None@@2016-11-09 14:05:04+00:00##root@#There is no need of specific postgresql configuration on this system
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@server-roles@@result_success@@server-roles@@server-roles-directive@@0@@Check postgresql process@@None@@2016-11-09 14:05:04+00:00##root@#Check postgresql process running was correct
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@server-roles@@result_success@@server-roles@@server-roles-directive@@0@@Check postgresql boot script@@None@@2016-11-09 14:05:04+00:00##root@#Check postgresql boot starting parameters was correct
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@Common@@result_success@@hasPolicyServer-root@@common-root@@00@@Binaries update@@None@@2016-11-09 14:05:04+00:00##root@#The CFEngine binaries in /var/rudder/cfengine-community/bin are up to date
Nov  9 15:05:15 ubuntu rudder[15306]: CFEngine(agent) rudder R: @@Common@@log_info@@hasPolicyServer-root@@common-root@@00@@common@@EndRun@@2016-11-09 14:05:04+00:00##root@#End execution with config [0]
Nov  9 15:05:15 ubuntu systemd[1]: Reloading LSB: Apache2 web server.
Nov  9 15:05:15 ubuntu apache2[16242]:  * Reloading Apache httpd web server apache2
Nov  9 15:05:16 ubuntu apache2[16242]:  *
Nov  9 15:05:16 ubuntu systemd[1]: Reloaded LSB: Apache2 web server.
Nov  9 15:05:16 ubuntu rudder[15078]: CFEngine(agent) rudder R: @@server-roles@@result_repaired@@server-roles@@server-roles-directive@@0@@Check allowed networks configuration@@None@@2016-11-09 14:05:02+00:00##root@#The Rudder allowed networks configuration has been corrected
Nov  9 15:05:16 ubuntu rudder[15078]: CFEngine(agent) rudder R: @@server-roles@@log_info@@server-roles@@server-roles-directive@@0@@Check allowed networks configuration@@None@@2016-11-09 14:05:02+00:00##root@#Apache has been reloaded successfully
Nov  9 15:05:16 ubuntu rudder[15078]: CFEngine(agent) rudder R: @@Common@@log_info@@hasPolicyServer-root@@common-root@@00@@common@@EndRun@@2016-11-09 14:05:02+00:00##root@#End execution with config [0]
Nov  9 15:05:19 ubuntu CRON[14929]: (CRON) info (No MTA installed, discarding output)
Nov  9 15:05:39 ubuntu rudder-jetty[15889]: Stopping Jetty: OK
Nov  9 15:05:39 ubuntu systemd[1]: Stopped LSB: Jetty 7 webserver.
Nov  9 15:05:39 ubuntu systemd[1]: Starting LSB: Jetty 7 webserver...
Nov  9 15:05:39 ubuntu rudder-jetty[17534]: Setting umask to 0007
Nov  9 15:06:03 ubuntu rudder-jetty[17534]: Starting Jetty: . . . . . OK Wed Nov  9 15:06:03 CET 2016
Nov  9 15:06:03 ubuntu systemd[1]: Started LSB: Jetty 7 webserver.
Nov  9 15:06:03 ubuntu rudder[13726]: CFEngine(agent) rudder Method 'service_action' failed in some repairs

So, we have two concurrent cf-agent running, causing mayhem
Happens in 4.0, but most likely in 3.1

Actions #1

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.17 to 3.1.18
Actions #2

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.18 to 3.1.19
Actions #3

Updated by Benoît PECCATTE about 7 years ago

  • Severity set to Minor - inconvenience | misleading | easy workaround
  • User visibility set to Operational - other Techniques | Technique editor | Rudder settings
  • Priority set to 16
Actions #4

Updated by Vincent MEMBRÉ about 7 years ago

  • Target version changed from 3.1.19 to 3.1.20
Actions #5

Updated by Vincent MEMBRÉ about 7 years ago

  • Target version changed from 3.1.20 to 3.1.21
  • Priority changed from 16 to 15
Actions #6

Updated by Vincent MEMBRÉ almost 7 years ago

  • Target version changed from 3.1.21 to 3.1.22
Actions #7

Updated by Benoît PECCATTE almost 7 years ago

  • Priority changed from 15 to 29
Actions #8

Updated by Vincent MEMBRÉ almost 7 years ago

  • Target version changed from 3.1.22 to 3.1.23
  • Priority changed from 29 to 28
Actions #9

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 3.1.23 to 3.1.24
Actions #10

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 3.1.24 to 3.1.25
  • Priority changed from 28 to 27
Actions #11

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 3.1.25 to 387
Actions #12

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 387 to 4.1.10
Actions #13

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 4.1.10 to 4.1.11
Actions #14

Updated by Vincent MEMBRÉ about 6 years ago

  • Target version changed from 4.1.11 to 4.1.12
Actions #15

Updated by Vincent MEMBRÉ about 6 years ago

  • Target version changed from 4.1.12 to 4.1.13
Actions #16

Updated by Vincent MEMBRÉ almost 6 years ago

  • Target version changed from 4.1.13 to 4.1.14
Actions #17

Updated by Benoît PECCATTE almost 6 years ago

  • Target version changed from 4.1.14 to 4.1.15
Actions #18

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 4.1.15 to 4.1.16
Actions #19

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 4.1.16 to 4.1.17
Actions #20

Updated by François ARMAND over 5 years ago

  • Subject changed from No server inventory in web interface to No root server inventory after a fresh install
  • Priority changed from 27 to 0
Actions #21

Updated by François ARMAND over 5 years ago

  • Subject changed from No root server inventory after a fresh install to Sometimes, no root server inventory after a fresh install
Actions #22

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 4.1.17 to 4.1.18
Actions #23

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 4.1.18 to 4.1.19
Actions #24

Updated by Alexis Mousset over 5 years ago

  • Target version changed from 4.1.19 to 4.1.20
Actions #25

Updated by François ARMAND about 5 years ago

  • Target version changed from 4.1.20 to 4.1.21
Actions #26

Updated by Vincent MEMBRÉ about 5 years ago

  • Target version changed from 4.1.21 to 4.1.22
Actions #27

Updated by Benoît PECCATTE about 5 years ago

  • Target version changed from 4.1.22 to 5.0.10
Actions #28

Updated by Vincent MEMBRÉ about 5 years ago

  • Target version changed from 5.0.10 to 5.0.11
Actions #29

Updated by Vincent MEMBRÉ about 5 years ago

  • Target version changed from 5.0.11 to 5.0.12
Actions #30

Updated by Vincent MEMBRÉ almost 5 years ago

  • Target version changed from 5.0.12 to 5.0.13
Actions #31

Updated by Vincent MEMBRÉ over 4 years ago

  • Target version changed from 5.0.13 to 5.0.14
Actions #32

Updated by Vincent MEMBRÉ over 4 years ago

  • Target version changed from 5.0.14 to 5.0.15
Actions #33

Updated by Benoît PECCATTE over 4 years ago

  • Effort required set to Medium
Actions #34

Updated by Vincent MEMBRÉ over 4 years ago

  • Target version changed from 5.0.15 to 5.0.16
Actions #35

Updated by Alexis Mousset over 4 years ago

  • Target version changed from 5.0.16 to 5.0.17
Actions #36

Updated by Vincent MEMBRÉ about 4 years ago

  • Target version changed from 5.0.17 to 5.0.18
Actions #37

Updated by Vincent MEMBRÉ almost 4 years ago

  • Target version changed from 5.0.18 to 5.0.19
Actions #38

Updated by Vincent MEMBRÉ over 3 years ago

  • Target version changed from 5.0.19 to 5.0.20
Actions #39

Updated by Vincent MEMBRÉ over 3 years ago

  • Target version changed from 5.0.20 to 797
Actions #40

Updated by Benoît PECCATTE almost 3 years ago

  • Target version changed from 797 to 6.1.14
Actions #41

Updated by Vincent MEMBRÉ almost 3 years ago

  • Target version changed from 6.1.14 to 6.1.15
Actions #42

Updated by Vincent MEMBRÉ almost 3 years ago

  • Target version changed from 6.1.15 to 6.1.16
Actions #43

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.16 to 6.1.17
Actions #44

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.17 to 6.1.18
Actions #45

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.18 to 6.1.19
Actions #46

Updated by Vincent MEMBRÉ about 2 years ago

  • Target version changed from 6.1.19 to 6.1.20
Actions #47

Updated by Vincent MEMBRÉ almost 2 years ago

  • Target version changed from 6.1.20 to 6.1.21
Actions #48

Updated by Vincent MEMBRÉ almost 2 years ago

  • Target version changed from 6.1.21 to old 6.1 issues to relocate
Actions #49

Updated by Alexis Mousset over 1 year ago

  • Target version changed from old 6.1 issues to relocate to old 6.2 issues to relocate
Actions #50

Updated by François ARMAND about 1 year ago

  • Status changed from New to Resolved
  • Regression set to No

We didn't see that behavior since 7.2 changes in inventory reception. Closing it.

Actions

Also available in: Atom PDF