Actions
Bug #23302
closed
Ubuntu 22.04 upgrade in 8.0 generate LDAP errors
Pull Request:
Severity:
Major - prevents use of part of Rudder | no simple workaround
UX impact:
User visibility:
Effort required:
Priority:
0
Name check:
To do
Fix check:
To do
Regression:
No
Description
I try to upgrade a rudder-server in 7.3.5 to 8.0-nightly, the installation seems to be ok, but I can see error and the webapp seems to keep loading for a while (several minutes)
023-08-17 11:11:37+0000 ERROR com.normation.rudder.repository.ldap.LDAPGitRevisionProvider - Error when trying to read persisted version of the current technique reference library revision to use. Using the last available from Git. Error was: BackendException: An error occurred; cause was: java.lang.Error: Error during LDAP connection pool initialisation. Exception: LDAPBindException:invalid credentials; Details: null
-> com.normation.ldap.sdk.PooledConnectionProvider.liftedTree1$1(LDAPConnectionProvider.scala:245)
-> com.normation.ldap.sdk.PooledConnectionProvider.pool(LDAPConnectionProvider.scala:236)
-> com.normation.ldap.sdk.PooledConnectionProvider.pool$(LDAPConnectionProvider.scala:235)
-> com.normation.ldap.sdk.RWPooledSimpleAuthConnectionProvider.pool$lzycompute(LDAPConnectionProvider.scala:395)
-> com.normation.ldap.sdk.RWPooledSimpleAuthConnectionProvider.pool(LDAPConnectionProvider.scala:395)
-> com.normation.ldap.sdk.RWPooledSimpleAuthConnectionProvider.$anonfun$newConnection$8(LDAPConnectionProvider.scala:408)
-> com.normation.zio$ZioRuntime$.$anonfun$unsafeRun$1(ZioCommons.scala:445)
-> com.normation.zio$ZioRuntime$.unsafeRun(ZioCommons.scala:445)
-> com.normation.zio$ZioRuntime$.runNow(ZioCommons.scala:428)
-> com.normation.zio$UnsafeRun.runNow(ZioCommons.scala:454)
-> com.normation.cfclerk.services.impl.GitTechniqueReader.<init>(GitTechniqueReader.scala:211) ;you probably need to increase value ldap.maxPoolSize property in configuration file, please check the documentation - see https://docs.rudder.io/reference/7.0/administration/performance.html#_ldap_configuration
[2023-08-17T11:11:40.181Z] ERROR FATAL An error happen during Rudder boot. Rudder will stop now. Error: SystemError: Error during initialization of Rudder; cause was: java.lang.ExceptionInInitializerError: null
->
java.lang.ExceptionInInitializerError
at bootstrap.liftweb.LiftInitContextListener.contextInitialized(LiftInitContextListener.scala:134)
at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1049)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:624)
at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:984)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:740)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:392)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1304)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:901)
at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:306)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:532)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
at org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:40)
at org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:183)
at org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:516)
at org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:151)
at org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileAdded(ScanningAppProvider.java:186)
at org.eclipse.jetty.deploy.providers.WebAppProvider.fileAdded(WebAppProvider.java:462)
at org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileAdded(ScanningAppProvider.java:58)
at org.eclipse.jetty.util.Scanner$DiscreteListener.pathAdded(Scanner.java:282)
at org.eclipse.jetty.util.Scanner.reportAddition(Scanner.java:836)
at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:802)
at org.eclipse.jetty.util.Scanner.scan(Scanner.java:709)
at org.eclipse.jetty.util.Scanner.doStart(Scanner.java:597)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:121)
at org.eclipse.jetty.deploy.providers.ScanningAppProvider.doStart(ScanningAppProvider.java:158)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
at org.eclipse.jetty.deploy.DeploymentManager.startAppProvider(DeploymentManager.java:605)
at org.eclipse.jetty.deploy.DeploymentManager.doStart(DeploymentManager.java:246)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)
at org.eclipse.jetty.server.Server.start(Server.java:470)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:121)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89)
at org.eclipse.jetty.server.Server.doStart(Server.java:415)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
at org.eclipse.jetty.xml.XmlConfiguration.main(XmlConfiguration.java:1875)
Caused by: Exception in thread "zio-fiber-6" com.normation.ldap.sdk.LDAPRudderError$BackendException: BackendException(An error occurred,java.lang.Error: Error during LDAP connection pool initialisation. Exception: LDAPBindException:invalid credentials; Details: null)
at com.normation.errors.IOResult.attempt(ZioCommons.scala:95)
at com.normation.ldap.sdk.LDAPIOResult.attempt(LDAPIOResult.scala:61)
at com.normation.ldap.sdk.LDAPConnectionProvider.withCon(LDAPConnectionProvider.scala:116)
at com.normation.rudder.repository.ldap.LDAPGitRevisionProvider.currentId.setID(LDAPGitRevisionProvider.scala:79)
at com.normation.cfclerk.services.impl.GitTechniqueReader.currentTechniquesInfoCache(GitTechniqueReader.scala:180)
at com.normation.cfclerk.services.impl.GitTechniqueReader.currentTechniquesInfoCache(GitTechniqueReader.scala:178)
at com.normation.cfclerk.services.impl.GitTechniqueReader.currentTechniquesInfoCache(GitTechniqueReader.scala:211)
at com.normation.zio.ZioRuntime.unsafeRun(ZioCommons.scala:445)
Finally, the rudder-jetty seems to be restarted several times, with the same error, then finally the webapp seems to start up normally
Files
Updated by Elaad FURREEDAN over 1 year ago
Seems to happen on debian11 also, but I get a message about rudder-jetty.service failed at the end of installation
root@server:~# apt-get update
Get:1 http://repository.rudder.io/apt/8.0-nightly bullseye InRelease [13.9 kB]
Hit:2 https://deb.debian.org/debian bullseye InRelease
Hit:3 https://security.debian.org/debian-security bullseye-security InRelease
Hit:4 https://deb.debian.org/debian bullseye-updates InRelease
Hit:5 https://deb.debian.org/debian bullseye-backports InRelease
Get:6 http://repository.rudder.io/apt/8.0-nightly bullseye/main amd64 Packages [2347 B]
Fetched 16.3 kB in 1s (22.5 kB/s)
Reading package lists... Done
root@server:~# apt-get install rudder-server
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
openjdk-17-jre-headless rudder-agent rudder-relay
Suggested packages:
libnss-mdns fonts-dejavu-extra fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei | fonts-wqy-zenhei fonts-indic
The following NEW packages will be installed:
openjdk-17-jre-headless
The following packages will be upgraded:
rudder-agent rudder-relay rudder-server
3 upgraded, 1 newly installed, 0 to remove and 14 not upgraded.
Need to get 239 MB of archives.
After this operation, 197 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://repository.rudder.io/apt/8.0-nightly bullseye/main amd64 rudder-server amd64 8.0.0~alpha2~git202308170211-debian11 [189 MB]
Get:2 https://security.debian.org/debian-security bullseye-security/main amd64 openjdk-17-jre-headless amd64 17.0.7+7-1~deb11u1 [43.7 MB]
Get:3 http://repository.rudder.io/apt/8.0-nightly bullseye/main amd64 rudder-relay amd64 8.0.0~alpha2~git202308170211-debian11 [3692 kB]
Get:4 http://repository.rudder.io/apt/8.0-nightly bullseye/main amd64 rudder-agent amd64 8.0.0~alpha2~git202308170211-debian11 [3223 kB]
Fetched 239 MB in 8s (29.1 MB/s)
Reading changelogs... Done
Preconfiguring packages ...
Selecting previously unselected package openjdk-17-jre-headless:amd64.
(Reading database ... 40422 files and directories currently installed.)
Preparing to unpack .../openjdk-17-jre-headless_17.0.7+7-1~deb11u1_amd64.deb ...
Unpacking openjdk-17-jre-headless:amd64 (17.0.7+7-1~deb11u1) ...
Preparing to unpack .../rudder-server_8.0.0~alpha2~git202308170211-debian11_amd64.deb ...
********************************************************************************
INFO: dpkg may ask you if you want to replace rudder-web.properties or
INFO: slapd.conf with the maintainer version.
INFO:
INFO: If you accept, please keep in mind that you will lose any manual
INFO: modifications in this file, like batchs configuration, or LDAP
INFO: authentication. It will also reset passwords to default values and break
INFO: upgrade scripts.
INFO:
INFO: We strongly advise you to respond NO to this question
INFO: ('keep your currently-installed version'). Rudder's upgrade script will
INFO: take care of upgrading these file automatically.
INFO:
********************************************************************************
Unpacking rudder-server (8.0.0~alpha2~git202308170211-debian11) over (7.3.5-debian11) ...
Preparing to unpack .../rudder-relay_8.0.0~alpha2~git202308170211-debian11_amd64.deb ...
Unpacking rudder-relay (8.0.0~alpha2~git202308170211-debian11) over (7.3.5-debian11) ...
Preparing to unpack .../rudder-agent_8.0.0~alpha2~git202308170211-debian11_amd64.deb ...
Unpacking rudder-agent (8.0.0~alpha2~git202308170211-debian11) over (7.3.5-debian11) ...
Setting up rudder-agent (8.0.0~alpha2~git202308170211-debian11) ...
Setting up openjdk-17-jre-headless:amd64 (17.0.7+7-1~deb11u1) ...
update-alternatives: using /usr/lib/jvm/java-17-openjdk-amd64/bin/java to provide /usr/bin/java (java) in auto mode
update-alternatives: using /usr/lib/jvm/java-17-openjdk-amd64/bin/jpackage to provide /usr/bin/jpackage (jpackage) in auto mode
update-alternatives: using /usr/lib/jvm/java-17-openjdk-amd64/bin/keytool to provide /usr/bin/keytool (keytool) in auto mode
update-alternatives: using /usr/lib/jvm/java-17-openjdk-amd64/bin/rmiregistry to provide /usr/bin/rmiregistry (rmiregistry) in auto mode
update-alternatives: using /usr/lib/jvm/java-17-openjdk-amd64/lib/jexec to provide /usr/bin/jexec (jexec) in auto mode
Setting up rudder-relay (8.0.0~alpha2~git202308170211-debian11) ...
Setting up rudder-server (8.0.0~alpha2~git202308170211-debian11) ...
Configuration file '/opt/rudder/etc/rudder-web.properties'
==> Modified (by you or by a script) since installation.
==> Package distributor has shipped an updated version.
What would you like to do about it ? Your options are:
Y or I : install the package maintainer's version
N or O : keep your currently-installed version
D : show the differences between the versions
Z : start a shell to examine the situation
The default action is to keep your current version.
*** rudder-web.properties (Y/I/N/O/D/Z) [default=N] ? y
Installing new version of config file /opt/rudder/etc/rudder-web.properties ...
Installing new version of config file /opt/rudder/etc/logback.xml ...
Configuration file '/opt/rudder/etc/openldap/slapd.conf'
==> Modified (by you or by a script) since installation.
==> Package distributor has shipped an updated version.
What would you like to do about it ? Your options are:
Y or I : install the package maintainer's version
N or O : keep your currently-installed version
D : show the differences between the versions
Z : start a shell to examine the situation
The default action is to keep your current version.
*** slapd.conf (Y/I/N/O/D/Z) [default=N] ? y
Installing new version of config file /opt/rudder/etc/openldap/slapd.conf ...
Already on 'master'
Job for rudder-jetty.service failed because a timeout was exceeded.
See "systemctl status rudder-jetty.service" and "journalctl -xe" for details.
Processing triggers for libc-bin (2.31-13+deb11u6) ...
Updated by Vincent MEMBRÉ about 1 year ago
- Target version changed from 8.0.0~beta1 to 8.0.0~beta2
Updated by Vincent MEMBRÉ about 1 year ago
- Target version changed from 8.0.0~beta2 to 8.0.0~beta3
Updated by Elaad FURREEDAN about 1 year ago
I choose to replace the file, this lead to the error, by choosing N on the upgrade, this error no longer appear. In the doc, we say:
Rudder includes a script for upgrading all files, databases, etc… which need migrating. Therefore, you should not replace your old files by the new ones when apt asks about this, unless you want to reset all your parameters.
Actions