Project

General

Profile

Actions

Bug #16568

closed

Webapp stuck after upgrade from 5.0 to 6.0

Added by Félix DALLIDET almost 5 years ago. Updated almost 5 years ago.

Status:
Rejected
Priority:
N/A
Assignee:
-
Category:
Server components
Target version:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
0
Name check:
To do
Fix check:
To do
Regression:

Description

When updating a 5.0 to a 6.0 everything went well (modulo a cfengine duplicated classes at the cf-promises run but which resolves itself afterward).
But, the webapp do not want to restart until I manually restart "rudder-slapd". Slapd is running well.

Here is the stack trace of my webapp, before restarting slapd.

root@server:~# vim /var/log/rudder/webapp/2020_01_16.stderrout.log
root@server:~# cat /var/log/rudder/webapp/2020_01_16.stderrout.log
2020-01-16 12:19:41.927:INFO:oejs.SetUIDListener:main: Setting umask=07
2020-01-16 12:19:41.930:INFO:oejs.Server:main: jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_141-8u141-b15-1~deb9u1-b15
2020-01-16 12:19:41.957:INFO:oejdp.ScanningAppProvider:main: Deployment monitor [file:///opt/rudder/share/webapps/] at interval 1
2020-01-16 12:19:42.742:INFO:oejw.StandardDescriptorProcessor:main: NO JSP Support for /endpoint, did not find org.eclipse.jetty.jsp.JettyJspServlet
Use configuration file defined by JVM property -Dlogback.configurationFile : /opt/rudder/etc/logback.xml
2020-01-16 12:19:43.227:INFO:oejs.session:main: DefaultSessionIdManager workerName=node0
2020-01-16 12:19:43.227:INFO:oejs.session:main: No SessionScavenger set, using defaults
2020-01-16 12:19:43.228:INFO:oejs.session:main: node0 Scavenging every 660000ms
2020-01-16 12:19:43.819:INFO:oejshC.endpoint:main: Initializing Spring FrameworkServlet 'dispatcher'
[2020-01-16 12:19:44] WARN  org.springframework.context.annotation.ConfigurationClassEnhancer - @Bean method PropertyPlaceholderConfig.propertyConfigurer is non-static and returns an object assignable to Spring's BeanFactoryPostProcessor interface. This will result in a failure to process annotations such as @Autowired, @Resource and @PostConstruct within the method's declaring @Configuration class. Add the 'static' modifier to this method to avoid these container lifecycle issues; see @Bean javadoc for complete details.
[2020-01-16 12:19:44] INFO  com.normation.inventory.provisioning.endpoint.config.PropertyPlaceholderConfig - Use configuration file defined by JVM property -Dinventoryweb.configFile : /opt/rudder/etc/inventory-web.properties
[2020-01-16 12:19:46] INFO  inventory-processing - Incoming inventory watcher started - process existing inventories
2020-01-16 12:19:46.501:INFO:oejsh.ContextHandler:main: Started o.e.j.w.WebAppContext@5a8e6209{/endpoint,file:///var/rudder/tmp/jetty/jetty-endpoint.war.dir/webapp/,AVAILABLE}{/endpoint.war}
2020-01-16 12:19:47.733:INFO:oejw.StandardDescriptorProcessor:main: NO JSP Support for /rudder, did not find org.eclipse.jetty.jsp.JettyJspServlet
Use configuration file defined by JVM property -Dlogback.configurationFile : /opt/rudder/etc/logback.xml
[2020-01-16 12:19:48] INFO  application - Use configuration file defined by JVM property -Drudder.configFile : /opt/rudder/etc/rudder-web.properties
[2020-01-16 12:19:48] INFO  application - Global exception handler configured to stop Rudder on: java.lang.Error
[2020-01-16 12:19:49] INFO  application - Property 'rudder.batch.delete.software.interval' is missing or empty in rudder.configFile. Default to 24 hours.
[2020-01-16 12:19:49] INFO  application - Starting Rudder 5.0.16-SNAPSHOT web application [build timestamp: 2020-01-15T15:38:48Z]
[2020-01-16 12:19:56] INFO  application - Starting [Store Agent Run Times] scheduler with a period of 5 s
[2020-01-16 12:19:56] INFO  application - List of registered properties:
[2020-01-16 12:19:56] INFO  application - registered property: awt.toolkit="sun.awt.X11.XToolkit" 
[2020-01-16 12:19:56] INFO  application - registered property: bin.emergency.stop="/opt/rudder/bin/cfe-red-button.sh" 
[2020-01-16 12:19:56] INFO  application - registered property: file.encoding.pkg="sun.io" 
[2020-01-16 12:19:56] INFO  application - registered property: file.separator="/" 
[2020-01-16 12:19:56] INFO  application - registered property: history.inventories.rootdir="/var/rudder/inventories/historical" 
[2020-01-16 12:19:56] INFO  application - registered property: inventoryweb.configFile="/opt/rudder/etc/inventory-web.properties" 
[2020-01-16 12:19:56] INFO  application - registered property: java.awt.graphicsenv="sun.awt.X11GraphicsEnvironment" 
[2020-01-16 12:19:56] INFO  application - registered property: java.awt.printerjob="sun.print.PSPrinterJob" 
[2020-01-16 12:19:56] INFO  application - registered property: java.class.path="/opt/rudder/jetty/start.jar" 
[2020-01-16 12:19:56] INFO  application - registered property: java.class.version="52.0" 
[2020-01-16 12:19:56] INFO  application - registered property: java.endorsed.dirs="/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/endorsed" 
[2020-01-16 12:19:56] INFO  application - registered property: java.ext.dirs="/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/ext:/usr/java/packages/lib/ext" 
[2020-01-16 12:19:56] INFO  application - registered property: java.home="/usr/lib/jvm/java-8-openjdk-amd64/jre" 
[2020-01-16 12:19:56] INFO  application - registered property: java.io.tmpdir="/var/rudder/tmp/jetty" 
[2020-01-16 12:19:56] INFO  application - registered property: java.library.path="/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib" 
[2020-01-16 12:19:56] INFO  application - registered property: java.runtime.name="OpenJDK Runtime Environment" 
[2020-01-16 12:19:56] INFO  application - registered property: java.runtime.version="1.8.0_141-8u141-b15-1~deb9u1-b15" 
[2020-01-16 12:19:56] INFO  application - registered property: java.specification.name="Java Platform API Specification" 
[2020-01-16 12:19:56] INFO  application - registered property: java.specification.vendor="Oracle Corporation" 
[2020-01-16 12:19:56] INFO  application - registered property: java.specification.version="1.8" 
[2020-01-16 12:19:56] INFO  application - registered property: java.vendor.url.bug="http://bugreport.sun.com/bugreport/" 
[2020-01-16 12:19:56] INFO  application - registered property: java.version="1.8.0_141" 
[2020-01-16 12:19:56] INFO  application - registered property: java.vm.info="mixed mode" 
[2020-01-16 12:19:56] INFO  application - registered property: java.vm.name="OpenJDK 64-Bit Server VM" 
[2020-01-16 12:19:56] INFO  application - registered property: java.vm.specification.name="Java Virtual Machine Specification" 
[2020-01-16 12:19:56] INFO  application - registered property: java.vm.specification.vendor="Oracle Corporation" 
[2020-01-16 12:19:56] INFO  application - registered property: java.vm.specification.version="1.8" 
[2020-01-16 12:19:56] INFO  application - registered property: java.vm.vendor="Oracle Corporation" 
[2020-01-16 12:19:56] INFO  application - registered property: java.vm.version="25.141-b15" 
[2020-01-16 12:19:56] INFO  application - registered property: jetty.base="/opt/rudder/etc/rudder-jetty-base" 
[2020-01-16 12:19:56] INFO  application - registered property: jetty.git.hash="d5fc0523cfa96bfebfbda19606cad384d772f04c" 
[2020-01-16 12:19:56] INFO  application - registered property: jetty.home="/opt/rudder/jetty" 
[2020-01-16 12:19:56] INFO  application - registered property: jetty.tag.version="master" 
[2020-01-16 12:19:56] INFO  application - registered property: jetty.version="9.4.11.v20180605" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.authdn="cn=manager,cn=rudder-configuration" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.authpw=**********
[2020-01-16 12:19:56] INFO  application - registered property: ldap.host="localhost" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.inventories.accepted.basedn="ou=Accepted Inventories, ou=Inventories, cn=rudder-configuration" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.inventories.pending.basedn="ou=Pending Inventories, ou=Inventories, cn=rudder-configuration" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.inventories.removed.basedn="ou=Removed Inventories, ou=Inventories, cn=rudder-configuration" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.inventories.software.basedn="ou=Inventories, cn=rudder-configuration" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.maxPoolSize="2" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.node.base="cn=rudder-configuration" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.port="389" 
[2020-01-16 12:19:56] INFO  application - registered property: ldap.rudder.base="ou=Rudder, cn=rudder-configuration" 
[2020-01-16 12:19:56] INFO  application - registered property: line.separator="\n" 
[2020-01-16 12:19:56] INFO  application - registered property: logback.configurationFile="/opt/rudder/etc/logback.xml" 
[2020-01-16 12:19:56] INFO  application - registered property: os.arch="amd64" 
[2020-01-16 12:19:56] INFO  application - registered property: os.name="Linux" 
[2020-01-16 12:19:56] INFO  application - registered property: os.version="4.9.0-3-amd64" 
[2020-01-16 12:19:56] INFO  application - registered property: path.separator=":" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.auth.provider="file" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.authFile="/opt/rudder/etc/rudder-users.xml" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.autoArchiveItems="true" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.databasecleaner.runtime.day="sunday" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.databasecleaner.runtime.hour="0" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.databasecleaner.runtime.minute="0" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.dyngroup.updateInterval="5" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.purge.inventories.delete.TTL="7" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.purge.inventories.delete.interval="24" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.reports.logInterval="1" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.reportsCleaner.deleteLogReport.TTL="2x" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.reportscleaner.archive.TTL="4" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.reportscleaner.compliancelevels.delete.TTL="15" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.reportscleaner.delete.TTL="15" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.reportscleaner.frequency="daily" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.storeAgentRunTimes.maxBatchSize="5" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.storeAgentRunTimes.maxDays="0" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.storeAgentRunTimes.maxMinutes="30" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.storeAgentRunTimes.updateInterval="5" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.batch.techniqueLibrary.updateInterval="5" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.community.port="5309" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.configFile="/opt/rudder/etc/rudder-web.properties" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.debug.nodeconfiguration.path="/var/log/rudder/nodeConfigurations" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.dir.backup="/var/rudder/share/backup/" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.dir.dependencies="/var/rudder/tools" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.dir.gitRoot="/var/rudder/configuration-repository" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.dir.lock="/var/rudder/lock/" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.dir.shared.files.folder="/var/rudder/configuration-repository/shared-files" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.dir.techniques="/var/rudder/configuration-repository/techniques" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.dir.uploaded.file.sharing="/var/rudder/files/" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.endpoint.cmdb="http://localhost:8080/endpoint/upload/" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.hooks.ignore-suffixes=".swp, ~, .bak, .cfnew   , .cfsaved  , .cfedited, .cfdisabled, .cfmoved,.dpkg-old, .dpkg-dist, .dpkg-new, .dpkg-tmp,.disable , .disabled , _disable , _disabled,.ucf-old , .ucf-dist , .ucf-new ,.rpmnew  , .rpmsave  , .rpmorig" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.jdbc.batch.max.size="500" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.jdbc.driver="org.postgresql.Driver" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.jdbc.maxPoolSize="25" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.jdbc.password=**********
[2020-01-16 12:19:56] INFO  application - registered property: rudder.jdbc.url="jdbc:postgresql://localhost:5432/rudder" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.jdbc.username="rudder" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.jvm.fatal.exceptions="" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.rest.allowNonAuthenticatedUser="true" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.server-roles.cfengine-mission-portal="autodetect" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.server-roles.db="autodetect" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.server-roles.inventory-endpoint="autodetect" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.server-roles.ldap="autodetect" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.server-roles.relay-promises-only="autodetect" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.server-roles.relay-top="autodetect" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.server-roles.web="autodetect" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.server.relay.api="https://localhost/rudder/relay-api" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.syslog.port="514" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.techniqueLibrary.git.refs.path="refs/heads/master" 
[2020-01-16 12:19:56] INFO  application - registered property: rudder.webdav.password=**********
[2020-01-16 12:19:56] INFO  application - registered property: rudder.webdav.user="rudder" 
[2020-01-16 12:19:56] INFO  application - registered property: run.mode="production" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.arch.data.model="64" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.boot.class.path="/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/resources.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jsse.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jce.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/charsets.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jfr.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/classes" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.boot.library.path="/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.cpu.endian="little" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.cpu.isalist="" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.io.unicode.encoding="UnicodeLittle" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.java.command="/opt/rudder/jetty/start.jar OPTIONS=Server jetty.state=/opt/rudder/etc/rudder-jetty-base/rudder-jetty.state jetty-started.xml start-log-file=/var/log/rudder/webapp/java.log" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.java.launcher="SUN_STANDARD" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.jnu.encoding="ANSI_X3.4-1968" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.management.compiler="HotSpot 64-Bit Tiered Compilers" 
[2020-01-16 12:19:56] INFO  application - registered property: sun.os.patch.level="unknown" 
[2020-01-16 12:19:56] INFO  application - registered property: upload.root.directory="/var/rudder/files/" 
[2020-01-16 12:19:56] INFO  application - registered property: user.country="US" 
[2020-01-16 12:19:56] INFO  application - registered property: user.dir="/opt/rudder/etc/rudder-jetty-base" 
[2020-01-16 12:19:56] INFO  application - registered property: user.home="/root" 
[2020-01-16 12:19:56] INFO  application - registered property: user.language="en" 
[2020-01-16 12:19:56] INFO  application - registered property: user.name="root" 
[2020-01-16 12:19:56] INFO  application - registered property: user.timezone="Europe/Paris" 
[2020-01-16 12:19:56] INFO  application - Plugin's license directory: '/opt/rudder/etc/plugins/licenses/'
[2020-01-16 12:19:56] INFO  bootchecks - Check LDAP and PostgreSQL connection
[2020-01-16 12:19:56] INFO  bootchecks - LDAP and PostgreSQL connection are OK
[2020-01-16 12:19:56] INFO  bootchecks - Check mandatory DIT entries
[2020-01-16 12:19:57] INFO  bootchecks - All the required DIT entries are present in the LDAP directory
[2020-01-16 12:19:57] INFO  bootchecks - Check initialization of User Technique Library
[2020-01-16 12:19:57] INFO  bootchecks - Check event log migration format 5 -> 6
[2020-01-16 12:19:57] INFO  bootchecks - Check existence of at least one archive of the configuration
[2020-01-16 12:19:57] INFO  bootchecks - First full archive of configuration-repository items done
[2020-01-16 12:19:57] INFO  bootchecks - Check rules archive directory in configuration-repository
[2020-01-16 12:19:57] INFO  migration - No migration detected by migration script (table 'migrationeventlog' is empty or does not exist)
[2020-01-16 12:19:57] INFO  bootchecks - Creating directory '/var/rudder/configuration-repository/ruleCategories' exists, done
[2020-01-16 12:19:57] INFO  bootchecks - Check that directive variables use the namespace 'rudder'
[2020-01-16 12:19:57] INFO  migration - Migration of inline variables in Directives to 'rudder' namespace already done, skipping
[2020-01-16 12:19:57] INFO  bootchecks - Check for force reload of Techniques library
[2020-01-16 12:19:57] INFO  bootchecks - Flag file '/opt/rudder/etc/force_technique_reload' does not exist, do not Technique library will not be reloaded
[2020-01-16 12:19:57] INFO  bootchecks - Check that system group / directive / rules for Rudder 4.2 are agent-specific
[2020-01-16 12:19:57] INFO  bootchecks - Regenerate all ncf techniques
[2020-01-16 12:19:57] INFO  bootchecks - Resume policy update if it was running before shutdown
[2020-01-16 12:19:57] INFO  bootchecks - Flag file '/opt/rudder/etc/policy-update-running' does not exist, No need to start a new policy update
[2020-01-16 12:19:57] INFO  bootchecks - Trigger policy update if it was requested during shutdown
[2020-01-16 12:19:57] INFO  bootchecks - Create system api token
[2020-01-16 12:19:57] INFO  bootchecks - System api token file created in /var/rudder/run/api-token
[2020-01-16 12:19:57] INFO  bootchecks - Update existing API token to 'RW' autorization level.
[2020-01-16 12:19:57] INFO  bootchecks - Check NashHorn JS engine for warning
2020-01-16 12:19:57.322:INFO:oejshC.rudder:main: Initializing Spring root WebApplicationContext
[2020-01-16 12:19:58] INFO  application - Configured authentication provider(s): [rootAdmin, file]
[2020-01-16 12:19:58] INFO  application - No master admin account is defined. You can define one with 'rudder.auth.admin.login' and 'rudder.auth.admin.password' properties in the configuration file
[2020-01-16 12:19:58] INFO  application - Add backend providers 'Default authentication backends provider: 'file','rootAdmin'
[2020-01-16 12:19:58] INFO  application - Using configuration file defined by JVM property -Drudder.authFile : /opt/rudder/etc/rudder-users.xml
[2020-01-16 12:19:59] INFO  bootstrap.liftweb.Boot - classpath
[2020-01-16 12:19:59] INFO  org.reflections.Reflections - Reflections took 121 ms to scan 121 urls, producing 0 keys and 0 values 
[2020-01-16 12:19:59] INFO  application - Application Rudder started
2020-01-16 12:19:59.946:INFO:oejsh.ContextHandler:main: Started o.e.j.w.WebAppContext@25c5e994{/rudder,file:///var/rudder/tmp/jetty/jetty-rudder.war.dir/webapp/,AVAILABLE}{/rudder.war}
2020-01-16 12:19:59.980:INFO:oejs.AbstractConnector:main: Started ServerConnector@436ccddd{HTTP/1.1,[http/1.1]}{127.0.0.1:8080}
2020-01-16 12:19:59.980:INFO:oejs.Server:main: Started @19049ms
[2020-01-16 12:20:08] INFO  bootchecks - All ncf techniques were updated
[2020-01-16 12:25:10] INFO  inventory-processing - Watch new inventory file 'server-root.ocs' with signature available: process.
[2020-01-16 12:25:12] INFO  inventory-processing - Report 'server-root.ocs' for node 'server.rudder.local' [root] (signature:certified) processed in 1 second and 12 milliseconds ms
[2020-01-16 12:25:26] INFO  scheduledJob - Update in node inventories main information detected: triggering a policy generation
[2020-01-16 12:25:26] INFO  policy.generation - Start policy generation, checking updated rules
[2020-01-16 12:25:26] INFO  policy.generation - [metrics] Xmx:1015 MB nodes:1 (cached:1) rules:5 (enabled:4) techniques:44 (enabled:44) directives:4 (enabled:4) groups:2 (dynamic:2) parameters:1
[2020-01-16 12:25:27] INFO  policy.generation - Configuration of following 1 nodes were updated, their policies are going to be written: [root]
[2020-01-16 12:25:29] INFO  policy.generation - Timing summary:
[2020-01-16 12:25:29] INFO  policy.generation - Run pre-gen scripts hooks     :         36 ms
[2020-01-16 12:25:29] INFO  policy.generation - Run pre-gen modules hooks     :          3 ms
[2020-01-16 12:25:29] INFO  policy.generation - Fetch all information         :        164 ms
[2020-01-16 12:25:29] INFO  policy.generation - Historize names               :        203 ms
[2020-01-16 12:25:29] INFO  policy.generation - Build current rule values     :         34 ms
[2020-01-16 12:25:29] INFO  policy.generation - Build target configuration    :        438 ms
[2020-01-16 12:25:29] INFO  policy.generation - Write node configurations     :       1998 ms
[2020-01-16 12:25:29] INFO  policy.generation - Save expected reports         :         10 ms
[2020-01-16 12:25:29] INFO  policy.generation - Run post generation hooks     :         56 ms
[2020-01-16 12:25:29] INFO  policy.generation - Number of nodes updated       :          1   
[2020-01-16 12:25:29] INFO  policy.generation - Policy generation completed in:        3 s
[2020-01-16 12:25:29] INFO  policy.generation - Flag file '/opt/rudder/etc/policy-update-running' successfully removed
[2020-01-16 12:25:29] INFO  policy.generation - Successful policy update '3' [started 2020-01-16 12:25:26 - ended 2020-01-16 12:25:29]
[2020-01-16 13:19:56] INFO  scheduledJob - Purged 0 unreferenced softwares
2020-01-16 15:05:17.997:INFO:oejshC.endpoint:Scanner-0: Destroying Spring FrameworkServlet 'dispatcher'
2020-01-16 15:05:18.003:INFO:oejsh.ContextHandler:Scanner-0: Stopped o.e.j.w.WebAppContext@5a8e6209{/endpoint,null,UNAVAILABLE}{/endpoint.war}
2020-01-16 15:05:24.110:INFO:oejshC.rudder:Scanner-0: Closing Spring root WebApplicationContext
2020-01-16 15:05:24.169:INFO:oejsh.ContextHandler:Scanner-0: Stopped o.e.j.w.WebAppContext@25c5e994{/rudder,null,UNAVAILABLE}{/rudder.war}
2020-01-16 15:05:25.678:INFO:oejw.StandardDescriptorProcessor:Scanner-0: NO JSP Support for /rudder, did not find org.eclipse.jetty.jsp.JettyJspServlet
Use configuration file defined by JVM property -Dlogback.configurationFile : /opt/rudder/etc/logback.xml
[2020-01-16T15:05:26.225+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further unconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2020-01-16T15:05:26.225+01:00] ERROR FATAL exception in thread 'pool-7-thread-3' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
    at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
    at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
    at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
    at com.normation.rudder.batch.AbstractScheduler$StatusManager.around(AbstractScheduler.scala:112)
    at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
    at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: net.liftweb.actor.ActorLogger$
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:565)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 15 more
2020-01-16 15:05:26.236:INFO:oejs.AbstractConnector:Thread-11: Stopped ServerConnector@436ccddd{HTTP/1.1,[http/1.1]}{127.0.0.1:8080}
2020-01-16 15:05:26.238:INFO:oejs.session:Thread-11: node0 Stopped scavenging
[2020-01-16 15:05:26] INFO  application - Rudder starts with PID 10042 on 1 cores
[2020-01-16 15:05:26] INFO  application - Use configuration file defined by JVM property -Drudder.configFile : /opt/rudder/etc/rudder-web.properties
[2020-01-16 15:05:27] INFO  application - Global exception handler configured to stop Rudder on: java.lang.Error
[2020-01-16 15:05:27] INFO  application - Property 'rudder.batch.delete.software.interval' is missing or empty in rudder.configFile. Default to 24 hours.
[2020-01-16 15:05:27] INFO  application - Starting Rudder 6.0.3-SNAPSHOT web application [build timestamp: 2020-01-16T10:05:21Z]
java.lang.NoClassDefFoundError: ch/qos/logback/classic/spi/ThrowableProxy
    at ch.qos.logback.classic.spi.LoggingEvent.<init>(LoggingEvent.java:119)
    at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:419)
    at ch.qos.logback.classic.Logger.filterAndLog_0_Or3Plus(Logger.java:383)
    at ch.qos.logback.classic.Logger.error(Logger.java:538)
    at net.liftweb.common.Logger.error(Logging.scala:275)
    at net.liftweb.common.Logger.error$(Logging.scala:275)
    at net.liftweb.common.WrappedLogger.error(Logging.scala:285)
    at com.normation.ldap.sdk.LDAPConnectionProvider.withCon(LDAPConnectionProvider.scala:148)
    at com.normation.ldap.sdk.LDAPConnectionProvider.withCon$(LDAPConnectionProvider.scala:143)
    at com.normation.ldap.sdk.ROPooledSimpleAuthConnectionProvider.withCon(LDAPConnectionProvider.scala:379)
    at com.normation.ldap.sdk.LDAPConnectionProvider.map(LDAPConnectionProvider.scala:93)
    at com.normation.ldap.sdk.LDAPConnectionProvider.map$(LDAPConnectionProvider.scala:92)
    at com.normation.ldap.sdk.ROPooledSimpleAuthConnectionProvider.map(LDAPConnectionProvider.scala:379)
    at com.normation.rudder.services.nodes.NodeInfoServiceCachedImpl.checkUpToDate(NodeInfoService.scala:643)
    at com.normation.rudder.services.nodes.NodeInfoServiceCached.isUpToDate(NodeInfoService.scala:225)
    at com.normation.rudder.services.nodes.NodeInfoServiceCached.isUpToDate$(NodeInfoService.scala:223)
    at com.normation.rudder.services.nodes.NodeInfoServiceCachedImpl.isUpToDate(NodeInfoService.scala:567)
    at com.normation.rudder.batch.CheckInventoryUpdate.$anonfun$new$3(CheckInventoryUpdate.scala:70)
    at monix.execution.internal.RunnableAction.run(RunnableAction.scala:25)
    at monix.execution.schedulers.ReferenceScheduler$$anon$1.run(ReferenceScheduler.scala:45)
    at java.util.concurrent.ForkJoinTask$RunnableExecuteAction.exec(ForkJoinTask.java:1402)
    at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
    at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
    at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
    at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157)
Caused by: java.lang.ClassNotFoundException: ch.qos.logback.classic.spi.ThrowableProxy
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:565)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 25 more
[2020-01-16 15:05:30] ERROR com.normation.rudder.repository.ldap.LDAPGitRevisionProvider - Error when trying to read persisted version of the current technique reference library revision to use. Using the last available from Git. Error was: BackendException: An error occured; cause was: java.lang.Error: null 
 -> com.normation.ldap.sdk.PooledConnectionProvider.liftedTree1$1(LDAPConnectionProvider.scala:243)
 -> com.normation.ldap.sdk.PooledConnectionProvider.pool(LDAPConnectionProvider.scala:238)
 -> com.normation.ldap.sdk.PooledConnectionProvider.pool$(LDAPConnectionProvider.scala:238)
[2020-01-16T15:05:34.112+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further inconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2020-01-16T15:05:34.162+01:00] ERROR FATAL exception in thread 'pool-7-thread-5' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
    at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
    at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
    at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
    at net.liftweb.http.SessionMaster$.around(SessionMaster.scala:42)
    at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
    at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
[2020-01-16T15:05:34.308+01:00] ERROR FATAL An error happen during Rudder boot. Rudder will stop now.
java.lang.ExceptionInInitializerError
    at bootstrap.liftweb.LiftInitContextListener.contextInitialized(LiftInitContextListener.scala:127)
    at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:953)
    at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:558)
    at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:918)
    at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:370)
    at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1497)
    at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1459)
    at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:848)
    at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:287)
    at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:545)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
    at org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:46)
    at org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:192)
    at org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:505)
    at org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:151)
    at org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileChanged(ScanningAppProvider.java:198)
    at org.eclipse.jetty.deploy.providers.WebAppProvider.fileChanged(WebAppProvider.java:390)
    at org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileChanged(ScanningAppProvider.java:70)
    at org.eclipse.jetty.util.Scanner.reportChange(Scanner.java:664)
    at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:532)
    at org.eclipse.jetty.util.Scanner.scan(Scanner.java:392)
    at org.eclipse.jetty.util.Scanner$1.run(Scanner.java:329)
    at java.util.TimerThread.mainLoop(Timer.java:555)
    at java.util.TimerThread.run(Timer.java:505)
Caused by: java.lang.RuntimeException: BackendException: An error occured; cause was: java.lang.Error: null 
 -> com.normation.ldap.sdk.PooledConnectionProvider.liftedTree1$1(LDAPConnectionProvider.scala:243)
 -> com.normation.ldap.sdk.PooledConnectionProvider.pool(LDAPConnectionProvider.scala:238)
 -> com.normation.ldap.sdk.PooledConnectionProvider.pool$(LDAPConnectionProvider.scala:238)
    at com.normation.zio$ZioRuntime$.$anonfun$runNow$3(ZioCommons.scala:358)
    at scala.Option.map(Option.scala:230)
    at zio.Cause.squashWith(Cause.scala:277)
    at zio.Cause.squashWith$(Cause.scala:276)
    at zio.Cause$Traced.squashWith(Cause.scala:434)
    at com.normation.zio$ZioRuntime$.$anonfun$runNow$2(ZioCommons.scala:358)
    at zio.Exit.fold(Exit.scala:89)
    at zio.Exit.fold$(Exit.scala:86)
    at zio.Exit$Failure.fold(Exit.scala:224)
    at com.normation.zio$ZioRuntime$.runNow(ZioCommons.scala:358)
    at com.normation.zio$UnsafeRun.runNow(ZioCommons.scala:383)
    at com.normation.cfclerk.services.impl.GitTechniqueReader.<init>(GitTechniqueReader.scala:204)
    at bootstrap.liftweb.RudderConfig$.techniqueReader$lzycompute(RudderConfig.scala:1290)
    at bootstrap.liftweb.RudderConfig$.techniqueReader(RudderConfig.scala:1252)
    at bootstrap.liftweb.RudderConfig$.techniqueRepositoryImpl$lzycompute(RudderConfig.scala:1655)
    at bootstrap.liftweb.RudderConfig$.techniqueRepositoryImpl(RudderConfig.scala:1653)
    at bootstrap.liftweb.RudderConfig$.logRepository$lzycompute(RudderConfig.scala:1242)
    at bootstrap.liftweb.RudderConfig$.logRepository(RudderConfig.scala:1240)
    at bootstrap.liftweb.RudderConfig$.woLdapRuleRepository$lzycompute(RudderConfig.scala:1500)
    at bootstrap.liftweb.RudderConfig$.woLdapRuleRepository(RudderConfig.scala:1495)
    at bootstrap.liftweb.RudderConfig$.<init>(RudderConfig.scala:512)
    at bootstrap.liftweb.RudderConfig$.<clinit>(RudderConfig.scala)
    ... 24 more
Fiber failed.
A checked error was not handled.
BackendException(An error occured,java.lang.Error)

Fiber:1 was supposed to continue to:
  a future continuation at com.normation.errors$IOResult$.effectNonBlocking(ZioCommons.scala:90)
  a future continuation at com.normation.ldap.sdk.LDAPIOResult$.effectNonBlocking(LDAPIOResult.scala:64)
  a future continuation at com.normation.ldap.sdk.LDAPConnectionProvider.flatMap(LDAPConnectionProvider.scala:92)
  a future continuation at com.normation.rudder.repository.ldap.LDAPGitRevisionProvider.currentId(LDAPGitRevisionProvider.scala:79)
  a future continuation at com.normation.cfclerk.services.impl.GitTechniqueReader.currentTechniquesInfoCache(GitTechniqueReader.scala:181)
  a future continuation at zio.ZIO.run(ZIO.scala:1123)
  a future continuation at zio.Semaphore.withPermits(Semaphore.scala:114)
  a future continuation at com.normation.cfclerk.services.impl.GitTechniqueReader.currentTechniquesInfoCache(GitTechniqueReader.scala:204)
  a future continuation at zio.ZIO.run(ZIO.scala:1123)
  a future continuation at zio.ZIO.bracket_(ZIO.scala:144)
  a future continuation at zio.ZIO.run(ZIO.scala:1123)
  a future continuation at zio.ZIO.bracket_(ZIO.scala:144)
  a future continuation at com.normation.zio$ZioRuntime$.runNow(ZioCommons.scala:358)

Fiber:1 execution trace:
  at com.normation.ldap.sdk.RWPooledSimpleAuthConnectionProvider.newConnection(LDAPConnectionProvider.scala:410)
  at com.normation.rudder.repository.ldap.LDAPGitRevisionProvider.currentId(LDAPGitRevisionProvider.scala:77)
  at com.normation.rudder.repository.ldap.LDAPGitRevisionProvider.getAvailableRevTreeId(LDAPGitRevisionProvider.scala:105)
  at com.normation.rudder.repository.ldap.LDAPGitRevisionProvider.getAvailableRevTreeId(LDAPGitRevisionProvider.scala:104)
  at com.normation.errors$IOResult$.effectM(ZioCommons.scala:104)
  at com.normation.rudder.repository.xml.GitFindUtils$.findRevTreeFromRevString(GitFindUtils.scala:135)
  at com.normation.rudder.repository.ldap.LDAPGitRevisionProvider.getAvailableRevTreeId(LDAPGitRevisionProvider.scala:103)
  at com.normation.errors$IOResult$.effect(ZioCommons.scala:96)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:157)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:148)
  at zio.ZIOFunctions.bracketExit(ZIO.scala:1702)
  at zio.internal.FiberContext.evaluateNow(FiberContext.scala:475)
  at zio.ZIO.bracket_(ZIO.scala:144)
  at zio.ZIO.run(ZIO.scala:1123)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:148)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:147)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:157)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:148)
  at zio.ZIO.ensuring(ZIO.scala:320)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:123)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:146)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:107)
  at zio.ZIO.ensuring(ZIO.scala:318)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:148)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:146)
  at zio.ZIO.flatten(ZIO.scala:402)
  at zio.ZIO$ZipLeftFn.apply(ZIO.scala:2673)
  at zio.UIO$.effectSuspendTotal(UIO.scala:183)
  at zio.Fiber.join(Fiber.scala:69)
  at zio.Fiber.join(Fiber.scala:69)
  at zio.internal.FiberContext.await(FiberContext.scala:619)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:145)
  at zio.ZIOFunctions.effectSuspendTotal(ZIO.scala:1943)
  at com.normation.cfclerk.services.impl.GitRepositoryProviderImpl.checkGitRepos(GitUtilsImpl.scala:82)
  at zio.ZIO.bracket_(ZIO.scala:144)
  at zio.internal.FiberContext.evaluateNow(FiberContext.scala:471)
  at com.normation.cfclerk.services.impl.GitRepositoryProviderImpl.db(GitUtilsImpl.scala:97)
  at com.normation.rudder.repository.ldap.LDAPGitRevisionProvider.currentId(LDAPGitRevisionProvider.scala:91)
  at zio.ZIO.unit(ZIO.scala:1408)
  at com.normation.errors$.effectUioUnit(ZioCommons.scala:63)
  at zio.ZIO.unit(ZIO.scala:1408)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:157)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:148)
  at zio.ZIOFunctions.bracketExit(ZIO.scala:1702)
  at zio.internal.FiberContext.evaluateNow(FiberContext.scala:475)
  at zio.ZIO.bracket_(ZIO.scala:144)
  at zio.ZIO.run(ZIO.scala:1123)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:148)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:147)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:157)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:148)
  at zio.ZIO.ensuring(ZIO.scala:320)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:123)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:146)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:107)
  at zio.ZIO.ensuring(ZIO.scala:318)
  at zio.internal.FiberContext$InterruptExit$.apply(FiberContext.scala:148)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:146)
  at zio.ZIO.flatten(ZIO.scala:402)
  at zio.ZIO$ZipLeftFn.apply(ZIO.scala:2673)
  at zio.UIO$.effectSuspendTotal(UIO.scala:183)
  at zio.Fiber.join(Fiber.scala:69)
  at zio.Fiber.join(Fiber.scala:69)
  at zio.internal.FiberContext.await(FiberContext.scala:619)
  at zio.blocking.Blocking$Service.effectBlocking(Blocking.scala:145)
  at zio.ZIOFunctions.effectSuspendTotal(ZIO.scala:1943)
  at com.normation.ZioLogger.logAndForgetResult(ZioCommons.scala:441)
  at zio.ZIO.bracket_(ZIO.scala:144)
  at zio.internal.FiberContext.evaluateNow(FiberContext.scala:471)
  at com.normation.rudder.repository.ldap.LDAPGitRevisionProvider.currentId(LDAPGitRevisionProvider.scala:90)
  at com.normation.ldap.sdk.LDAPIOResult$.effectNonBlocking(LDAPIOResult.scala:64)
  at com.normation.errors$IOResult$.effectNonBlocking(ZioCommons.scala:90)
  at com.normation.ldap.sdk.RWPooledSimpleAuthConnectionProvider.newConnection(LDAPConnectionProvider.scala:410)
  at zio.Semaphore.withPermits(Semaphore.scala:114)
  at zio.Semaphore.withPermits(Semaphore.scala:114)
  at zio.Ref$.modify$extension(Ref.scala:53)
  at zio.Semaphore.prepare(Semaphore.scala:142)
  at zio.Promise$.make(Promise.scala:260)
  at zio.ZIO.bracket_(ZIO.scala:144)
  at zio.internal.FiberContext.lock(FiberContext.scala:543)
  at zio.internal.FiberContext.lock(FiberContext.scala:543)
  at zio.blocking.Blocking$Service.blocking(Blocking.scala:69)
  at zio.blocking.package$.blockingExecutor(blocking.scala:23)
  at zio.ZIO.bracket_(ZIO.scala:144)
  at zio.internal.FiberContext.evaluateNow(FiberContext.scala:471)

Fiber:1 was spawned by: <empty trace>
[2020-01-16T15:05:56.385+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further inconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2020-01-16T15:05:56.385+01:00] ERROR FATAL exception in thread 'pool-7-thread-7' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
    at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
    at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
    at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
    at com.normation.rudder.batch.AutomaticReportsCleaning$LADatabaseCleaner.around(AutomaticReportsCleaner.scala:403)
    at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
    at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
[2020-01-16T15:05:56.386+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further inconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2020-01-16T15:05:56.386+01:00] ERROR FATAL exception in thread 'pool-7-thread-8' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
    at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
    at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
    at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
    at com.normation.rudder.batch.AutomaticReportsCleaning$LADatabaseCleaner.around(AutomaticReportsCleaner.scala:403)
    at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
    at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
[2020-01-16T15:05:59.103+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further inconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2020-01-16T15:05:59.103+01:00] ERROR FATAL exception in thread 'pool-7-thread-11' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
    at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
    at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
    at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
    at com.normation.rudder.batch.AutomaticReportLogger$LAAutomaticReportLogger.around(AutomaticReportLogger.scala:90)
    at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
    at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
[2020-01-16T15:09:55.911+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further inconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2020-01-16T15:09:55.911+01:00] ERROR FATAL exception in thread 'pool-7-thread-13' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
    at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
    at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
    at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
    at com.normation.rudder.batch.UpdateDynamicGroups$LAUpdateDyngroupManager.around(UpdateDynamicGroups.scala:117)
    at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
    at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
[2020-01-16T15:09:56.362+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further inconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2020-01-16T15:09:56.362+01:00] ERROR FATAL exception in thread 'pool-7-thread-15' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
    at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
    at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
    at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
    at com.normation.rudder.batch.CheckTechniqueLibrary$LAUpdateTechLibManager.around(CheckPolicyTemplateLibrary.scala:85)
    at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
    at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

Actions #1

Updated by François ARMAND almost 5 years ago

I'm wondering if it could be a problem with the LDAP connection pool. Some connexions would not be valide anymore (why?), leading to null pointer exception and a restart of LDAP server would change things.

I still don't understand all the NoClassDefFound:

(several times)
'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger
...
java.lang.NoClassDefFoundError: ch/qos/logback/classic/spi/ThrowableProxy

Actions #2

Updated by Vincent MEMBRÉ almost 5 years ago

  • Target version changed from 6.0.3 to 6.0.4
Actions #3

Updated by François ARMAND almost 5 years ago

  • Status changed from New to Rejected

We weren't able to reproduce that, and a lot of correction were done on upgrade. If anybody finds it, please reopen.

Actions

Also available in: Atom PDF