Actions
Bug #16424
closed
After plugin installation the webapp is super long to restart
Pull Request:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
0
Name check:
To do
Fix check:
To do
Regression:
Description
I had a fresh server in 6.0.1-nightly, I installed the aix and api-auth plugins, which need a webapp restart.
I thought the webapp was broken, there were several errors in the logs, but it started itself after some minutes.
This is very strange since everything else is super fluid.
Here is the log dump:
2019-12-17 14:40:31.554:INFO:oejsh.ContextHandler:main: Started o.e.j.w.WebAppContext@451001e5{/rudder,file:///var/rudder/tmp/jetty/jetty-rudder.war.dir/webapp/,AVAILABLE}{/rudder.war}
2019-12-17 14:40:31.585:INFO:oejs.AbstractConnector:main: Started ServerConnector@41bbb219{HTTP/1.1,[http/1.1]}{127.0.0.1:8080}
2019-12-17 14:40:31.585:INFO:oejs.Server:main: Started @15249ms
[2019-12-17 14:40:31+0100] INFO policy.generation - Configuration of following 1 nodes were updated, their policies are going to be written: [root]
[2019-12-17 14:40:34+0100] INFO application.plugin - Plugin 'rudder-plugin-aix' has a license and the license signature is valid.
[2019-12-17 14:40:35+0100] INFO policy.generation - Timing summary:
[2019-12-17 14:40:35+0100] INFO policy.generation - Run pre-gen scripts hooks : 62 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Run pre-gen modules hooks : 2 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Fetch all information : 281 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Historize names : 268 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Build current rule values : 42 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Build target configuration : 1345 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Write node configurations : 3491 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Save expected reports : 10 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Run post generation hooks : 80 ms
[2019-12-17 14:40:35+0100] INFO policy.generation - Number of nodes updated : 1
[2019-12-17 14:40:35+0100] INFO policy.generation - Policy generation succeeded in: 7 s
[2019-12-17 14:40:35+0100] INFO policy.generation - Flag file '/opt/rudder/etc/policy-update-running' successfully removed
[2019-12-17 14:40:35+0100] INFO policy.generation - Successful policy update '4' [started 2019-12-17 14:40:28 - ended 2019-12-17 14:40:35]
[2019-12-17 14:41:05+0100] INFO inventory-processing - Watch new inventory file 'agent-0acb27e4-1a37-42fa-b459-32b44085959b.ocs' with signature available: process.
[2019-12-17 14:41:07+0100] INFO inventory-processing - Report 'agent-0acb27e4-1a37-42fa-b459-32b44085959b.ocs' for node 'agent.rudder.local' [0acb27e4-1a37-42fa-b459-32b44085959b] (signature:certified) processed in 401 milliseconds ms
[2019-12-17 14:47:40+0100] INFO compliance - [metrics] global compliance (number of components): undefined
[2019-12-17 14:48:33+0100] INFO net.liftweb.http.LiftServlet - Request for /rudder/lift/comet/79510238905/F1138047776327VVQZCQ/F1138047776328RZNY2X failed Invalid for read: id=node01iv0gd4a0jutx1e4bzxz9eijgb1 not resident
java.lang.IllegalStateException: Invalid for read: id=node01iv0gd4a0jutx1e4bzxz9eijgb1 not resident
at org.eclipse.jetty.server.session.Session.checkValidForRead(Session.java:637)
at org.eclipse.jetty.server.session.Session.getAttribute(Session.java:657)
at org.springframework.security.web.context.HttpSessionSecurityContextRepository$SaveToSessionResponseWrapper.saveContext(HttpSessionSecurityContextRepository.java:376)
at org.springframework.security.web.context.SaveContextOnUpdateOrErrorResponseWrapper.onResponseCommitted(SaveContextOnUpdateOrErrorResponseWrapper.java:85)
at org.springframework.security.web.util.OnCommittedResponseWrapper.doOnResponseCommitted(OnCommittedResponseWrapper.java:246)
at org.springframework.security.web.util.OnCommittedResponseWrapper.access$000(OnCommittedResponseWrapper.java:34)
at org.springframework.security.web.util.OnCommittedResponseWrapper$SaveContextServletOutputStream.flush(OnCommittedResponseWrapper.java:513)
at org.springframework.security.web.util.OnCommittedResponseWrapper$SaveContextServletOutputStream.flush(OnCommittedResponseWrapper.java:514)
at net.liftweb.http.LiftServlet.sendResponse(LiftServlet.scala:1013)
at net.liftweb.http.LiftServlet.doService(LiftServlet.scala:450)
at net.liftweb.http.LiftServlet.$anonfun$service$2(LiftServlet.scala:162)
at net.liftweb.http.LiftServlet.$anonfun$service$2$adapted(LiftServlet.scala:162)
at net.liftweb.http.StandardServiceTimer$.$anonfun$logTime$1(ServiceRequestTimer.scala:19)
at net.liftweb.util.TimeHelpers.calcTime(TimeHelpers.scala:427)
at net.liftweb.util.TimeHelpers.calcTime$(TimeHelpers.scala:425)
at net.liftweb.util.Helpers$.calcTime(Helpers.scala:34)
at net.liftweb.util.TimeHelpers.logTime(TimeHelpers.scala:446)
at net.liftweb.util.TimeHelpers.logTime$(TimeHelpers.scala:445)
at net.liftweb.util.Helpers$.logTime(Helpers.scala:34)
at net.liftweb.http.StandardServiceTimer$.logTime(ServiceRequestTimer.scala:18)
at net.liftweb.http.LiftServlet.doIt$1(LiftServlet.scala:162)
at net.liftweb.http.LiftServlet.service(LiftServlet.scala:166)
at net.liftweb.http.provider.HTTPProvider.$anonfun$service$7(HTTPProvider.scala:72)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.URLRewriter$.doWith(Req.scala:1357)
at net.liftweb.http.provider.HTTPProvider.$anonfun$service$4(HTTPProvider.scala:71)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.provider.HTTPProvider.$anonfun$service$3(HTTPProvider.scala:70)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.provider.HTTPProvider.service(HTTPProvider.scala:60)
at net.liftweb.http.provider.HTTPProvider.service$(HTTPProvider.scala:55)
at net.liftweb.http.LiftFilter.service(LiftServlet.scala:1063)
at net.liftweb.http.provider.servlet.ServletFilterProvider.$anonfun$doFilter$3(ServletFilterProvider.scala:83)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at net.liftweb.http.provider.servlet.ServletFilterProvider.handleLoan$1(ServletFilterProvider.scala:59)
at net.liftweb.http.provider.servlet.ServletFilterProvider.handleLoanWrappers(ServletFilterProvider.scala:63)
at net.liftweb.http.provider.servlet.ServletFilterProvider.$anonfun$doFilter$2(ServletFilterProvider.scala:82)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$6(Vars.scala:612)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$5(Vars.scala:611)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$4(Vars.scala:611)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$3(Vars.scala:610)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.CoreRequestVarHandler.apply(Vars.scala:609)
at net.liftweb.http.CoreRequestVarHandler.apply$(Vars.scala:592)
at net.liftweb.http.RequestVarHandler$.apply(Vars.scala:508)
at net.liftweb.http.provider.servlet.ServletFilterProvider.$anonfun$doFilter$1(ServletFilterProvider.scala:77)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$6(Vars.scala:612)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$5(Vars.scala:611)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$4(Vars.scala:611)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$3(Vars.scala:610)
at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
at net.liftweb.http.CoreRequestVarHandler.apply(Vars.scala:609)
at net.liftweb.http.CoreRequestVarHandler.apply$(Vars.scala:592)
at net.liftweb.http.TransientRequestVarHandler$.apply(Vars.scala:521)
at net.liftweb.http.provider.servlet.ServletFilterProvider.doFilter(ServletFilterProvider.scala:75)
at net.liftweb.http.provider.servlet.ServletFilterProvider.doFilter$(ServletFilterProvider.scala:69)
at net.liftweb.http.LiftFilter.doFilter(LiftServlet.scala:1063)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:320)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:119)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:74)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:215)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:178)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:357)
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:270)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
at org.eclipse.jetty.server.Server.handle(Server.java:531)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.base/java.lang.Thread.run(Thread.java:844)
2019-12-17 14:48:33.078:WARN:oejs.HttpChannel:qtp22671767-13: /rudder/lift/comet/79510238905/F1138047776327VVQZCQ/F1138047776328RZNY2X
java.lang.IllegalStateException: Invalid for read: id=node01iv0gd4a0jutx1e4bzxz9eijgb1 not resident
at org.eclipse.jetty.server.session.Session.checkValidForRead(Session.java:637)
at org.eclipse.jetty.server.session.Session.getAttribute(Session.java:657)
at org.springframework.security.web.context.HttpSessionSecurityContextRepository$SaveToSessionResponseWrapper.saveContext(HttpSessionSecurityContextRepository.java:376)
at org.springframework.security.web.context.HttpSessionSecurityContextRepository.saveContext(HttpSessionSecurityContextRepository.java:154)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:114)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:215)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:178)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:357)
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:270)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
at org.eclipse.jetty.server.Server.handle(Server.java:531)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
at java.base/java.lang.Thread.run(Thread.java:844)
2019-12-17 14:48:33.125:INFO:oejshC.rudder:Scanner-0: Closing Spring root WebApplicationContext
2019-12-17 14:48:33.170:INFO:oejsh.ContextHandler:Scanner-0: Stopped o.e.j.w.WebAppContext@451001e5{/rudder,null,UNAVAILABLE}{/rudder.war}
2019-12-17 14:48:34.870:INFO:oejw.StandardDescriptorProcessor:Scanner-0: NO JSP Support for /rudder, did not find org.eclipse.jetty.jsp.JettyJspServlet
Use configuration file defined by JVM property -Dlogback.configurationFile : /opt/rudder/etc/logback.xml
[2019-12-17 14:48:35+0100] INFO application - Rudder starts with PID 21788 on 2 cores
[2019-12-17 14:48:35+0100] INFO application - Use configuration file defined by JVM property -Drudder.configFile : /opt/rudder/etc/rudder-web.properties
[2019-12-17T14:48:35.661+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further inconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2019-12-17T14:48:35.661+01:00] ERROR FATAL exception in thread 'pool-6-thread-9' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
at com.normation.rudder.batch.AbstractScheduler$StatusManager.around(AbstractScheduler.scala:113)
at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.ClassNotFoundException: net.liftweb.actor.ActorLogger$
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:466)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:566)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:499)
at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:565)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:499)
... 15 more
2019-12-17 14:48:35.671:INFO:oejs.AbstractConnector:Thread-11: Stopped ServerConnector@41bbb219{HTTP/1.1,[http/1.1]}{127.0.0.1:8080}
2019-12-17 14:48:35.678:INFO:oejs.session:Thread-11: node0 Stopped scavenging
[2019-12-17 14:48:35+0100] INFO application - Global exception handler configured to stop Rudder on: java.lang.Error
[2019-12-17 14:48:35+0100] INFO application - Property 'rudder.batch.delete.software.interval' is missing or empty in rudder.configFile. Default to 24 hours.
[2019-12-17 14:48:35+0100] INFO application - Starting Rudder 6.0.1-SNAPSHOT web application [build timestamp: 2019-12-10T12:03:23Z]
[2019-12-17 14:48:41+0100] INFO report - Disable automatic archive since archive maximum age is older than delete maximum age
[2019-12-17 14:48:42+0100] INFO application - Starting [Store Agent Run Times] scheduler with a period of 5 s
2019-12-17 14:48:42.331:INFO:oejshC.rudder:Scanner-0: Initializing Spring root WebApplicationContext
[2019-12-17 14:48:42+0100] INFO application - List of registered properties:
[2019-12-17 14:48:42+0100] INFO application - registered property: awt.toolkit="sun.awt.X11.XToolkit"
[2019-12-17 14:48:42+0100] INFO application - registered property: com.zaxxer.hikari.pool_number="1"
[2019-12-17 14:48:42+0100] INFO application - registered property: content.types.user.table="/var/rudder/tmp/jetty/jetty-rudder.war.dir/webapp/WEB-INF/classes/content-types.properties"
[2019-12-17 14:48:42+0100] INFO application - registered property: file.encoding.pkg="sun.io"
[2019-12-17 14:48:42+0100] INFO application - registered property: file.separator="/"
[2019-12-17 14:48:42+0100] INFO application - registered property: history.inventories.rootdir="/var/rudder/inventories/historical"
[2019-12-17 14:48:42+0100] INFO application - registered property: inventories.root.directory="/var/rudder/inventories"
[2019-12-17 14:48:42+0100] INFO application - registered property: inventories.watcher.enable="true"
[2019-12-17 14:48:42+0100] INFO application - registered property: inventories.watcher.waitForSignatureDuration="10"
[2019-12-17 14:48:42+0100] INFO application - registered property: inventory.parse.parallelization="0.5x"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.awt.graphicsenv="sun.awt.X11GraphicsEnvironment"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.awt.headless="true"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.awt.printerjob="sun.print.PSPrinterJob"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.class.path="/opt/rudder/jetty/start.jar"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.class.version="54.0"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.home="/usr/lib64/jvm/java-10-openjdk-10"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.io.tmpdir="/var/rudder/tmp/jetty"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.library.path="/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.runtime.name="OpenJDK Runtime Environment"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.runtime.version="10.0.1+10-suse-1.30-x8664"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.specification.name="Java Platform API Specification"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.specification.vendor="Oracle Corporation"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.specification.version="10"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vendor.url.bug="http://bugreport.java.com/bugreport/"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.version.date="2018-04-17"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vm.compressedOopsMode="32-bit"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vm.info="mixed mode"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vm.name="OpenJDK 64-Bit Server VM"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vm.specification.name="Java Virtual Machine Specification"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vm.specification.vendor="Oracle Corporation"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vm.specification.version="10"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vm.vendor="Oracle Corporation"
[2019-12-17 14:48:42+0100] INFO application - registered property: java.vm.version="10.0.1+10-suse-1.30-x8664"
[2019-12-17 14:48:42+0100] INFO application - registered property: jdk.debug="release"
[2019-12-17 14:48:42+0100] INFO application - registered property: jetty.base="/opt/rudder/etc/rudder-jetty-base"
[2019-12-17 14:48:42+0100] INFO application - registered property: jetty.git.hash="d5fc0523cfa96bfebfbda19606cad384d772f04c"
[2019-12-17 14:48:42+0100] INFO application - registered property: jetty.home="/opt/rudder/jetty"
[2019-12-17 14:48:42+0100] INFO application - registered property: jetty.tag.version="master"
[2019-12-17 14:48:42+0100] INFO application - registered property: jetty.version="9.4.11.v20180605"
[2019-12-17 14:48:42+0100] INFO application - registered property: jna.loaded="true"
[2019-12-17 14:48:42+0100] INFO application - registered property: jna.platform.library.path="/usr/lib64:/lib64:/usr/lib:/lib"
[2019-12-17 14:48:42+0100] INFO application - registered property: jnidispatch.path="/var/rudder/tmp/jetty/jna-3506402/jna11868617978922040481.tmp"
[2019-12-17 14:48:42+0100] INFO application - registered property: ldap.authdn="cn=manager,cn=rudder-configuration"
[2019-12-17 14:48:42+0100] INFO application - registered property: ldap.authpw=**********
[2019-12-17 14:48:42+0100] INFO application - registered property: ldap.host="localhost"
[2019-12-17 14:48:42+0100] INFO application - registered property: ldap.maxPoolSize="2"
[2019-12-17 14:48:42+0100] INFO application - registered property: ldap.port="389"
[2019-12-17 14:48:42+0100] INFO application - registered property: ldif.tracelog.rootdir="/var/rudder/inventories/debug"
[2019-12-17 14:48:42+0100] INFO application - registered property: line.separator="\n"
[2019-12-17 14:48:42+0100] INFO application - registered property: logback.configurationFile="/opt/rudder/etc/logback.xml"
[2019-12-17 14:48:42+0100] INFO application - registered property: os.arch="amd64"
[2019-12-17 14:48:42+0100] INFO application - registered property: os.name="Linux"
[2019-12-17 14:48:42+0100] INFO application - registered property: os.version="4.12.14-23-default"
[2019-12-17 14:48:42+0100] INFO application - registered property: path.separator=":"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.auth.provider="file"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.authFile="/opt/rudder/etc/rudder-users.xml"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.autoArchiveItems="true"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.databasecleaner.runtime.day="sunday"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.databasecleaner.runtime.hour="0"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.databasecleaner.runtime.minute="0"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.dyngroup.updateInterval="5"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.purge.inventories.delete.TTL="7"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.purge.inventories.delete.interval="24"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.reports.logInterval="1"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.reportsCleaner.deleteLogReport.TTL="2x"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.reportscleaner.archive.TTL="4"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.reportscleaner.compliancelevels.delete.TTL="8"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.reportscleaner.delete.TTL="4"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.reportscleaner.frequency="daily"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.storeAgentRunTimes.maxBatchSize="5"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.storeAgentRunTimes.maxDays="0"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.storeAgentRunTimes.maxMinutes="30"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.storeAgentRunTimes.updateInterval="5"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.batch.techniqueLibrary.updateInterval="5"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.community.port="5309"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.configFile="/opt/rudder/etc/rudder-web.properties"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.debug.nodeconfiguration.path="/var/log/rudder/nodeConfigurations"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.dir.backup="/var/rudder/share/backup/"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.dir.dependencies="/var/rudder/tools"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.dir.gitRoot="/var/rudder/configuration-repository"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.dir.lock="/var/rudder/lock/"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.dir.shared.files.folder="/var/rudder/configuration-repository/shared-files"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.endpoint.cmdb="http://localhost:8080/endpoint/upload/"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.hooks.ignore-suffixes=".swp, ~, .bak, .cfnew , .cfsaved , .cfedited, .cfdisabled, .cfmoved,.dpkg-old, .dpkg-dist, .dpkg-new, .dpkg-tmp,.disable , .disabled , _disable , _disabled,.ucf-old , .ucf-dist , .ucf-new ,.rpmnew , .rpmsave , .rpmorig"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.jdbc.batch.max.size="500"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.jdbc.driver="org.postgresql.Driver"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.jdbc.maxPoolSize="25"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.jdbc.password=**********
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.jdbc.url="jdbc:postgresql://localhost:5432/rudder"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.jdbc.username="rudder"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.jvm.fatal.exceptions=""
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.relayd.reload="/opt/rudder/bin/rudder relay reload -p"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.rest.allowNonAuthenticatedUser="true"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.server-roles.cfengine-mission-portal="autodetect"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.server-roles.db="autodetect"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.server-roles.inventory-endpoint="autodetect"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.server-roles.ldap="autodetect"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.server-roles.relay-promises-only="autodetect"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.server-roles.relay-top="autodetect"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.server-roles.web="autodetect"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.server.relay.api="https://localhost/rudder/relay-api"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.syslog.port="514"
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.webdav.password=**********
[2019-12-17 14:48:42+0100] INFO application - registered property: rudder.webdav.user="rudder"
[2019-12-17 14:48:42+0100] INFO application - registered property: run.mode="production"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.arch.data.model="64"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.boot.library.path="/usr/lib64/jvm/java-10-openjdk-10/lib"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.cpu.endian="little"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.cpu.isalist=""
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.io.unicode.encoding="UnicodeLittle"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.java.command="/opt/rudder/jetty/start.jar OPTIONS=Server jetty.state=/opt/rudder/etc/rudder-jetty-base/rudder-jetty.state jetty-started.xml"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.java.launcher="SUN_STANDARD"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.jnu.encoding="ANSI_X3.4-1968"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.management.compiler="HotSpot 64-Bit Tiered Compilers"
[2019-12-17 14:48:42+0100] INFO application - registered property: sun.os.patch.level="unknown"
[2019-12-17 14:48:42+0100] INFO application - registered property: user.country="US"
[2019-12-17 14:48:42+0100] INFO application - registered property: user.dir="/opt/rudder/etc/rudder-jetty-base"
[2019-12-17 14:48:42+0100] INFO application - registered property: user.home="/root"
[2019-12-17 14:48:42+0100] INFO application - registered property: user.language="en"
[2019-12-17 14:48:42+0100] INFO application - registered property: user.name="root"
[2019-12-17 14:48:42+0100] INFO application - registered property: user.timezone="Europe/Paris"
[2019-12-17 14:48:42+0100] INFO application - registered property: waiting.inventory.queue.size="50"
[2019-12-17 14:48:42+0100] INFO application - Plugin's license directory: '/opt/rudder/etc/plugins/licenses/'
[2019-12-17 14:48:42+0100] INFO bootchecks - Check LDAP and PostgreSQL connection
[2019-12-17 14:48:42+0100] INFO bootchecks - LDAP and PostgreSQL connection are OK
[2019-12-17 14:48:42+0100] INFO bootchecks - Check mandatory DIT entries
[2019-12-17 14:48:42+0100] INFO bootchecks - All the required DIT entries are present in the LDAP directory
[2019-12-17 14:48:42+0100] INFO bootchecks - Check initialization of User Technique Library
[2019-12-17 14:48:42+0100] INFO bootchecks - Check event log migration format 5 -> 6
[2019-12-17 14:48:42+0100] INFO bootchecks - Check existence of at least one archive of the configuration
[2019-12-17 14:48:42+0100] INFO migration - No migration detected by migration script (table 'migrationeventlog' is empty or does not exist)
[2019-12-17 14:48:42+0100] INFO bootchecks - First full archive of configuration-repository items done
[2019-12-17 14:48:42+0100] INFO bootchecks - Check rules archive directory in configuration-repository
[2019-12-17 14:48:42+0100] INFO bootchecks - Creating directory '/var/rudder/configuration-repository/ruleCategories' exists, done
[2019-12-17 14:48:42+0100] INFO bootchecks - Check for force reload of Techniques library
[2019-12-17 14:48:42+0100] INFO bootchecks - Flag file '/opt/rudder/etc/force_technique_reload' does not exist, do not Technique library will not be reloaded
[2019-12-17 14:48:42+0100] INFO bootchecks - Check that system group / directive / rules for Rudder 4.2 are agent-specific
[2019-12-17 14:48:42+0100] INFO bootchecks - Regenerate all ncf techniques
[2019-12-17 14:48:43+0100] INFO bootchecks - Flag file '/opt/rudder/etc/force_ncf_technique_update' does not exist, do not regenerate ncf Techniques
[2019-12-17 14:48:43+0100] INFO bootchecks - Resume policy update if it was running before shutdown
[2019-12-17 14:48:43+0100] INFO bootchecks - Flag file '/opt/rudder/etc/policy-update-running' does not exist, No need to start a new policy update
[2019-12-17 14:48:43+0100] INFO bootchecks - Trigger policy update if it was requested during shutdown
[2019-12-17 14:48:43+0100] INFO bootchecks - Create system api token
[2019-12-17 14:48:43+0100] INFO bootchecks - System api token file created in /var/rudder/run/api-token
[2019-12-17 14:48:43+0100] INFO bootchecks - Update existing API token to 'RW' autorization level.
[2019-12-17 14:48:43+0100] INFO bootchecks - Check NashHorn JS engine for warning
[2019-12-17 14:48:43+0100] INFO application - Configured authentication provider(s): [rootAdmin, file]
[2019-12-17 14:48:43+0100] INFO application - No master admin account is defined. You can define one with 'rudder.auth.admin.login' and 'rudder.auth.admin.password' properties in the configuration file
[2019-12-17 14:48:43+0100] INFO application - Add backend providers 'Default authentication backends provider: 'file','rootAdmin'
[2019-12-17 14:48:43+0100] INFO application - Using configuration file defined by JVM property -Drudder.authFile : /opt/rudder/etc/rudder-users.xml
[2019-12-17 14:48:44+0100] INFO bootstrap.liftweb.Boot - classpath
[2019-12-17 14:48:44+0100] INFO org.reflections.Reflections - Reflections took 59 ms to scan 2 urls, producing 3 keys and 6 values
[2019-12-17 14:48:44+0100] INFO api-processing - Update API authorization level to 'Fine grained API authorizations with ACLs'
[2019-12-17 14:48:44+0100] INFO application.plugin - Initializing plugin 'rudder-plugin-api-authorizations': 6.0-1.5.0
INFO Configure inventory processing with parallelism of '1' and queue size of '50'
[2019-12-17 14:48:45+0100] INFO inventory-processing - Incoming inventory watcher started - process existing inventories
[2019-12-17 14:48:45+0100] INFO application.plugin - Initializing plugin 'rudder-plugin-aix': 6.0-1.4.0
[2019-12-17 14:48:45+0100] INFO application.plugin - Initializing plugin 'rudder-plugin-vault': 6.0-1.1.0
[2019-12-17 14:48:45+0100] INFO application - Application Rudder started
2019-12-17 14:48:45.370:INFO:oejsh.ContextHandler:Scanner-0: Started o.e.j.w.WebAppContext@6f26b9b6{/rudder,file:///var/rudder/tmp/jetty/jetty-rudder.war.dir/webapp/,AVAILABLE}{/rudder.war}
2019-12-17 14:48:45.389:INFO:oejshC.rudder:Thread-11: Closing Spring root WebApplicationContext
2019-12-17 14:48:45.473:INFO:oejsh.ContextHandler:Thread-11: Stopped o.e.j.w.WebAppContext@6f26b9b6{/rudder,null,UNAVAILABLE}{/rudder.war}
Updated by François ARMAND over 4 years ago
- Is duplicate of Bug #12911: During upgrade, jetty doesn't seems to always restart correctly added
Updated by François ARMAND over 4 years ago
- Status changed from New to Rejected
Closing as duplicate of: https://issues.rudder.io/issues/12911
Actions