Project

General

Profile

Actions

Bug #16424

closed

After plugin installation the webapp is super long to restart

Added by Félix DALLIDET about 5 years ago. Updated about 5 years ago.

Status:
Rejected
Priority:
N/A
Assignee:
-
Category:
Server components
Target version:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
0
Name check:
To do
Fix check:
To do
Regression:

Description

I had a fresh server in 6.0.1-nightly, I installed the aix and api-auth plugins, which need a webapp restart.
I thought the webapp was broken, there were several errors in the logs, but it started itself after some minutes.
This is very strange since everything else is super fluid.

Here is the log dump:

2019-12-17 14:40:31.554:INFO:oejsh.ContextHandler:main: Started o.e.j.w.WebAppContext@451001e5{/rudder,file:///var/rudder/tmp/jetty/jetty-rudder.war.dir/webapp/,AVAILABLE}{/rudder.war}
2019-12-17 14:40:31.585:INFO:oejs.AbstractConnector:main: Started ServerConnector@41bbb219{HTTP/1.1,[http/1.1]}{127.0.0.1:8080}
2019-12-17 14:40:31.585:INFO:oejs.Server:main: Started @15249ms
[2019-12-17 14:40:31+0100] INFO  policy.generation - Configuration of following 1 nodes were updated, their policies are going to be written: [root]
[2019-12-17 14:40:34+0100] INFO  application.plugin - Plugin 'rudder-plugin-aix' has a license and the license signature is valid.
[2019-12-17 14:40:35+0100] INFO  policy.generation - Timing summary:
[2019-12-17 14:40:35+0100] INFO  policy.generation - Run pre-gen scripts hooks     :         62 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Run pre-gen modules hooks     :          2 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Fetch all information         :        281 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Historize names               :        268 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Build current rule values     :         42 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Build target configuration    :       1345 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Write node configurations     :       3491 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Save expected reports         :         10 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Run post generation hooks     :         80 ms
[2019-12-17 14:40:35+0100] INFO  policy.generation - Number of nodes updated       :          1   
[2019-12-17 14:40:35+0100] INFO  policy.generation - Policy generation succeeded in:        7 s
[2019-12-17 14:40:35+0100] INFO  policy.generation - Flag file '/opt/rudder/etc/policy-update-running' successfully removed
[2019-12-17 14:40:35+0100] INFO  policy.generation - Successful policy update '4' [started 2019-12-17 14:40:28 - ended 2019-12-17 14:40:35]
[2019-12-17 14:41:05+0100] INFO  inventory-processing - Watch new inventory file 'agent-0acb27e4-1a37-42fa-b459-32b44085959b.ocs' with signature available: process.
[2019-12-17 14:41:07+0100] INFO  inventory-processing - Report 'agent-0acb27e4-1a37-42fa-b459-32b44085959b.ocs' for node 'agent.rudder.local' [0acb27e4-1a37-42fa-b459-32b44085959b] (signature:certified) processed in 401 milliseconds ms
[2019-12-17 14:47:40+0100] INFO  compliance - [metrics] global compliance (number of components): undefined
[2019-12-17 14:48:33+0100] INFO  net.liftweb.http.LiftServlet - Request for /rudder/lift/comet/79510238905/F1138047776327VVQZCQ/F1138047776328RZNY2X failed Invalid for read: id=node01iv0gd4a0jutx1e4bzxz9eijgb1 not resident
java.lang.IllegalStateException: Invalid for read: id=node01iv0gd4a0jutx1e4bzxz9eijgb1 not resident
    at org.eclipse.jetty.server.session.Session.checkValidForRead(Session.java:637)
    at org.eclipse.jetty.server.session.Session.getAttribute(Session.java:657)
    at org.springframework.security.web.context.HttpSessionSecurityContextRepository$SaveToSessionResponseWrapper.saveContext(HttpSessionSecurityContextRepository.java:376)
    at org.springframework.security.web.context.SaveContextOnUpdateOrErrorResponseWrapper.onResponseCommitted(SaveContextOnUpdateOrErrorResponseWrapper.java:85)
    at org.springframework.security.web.util.OnCommittedResponseWrapper.doOnResponseCommitted(OnCommittedResponseWrapper.java:246)
    at org.springframework.security.web.util.OnCommittedResponseWrapper.access$000(OnCommittedResponseWrapper.java:34)
    at org.springframework.security.web.util.OnCommittedResponseWrapper$SaveContextServletOutputStream.flush(OnCommittedResponseWrapper.java:513)
    at org.springframework.security.web.util.OnCommittedResponseWrapper$SaveContextServletOutputStream.flush(OnCommittedResponseWrapper.java:514)
    at net.liftweb.http.LiftServlet.sendResponse(LiftServlet.scala:1013)
    at net.liftweb.http.LiftServlet.doService(LiftServlet.scala:450)
    at net.liftweb.http.LiftServlet.$anonfun$service$2(LiftServlet.scala:162)
    at net.liftweb.http.LiftServlet.$anonfun$service$2$adapted(LiftServlet.scala:162)
    at net.liftweb.http.StandardServiceTimer$.$anonfun$logTime$1(ServiceRequestTimer.scala:19)
    at net.liftweb.util.TimeHelpers.calcTime(TimeHelpers.scala:427)
    at net.liftweb.util.TimeHelpers.calcTime$(TimeHelpers.scala:425)
    at net.liftweb.util.Helpers$.calcTime(Helpers.scala:34)
    at net.liftweb.util.TimeHelpers.logTime(TimeHelpers.scala:446)
    at net.liftweb.util.TimeHelpers.logTime$(TimeHelpers.scala:445)
    at net.liftweb.util.Helpers$.logTime(Helpers.scala:34)
    at net.liftweb.http.StandardServiceTimer$.logTime(ServiceRequestTimer.scala:18)
    at net.liftweb.http.LiftServlet.doIt$1(LiftServlet.scala:162)
    at net.liftweb.http.LiftServlet.service(LiftServlet.scala:166)
    at net.liftweb.http.provider.HTTPProvider.$anonfun$service$7(HTTPProvider.scala:72)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.URLRewriter$.doWith(Req.scala:1357)
    at net.liftweb.http.provider.HTTPProvider.$anonfun$service$4(HTTPProvider.scala:71)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.provider.HTTPProvider.$anonfun$service$3(HTTPProvider.scala:70)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.provider.HTTPProvider.service(HTTPProvider.scala:60)
    at net.liftweb.http.provider.HTTPProvider.service$(HTTPProvider.scala:55)
    at net.liftweb.http.LiftFilter.service(LiftServlet.scala:1063)
    at net.liftweb.http.provider.servlet.ServletFilterProvider.$anonfun$doFilter$3(ServletFilterProvider.scala:83)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.http.provider.servlet.ServletFilterProvider.handleLoan$1(ServletFilterProvider.scala:59)
    at net.liftweb.http.provider.servlet.ServletFilterProvider.handleLoanWrappers(ServletFilterProvider.scala:63)
    at net.liftweb.http.provider.servlet.ServletFilterProvider.$anonfun$doFilter$2(ServletFilterProvider.scala:82)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$6(Vars.scala:612)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$5(Vars.scala:611)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$4(Vars.scala:611)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$3(Vars.scala:610)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.CoreRequestVarHandler.apply(Vars.scala:609)
    at net.liftweb.http.CoreRequestVarHandler.apply$(Vars.scala:592)
    at net.liftweb.http.RequestVarHandler$.apply(Vars.scala:508)
    at net.liftweb.http.provider.servlet.ServletFilterProvider.$anonfun$doFilter$1(ServletFilterProvider.scala:77)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$6(Vars.scala:612)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$5(Vars.scala:611)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$4(Vars.scala:611)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.CoreRequestVarHandler.$anonfun$apply$3(Vars.scala:610)
    at net.liftweb.util.ThreadGlobal.doWith(ThreadGlobal.scala:71)
    at net.liftweb.http.CoreRequestVarHandler.apply(Vars.scala:609)
    at net.liftweb.http.CoreRequestVarHandler.apply$(Vars.scala:592)
    at net.liftweb.http.TransientRequestVarHandler$.apply(Vars.scala:521)
    at net.liftweb.http.provider.servlet.ServletFilterProvider.doFilter(ServletFilterProvider.scala:75)
    at net.liftweb.http.provider.servlet.ServletFilterProvider.doFilter$(ServletFilterProvider.scala:69)
    at net.liftweb.http.LiftFilter.doFilter(LiftServlet.scala:1063)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:320)
    at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
    at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:119)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:74)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:215)
    at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:178)
    at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:357)
    at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:270)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
    at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
    at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
    at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
    at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
    at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
    at org.eclipse.jetty.server.Server.handle(Server.java:531)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
    at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
    at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
    at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
    at java.base/java.lang.Thread.run(Thread.java:844)
2019-12-17 14:48:33.078:WARN:oejs.HttpChannel:qtp22671767-13: /rudder/lift/comet/79510238905/F1138047776327VVQZCQ/F1138047776328RZNY2X
java.lang.IllegalStateException: Invalid for read: id=node01iv0gd4a0jutx1e4bzxz9eijgb1 not resident
    at org.eclipse.jetty.server.session.Session.checkValidForRead(Session.java:637)
    at org.eclipse.jetty.server.session.Session.getAttribute(Session.java:657)
    at org.springframework.security.web.context.HttpSessionSecurityContextRepository$SaveToSessionResponseWrapper.saveContext(HttpSessionSecurityContextRepository.java:376)
    at org.springframework.security.web.context.HttpSessionSecurityContextRepository.saveContext(HttpSessionSecurityContextRepository.java:154)
    at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:114)
    at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334)
    at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:215)
    at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:178)
    at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:357)
    at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:270)
    at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
    at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
    at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
    at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
    at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
    at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
    at org.eclipse.jetty.server.Server.handle(Server.java:531)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
    at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
    at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
    at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
    at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
    at java.base/java.lang.Thread.run(Thread.java:844)
2019-12-17 14:48:33.125:INFO:oejshC.rudder:Scanner-0: Closing Spring root WebApplicationContext
2019-12-17 14:48:33.170:INFO:oejsh.ContextHandler:Scanner-0: Stopped o.e.j.w.WebAppContext@451001e5{/rudder,null,UNAVAILABLE}{/rudder.war}
2019-12-17 14:48:34.870:INFO:oejw.StandardDescriptorProcessor:Scanner-0: NO JSP Support for /rudder, did not find org.eclipse.jetty.jsp.JettyJspServlet
Use configuration file defined by JVM property -Dlogback.configurationFile : /opt/rudder/etc/logback.xml
[2019-12-17 14:48:35+0100] INFO  application - Rudder starts with PID 21788 on 2 cores
[2019-12-17 14:48:35+0100] INFO  application - Use configuration file defined by JVM property -Drudder.configFile : /opt/rudder/etc/rudder-web.properties
[2019-12-17T14:48:35.661+01:00] ERROR FATAL Rudder JVM caught an unhandled fatal exception. Rudder will now stop to prevent further inconsistant behavior. This is likely a bug, please contact Rudder developers. You can configure the list of fatal exception in /opt/rudder/etc/rudder-web.properties -> rudder.jvm.fatal.exceptions
[2019-12-17T14:48:35.661+01:00] ERROR FATAL exception in thread 'pool-6-thread-9' (in threadgroup 'main'): 'java.lang.NoClassDefFoundError': 'net/liftweb/actor/ActorLogger$'
java.lang.NoClassDefFoundError: net/liftweb/actor/ActorLogger$
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:345)
    at net.liftweb.actor.SpecializedLiftActor$$anonfun$exceptionHandler$1.applyOrElse(LiftActor.scala:344)
    at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
    at net.liftweb.actor.SpecializedLiftActor.proc2(LiftActor.scala:324)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$processMailbox$1(LiftActor.scala:226)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at net.liftweb.actor.SpecializedLiftActor.around(LiftActor.scala:240)
    at net.liftweb.actor.SpecializedLiftActor.around$(LiftActor.scala:239)
    at com.normation.rudder.batch.AbstractScheduler$StatusManager.around(AbstractScheduler.scala:113)
    at net.liftweb.actor.SpecializedLiftActor.processMailbox(LiftActor.scala:226)
    at net.liftweb.actor.SpecializedLiftActor.$anonfun$$bang$3(LiftActor.scala:189)
    at net.liftweb.actor.LAScheduler$$anon$2$$anon$3.run(LiftActor.scala:76)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.ClassNotFoundException: net.liftweb.actor.ActorLogger$
    at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:466)
    at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:566)
    at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:499)
    at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:565)
    at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:499)
    ... 15 more
2019-12-17 14:48:35.671:INFO:oejs.AbstractConnector:Thread-11: Stopped ServerConnector@41bbb219{HTTP/1.1,[http/1.1]}{127.0.0.1:8080}
2019-12-17 14:48:35.678:INFO:oejs.session:Thread-11: node0 Stopped scavenging
[2019-12-17 14:48:35+0100] INFO  application - Global exception handler configured to stop Rudder on: java.lang.Error
[2019-12-17 14:48:35+0100] INFO  application - Property 'rudder.batch.delete.software.interval' is missing or empty in rudder.configFile. Default to 24 hours.
[2019-12-17 14:48:35+0100] INFO  application - Starting Rudder 6.0.1-SNAPSHOT web application [build timestamp: 2019-12-10T12:03:23Z]
[2019-12-17 14:48:41+0100] INFO  report - Disable automatic archive since archive maximum age is older than delete maximum age
[2019-12-17 14:48:42+0100] INFO  application - Starting [Store Agent Run Times] scheduler with a period of 5 s
2019-12-17 14:48:42.331:INFO:oejshC.rudder:Scanner-0: Initializing Spring root WebApplicationContext
[2019-12-17 14:48:42+0100] INFO  application - List of registered properties:
[2019-12-17 14:48:42+0100] INFO  application - registered property: awt.toolkit="sun.awt.X11.XToolkit" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: com.zaxxer.hikari.pool_number="1" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: content.types.user.table="/var/rudder/tmp/jetty/jetty-rudder.war.dir/webapp/WEB-INF/classes/content-types.properties" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: file.encoding.pkg="sun.io" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: file.separator="/" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: history.inventories.rootdir="/var/rudder/inventories/historical" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: inventories.root.directory="/var/rudder/inventories" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: inventories.watcher.enable="true" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: inventories.watcher.waitForSignatureDuration="10" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: inventory.parse.parallelization="0.5x" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.awt.graphicsenv="sun.awt.X11GraphicsEnvironment" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.awt.headless="true" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.awt.printerjob="sun.print.PSPrinterJob" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.class.path="/opt/rudder/jetty/start.jar" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.class.version="54.0" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.home="/usr/lib64/jvm/java-10-openjdk-10" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.io.tmpdir="/var/rudder/tmp/jetty" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.library.path="/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.runtime.name="OpenJDK Runtime Environment" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.runtime.version="10.0.1+10-suse-1.30-x8664" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.specification.name="Java Platform API Specification" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.specification.vendor="Oracle Corporation" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.specification.version="10" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vendor.url.bug="http://bugreport.java.com/bugreport/" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.version.date="2018-04-17" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vm.compressedOopsMode="32-bit" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vm.info="mixed mode" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vm.name="OpenJDK 64-Bit Server VM" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vm.specification.name="Java Virtual Machine Specification" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vm.specification.vendor="Oracle Corporation" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vm.specification.version="10" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vm.vendor="Oracle Corporation" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: java.vm.version="10.0.1+10-suse-1.30-x8664" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jdk.debug="release" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jetty.base="/opt/rudder/etc/rudder-jetty-base" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jetty.git.hash="d5fc0523cfa96bfebfbda19606cad384d772f04c" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jetty.home="/opt/rudder/jetty" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jetty.tag.version="master" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jetty.version="9.4.11.v20180605" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jna.loaded="true" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jna.platform.library.path="/usr/lib64:/lib64:/usr/lib:/lib" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: jnidispatch.path="/var/rudder/tmp/jetty/jna-3506402/jna11868617978922040481.tmp" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: ldap.authdn="cn=manager,cn=rudder-configuration" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: ldap.authpw=**********
[2019-12-17 14:48:42+0100] INFO  application - registered property: ldap.host="localhost" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: ldap.maxPoolSize="2" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: ldap.port="389" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: ldif.tracelog.rootdir="/var/rudder/inventories/debug" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: line.separator="\n" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: logback.configurationFile="/opt/rudder/etc/logback.xml" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: os.arch="amd64" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: os.name="Linux" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: os.version="4.12.14-23-default" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: path.separator=":" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.auth.provider="file" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.authFile="/opt/rudder/etc/rudder-users.xml" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.autoArchiveItems="true" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.databasecleaner.runtime.day="sunday" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.databasecleaner.runtime.hour="0" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.databasecleaner.runtime.minute="0" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.dyngroup.updateInterval="5" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.purge.inventories.delete.TTL="7" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.purge.inventories.delete.interval="24" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.reports.logInterval="1" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.reportsCleaner.deleteLogReport.TTL="2x" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.reportscleaner.archive.TTL="4" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.reportscleaner.compliancelevels.delete.TTL="8" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.reportscleaner.delete.TTL="4" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.reportscleaner.frequency="daily" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.storeAgentRunTimes.maxBatchSize="5" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.storeAgentRunTimes.maxDays="0" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.storeAgentRunTimes.maxMinutes="30" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.storeAgentRunTimes.updateInterval="5" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.batch.techniqueLibrary.updateInterval="5" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.community.port="5309" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.configFile="/opt/rudder/etc/rudder-web.properties" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.debug.nodeconfiguration.path="/var/log/rudder/nodeConfigurations" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.dir.backup="/var/rudder/share/backup/" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.dir.dependencies="/var/rudder/tools" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.dir.gitRoot="/var/rudder/configuration-repository" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.dir.lock="/var/rudder/lock/" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.dir.shared.files.folder="/var/rudder/configuration-repository/shared-files" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.endpoint.cmdb="http://localhost:8080/endpoint/upload/" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.hooks.ignore-suffixes=".swp, ~, .bak, .cfnew   , .cfsaved  , .cfedited, .cfdisabled, .cfmoved,.dpkg-old, .dpkg-dist, .dpkg-new, .dpkg-tmp,.disable , .disabled , _disable , _disabled,.ucf-old , .ucf-dist , .ucf-new ,.rpmnew  , .rpmsave  , .rpmorig" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.jdbc.batch.max.size="500" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.jdbc.driver="org.postgresql.Driver" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.jdbc.maxPoolSize="25" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.jdbc.password=**********
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.jdbc.url="jdbc:postgresql://localhost:5432/rudder" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.jdbc.username="rudder" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.jvm.fatal.exceptions="" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.relayd.reload="/opt/rudder/bin/rudder relay reload -p" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.rest.allowNonAuthenticatedUser="true" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.server-roles.cfengine-mission-portal="autodetect" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.server-roles.db="autodetect" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.server-roles.inventory-endpoint="autodetect" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.server-roles.ldap="autodetect" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.server-roles.relay-promises-only="autodetect" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.server-roles.relay-top="autodetect" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.server-roles.web="autodetect" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.server.relay.api="https://localhost/rudder/relay-api" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.syslog.port="514" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.webdav.password=**********
[2019-12-17 14:48:42+0100] INFO  application - registered property: rudder.webdav.user="rudder" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: run.mode="production" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.arch.data.model="64" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.boot.library.path="/usr/lib64/jvm/java-10-openjdk-10/lib" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.cpu.endian="little" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.cpu.isalist="" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.io.unicode.encoding="UnicodeLittle" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.java.command="/opt/rudder/jetty/start.jar OPTIONS=Server jetty.state=/opt/rudder/etc/rudder-jetty-base/rudder-jetty.state jetty-started.xml" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.java.launcher="SUN_STANDARD" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.jnu.encoding="ANSI_X3.4-1968" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.management.compiler="HotSpot 64-Bit Tiered Compilers" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: sun.os.patch.level="unknown" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: user.country="US" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: user.dir="/opt/rudder/etc/rudder-jetty-base" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: user.home="/root" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: user.language="en" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: user.name="root" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: user.timezone="Europe/Paris" 
[2019-12-17 14:48:42+0100] INFO  application - registered property: waiting.inventory.queue.size="50" 
[2019-12-17 14:48:42+0100] INFO  application - Plugin's license directory: '/opt/rudder/etc/plugins/licenses/'
[2019-12-17 14:48:42+0100] INFO  bootchecks - Check LDAP and PostgreSQL connection
[2019-12-17 14:48:42+0100] INFO  bootchecks - LDAP and PostgreSQL connection are OK
[2019-12-17 14:48:42+0100] INFO  bootchecks - Check mandatory DIT entries
[2019-12-17 14:48:42+0100] INFO  bootchecks - All the required DIT entries are present in the LDAP directory
[2019-12-17 14:48:42+0100] INFO  bootchecks - Check initialization of User Technique Library
[2019-12-17 14:48:42+0100] INFO  bootchecks - Check event log migration format 5 -> 6
[2019-12-17 14:48:42+0100] INFO  bootchecks - Check existence of at least one archive of the configuration
[2019-12-17 14:48:42+0100] INFO  migration - No migration detected by migration script (table 'migrationeventlog' is empty or does not exist)
[2019-12-17 14:48:42+0100] INFO  bootchecks - First full archive of configuration-repository items done
[2019-12-17 14:48:42+0100] INFO  bootchecks - Check rules archive directory in configuration-repository
[2019-12-17 14:48:42+0100] INFO  bootchecks - Creating directory '/var/rudder/configuration-repository/ruleCategories' exists, done
[2019-12-17 14:48:42+0100] INFO  bootchecks - Check for force reload of Techniques library
[2019-12-17 14:48:42+0100] INFO  bootchecks - Flag file '/opt/rudder/etc/force_technique_reload' does not exist, do not Technique library will not be reloaded
[2019-12-17 14:48:42+0100] INFO  bootchecks - Check that system group / directive / rules for Rudder 4.2 are agent-specific
[2019-12-17 14:48:42+0100] INFO  bootchecks - Regenerate all ncf techniques
[2019-12-17 14:48:43+0100] INFO  bootchecks - Flag file '/opt/rudder/etc/force_ncf_technique_update' does not exist, do not regenerate ncf Techniques
[2019-12-17 14:48:43+0100] INFO  bootchecks - Resume policy update if it was running before shutdown
[2019-12-17 14:48:43+0100] INFO  bootchecks - Flag file '/opt/rudder/etc/policy-update-running' does not exist, No need to start a new policy update
[2019-12-17 14:48:43+0100] INFO  bootchecks - Trigger policy update if it was requested during shutdown
[2019-12-17 14:48:43+0100] INFO  bootchecks - Create system api token
[2019-12-17 14:48:43+0100] INFO  bootchecks - System api token file created in /var/rudder/run/api-token
[2019-12-17 14:48:43+0100] INFO  bootchecks - Update existing API token to 'RW' autorization level.
[2019-12-17 14:48:43+0100] INFO  bootchecks - Check NashHorn JS engine for warning
[2019-12-17 14:48:43+0100] INFO  application - Configured authentication provider(s): [rootAdmin, file]
[2019-12-17 14:48:43+0100] INFO  application - No master admin account is defined. You can define one with 'rudder.auth.admin.login' and 'rudder.auth.admin.password' properties in the configuration file
[2019-12-17 14:48:43+0100] INFO  application - Add backend providers 'Default authentication backends provider: 'file','rootAdmin'
[2019-12-17 14:48:43+0100] INFO  application - Using configuration file defined by JVM property -Drudder.authFile : /opt/rudder/etc/rudder-users.xml
[2019-12-17 14:48:44+0100] INFO  bootstrap.liftweb.Boot - classpath
[2019-12-17 14:48:44+0100] INFO  org.reflections.Reflections - Reflections took 59 ms to scan 2 urls, producing 3 keys and 6 values 
[2019-12-17 14:48:44+0100] INFO  api-processing - Update API authorization level to 'Fine grained API authorizations with ACLs'
[2019-12-17 14:48:44+0100] INFO  application.plugin - Initializing plugin 'rudder-plugin-api-authorizations': 6.0-1.5.0
INFO Configure inventory processing with parallelism of '1' and queue size of '50'
[2019-12-17 14:48:45+0100] INFO  inventory-processing - Incoming inventory watcher started - process existing inventories
[2019-12-17 14:48:45+0100] INFO  application.plugin - Initializing plugin 'rudder-plugin-aix': 6.0-1.4.0
[2019-12-17 14:48:45+0100] INFO  application.plugin - Initializing plugin 'rudder-plugin-vault': 6.0-1.1.0
[2019-12-17 14:48:45+0100] INFO  application - Application Rudder started
2019-12-17 14:48:45.370:INFO:oejsh.ContextHandler:Scanner-0: Started o.e.j.w.WebAppContext@6f26b9b6{/rudder,file:///var/rudder/tmp/jetty/jetty-rudder.war.dir/webapp/,AVAILABLE}{/rudder.war}
2019-12-17 14:48:45.389:INFO:oejshC.rudder:Thread-11: Closing Spring root WebApplicationContext
2019-12-17 14:48:45.473:INFO:oejsh.ContextHandler:Thread-11: Stopped o.e.j.w.WebAppContext@6f26b9b6{/rudder,null,UNAVAILABLE}{/rudder.war}


Related issues 1 (0 open1 closed)

Is duplicate of Rudder - Bug #12911: During upgrade, jetty doesn't seems to always restart correctly ReleasedNicolas CHARLESActions
Actions #1

Updated by François ARMAND about 5 years ago

  • Is duplicate of Bug #12911: During upgrade, jetty doesn't seems to always restart correctly added
Actions #2

Updated by François ARMAND about 5 years ago

  • Status changed from New to Rejected

Closing as duplicate of: https://issues.rudder.io/issues/12911

Actions

Also available in: Atom PDF