Project

General

Profile

Actions
Copy link

Bug #26200

closed

Error at rudder start after an upgrade

Added by Nicolas CHARLES 3 months ago. Updated about 1 month ago.

Status:
Released
Priority:
1 (highest)
Assignee:
Vincent MEMBRÉ
Category:
Architecture - Code maintenance
Target version:
8.1.12
Pull Request:
https://github.com/Normation/rudder/p...
Severity:
Critical - prevents main use of Rudder | no workaround | data loss | security
UX impact:
I hate Rudder for that
User visibility:
Effort required:
Priority:
0
Name check:
To do
Fix check:
Checked
Regression:
No

Description

[2025-01-16T07:20:18.908-08:00] ERROR FATAL An error happen during Rudder boot. Rudder will stop now. Error: SystemError: Error during initialization of Rudder; cause was
: java.lang.RuntimeException: uncaught exception 
 -> 

java.lang.RuntimeException: uncaught exception
        at bootstrap.liftweb.LiftInitContextListener.contextInitialized(LiftInitContextListener.scala:154)
        at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1049)
        at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:624)
        at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:984)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:740)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:392)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1304)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:901)
        at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:306)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:532)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:40)
        at org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:183)
        at org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:516)
        at org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:151)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileAdded(ScanningAppProvider.java:210)
        at org.eclipse.jetty.deploy.providers.WebAppProvider.fileAdded(WebAppProvider.java:462)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileAdded(ScanningAppProvider.java:61)
        at org.eclipse.jetty.util.Scanner$DiscreteListener.pathAdded(Scanner.java:284)
        at org.eclipse.jetty.util.Scanner.reportAddition(Scanner.java:896)
        at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:862)
        at org.eclipse.jetty.util.Scanner.scan(Scanner.java:769)
        at org.eclipse.jetty.util.Scanner.startScanning(Scanner.java:658)
        at org.eclipse.jetty.util.Scanner.doStart(Scanner.java:630)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:121)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider.doStart(ScanningAppProvider.java:182)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.deploy.DeploymentManager.startAppProvider(DeploymentManager.java:605)
        at org.eclipse.jetty.deploy.DeploymentManager.doStart(DeploymentManager.java:246)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)

        at org.eclipse.jetty.server.Server.start(Server.java:470)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:121)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89)
        at org.eclipse.jetty.server.Server.doStart(Server.java:415)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.xml.XmlConfiguration.main(XmlConfiguration.java:1919)
Caused by: Exception in thread "zio-fiber-123" com.normation.errors$SystemError: SystemError(error when getting global scores for node,org.postgresql.util.PSQLException: 
ERROR: relation "globalscore" does not exist
  Position: 45)
        at zio.interop.ZioMonadErrorE.raiseError.trace(cats.scala:628)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.free.Free.foldMap(Free.scala:166)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.effect.kernel.Resource.fold(Resource.scala:173)
        at com.normation.rudder.db.Doobie.transactIOResult(Doobie.scala:93)
        at com.normation.rudder.score.GlobalScoreRepositoryImpl.getAll(GlobalScoreRepository.scala:127)
        at com.normation.rudder.score.ScoreServiceImpl.init(ScoreService.scala:76)
        at bootstrap.liftweb.RudderConfigInit.init(RudderConfig.scala:3874)
Exception in thread "zio-fiber-153" java.lang.InterruptedException: Interrupted by thread "zio-fiber-153" 
        at bootstrap.liftweb.RudderConfigInit.init(RudderConfig.scala:3874)

Related issues 3 (1 open — 2 closed)

Related to Rudder - Bug #25948: Score breakdown has inconsistent numbersPending releaseFrançois ARMANDActions
Related to Rudder - Bug #25842: scoreService and scoreServiceManager are not initialized where they shouldReleasedVincent MEMBRÉActions
Related to Rudder - Bug #26286: InstanceId check must be in early bootstrap checksReleasedClark ANDRIANASOLOActions
Actions
Copy link
 #1

Updated by Nicolas CHARLES 3 months ago

  • Related to Bug #25948: Score breakdown has inconsistent numbers added
Actions
Copy link
 #2

Updated by François ARMAND 2 months ago

  • Assignee set to François ARMAND
  • Priority changed from To review to 1 (highest)

So, the problem is that we change the order of database init / start of campaign in #25842 and that the service are still not init where they should.
They actually need to be init post bootstrap check, because table migration is done post bootstrap check.

Or we need to do table migration PRE-Rudder config, post database init. Perhaps that one is special.

Actions
Copy link
 #3

Updated by François ARMAND 2 months ago

  • Related to Bug #25842: scoreService and scoreServiceManager are not initialized where they should added
Actions
Copy link
 #4

Updated by Vincent MEMBRÉ 2 months ago

  • Status changed from New to In progress
  • Assignee changed from François ARMAND to Vincent MEMBRÉ
Actions
Copy link
 #5

Updated by François ARMAND 2 months ago

  • Assignee changed from Vincent MEMBRÉ to François ARMAND
Actions
Copy link
 #6

Updated by François ARMAND 2 months ago

  • Status changed from In progress to Pending technical review
  • Assignee changed from François ARMAND to Vincent MEMBRÉ
  • Pull Request set to https://github.com/Normation/rudder/pull/6142
Actions
Copy link
 #7

Updated by Anonymous 2 months ago

  • Status changed from Pending technical review to Pending release
Actions
Copy link
 #9

Updated by François ARMAND 2 months ago

  • Related to Bug #26286: InstanceId check must be in early bootstrap checks added
Actions
Copy link
 #10

Updated by Alexis Mousset about 1 month ago

  • Subject changed from Error at rudder start after an upgrade from 8.0 to 8.1.11 to Error at rudder start after an upgrade
Actions
Copy link
 #11

Updated by Alexis Mousset about 1 month ago

  • Fix check changed from To do to Checked
Actions
Copy link
 #12

Updated by Vincent MEMBRÉ about 1 month ago

  • Status changed from Pending release to Released

This bug has been fixed in Rudder 8.1.12 and 8.2.5 which were released today.

Actions
Copy link

Also available in: Atom PDF