Project

General

Profile

Actions
Copy link

Bug #26200

open

Error at rudder start after an upgrade

Added by Nicolas CHARLES about 1 month ago. Updated 2 days ago.

Status:
Pending release
Priority:
1 (highest)
Assignee:
Vincent MEMBRÉ
Category:
Architecture - Code maintenance
Target version:
8.1.12
Pull Request:
https://github.com/Normation/rudder/p...
Severity:
Critical - prevents main use of Rudder | no workaround | data loss | security
UX impact:
I hate Rudder for that
User visibility:
Effort required:
Priority:
0
Name check:
To do
Fix check:
Checked
Regression:
No

Description

[2025-01-16T07:20:18.908-08:00] ERROR FATAL An error happen during Rudder boot. Rudder will stop now. Error: SystemError: Error during initialization of Rudder; cause was
: java.lang.RuntimeException: uncaught exception 
 -> 

java.lang.RuntimeException: uncaught exception
        at bootstrap.liftweb.LiftInitContextListener.contextInitialized(LiftInitContextListener.scala:154)
        at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1049)
        at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:624)
        at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:984)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:740)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:392)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1304)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:901)
        at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:306)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:532)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:40)
        at org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:183)
        at org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:516)
        at org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:151)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileAdded(ScanningAppProvider.java:210)
        at org.eclipse.jetty.deploy.providers.WebAppProvider.fileAdded(WebAppProvider.java:462)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileAdded(ScanningAppProvider.java:61)
        at org.eclipse.jetty.util.Scanner$DiscreteListener.pathAdded(Scanner.java:284)
        at org.eclipse.jetty.util.Scanner.reportAddition(Scanner.java:896)
        at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:862)
        at org.eclipse.jetty.util.Scanner.scan(Scanner.java:769)
        at org.eclipse.jetty.util.Scanner.startScanning(Scanner.java:658)
        at org.eclipse.jetty.util.Scanner.doStart(Scanner.java:630)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:121)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider.doStart(ScanningAppProvider.java:182)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.deploy.DeploymentManager.startAppProvider(DeploymentManager.java:605)
        at org.eclipse.jetty.deploy.DeploymentManager.doStart(DeploymentManager.java:246)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)

        at org.eclipse.jetty.server.Server.start(Server.java:470)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:121)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89)
        at org.eclipse.jetty.server.Server.doStart(Server.java:415)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.xml.XmlConfiguration.main(XmlConfiguration.java:1919)
Caused by: Exception in thread "zio-fiber-123" com.normation.errors$SystemError: SystemError(error when getting global scores for node,org.postgresql.util.PSQLException: 
ERROR: relation "globalscore" does not exist
  Position: 45)
        at zio.interop.ZioMonadErrorE.raiseError.trace(cats.scala:628)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.free.Free.foldMap(Free.scala:166)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.effect.kernel.Resource.fold(Resource.scala:173)
        at com.normation.rudder.db.Doobie.transactIOResult(Doobie.scala:93)
        at com.normation.rudder.score.GlobalScoreRepositoryImpl.getAll(GlobalScoreRepository.scala:127)
        at com.normation.rudder.score.ScoreServiceImpl.init(ScoreService.scala:76)
        at bootstrap.liftweb.RudderConfigInit.init(RudderConfig.scala:3874)
Exception in thread "zio-fiber-153" java.lang.InterruptedException: Interrupted by thread "zio-fiber-153" 
        at bootstrap.liftweb.RudderConfigInit.init(RudderConfig.scala:3874)

Related issues 3 (2 open — 1 closed)

Related to Rudder - Bug #25948: Score breakdown has inconsistent numbersPending releaseFrançois ARMANDActions
Related to Rudder - Bug #25842: scoreService and scoreServiceManager are not initialized where they shouldReleasedVincent MEMBRÉActions
Related to Rudder - Bug #26286: InstanceId check must be in early bootstrap checksPending releaseClark ANDRIANASOLOActions
Actions
Copy link
 #1

Updated by Nicolas CHARLES about 1 month ago

  • Related to Bug #25948: Score breakdown has inconsistent numbers added
Actions
Copy link
 #2

Updated by François ARMAND about 1 month ago

  • Assignee set to François ARMAND
  • Priority changed from To review to 1 (highest)

So, the problem is that we change the order of database init / start of campaign in #25842 and that the service are still not init where they should.
They actually need to be init post bootstrap check, because table migration is done post bootstrap check.

Or we need to do table migration PRE-Rudder config, post database init. Perhaps that one is special.

Actions
Copy link
 #3

Updated by François ARMAND about 1 month ago

  • Related to Bug #25842: scoreService and scoreServiceManager are not initialized where they should added
Actions
Copy link
 #4

Updated by Vincent MEMBRÉ about 1 month ago

  • Status changed from New to In progress
  • Assignee changed from François ARMAND to Vincent MEMBRÉ
Actions
Copy link
 #5

Updated by François ARMAND about 1 month ago

  • Assignee changed from Vincent MEMBRÉ to François ARMAND
Actions
Copy link
 #6

Updated by François ARMAND about 1 month ago

  • Status changed from In progress to Pending technical review
  • Assignee changed from François ARMAND to Vincent MEMBRÉ
  • Pull Request set to https://github.com/Normation/rudder/pull/6142
Actions
Copy link
 #7

Updated by Anonymous 24 days ago

  • Status changed from Pending technical review to Pending release
Actions
Copy link
 #9

Updated by François ARMAND 23 days ago

  • Related to Bug #26286: InstanceId check must be in early bootstrap checks added
Actions
Copy link
 #10

Updated by Alexis Mousset 3 days ago

  • Subject changed from Error at rudder start after an upgrade from 8.0 to 8.1.11 to Error at rudder start after an upgrade
Actions
Copy link
 #11

Updated by Alexis Mousset 2 days ago

  • Fix check changed from To do to Checked
Actions
Copy link

Also available in: Atom PDF