Bug #26200: Error at rudder start after an upgrade - Rudder - Issue Tracker

Actions

Copy link

Bug #26200

closed

Error at rudder start after an upgrade

Added by Nicolas CHARLES 3 months ago. Updated about 2 months ago.

Status:

Released

Priority:

1 (highest)

Assignee:

Vincent MEMBRÉ

Category:

Architecture - Code maintenance

Target version:

8.1.12

Pull Request:

https://github.com/Normation/rudder/p...

Severity:

Critical - prevents main use of Rudder | no workaround | data loss | security

UX impact:

I hate Rudder for that

User visibility:

Effort required:

Priority:

Name check:

To do

Fix check:

Checked

Regression:

Description

[2025-01-16T07:20:18.908-08:00] ERROR FATAL An error happen during Rudder boot. Rudder will stop now. Error: SystemError: Error during initialization of Rudder; cause was
: java.lang.RuntimeException: uncaught exception 
 -> 

java.lang.RuntimeException: uncaught exception
        at bootstrap.liftweb.LiftInitContextListener.contextInitialized(LiftInitContextListener.scala:154)
        at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1049)
        at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:624)
        at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:984)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:740)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:392)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1304)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:901)
        at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:306)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:532)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:40)
        at org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:183)
        at org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:516)
        at org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:151)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileAdded(ScanningAppProvider.java:210)
        at org.eclipse.jetty.deploy.providers.WebAppProvider.fileAdded(WebAppProvider.java:462)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileAdded(ScanningAppProvider.java:61)
        at org.eclipse.jetty.util.Scanner$DiscreteListener.pathAdded(Scanner.java:284)
        at org.eclipse.jetty.util.Scanner.reportAddition(Scanner.java:896)
        at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:862)
        at org.eclipse.jetty.util.Scanner.scan(Scanner.java:769)
        at org.eclipse.jetty.util.Scanner.startScanning(Scanner.java:658)
        at org.eclipse.jetty.util.Scanner.doStart(Scanner.java:630)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:121)
        at org.eclipse.jetty.deploy.providers.ScanningAppProvider.doStart(ScanningAppProvider.java:182)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.deploy.DeploymentManager.startAppProvider(DeploymentManager.java:605)
        at org.eclipse.jetty.deploy.DeploymentManager.doStart(DeploymentManager.java:246)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171)

        at org.eclipse.jetty.server.Server.start(Server.java:470)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:121)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89)
        at org.eclipse.jetty.server.Server.doStart(Server.java:415)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
        at org.eclipse.jetty.xml.XmlConfiguration.main(XmlConfiguration.java:1919)
Caused by: Exception in thread "zio-fiber-123" com.normation.errors$SystemError: SystemError(error when getting global scores for node,org.postgresql.util.PSQLException: 
ERROR: relation "globalscore" does not exist
  Position: 45)
        at zio.interop.ZioMonadErrorE.raiseError.trace(cats.scala:628)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.Monad.map(Monad.scala:35)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.free.Free.foldMap(Free.scala:166)
        at zio.interop.ZioMonadError.tailRecM.loop(cats.scala:604)
        at cats.effect.kernel.Resource.fold(Resource.scala:173)
        at com.normation.rudder.db.Doobie.transactIOResult(Doobie.scala:93)
        at com.normation.rudder.score.GlobalScoreRepositoryImpl.getAll(GlobalScoreRepository.scala:127)
        at com.normation.rudder.score.ScoreServiceImpl.init(ScoreService.scala:76)
        at bootstrap.liftweb.RudderConfigInit.init(RudderConfig.scala:3874)
Exception in thread "zio-fiber-153" java.lang.InterruptedException: Interrupted by thread "zio-fiber-153" 
        at bootstrap.liftweb.RudderConfigInit.init(RudderConfig.scala:3874)

Related issues 3 (1 open — 2 closed)

Actions

Copy link

Updated by Nicolas CHARLES 3 months ago

Related to Bug #25948: Score breakdown has inconsistent numbers added

Actions

Copy link

Updated by François ARMAND 3 months ago

Assignee set to François ARMAND
Priority changed from To review to 1 (highest)

So, the problem is that we change the order of database init / start of campaign in #25842 and that the service are still not init where they should.
They actually need to be init post bootstrap check, because table migration is done post bootstrap check.

Or we need to do table migration PRE-Rudder config, post database init. Perhaps that one is special.

Actions

Copy link

Updated by François ARMAND 3 months ago

Related to Bug #25842: scoreService and scoreServiceManager are not initialized where they should added

Actions

Copy link

Updated by Vincent MEMBRÉ 3 months ago

Status changed from New to In progress
Assignee changed from François ARMAND to Vincent MEMBRÉ

Actions

Copy link

Updated by François ARMAND 3 months ago

Assignee changed from Vincent MEMBRÉ to François ARMAND

Actions

Copy link

Updated by François ARMAND 3 months ago

Status changed from In progress to Pending technical review
Assignee changed from François ARMAND to Vincent MEMBRÉ
Pull Request set to https://github.com/Normation/rudder/pull/6142

PR https://github.com/Normation/rudder/pull/6142

Actions

Copy link

Updated by Anonymous 3 months ago

Status changed from Pending technical review to Pending release

Applied in changeset rudder|d098700a47e9fcd20754484f6ba91b73b7959c33.

Actions

Copy link

Updated by François ARMAND 3 months ago

Related to Bug #26286: InstanceId check must be in early bootstrap checks added

Actions

Copy link

#10

Updated by Alexis Mousset 2 months ago

Subject changed from Error at rudder start after an upgrade from 8.0 to 8.1.11 to Error at rudder start after an upgrade

Actions

Copy link

#11

Updated by Alexis Mousset 2 months ago

Fix check changed from To do to Checked

Actions

Copy link

#12

Updated by Vincent MEMBRÉ about 2 months ago

Status changed from Pending release to Released

This bug has been fixed in Rudder 8.1.12 and 8.2.5 which were released today.

Actions

Copy link

Also available in: Atom PDF

Project

General

Profile

Rudder

Custom queries

Bug #26200

Error at rudder start after an upgrade

Updated by Nicolas CHARLES 3 months ago

Updated by François ARMAND 3 months ago

Updated by François ARMAND 3 months ago

Updated by Vincent MEMBRÉ 3 months ago

Updated by François ARMAND 3 months ago

Updated by François ARMAND 3 months ago

Updated by Anonymous 3 months ago

Updated by François ARMAND 3 months ago

Updated by Alexis Mousset 2 months ago

Updated by Alexis Mousset 2 months ago

Updated by Vincent MEMBRÉ about 2 months ago

Related to Rudder - Bug #25948: Score breakdown has inconsistent numbers	Pending release	François ARMAND	Actions
Related to Rudder - Bug #25842: scoreService and scoreServiceManager are not initialized where they should	Released	Vincent MEMBRÉ	Actions
Related to Rudder - Bug #26286: InstanceId check must be in early bootstrap checks	Released	Clark ANDRIANASOLO	Actions