Bug #25738: Race condition when the agent run during a server/relay upgrade - Rudder - Issue Tracker

Actions

Bug #25738

open

Race condition when the agent run during a server/relay upgrade

Bug #25738: Race condition when the agent run during a server/relay upgrade

Added by Alexis Mousset almost 2 years ago. Updated about 1 month ago.

Status:

New

Priority:

N/A

Assignee:

-

Category:

Packaging

Target version:

Pull Request:

Severity:

UX impact:

User visibility:

Effort required:

Priority:

0

Name check:

To do

Fix check:

To do

Regression:

No

Description

When upgrading a Rudder relay or server, if an agent is already running, it can end up trying to restart jetty or apache2 (at least) while they are being stopped by the package scripts.

Given how system works, this leads to making the stop operation fail, hence interrupting the packaging script and making the upgrade fail.

For example, the server install output:

Job for apache2.service canceled.
**************************************************************************************
ERROR: rudder-webapp postinstall script failed !

Trying to recover the problem, you should check that your instance is properly working

You may need to execute: apt-get install -f
You should also try to manually execute: /opt/rudder/bin/rudder-upgrade

   Such errors should not happen, please open an issue for this problem on 
            https://issues.rudder.io/projects/rudder/issues/new
**************************************************************************************

As an illustration, if you have a stop action that takes a long time, then calling start while the stop job is running will with the default job mode (replace) cancel the installed/running stop job, and install a start job in the unit's job slot.

(https://serverfault.com/questions/936220/what-could-cause-a-systemd-service-stop-to-end-with-job-being-canceled)

And indeed in the agent logs:

2024-10-25T10:05:25+00:00 R: @@rudder-service-apache@@result_repaired@@policy-server-root@@rudder-service-apache-root@@apache_started@@Apache service@@Started@@2024-10-25 10:05:09+00:00##root@#Ensure that service apache2 is running  was repaired

Related issues 1 (0 open — 1 closed)

Updated by Alexis Mousset almost 2 years ago Actions
Copy link
#1

Related to Bug #24559: When upgrading from 8.0 to 8.1 on Ubuntu 22, the webapp doesn't start added

Updated by Vincent MEMBRÉ almost 2 years ago Actions
Copy link
#2

Target version changed from 8.1.8 to 8.1.9

Updated by Vincent MEMBRÉ almost 2 years ago Actions
Copy link
#3

Target version changed from 8.1.9 to 8.1.10

Updated by Vincent MEMBRÉ almost 2 years ago Actions
Copy link
#4

Target version changed from 8.1.10 to 8.1.11

Updated by Vincent MEMBRÉ over 1 year ago Actions
Copy link
#5

Target version changed from 8.1.11 to 8.1.12

Updated by Vincent MEMBRÉ over 1 year ago Actions
Copy link
#6

Target version changed from 8.1.12 to 8.1.13

Updated by Vincent MEMBRÉ over 1 year ago Actions
Copy link
#7

Target version changed from 8.1.13 to 8.2.6

Updated by Vincent MEMBRÉ over 1 year ago Actions
Copy link
#8

Target version changed from 8.2.6 to 8.2.7

Updated by Vincent MEMBRÉ over 1 year ago Actions
Copy link
#9

Target version changed from 8.2.7 to 8.2.8

Updated by Félix DALLIDET about 1 year ago Actions
Copy link
#10

Target version changed from 8.2.8 to 8.2.9

Updated by Vincent MEMBRÉ 12 months ago Actions
Copy link
#11

Target version changed from 8.2.9 to 1133

Updated by Alexis Mousset 11 months ago Actions
Copy link
#12

Target version changed from 1133 to 8.3.6

Updated by Vincent MEMBRÉ 10 months ago Actions
Copy link
#13

Target version changed from 8.3.6 to 8.3.7

Updated by Vincent MEMBRÉ 9 months ago Actions
Copy link
#14

Target version changed from 8.3.7 to 8.3.8

Updated by Vincent MEMBRÉ 9 months ago Actions
Copy link
#15

Target version changed from 8.3.8 to 8.3.9

Updated by Vincent MEMBRÉ 7 months ago Actions
Copy link
#16

Target version changed from 8.3.9 to 8.3.10

Updated by Vincent MEMBRÉ 5 months ago Actions
Copy link
#17

Target version changed from 8.3.10 to 8.3.11

Updated by Vincent MEMBRÉ 4 months ago Actions
Copy link
#18

Target version changed from 8.3.11 to 8.3.12

Updated by Vincent MEMBRÉ 3 months ago Actions
Copy link
#19

Target version changed from 8.3.12 to 8.3.13

Updated by Vincent MEMBRÉ 2 months ago Actions
Copy link
#20

Target version changed from 8.3.13 to 1167

Updated by Alexis Mousset about 2 months ago Actions
Copy link
#21

Target version changed from 1167 to 9.0.9

Updated by Alexis Mousset about 1 month ago Actions
Copy link
#22

Target version changed from 9.0.9 to 9.0.10

Actions

Also available in: PDF Atom