Project

General

Profile

Actions

Bug #9485

closed

Rudder interface slows down to a halt on RHEL7

Added by Nicolas CHARLES over 7 years ago. Updated over 7 years ago.

Status:
Rejected
Priority:
N/A
Assignee:
-
Category:
System integration
Target version:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
Name check:
Fix check:
Regression:

Description

On RHEL7, after a while, the web interface slows down to a halt, making it unusable

to reproduce, go to technical log, click on get logs several time, see a lot of datatables, and then changing page gets toooo slow

Apache log:

[Thu Oct 20 16:09:17.021499 2016] [authz_core:debug] [pid 26149] mod_authz_core.c(809): [client 192.168.41.1:37829] AH01626: authorization result of Require all granted: granted
[Thu Oct 20 16:09:17.021517 2016] [authz_core:debug] [pid 26149] mod_authz_core.c(809): [client 192.168.41.1:37829] AH01626: authorization result of <RequireAny>: granted
[Thu Oct 20 16:09:17.021543 2016] [proxy:debug] [pid 26149] mod_proxy.c(1117): [client 192.168.41.1:37829] AH01143: Running scheme http handler (attempt 0)
[Thu Oct 20 16:09:17.021546 2016] [proxy_ajp:debug] [pid 26149] mod_proxy_ajp.c(713): [client 192.168.41.1:37829] AH00894: declining URL http://localhost:8080/rudder/javascript/angular/angular-animate.min.js.map
[Thu Oct 20 16:09:17.021549 2016] [proxy_fcgi:debug] [pid 26149] mod_proxy_fcgi.c(946): [client 192.168.41.1:37829] AH01076: url: http://localhost:8080/rudder/javascript/angular/angular-animate.min.js.map proxyname: (null) proxyport: 0
[Thu Oct 20 16:09:17.021552 2016] [proxy_fcgi:debug] [pid 26149] mod_proxy_fcgi.c(949): [client 192.168.41.1:37829] AH01077: declining URL http://localhost:8080/rudder/javascript/angular/angular-animate.min.js.map
[Thu Oct 20 16:09:17.021562 2016] [proxy:debug] [pid 26149] proxy_util.c(2203): AH00942: HTTP: has acquired connection for (localhost)
[Thu Oct 20 16:09:17.021565 2016] [proxy:debug] [pid 26149] proxy_util.c(2256): [client 192.168.41.1:37829] AH00944: connecting http://localhost:8080/rudder/javascript/angular/angular-animate.min.js.map to localhost:8080
[Thu Oct 20 16:09:17.021568 2016] [proxy:debug] [pid 26149] proxy_util.c(2422): [client 192.168.41.1:37829] AH00947: connected /rudder/javascript/angular/angular-animate.min.js.map to localhost:8080
[Thu Oct 20 16:09:17.021578 2016] [authz_core:debug] [pid 26150] mod_authz_core.c(809): [client 192.168.41.1:37831] AH01626: authorization result of Require all granted: granted
[Thu Oct 20 16:09:17.021587 2016] [authz_core:debug] [pid 26150] mod_authz_core.c(809): [client 192.168.41.1:37831] AH01626: authorization result of <RequireAny>: granted
[Thu Oct 20 16:09:17.021606 2016] [proxy:debug] [pid 26150] mod_proxy.c(1117): [client 192.168.41.1:37831] AH01143: Running scheme http handler (attempt 0)
[Thu Oct 20 16:09:17.021609 2016] [proxy_ajp:debug] [pid 26150] mod_proxy_ajp.c(713): [client 192.168.41.1:37831] AH00894: declining URL http://localhost:8080/rudder/javascript/angular/angular.min.js.map
[Thu Oct 20 16:09:17.021611 2016] [proxy_fcgi:debug] [pid 26150] mod_proxy_fcgi.c(946): [client 192.168.41.1:37831] AH01076: url: http://localhost:8080/rudder/javascript/angular/angular.min.js.map proxyname: (null) proxyport: 0
[Thu Oct 20 16:09:17.021613 2016] [proxy_fcgi:debug] [pid 26150] mod_proxy_fcgi.c(949): [client 192.168.41.1:37831] AH01077: declining URL http://localhost:8080/rudder/javascript/angular/angular.min.js.map
[Thu Oct 20 16:09:17.021615 2016] [proxy:debug] [pid 26150] proxy_util.c(2203): AH00942: HTTP: has acquired connection for (localhost)
[Thu Oct 20 16:09:17.021618 2016] [proxy:debug] [pid 26150] proxy_util.c(2256): [client 192.168.41.1:37831] AH00944: connecting http://localhost:8080/rudder/javascript/angular/angular.min.js.map to localhost:8080
[Thu Oct 20 16:09:17.021621 2016] [proxy:debug] [pid 26150] proxy_util.c(2422): [client 192.168.41.1:37831] AH00947: connected /rudder/javascript/angular/angular.min.js.map to localhost:8080
[Thu Oct 20 16:09:17.021634 2016] [proxy:debug] [pid 26149] proxy_util.c(2789): (111)Connection refused: AH00957: HTTP: attempt to connect to [::1]:8080 (localhost) failed
[Thu Oct 20 16:09:17.021658 2016] [proxy:debug] [pid 26150] proxy_util.c(2789): (111)Connection refused: AH00957: HTTP: attempt to connect to [::1]:8080 (localhost) failed
[Thu Oct 20 16:09:17.021682 2016] [proxy:debug] [pid 26149] proxy_util.c(2798): AH02824: HTTP: connection established with 127.0.0.1:8080 (localhost)
[Thu Oct 20 16:09:17.021690 2016] [proxy:debug] [pid 26149] proxy_util.c(2923): AH00962: HTTP: connection complete to [::1]:8080 (localhost)
[Thu Oct 20 16:09:17.021693 2016] [proxy:debug] [pid 26150] proxy_util.c(2798): AH02824: HTTP: connection established with 127.0.0.1:8080 (localhost)
[Thu Oct 20 16:09:17.021700 2016] [proxy:debug] [pid 26150] proxy_util.c(2923): AH00962: HTTP: connection complete to [::1]:8080 (localhost)


Related issues 1 (0 open1 closed)

Related to Rudder - Bug #7134: Rudder API timeouts when passing wrong parametersReleasedAlexis Mousset2015-08-26Actions
Actions #1

Updated by Nicolas CHARLES over 7 years ago

Replacing localhost by 127.0.0.1 in /etc/httpd/conf.d/rudder-vhost-ssl.conf seems to solve the issue

Actions #2

Updated by Nicolas CHARLES over 7 years ago

Commenting rudder-apache-common.conf:ProxyErrorOverride On fixes the issue also

Actions #3

Updated by Benoît PECCATTE over 7 years ago

  • Related to Bug #7134: Rudder API timeouts when passing wrong parameters added
Actions #4

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 318 to 4.0.0~rc2
Actions #5

Updated by Benoît PECCATTE over 7 years ago

  • Status changed from New to Rejected

This happens because of 2 simultaneous problems:
- IPv6 can make some queries happen twice if it is configured to be used but not available on the machine (here on localhost)
- Apache 2.4.1 has a bug with ProxyErrorOverride https://bz.apache.org/bugzilla/show_bug.cgi?id=53420

localhost IPv6 access can be disabled in the system using 127.0.0.1 in /etc/hosts or by configuring /etc/gai.conf

The apache problem is solved when calling the Rudder API by #7134.
It may happen when calling web pages, but we have not seen any occurrence yet.

If it happens anyway, 2 different workaround are possible:
- comment the ProxyErrorOverride lines in /opt/rudder/etc/rudder-apache-common.conf
- upgrade apache to a recent version

We cannot go farther in Rudder since this is a bug in apache or a misconfiguration in the system, so I'm closing this issue.

Actions

Also available in: Atom PDF