Bug #9485
closed
Rudder interface slows down to a halt on RHEL7
Description
On RHEL7, after a while, the web interface slows down to a halt, making it unusable
to reproduce, go to technical log, click on get logs several time, see a lot of datatables, and then changing page gets toooo slow
Apache log:
[Thu Oct 20 16:09:17.021499 2016] [authz_core:debug] [pid 26149] mod_authz_core.c(809): [client 192.168.41.1:37829] AH01626: authorization result of Require all granted: granted [Thu Oct 20 16:09:17.021517 2016] [authz_core:debug] [pid 26149] mod_authz_core.c(809): [client 192.168.41.1:37829] AH01626: authorization result of <RequireAny>: granted [Thu Oct 20 16:09:17.021543 2016] [proxy:debug] [pid 26149] mod_proxy.c(1117): [client 192.168.41.1:37829] AH01143: Running scheme http handler (attempt 0) [Thu Oct 20 16:09:17.021546 2016] [proxy_ajp:debug] [pid 26149] mod_proxy_ajp.c(713): [client 192.168.41.1:37829] AH00894: declining URL http://localhost:8080/rudder/javascript/angular/angular-animate.min.js.map [Thu Oct 20 16:09:17.021549 2016] [proxy_fcgi:debug] [pid 26149] mod_proxy_fcgi.c(946): [client 192.168.41.1:37829] AH01076: url: http://localhost:8080/rudder/javascript/angular/angular-animate.min.js.map proxyname: (null) proxyport: 0 [Thu Oct 20 16:09:17.021552 2016] [proxy_fcgi:debug] [pid 26149] mod_proxy_fcgi.c(949): [client 192.168.41.1:37829] AH01077: declining URL http://localhost:8080/rudder/javascript/angular/angular-animate.min.js.map [Thu Oct 20 16:09:17.021562 2016] [proxy:debug] [pid 26149] proxy_util.c(2203): AH00942: HTTP: has acquired connection for (localhost) [Thu Oct 20 16:09:17.021565 2016] [proxy:debug] [pid 26149] proxy_util.c(2256): [client 192.168.41.1:37829] AH00944: connecting http://localhost:8080/rudder/javascript/angular/angular-animate.min.js.map to localhost:8080 [Thu Oct 20 16:09:17.021568 2016] [proxy:debug] [pid 26149] proxy_util.c(2422): [client 192.168.41.1:37829] AH00947: connected /rudder/javascript/angular/angular-animate.min.js.map to localhost:8080 [Thu Oct 20 16:09:17.021578 2016] [authz_core:debug] [pid 26150] mod_authz_core.c(809): [client 192.168.41.1:37831] AH01626: authorization result of Require all granted: granted [Thu Oct 20 16:09:17.021587 2016] [authz_core:debug] [pid 26150] mod_authz_core.c(809): [client 192.168.41.1:37831] AH01626: authorization result of <RequireAny>: granted [Thu Oct 20 16:09:17.021606 2016] [proxy:debug] [pid 26150] mod_proxy.c(1117): [client 192.168.41.1:37831] AH01143: Running scheme http handler (attempt 0) [Thu Oct 20 16:09:17.021609 2016] [proxy_ajp:debug] [pid 26150] mod_proxy_ajp.c(713): [client 192.168.41.1:37831] AH00894: declining URL http://localhost:8080/rudder/javascript/angular/angular.min.js.map [Thu Oct 20 16:09:17.021611 2016] [proxy_fcgi:debug] [pid 26150] mod_proxy_fcgi.c(946): [client 192.168.41.1:37831] AH01076: url: http://localhost:8080/rudder/javascript/angular/angular.min.js.map proxyname: (null) proxyport: 0 [Thu Oct 20 16:09:17.021613 2016] [proxy_fcgi:debug] [pid 26150] mod_proxy_fcgi.c(949): [client 192.168.41.1:37831] AH01077: declining URL http://localhost:8080/rudder/javascript/angular/angular.min.js.map [Thu Oct 20 16:09:17.021615 2016] [proxy:debug] [pid 26150] proxy_util.c(2203): AH00942: HTTP: has acquired connection for (localhost) [Thu Oct 20 16:09:17.021618 2016] [proxy:debug] [pid 26150] proxy_util.c(2256): [client 192.168.41.1:37831] AH00944: connecting http://localhost:8080/rudder/javascript/angular/angular.min.js.map to localhost:8080 [Thu Oct 20 16:09:17.021621 2016] [proxy:debug] [pid 26150] proxy_util.c(2422): [client 192.168.41.1:37831] AH00947: connected /rudder/javascript/angular/angular.min.js.map to localhost:8080 [Thu Oct 20 16:09:17.021634 2016] [proxy:debug] [pid 26149] proxy_util.c(2789): (111)Connection refused: AH00957: HTTP: attempt to connect to [::1]:8080 (localhost) failed [Thu Oct 20 16:09:17.021658 2016] [proxy:debug] [pid 26150] proxy_util.c(2789): (111)Connection refused: AH00957: HTTP: attempt to connect to [::1]:8080 (localhost) failed [Thu Oct 20 16:09:17.021682 2016] [proxy:debug] [pid 26149] proxy_util.c(2798): AH02824: HTTP: connection established with 127.0.0.1:8080 (localhost) [Thu Oct 20 16:09:17.021690 2016] [proxy:debug] [pid 26149] proxy_util.c(2923): AH00962: HTTP: connection complete to [::1]:8080 (localhost) [Thu Oct 20 16:09:17.021693 2016] [proxy:debug] [pid 26150] proxy_util.c(2798): AH02824: HTTP: connection established with 127.0.0.1:8080 (localhost) [Thu Oct 20 16:09:17.021700 2016] [proxy:debug] [pid 26150] proxy_util.c(2923): AH00962: HTTP: connection complete to [::1]:8080 (localhost)
Updated by Nicolas CHARLES about 8 years ago
Replacing localhost by 127.0.0.1 in /etc/httpd/conf.d/rudder-vhost-ssl.conf seems to solve the issue
Updated by Nicolas CHARLES about 8 years ago
Commenting rudder-apache-common.conf:ProxyErrorOverride On fixes the issue also
Updated by Benoît PECCATTE about 8 years ago
- Related to Bug #7134: Rudder API timeouts when passing wrong parameters added
Updated by Vincent MEMBRÉ about 8 years ago
- Target version changed from 318 to 4.0.0~rc2
Updated by Benoît PECCATTE about 8 years ago
- Status changed from New to Rejected
This happens because of 2 simultaneous problems:
- IPv6 can make some queries happen twice if it is configured to be used but not available on the machine (here on localhost)
- Apache 2.4.1 has a bug with ProxyErrorOverride https://bz.apache.org/bugzilla/show_bug.cgi?id=53420
localhost IPv6 access can be disabled in the system using 127.0.0.1 in /etc/hosts or by configuring /etc/gai.conf
The apache problem is solved when calling the Rudder API by #7134.
It may happen when calling web pages, but we have not seen any occurrence yet.
If it happens anyway, 2 different workaround are possible:
- comment the ProxyErrorOverride lines in /opt/rudder/etc/rudder-apache-common.conf
- upgrade apache to a recent version
We cannot go farther in Rudder since this is a bug in apache or a misconfiguration in the system, so I'm closing this issue.