Bug #16448
closedTrigger remote run in node details says it timeouts
Description
Trigger remote run in node details always says that the request time while the request is correctly done, the run started, and we can even have the result when the compliance table is refreshed.
Files
Updated by Elaad FURREEDAN almost 5 years ago
- Status changed from New to In progress
Updated by François ARMAND almost 5 years ago
- Subject changed from Trigger remote run in node details timeeout to Trigger remote run in node details says it timeeout
It happens on centos 7 or 8 but not on debian 10 => selinux problem ?
It also happens in debian 9
Updated by François ARMAND almost 5 years ago
- File 2020-01-08_10.52.24-Rudder_-_Search_Nodes.png 2020-01-08_10.52.24-Rudder_-_Search_Nodes.png added
I get on output with some errors about lmdb which don't appear if I interactivelly run agent from node with rudder agent run -v
(see screenshot)
Updated by Vincent MEMBRÉ almost 5 years ago
- Target version changed from 6.0.2 to 6.0.3
Updated by Elaad FURREEDAN almost 5 years ago
On Debian 9 the first run failed with : "Error when trying to contact internal remote-run API: Read timed out" and succeed on the second run.
On CentOS 7.6 it's not working on every try.
Updated by Elaad FURREEDAN almost 5 years ago
- Assignee changed from Elaad FURREEDAN to Alexis Mousset
Updated by Vincent MEMBRÉ almost 5 years ago
- Target version changed from 6.0.3 to 6.0.4
Updated by François ARMAND almost 5 years ago
Update: on centos 7.6, it does not work for the first run(s? - perhaps several?) but as for Debian 9 in https://issues.rudder.io/issues/16448#note-5, it works after some time - both on root server and on other nodes.
Updated by François ARMAND almost 5 years ago
And it stopped working - no idea why or how.
Updated by François ARMAND almost 5 years ago
When the problem happens, I get that log trace:
[2020-02-19 12:07:15+0000] DEBUG nodes - Executing remote run call: HttpRequest(https://localhost/rudder/relay-api/remote-run/nodes/root,POST,FormBodyConnectFunc,List((classes,), (keep_output,true), (asynchronous,false)),List((User-Agent,rudder/remote run query for node root), (content-type,application/x-www-form-urlencoded)),List(scalaj.http.HttpOptions$$$Lambda$2085/304503000@5c6990e1, scalaj.http.HttpOptions$$$Lambda$2086/805996536@51b20348, scalaj.http.HttpOptions$$$Lambda$8733/1911143550@24a94956, scalaj.http.HttpOptions$$$Lambda$2085/304503000@b77b0e, scalaj.http.HttpOptions$$$Lambda$2086/805996536@10c91d61, scalaj.http.HttpOptions$$$Lambda$2087/1983137208@5120f473),None,UTF-8,4096,PlainUrlFunc,true,None) [2020-02-19 12:07:15+0000] DEBUG nodes - Processing remore-run on root: HTTP status 200 [2020-02-19 12:07:20+0000] DEBUG nodes - === done processing request ! [2020-02-19 12:07:20+0000] ERROR nodes - Error occured when contacting internal remote-run API to apply classes on Node 'root': request timed out after 5 s [2020-02-19 12:07:20+0000] DEBUG nodes - === I'm going to close output stream! [2020-02-19 12:07:20+0000] DEBUG nodes - === closed! [2020-02-19 12:07:20+0000] DEBUG nodes - === fiber joined! [2020-02-19 12:07:20+0000] DEBUG nodes - === out closed!
Updated by François ARMAND almost 5 years ago
- Assignee changed from Alexis Mousset to François ARMAND
Updated by François ARMAND almost 5 years ago
- Assignee changed from François ARMAND to Vincent MEMBRÉ
- Pull Request set to https://github.com/Normation/rudder/pull/2777
Updated by François ARMAND almost 5 years ago
- Assignee changed from Vincent MEMBRÉ to Alexis Mousset
The "timeout" problem was due to pipe being not closed at the correct place, and so leading to other stream never ending.
But there is still a problem with remote run behind relays (see linked ticket).
Updated by François ARMAND almost 5 years ago
- Related to Bug #16760: Remote run always timeout for nodes behing relays added
Updated by François ARMAND almost 5 years ago
- Status changed from In progress to Pending release
Applied in changeset rudder|4aeb010a336c1657e974691c220efda7f692eae3.
Updated by François ARMAND almost 5 years ago
- Target version changed from 6.0.4 to 6.0.3
Updated by François ARMAND almost 5 years ago
- Subject changed from Trigger remote run in node details says it timeeout to Trigger remote run in node details says it timeouts
Updated by François ARMAND almost 5 years ago
- Fix check changed from To do to Checked
Updated by Alexis Mousset almost 5 years ago
- Name check changed from To do to Reviewed
Updated by Vincent MEMBRÉ almost 5 years ago
- Status changed from Pending release to Released
This bug has been fixed in Rudder 6.0.3 which was released today.