Project

General

Profile

Bug #14465

Updated by François ARMAND about 1 year ago

We saw that exception during policy generation of a rather big :  

 <pre> 
 ⇨ Policy update error for process '754' at 2019-03-13 16:35:10 
 ⇨ Exception caught during policy update process: Task java.util.concurrent.FutureTask@4cc89444 rejected from java.util.concurrent.ThreadPoolExecutor@7a2cae84[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 24] 
 </pre> 

 https://stackoverflow.com/questions/42843427/getting-error-futuretask2c7b84de-rejected-when-using-threadpool 
 https://stackoverflow.com/questions/8183205/what-could-be-the-cause-of-rejectedexecutionexception 

 Update:  
 to correct that problem, we need to be able to control the max parallelism in generation globally, and for desesperate cases, we need to also be able to control JS timeout.  

 These two parameters are quite advanced, and we will only expose them through @settings@ API, but not in the UI.  

 You can manage them with: 

 <pre> 
 # for max parallelism, either use '1x' to mean "1 time the number of CPU / 2" or '3' to mean '3 threads' 
 curl -k -H "X-API-Token: xxx"    -X POST 'https://.../rudder/api/latest/settings/rudder_generation_max_parallelism' -d "value=1x"  
 # value is in seconds 
 curl -k -H "X-API-Token: xxx"    -X POST 'https://.../rudder/api/latest/settings/rudder_generation_js_timeout' -d "value=10"  
 </pre>

Back