Project

General

Profile

Actions
Copy link

Architecture #7471

open

Techniques should be reloaded before importing an archive

Added by Nicolas CHARLES almost 9 years ago. Updated 14 days ago.

Status:
New
Priority:
4
Assignee:
-
Category:
Web - Config management
Target version:
8.1.9
Pull Request:
Effort required:
Very Small
Name check:
Fix check:
Regression:

Description

I put files in /var/rudder/configuraition-repository, git added them, and queried the api to import them in Rudder
curl -f -s "http://localhost:8080/rudder/api/archives/restore/full/latestCommit"

I had the following error

[2015-11-25 14:24:10] ERROR historization - Could not find version 1.0 for Technique with name someNewTechnique for Directive dc1d684f-eb61-48ae-a074-13e876a055df

Generation obviously fails, and the Web Interface complains that it doesn't find the technique (in the directive screen, the technique is in red)

After 5 minutes, problem automagically solves itself as the techniques is correctly imported by auto-import

WORKAROUND: this is because the technique library is not updated before an import, and so the new techniques in the git are not seen. After 5 minutes, the default "auto-update technique library" process happened. So the work around is to force a technique reload before importing:

# add files on git & git commit, then:
curl -f -s "http://localhost:8080/rudder/api/techniqueLibrary/reload" 
curl -f -s "http://localhost:8080/rudder/api/archives/restore/full/latestCommit"

Related issues 3 (2 open — 1 closed)

Related to Rudder - Bug #4480: When restoring archive (full or groups) dynamic groups are created emptyReleasedNicolas CHARLESActions
Related to Rudder - Bug #20520: Error while importing ncf techniques using the restore from latest commit featureNewActions
Related to Rudder - Bug #24294: API Import does not reload imported techniques before importing elements that rely on themNewFrançois ARMANDActions
Actions
Copy link
 #1

Updated by Nicolas CHARLES almost 9 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by François ARMAND almost 9 years ago

  • Description updated (diff)
  • Priority changed from N/A to 4
  • Target version changed from 3.2.0~beta1 to 2.11.17
Actions
Copy link
 #3

Updated by Vincent MEMBRÉ almost 9 years ago

  • Target version changed from 2.11.17 to 2.11.18
Actions
Copy link
 #4

Updated by Vincent MEMBRÉ almost 9 years ago

  • Target version changed from 2.11.18 to 2.11.19
Actions
Copy link
 #5

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.11.19 to 2.11.20
Actions
Copy link
 #6

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.11.20 to 2.11.21
Actions
Copy link
 #7

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.11.21 to 2.11.22
Actions
Copy link
 #8

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.11.22 to 2.11.23
Actions
Copy link
 #9

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.11.23 to 2.11.24
Actions
Copy link
 #10

Updated by Vincent MEMBRÉ about 8 years ago

  • Target version changed from 2.11.24 to 308
Actions
Copy link
 #11

Updated by Vincent MEMBRÉ about 8 years ago

  • Target version changed from 308 to 3.1.14
Actions
Copy link
 #12

Updated by Vincent MEMBRÉ about 8 years ago

  • Target version changed from 3.1.14 to 3.1.15
Actions
Copy link
 #13

Updated by Vincent MEMBRÉ about 8 years ago

  • Target version changed from 3.1.15 to 3.1.16
Actions
Copy link
 #14

Updated by Vincent MEMBRÉ about 8 years ago

  • Target version changed from 3.1.16 to 3.1.17
Actions
Copy link
 #15

Updated by Vincent MEMBRÉ almost 8 years ago

  • Target version changed from 3.1.17 to 3.1.18
Actions
Copy link
 #16

Updated by Vincent MEMBRÉ almost 8 years ago

  • Target version changed from 3.1.18 to 3.1.19
Actions
Copy link
 #17

Updated by Jonathan CLARKE over 7 years ago

  • Severity set to Minor - inconvenience | misleading | easy workaround
  • User visibility set to Infrequent - complex configurations | third party integrations
Actions
Copy link
 #18

Updated by Benoît PECCATTE over 7 years ago

  • Priority set to 5
Actions
Copy link
 #19

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.19 to 3.1.20
Actions
Copy link
 #20

Updated by Jonathan CLARKE over 7 years ago

  • Assignee deleted (François ARMAND)
Actions
Copy link
 #21

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.20 to 3.1.21
Actions
Copy link
 #22

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.21 to 3.1.22
Actions
Copy link
 #23

Updated by Benoît PECCATTE over 7 years ago

  • Priority changed from 5 to 18
Actions
Copy link
 #24

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.22 to 3.1.23
Actions
Copy link
 #25

Updated by Vincent MEMBRÉ about 7 years ago

  • Target version changed from 3.1.23 to 3.1.24
Actions
Copy link
 #26

Updated by Vincent MEMBRÉ about 7 years ago

  • Target version changed from 3.1.24 to 3.1.25
Actions
Copy link
 #27

Updated by Vincent MEMBRÉ almost 7 years ago

  • Target version changed from 3.1.25 to 387
Actions
Copy link
 #28

Updated by Vincent MEMBRÉ almost 7 years ago

  • Target version changed from 387 to 4.1.10
Actions
Copy link
 #29

Updated by Vincent MEMBRÉ almost 7 years ago

  • Target version changed from 4.1.10 to 4.1.11
Actions
Copy link
 #30

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 4.1.11 to 4.1.12
Actions
Copy link
 #31

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 4.1.12 to 4.1.13
Actions
Copy link
 #32

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 4.1.13 to 4.1.14
Actions
Copy link
 #33

Updated by Benoît PECCATTE over 6 years ago

  • Target version changed from 4.1.14 to 4.1.15
Actions
Copy link
 #34

Updated by Vincent MEMBRÉ about 6 years ago

  • Target version changed from 4.1.15 to 4.1.16
Actions
Copy link
 #35

Updated by Vincent MEMBRÉ about 6 years ago

  • Target version changed from 4.1.16 to 4.1.17
Actions
Copy link
 #36

Updated by Vincent MEMBRÉ almost 6 years ago

  • Target version changed from 4.1.17 to 4.1.18
Actions
Copy link
 #37

Updated by Vincent MEMBRÉ almost 6 years ago

  • Target version changed from 4.1.18 to 4.1.19
Actions
Copy link
 #38

Updated by Alexis Mousset almost 6 years ago

  • Target version changed from 4.1.19 to 4.1.20
Actions
Copy link
 #39

Updated by François ARMAND over 5 years ago

  • Target version changed from 4.1.20 to 4.1.21
  • Priority changed from 18 to 19
Actions
Copy link
 #40

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 4.1.21 to 4.1.22
Actions
Copy link
 #41

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 4.1.22 to 4.1.23
Actions
Copy link
 #42

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 4.1.23 to 4.1.24
Actions
Copy link
 #43

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 4.1.24 to 588
Actions
Copy link
 #44

Updated by Vincent MEMBRÉ over 5 years ago

  • Target version changed from 588 to 5.0.13

Like we trigger an automatic group update and wait for result (#4480) we should also do it for technique library here

Actions
Copy link
 #45

Updated by Vincent MEMBRÉ over 5 years ago

  • Related to Bug #4480: When restoring archive (full or groups) dynamic groups are created empty added
Actions
Copy link
 #46

Updated by Vincent MEMBRÉ about 5 years ago

  • Target version changed from 5.0.13 to 5.0.14
Actions
Copy link
 #47

Updated by Vincent MEMBRÉ about 5 years ago

  • Target version changed from 5.0.14 to 5.0.15
  • Priority changed from 19 to 20
Actions
Copy link
 #48

Updated by François ARMAND about 5 years ago

  • Subject changed from Putting Techniques, Groups, Directives in the /var/rudder/configuration and importing from last commit may fail to import techniques to Techniques should be reloaded before importing an archive
  • Description updated (diff)
  • Effort required set to Very Small
  • Priority changed from 20 to 46

I'm not sure it's a bug (the documentation explains it like in the workaround). https://docs.rudder.io/reference/5.0/administration/server.html#_importing_configuration

The question is what happens if it's not import from master but from a different commit with other techniques ? It seems that we should reload technique lib in that case:

In master (current)

technique1
technique2

directive1_technique1
directive2_technique2

In archive1:


technique1
technique3

directive1_technique1
directive3_technique3

Obviously, importing archive1 won't work => it's a bug, and it should be easy to correct.

Actions
Copy link
 #49

Updated by Vincent MEMBRÉ almost 5 years ago

  • Target version changed from 5.0.15 to 5.0.16
  • Priority changed from 46 to 47
Actions
Copy link
 #50

Updated by Alexis Mousset almost 5 years ago

  • Target version changed from 5.0.16 to 5.0.17
Actions
Copy link
 #51

Updated by Vincent MEMBRÉ over 4 years ago

  • Target version changed from 5.0.17 to 5.0.18
  • Priority changed from 47 to 48
Actions
Copy link
 #52

Updated by Vincent MEMBRÉ over 4 years ago

  • Target version changed from 5.0.18 to 5.0.19
  • Priority changed from 48 to 49
Actions
Copy link
 #53

Updated by Vincent MEMBRÉ about 4 years ago

  • Target version changed from 5.0.19 to 5.0.20
  • Priority changed from 49 to 50
Actions
Copy link
 #54

Updated by Vincent MEMBRÉ about 4 years ago

  • Target version changed from 5.0.20 to 797
Actions
Copy link
 #55

Updated by Benoît PECCATTE over 3 years ago

  • Target version changed from 797 to 6.1.14
Actions
Copy link
 #56

Updated by Vincent MEMBRÉ over 3 years ago

  • Target version changed from 6.1.14 to 6.1.15
Actions
Copy link
 #57

Updated by Vincent MEMBRÉ over 3 years ago

  • Target version changed from 6.1.15 to 6.1.16
Actions
Copy link
 #58

Updated by Vincent MEMBRÉ about 3 years ago

  • Target version changed from 6.1.16 to 6.1.17
Actions
Copy link
 #59

Updated by Vincent MEMBRÉ about 3 years ago

  • Target version changed from 6.1.17 to 6.1.18
Actions
Copy link
 #60

Updated by Vincent MEMBRÉ almost 3 years ago

  • Target version changed from 6.1.18 to 6.1.19
Actions
Copy link
 #61

Updated by François ARMAND almost 3 years ago

  • Tracker changed from Bug to Architecture
  • Severity deleted (Minor - inconvenience | misleading | easy workaround)
  • User visibility deleted (Infrequent - complex configurations | third party integrations)
  • Priority deleted (50)
Actions
Copy link
 #62

Updated by François ARMAND almost 3 years ago

  • Related to Bug #20520: Error while importing ncf techniques using the restore from latest commit feature added
Actions
Copy link
 #63

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.19 to 6.1.20
Actions
Copy link
 #64

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.20 to 6.1.21
Actions
Copy link
 #65

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.21 to old 6.1 issues to relocate
Actions
Copy link
 #66

Updated by Alexis Mousset over 1 year ago

  • Target version changed from old 6.1 issues to relocate to 8.0.0~alpha1
Actions
Copy link
 #67

Updated by Vincent MEMBRÉ over 1 year ago

  • Target version changed from 8.0.0~alpha1 to 8.0.0~beta1
Actions
Copy link
 #68

Updated by Alexis Mousset over 1 year ago

  • Target version changed from 8.0.0~beta1 to 8.1.0~alpha1
Actions
Copy link
 #69

Updated by Vincent MEMBRÉ 10 months ago

  • Target version changed from 8.1.0~alpha1 to 8.1.0~beta1
Actions
Copy link
 #70

Updated by Vincent MEMBRÉ 9 months ago

  • Target version changed from 8.1.0~beta1 to 8.1.0~beta2
Actions
Copy link
 #71

Updated by Vincent MEMBRÉ 8 months ago

  • Target version changed from 8.1.0~beta2 to 8.1.0~rc1
Actions
Copy link
 #72

Updated by Vincent MEMBRÉ 8 months ago

  • Target version changed from 8.1.0~rc1 to 8.1.0
Actions
Copy link
 #73

Updated by Vincent MEMBRÉ 8 months ago

  • Target version changed from 8.1.0 to 8.1.1
Actions
Copy link
 #74

Updated by Vincent MEMBRÉ 7 months ago

  • Target version changed from 8.1.1 to 8.1.2
Actions
Copy link
 #75

Updated by Vincent MEMBRÉ 7 months ago

  • Target version changed from 8.1.2 to 8.1.3
Actions
Copy link
 #76

Updated by Vincent MEMBRÉ 6 months ago

  • Target version changed from 8.1.3 to 8.1.4
Actions
Copy link
 #77

Updated by Vincent MEMBRÉ 5 months ago

  • Target version changed from 8.1.4 to 8.1.5
Actions
Copy link
 #78

Updated by Vincent MEMBRÉ 5 months ago

  • Target version changed from 8.1.5 to 8.1.6
Actions
Copy link
 #79

Updated by Nicolas CHARLES 4 months ago

  • Related to Bug #24294: API Import does not reload imported techniques before importing elements that rely on them added
Actions
Copy link
 #80

Updated by Vincent MEMBRÉ 4 months ago

  • Target version changed from 8.1.6 to 8.1.7
Actions
Copy link
 #81

Updated by Vincent MEMBRÉ 2 months ago

  • Target version changed from 8.1.7 to 8.1.8
Actions
Copy link
 #82

Updated by Vincent MEMBRÉ 14 days ago

  • Target version changed from 8.1.8 to 8.1.9
Actions
Copy link

Also available in: Atom PDF