https://issues.rudder.io/https://issues.rudder.io/themes/rudder7/favicon/favicon.ico?17096450182020-07-10T15:05:49ZIssue TrackerRudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1311642020-07-10T15:05:49ZNicolas Ecarnot
<ul></ul><p>Update : Carefully reading the error logs, I see that not all my custom techniques are implied.<br />Comparing the "good and the bad" ones (those which don't generate an issue), I see that in /var/rudder/configuration-repository/techniques/ncf_techniques are directories named along old techniques I made but since deleted.<br />I don't know if I can just delete them and commit?</p> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1311682020-07-10T16:02:27ZFrançois ARMANDfrancois.armand@rudder.io
<ul></ul><p>You can go to "settings > active tree" and click on techniques and delete from here. It may happen that a technique from the editor was deleted for it but remains known on rudder (it should not happen and it's a bug, but it can).</p> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1311762020-07-10T19:51:40ZFrançois ARMANDfrancois.armand@rudder.io
<ul></ul><p>I'm unable to reproduce.</p>
<p>What I did:</p>
<p>- install rudder server and a node with Rudder 6.0.6 on debian 10<br />- clone a git repos in server /var/rudder/configuration-repository/sit-rudder<br />- create 2 user techniques with executre command generic method (and directives and bind to rule)<br />- create a directive "Download file (from server)" (and bind to rule)</p>
<p>(note that shared-file is not added ni /var/rudder/configuration-repository in my case - is it the same for you?)</p>
<p>Check that the node download file, and that if I change sit-rudder repos and git pull ni clone, node get updated content.</p>
<p>Then I upgraded to rudder 6.1.0 with your procedure (putting "6.1.0" in repos line). I checked that everything was working ok, deleted one of the two user technique (but I didn't leave anything in <code>/var/rudder/configuration-repository/techniques/ncf_techniques</code> so that's a difference).</p>
<p>I modified repos, pulled in clone, regenerated, created new technique => everything is fine.</p>
<p>Some random ideas:</p>
<p>- your message about "something change in resources" is very strange. Rudder believes that you added "shared-files/sit-rudder" as a resource, but that it is not in saved for technique in rudder fs (under <code>/var/rudder/configuration-repository/techniques/ncf_techniques/xxxx/1.0/resources</code>). I don't even know how you could do that". Perhaps browser local storage used by rudder got corrupted for some reason. Can you try to clean it ? In firefox: shift+f9 to open storage debug panel, at the bottom there is "session storage", click on url of rudder server, then there should be two keys: storeOriginalTechnique and storeSelectedTechnique => delete them (suppr). (session storage is deleted when you close your firefox or the tab with rudder, not when you log out of rudder)</p>
<p>- do you use symlink ? I'm not sure why it would create chaos like what you experience, but I feel they could</p>
<p>- the error message is incorrect for <code>Error when trying to open template 'TechniqueResourceIdByPath(...</code>. It should not be "template" but resource. Can you provide us with a tar.gz of the technique directory of one of the technique rising that error ? (for ex: <code>/var/rudder/configuration-repository/techniques/ncf_techniques/sit___timezone___centos_new</code>) ?</p> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1312852020-07-15T10:36:18ZNicolas Ecarnot
<ul></ul><p>François ARMAND wrote in <a href="#note-2">#note-2</a>:</p>
<blockquote>
<p>You can go to "settings > active tree" and click on techniques and delete from here. It may happen that a technique from the editor was deleted for it but remains known on rudder (it should not happen and it's a bug, but it can).</p>
</blockquote>
<p>François,</p>
<p>This morning, I used your hint about cleaning things up with this active tree, and by keeping an eye on /var/log/rudder/core/rudder-webapp.log<br />It can be too soon to yell victory, but so far so good, as no error appear now and the policies were able to being built.<br />The next step is for me to change the content of shared-files/sit-rudder and see how it goes.</p>
<p>I'm sorry to say that but I think your right when you write : "my best guess for now is that something want horribly wrong during update, technique deleted from editor but not from fs/git had their metadata.xml corrupted, Ragnarök ensues.".<br />And the worst : I'm quite sure I won't be able to reproduce, and honestly, not really willing to as it's a production setup.</p> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1312872020-07-15T11:39:30ZFrançois ARMANDfrancois.armand@rudder.io
<ul><li><strong>Subject</strong> changed from <i>After upgrade from 6.0 to 6.1, policies cannot be generated</i> to <i>After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generation</i></li><li><strong>Severity</strong> changed from <i>Critical - prevents main use of Rudder | no workaround | data loss | security</i> to <i>Major - prevents use of part of Rudder | no simple workaround</i></li><li><strong>Priority</strong> changed from <i>76</i> to <i>52</i></li></ul><p>No pb regarding reproduction/etc. We did pinned-out the cause, even if not the root cause of that first problem. <br />So we know that if technique deleted from editor, but still present in <code>/var/rudder/configuration-repository/techniques/ncf_techniques/</code> exists, migration is broken. We need to prevent that at least.</p>
<p>I'm updating title accordingly and lessen a bit severity since we seem to have a workaround now.</p> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1313242020-07-15T20:44:09ZFrançois ARMANDfrancois.armand@rudder.io
<ul><li><strong>Related to</strong> <i><a class="issue tracker-1 status-5 priority-16 priority-default closed" href="/issues/17977">Bug #17977</a>: Resource automatically added on newly created technique - since 6.1 upgrade</i> added</li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1313262020-07-15T20:44:46ZFrançois ARMANDfrancois.armand@rudder.io
<ul></ul><p>It may be a side effect of <a class="issue tracker-1 status-5 priority-16 priority-default closed" title="Bug: Resource automatically added on newly created technique - since 6.1 upgrade (Released)" href="https://issues.rudder.io/issues/17977">#17977</a></p> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1319092020-07-24T08:17:42ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.2</i> to <i>6.1.3</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1323802020-08-03T23:14:53ZFrançois ARMANDfrancois.armand@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.3</i> to <i>6.1.4</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1329702020-09-01T21:18:33ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.4</i> to <i>6.1.5</i></li><li><strong>Priority</strong> changed from <i>52</i> to <i>51</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1338472020-10-01T13:17:35ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.5</i> to <i>6.1.6</i></li><li><strong>Priority</strong> changed from <i>51</i> to <i>50</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1346382020-10-23T13:36:41ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.6</i> to <i>6.1.7</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1373612020-12-07T16:28:36ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.7</i> to <i>6.1.8</i></li><li><strong>Priority</strong> changed from <i>50</i> to <i>48</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1379052021-01-18T08:16:26ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.8</i> to <i>6.1.9</i></li><li><strong>Priority</strong> changed from <i>48</i> to <i>47</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1382602021-01-28T16:03:44ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.9</i> to <i>6.1.10</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1390702021-03-16T18:24:39ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.10</i> to <i>6.1.11</i></li><li><strong>Priority</strong> changed from <i>47</i> to <i>46</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1392722021-03-18T22:05:51ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.11</i> to <i>6.1.12</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1398292021-04-12T08:34:35ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.12</i> to <i>6.1.13</i></li><li><strong>Priority</strong> changed from <i>46</i> to <i>45</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1405292021-05-15T11:01:32ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.13</i> to <i>6.1.14</i></li><li><strong>Priority</strong> changed from <i>45</i> to <i>44</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1421812021-07-06T17:47:45ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.14</i> to <i>6.1.15</i></li><li><strong>Priority</strong> changed from <i>44</i> to <i>43</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1428782021-07-19T15:49:11ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.15</i> to <i>6.1.16</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1447302021-09-02T21:49:22ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.16</i> to <i>6.1.17</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1474152021-11-08T23:44:09ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.17</i> to <i>6.1.18</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1488102021-12-14T23:20:21ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.18</i> to <i>6.1.19</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1527672022-04-07T10:33:34ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.19</i> to <i>6.1.20</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1562442022-05-31T09:46:59ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.20</i> to <i>6.1.21</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1576412022-06-24T14:06:26ZVincent MEMBRÉvme@rudder.io
<ul><li><strong>Target version</strong> changed from <i>6.1.21</i> to <i>old 6.1 issues to relocate</i></li></ul> Rudder - Bug #17939: After upgrade from 6.0 to 6.1, deleted technique in editor still present in techniques repos breaks generationhttps://issues.rudder.io/issues/17939?journal_id=1778022023-11-16T16:09:31ZFrançois ARMANDfrancois.armand@rudder.io
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Rejected</i></li><li><strong>Priority</strong> changed from <i>43</i> to <i>0</i></li><li><strong>Regression</strong> set to <i>No</i></li></ul><p>I'm closing that one since it's very very old, and (hopefuly) not relevant anymore</p>