User story #9698
closedImport node properties from external data sources
Description
Some data may be available outside of Rudder to be used to configure your nodes.
To be able to use them in Rudder you need to add them into Rudder as Node properties.
That task may be complicated to achieve and even more to automate (so data stays up to date), we want to add a way to do this easily in Rudder.
We will have to define those external data sources in Rudder. Rudder will then fetch data from them and add them as properties for each nodes.
Data structure:
- name
- url
- request type (one by node, one for all nodes)
- headers
- A way to define data access into received data
- Update frequency
We need:
- Backend storage for datasources
- An api Rest to define datasource
- An ui to define datasource
- System to fetch data sources and add them as properties
- Scheduler to launch it asynchronously
- Use these data in policy generation
Updated by Janos Mattyasovszky almost 8 years ago
Also don't forget to have somekind of failsafe to handle the case when no data is returned (no error but empty dataset) => Would you delete all existing properties?
Updated by François ARMAND almost 8 years ago
@Janos Matya: in all case, the behavior is limited to the key "data-source-name".
We have thought to have an option in the data source configuration with the following option, when nothing is found for a node:
- ignore (i.e: don't modify the existing state)
- raise an error;
- delete value for "data-source-name" key
- use a default value = ....
Updated by Vincent MEMBRÉ almost 8 years ago
- Target version changed from 4.1.0~beta1 to 4.1.0~beta2
Updated by Vincent MEMBRÉ almost 8 years ago
- Status changed from New to Pending technical review
- Target version changed from 4.1.0~beta2 to 4.1.0~beta1
Updated by Vincent MEMBRÉ almost 8 years ago
- Status changed from Pending technical review to 12
Updated by Vincent MEMBRÉ almost 8 years ago
- Status changed from 12 to Pending release
Updated by Vincent MEMBRÉ almost 8 years ago
- Status changed from Pending release to Released
This bug has been fixed in Rudder 4.1.0 which was released today.
- 4.1.0: Announce Changelog
- Download: https://www.rudder-project.org/site/get-rudder/downloads/
Updated by Benoît PECCATTE over 7 years ago
- Related to User story #6264: Get directive parameter value from external source (kv store, rest, etc) added