You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There is a handy feature in Kedro: special tags for datasets according to the data engineering convention. It is quite useful in combination with kedro viz or (as in my case) for creating a UI on top of Kedro and sorting/filtering datasets according to their position in a pipeline.
I think we need to support this feature and provide some way to specify the layer for pipeline checkpoints.
Currently I am subclassing KedroWings and use simple rules based on the first two letters of dataset locations:
I think we can provide additional parameter to the KedroWings which accepts dictionary with regular expression -> layer name and use the default convention for XX_* datasets.
The text was updated successfully, but these errors were encountered:
There is a handy feature in Kedro: special tags for datasets according to the data engineering convention. It is quite useful in combination with
kedro viz
or (as in my case) for creating a UI on top of Kedro and sorting/filtering datasets according to their position in a pipeline.I think we need to support this feature and provide some way to specify the layer for pipeline checkpoints.
Currently I am subclassing
KedroWings
and use simple rules based on the first two letters of dataset locations:I think we can provide additional parameter to the
KedroWings
which accepts dictionary withregular expression
->layer name
and use the default convention forXX_*
datasets.The text was updated successfully, but these errors were encountered: