Frictionless includes more than 40+ built-in transform steps. They are grouped by the object so you can find them easily if you have code auto completion. Start typing, for example,
steps.table... and you will see all the available steps. The groups are listed below and you will find every group described in more detail in the next sections. It's also possible to write custom transform steps. Please read the section below to learn more about it. Let's prepare the data that we need to show how the checks below work:
transform.csvto reproduce the examples (right-click and "Save link as").
transform-groups.csvto reproduce the examples (right-click and "Save link as").
transform-pivot.csvto reproduce the examples (right-click and "Save link as").
The Resource steps are only available for a package transformation. This includes some basic resource management operations like adding or removing resources along with the hierarchical
These steps are meant to be used on a table level of a resource. This includes various different operations from simple validation or writing to the disc to complex re-shaping like pivoting or melting.
Group rows under the given group_name then apply aggregation functions provided as aggregation dictionary (see example)
table_normalize step normalizes an underlaying tabular stream (cast types and fix dimensions) according to a provided or inferred schema. If your data is not really big it's recommended to normalize a table before any others steps.
The Field steps are responsible for managing a Table Schema's fields. You can add or remove them along with more complex operations like unpacking.
These steps are row-based including row filtering, slicing, and many more.
The Cell steps are responsible for cell operations like converting, replacing, or formating, along with others.