You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Minh Pham edited this page Jun 15, 2020
·
11 revisions
Welcome to the MINT-Transformation wiki!
A framework to construct a transformation pipeline based on a given specifications
Our framework can incoporate general transformation libraries (e.g. GDAL, xarray) in form of wrapper functions and perform these implemented transformation operations. For instance, we already imported Topoflow transformation notebook in our system.
Our framework also allows users to write format-independent transformation functions with the help of D-REPR. MINT-Transformation takes care of reading and writing data from/to different data formats while users can implement the transformations using a common graph-like representation.
MINT-Transformation currently support data streaming, which allows the pipelines to be run against large datasets of multiple TBs.