DataFlow in Expression Language: Difference between revisions
Jump to navigation
Jump to search
(Created page with "DataFlow is an object representing a stream for tabular data. Difference to the DataFrame is that the DataFrame contains all its contents stored to the system memory. If there...") |
No edit summary |
||
| Line 2: | Line 2: | ||
{| class="wikitable" | {| class="wikitable" | ||
!''' | !'''Function''' | ||
!'''Punctions''' | |||
! '''Description''' | ! '''Description''' | ||
|- | |- | ||
||Persist (String*) | ||Persist (String*) | ||
||Datatable | |||
||Write DataFlow into datatable. Works similarly as the name function in the See the [[DataFrame_in_Expression_Language#DataFrame_Functions|DataFrames]]. | ||Write DataFlow into datatable. Works similarly as the name function in the See the [[DataFrame_in_Expression_Language#DataFrame_Functions|DataFrames]]. | ||
|- | |- | ||
|} | |} | ||
Revision as of 15:59, 7 December 2022
DataFlow is an object representing a stream for tabular data. Difference to the DataFrame is that the DataFrame contains all its contents stored to the system memory. If there is lot of data, also lot of memory is required when using the DataFrame. On the other hand, in the DataFlow, the tabular contents "flows" from a source and is stored to a destination. Data can be manipulated, while having only a small portion of the entire data in memory at the same time. Thus DataFlows are suitable for ETL where the data volumes are large.
| Function | Punctions | Description |
|---|---|---|
| Persist (String*) | Datatable | Write DataFlow into datatable. Works similarly as the name function in the See the DataFrames. |