Version: v2.5
UnionDistinct
This node creates a new DataFrame by performing a DISTINCT on the result set, eliminating any duplicate rows
Input
It takes in multiple DataFrames as input
Output
This node does union of all the rows from the incoming DataFrames to generate the output DataFrame
Type
join
Fields
Examples
Input1
id | label | f1 | f2 |
---|---|---|---|
6 | 1.0 | 2.1 | 2.0 |
4 | 0.0 | 4.1 | 5.0 |
5 | 0.0 | 3.1 | 6.0 |
66 | 1.0 | 2.1 | 2.0 |
Input2
id | label | f1 | f2 |
---|---|---|---|
6 | 1.0 | 2.1 | 2.0 |
4 | 0.0 | 4.1 | 5.0 |
5 | 0.0 | 3.1 | 6.0 |
66 | 1.0 | 2.1 | 2.0 |
Output
id | label | f1 | f2 |
---|---|---|---|
6 | 1.0 | 2.1 | 2.0 |
4 | 0.0 | 4.1 | 5.0 |
5 | 0.0 | 3.1 | 6.0 |
66 | 1.0 | 2.1 | 2.0 |