Insert Into HIVE Table¶
Saves the DataFrame into an Apache HIVE Table
Type¶
transform
Class¶
fire.nodes.save.NodeInsertIntoTable
Fields¶
Name |
Title |
Description |
|---|---|---|
database |
HIVE Database |
Name of the HIVE Database |
table |
HIVE Table |
Name of the HIVE table |
saveMode |
Save Mode |
Whether to Append, Overwrite or Error if the path Exists |
partitionBy |
Partition By |
List of columns to partition by - separated by space |
partitionBy |
Partition By |
Partition By Column (can be empty) |
bucketBy |
Bucket By |
Bucket By Column (can be empty) |
Details¶
Insert Into HIVE Table Node Details¶
This node inserts data into a HIVE table.
When using Insert Into Table, the HIVE table has to already exist, Otherwise it throws the following exception:org.apache.spark.sql.catalyst.analysis.NoSuchTableException: Table or view ‘xyz’ not found in database ‘abc’;
Parameters to be set:¶
OUTPUT STORAGE LEVEL: Keep this as DEFAULT.
HIVE DATABASE: Specify the HIVE database containing the target table.
HIVE TABLE: Specify the table within the HIVE database where data will be inserted.
SAVE MODE: Choose how to handle existing data in the table (Append, Overwrite, ErrorIfExists, Ignore).
PARTITION BY: (Optional) Specify columns to partition the HIVE table.
BUCKET BY: (Optional) Specify columns to bucket the HIVE table.