Insert Into HIVE Table

Saves the DataFrame into an Apache HIVE Table

Type

transform

Class

fire.nodes.save.NodeInsertIntoTable

Fields

Name

Title

Description

database

HIVE Database

Name of the HIVE Database

table

HIVE Table

Name of the HIVE table

saveMode

Save Mode

Whether to Append, Overwrite or Error if the path Exists

partitionBy

Partition By

List of columns to partition by - separated by space

partitionBy

Partition By

Partition By Column (can be empty)

bucketBy

Bucket By

Bucket By Column (can be empty)

Details

Insert Into HIVE Table Node Details

This node inserts data into a HIVE table.

When using Insert Into Table, the HIVE table has to already exist, Otherwise it throws the following exception:org.apache.spark.sql.catalyst.analysis.NoSuchTableException: Table or view ‘xyz’ not found in database ‘abc’;

Parameters to be set:

  • OUTPUT STORAGE LEVEL: Keep this as DEFAULT.

  • HIVE DATABASE: Specify the HIVE database containing the target table.

  • HIVE TABLE: Specify the table within the HIVE database where data will be inserted.

  • SAVE MODE: Choose how to handle existing data in the table (Append, Overwrite, ErrorIfExists, Ignore).

  • PARTITION BY: (Optional) Specify columns to partition the HIVE table.

  • BUCKET BY: (Optional) Specify columns to bucket the HIVE table.