Write To Snowflake¶
Input¶
The Dataframe from the previous node
Output¶
The incoming Dataframe is passed to the next node as it is
Type¶
transform
Class¶
fire.nodes.snowflake.NodeWriteToSnowFlake
Fields¶
Name |
Title |
Description |
|---|---|---|
authType |
Auth Type |
Authentication Type. Possible value is OAUTH or USER_CREDENTIAL or KEYPAIR |
connection |
Connection |
The Snowflake connection to connect |
sfWarehouse |
Snowflake Warehouse |
Warehouse for connecting to the Snowflake |
sfDatabase |
Snowflake Database |
Database for connecting to the Snowflake |
sfSchema |
Snowflake Schema |
Schema for connecting to the Snowflake |
dbtable |
Snowflake Table |
Snowflake Table from which to write the data |
columnMapping |
Column Mapping |
The connector must map columns from the Spark data frame to the Snowflake table |
saveMode |
Save Mode |
Whether to Append, Overwrite or Error if the table Exists |
properties |
Properties |
|
extraOptionsKeys |
Properties Name |
Extra options/properites available while executing in WriteToSnowFlake. |
extraOptionsValues |
Properties Value |
Config Values for the Corresponding properites name |
Details¶
Write To Snowflake Node Details¶
This node saves the rows of the incoming dataframe into the specified table in Snowflake.
Parameters to be set:¶
OUTPUT STORAGE LEVEL : Keep this as DEFAULT.
CONNECTION : Select the desired snowflake connection to be used.
SNOWFLAKE WAREHOUSE : Specify the virtual warehouse to use for the connection.
SNOWFLAKE DATABASE : Specify the database to use once connected.
SNOWFLAKE SCHEMA : Specify the schema to use for the specified database once connected.
SNOWFLAKE TABLE : Specify the table from which data is to be read.
SAVE MODE : Select the mode of operation on the table.
Append: If data/table already exists, contents of the table are to be appended to existing data.
Overwrite: If table already exists, existing data is overwritten by the new content.
ErrorIfExists: If data already exists, an exception is thrown and operation stops.
Ignore: If table already exists, the save operation is ignored.
Examples¶
Write To Snowflake Node Examples¶
The below example will save the input dataframe to the CUST_BASIC_LA table.¶
CONNECTION : SNOWFLAKE_DEV_ENV_NCUS
SNOWFLAKE WAREHOUSE : SNOWFLAKE_BI_VWH
SNOWFLAKE DATABASE : CUSTOMER_SALES_NCUS
SNOWFLAKE SCHEMA : INT_NA_CUSTSALES
SNOWFLAKE TABLE : CUST_BASIC_LA
SAVE MODE : Overwrite