Structured Streaming File Sink

It writes the DataFrame to files with Structured Streaming

Input

It takes in DataFrame as input

Output

It writes the incoming DataFrame to files.

Type

transform

Class

fire.nodes.structuredstreaming.NodeStructuredStreamingFileSink

Fields

Name	Title	Description
path	Path	Path where to write the files
outputMode	Output Mode	Output Mode for saving to Files
checkpointLocation	Checkpoint Location	Checkpoint Location on HDFS compatible file system for Streaming
format	Format	File Format
awaitTermination	Await Termination
triggerIntervalInSeconds	Trigger Interval In Seconds
partitionBy	Partition By Columns	Partition By Columns separated by space (can be empty in which case partitionBy would not be applied)