Date Time Field Extract

It creates a new DataFrame by extracting Date and Time fields.

Input

It takes in a DataFrame as Input

Output

The output DataFrame has year/month/dayofmonth/hour/minute/second values extracted from the specified TimeStamp column into new columns

Type

transform

Class

fire.nodes.etl.NodeDateTimeFieldExtract

Fields

Name	Title	Description
inputCol	Column	The input column name
extractYear	Extract Year	Extract Year
extractMonth	Extract Month	Extract Month
extractDayOfMonth	Extract Day of Month	Extract Day of Month
extractHour	Extract Hour	Extract Hour
extractMinute	Extract Minute	Extract Minute
extractSecond	Extract Second	Extract Second
extractWeekOfYear	Extract Week Of Year	Extract WeekOfYear
extractDayOfWeek	Extract Day Of Week	Extract Day Of Week
extractDayOfYear	Extract Day Of Year	Extract Day Of Year
extractMonthName	Extract Month Name	Extract Month Name

Details

Date Time Field Extract Details

Spark functions provides hour(), minute(), second() and weekofyear() functions to extract hour, minute, second and week of the year from Timestamp column respectively along with the standard functions of year(), month() and day().

It creates a new DataFrame by extracting the Date and Time fields.

Input

• Column :- The input column is selected here and it should be of DateTimeStamp datatype.

Output

• The values that can be extracted are YEAR,MONTH,DAY OF MONTH,HOUR,MINUTE,SECOND,WEEKOFYEAR,DAYOFWEEK and MONTHNAME

• The values that need to be extracted have to be set to true (by default it is false).

• Example:- The incoming Dataframe has a Date value as 2022-01-01 14:30:45 in YYYY-MM-DD HH:mm:ss format

  Set the EXTRACT YEAR as true to get the year( YEAR : 2022 )

Examples

If incoming Dataframe has Date value as 2022-01-01 14:30:45 in YYYY-MM-DD HH:mm:ss format then using datetimeextract node would result in followings

added as new columns to the Dataframe:

• YEAR : 2022

• MONTH : 01

• DAY OF MONTH : 01

• HOUR : 14

• MINUTE : 30

• SECOND : 45

• WEEKOFYEAR : 1