Validate Fields Advanced
===========

Validation Multiple Node

Type
--------- 

transform

Class
--------- 

fire.nodes.etl.NodeValidationMultiple

Fields
--------- 

.. list-table::
      :widths: 10 5 10
      :header-rows: 1

      * - Name
        - Title
        - Description
      * - measureValue
        - Validation Successful if Percent Good Records >= 
        - Condition for Validation Passing
      * - inputCols
        - Columns
        - Columns
      * - functions1
        - Function
        - Validation Function to apply
      * - values1
        - Values
        - Values
      * - conditions1
        - Condition
        - Validation Condition to apply
      * - functions2
        - Function
        - Validation Function to apply
      * - values2
        - Values
        - Values
      * - conditions2
        - Condition
        - Validation Condition to apply
      * - functions3
        - Function
        - Validation Function to apply
      * - values3
        - Values
        - Values


Details
-------
Validate Fields Advanced Node Details
+++++++++++++++


This node creates two outgoing Dataframes based on the result of Validation Rules on the incoming Dataframe. 

First outgoing Dataframe consists of rows that succeeds the Validation Rules and second one consists of failed rows.   


This node facilitates checking of multiple conditions in each rule joined by AND or OR.


Multiple validation rules can be defined for multiple columns. Succeeded and Failed Dataframes are created by applying all the validation rules on the incoming Dataframes.


Examples
-------
Validate Fields Advanced Node Examples
+++++++++++++++


Incoming Dataframe has following rows:


::

    EMP_CD       |    EMP_NAME       |    DEPT       |    SALARY       |    AGE       |    DATE_OF_JOINING       |    EMAIL
    ------------------------------------------------------------------------------------------------------------------------------------
    E01          |    ANTHONY        |    HR         |    50000        |    40        |    2020-12-12            |    anthony@hrdept.com
    E02          |    LISA           |    HR         |    35000        |    35        |    2021-02-30            |    lisa@hrdept.com
    E03          |    MARTIN         |    HR         |    20000        |    25        |    2020-01-01            |    martin@nodept.com
    E04          |    DAVID          |    SALES      |    55000        |    40        |    2021-13-13            |    david@salesdept.com
    E05          |    MARK           |    SALES      |    60000        |    27        |    2020-01-01            |    mark@salesdept.com
    E06          |    JOE            |    SALES      |    40000        |    31        |    2010-01-01            |    joe@salesdept.com
    E07          |    BELLA          |    HR         |    60000        |    24        |    2001-12-12            |    bella@hrdept.com


if following Validation Rules are defined in Validation node:


::

    COLUMNS       |    FUNCTION             |    VALUES       |    CONDITION    |    FUNCTION               |    VALUES
    ------------------------------------------------------------------------------------------------------------------------
    AGE           |    VALUE_GREATER_THAN   |    30           |    AND          |    VALUE_LESS_THAN        |    41
    EMP_NAME      |    LENGTH_GREATER_THAN  |    2            |    AND          |    LENGTH_LESS_THAN       |    5


then outgoing Dataframes would be created as below:



Succeeded Dataframe consisting of rows that succeeded Validation Rules:
+++++++++++++++


::

    EMP_CD    |   EMP_NAME  |    DEPT    |  SALARY  |    AGE   |  DATE_OF_JOINING  |  EMAIL              |  validation_result | validation_result_reason
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    E02       |   LISA      |    HR      |  35000   |    35    |  2021-02-30       |  lisa@hrdept.com    |  1                 |
    E06       |   JOE       |    SALES   |  40000   |    31    |  2010-01-01       |  joe@salesdept.com  |  1                 |



Failed Dataframe consisting of rows that failed Validation Rules:
+++++++++++++++


::

    EMP_CD    |   EMP_NAME  |    DEPT    |  SALARY  |    AGE   |  DATE_OF_JOINING  |  EMAIL              |  validation_result | validation_result_reason
    -----------------------------------------------------------------------------------------------------------------------------------------------------------
    E01       |   ANTHONY   |    HR      |  50000   |    40    |  2020-12-12       |  anthony@hrdept.com |  0                 | EMP_NAME value length is not less than 5 ,
    E03       |   MARTIN    |    HR      |  20000   |    25    |  2020-01-01       |  martin@nodept.com  |  0                 | AGE is not greater than 30 , EMP_NAME value length is not less than 5 ,
    E04       |   DAVID     |    SALES   |  55000   |    40    |  2021-13-13       |  david@salesdept.com|  0                 | EMP_NAME value length is not less than 5 ,
    E05       |   MARK      |    SALES   |  60000   |    27    |  2020-01-01       |  mark@salesdept.com |  0                 | AGE is not greater than 30 ,
    E07       |   BELLA     |    HR      |  60000   |    24    |  2001-12-12       |  bella@hrdept.com   |  0                 | AGE is not greater than 30 , EMP_NAME value length is not less than 5 ,