Live File Processor Agent File – Datum

<< Click to Display Table of Contents >>

Navigation:  Live > Agents > File Agents > File Processor > Settings > File >

Live File Processor Agent File – Datum

Datum_Value

 

Setting

Type

Description

datumValueColumnHeaderRegex

Regex

Add DT_LOGGER_DATUM table rows for column(s) whose header text matches this pattern.

 

Default Value: All columns.

 

Also see ignoreColumnHeadersRegex; it may be easier to exclude a column using this setting rather than include it using datumValueColumnHeaderRegex.

 

And updateExistingValues to update the DT_LOGGER_DATUM.DATUM_VALUE and DATUM_QUALIFIER, if a datum row (LOGGER_SERIES_ID and DATUM_UTC_DT) already exists in the database.

 

Note: The datum values (in the files) are currently parsed using a dot decimal separator (e.g., 1.23), regardless of the user's local settings.

 

 

Datum_Qualifier

 

Setting

Type

Description

datumQualifierColumnHeaderRegex

Regex

The DT_LOGGER_DATUM.DATUM_QUALIFIER column header text pattern (see LoggerDatum example).

 

Also see defaultDatumQualifier* to set (DT_LOGGER_SERIES.DEFAULT_DATUM_QUALIFIER and) DT_LOGGER_DATUM.DATUM_QUALIFIER when adding a new datum row (if a datum qualifier – datumQualifierColumnHeaderRegex – is not provided).

 

 

Datum Value Replacements

 

Setting

Type

Description

datumValueReplacements

String

Replace these case-insensitive string datum values (from the file) with these float or NULL values.

 

Note: DT_LOGGER_DATUM.DATUM_VALUE must be a float or NULL.

 

Examples:

 

' => NULL || NaN => NULL || NULL => NULL'
 
Replace empty, 'NaN', and 'NULL' datum values with NULL.

 

'N => 0 || NNE => 22.5 || NE => 45 || ENE => 67.5 || E => 90 || ESE => 112.5 || SE => 135 || SSE => 157.5 || S => 180 || SSW => 202.5 || SW => 225 || WSW => 247.5 || W => 270 || WNW => 292.5 || NW => 315 || NNW => 337.5'
 
Replace 'N' with 0, 'NNE' with 22.5, 'NE' with 45, etc.

 

'* => NULL'
 
Replace all non-float values with NULL.

 

Default Value: NaN => NULL || NULL => NULL

dataLinesRegexReplacements

Regex Replacements

Replace text in a data line using these Regex patterns and replacement strings (see Envirosuite example).

 

It is similar to datumValueReplacements, but it operates on the whole line (not a single datum value), and it can use regular expressions (it does not need to be an exact match).

 

 

Data End

 

Setting

Type

Description

dataEndLineRegex

Regex

Stop loading data at this line (see Diver example).

 

Start looking for a new header, if multiHeaderFiles = true
(see AreaRAE example).

 

 

Logging

 

Setting

Type

Description

logDatumValueParseErrors

Logging Level

Log a message if a datum value is not a float, and not in datumValueReplacements?

 

Default Value: Off

logDuplicateDatumRowErrors

Logging Level

Log a message if a there is a duplicate datum row (series and date and time) in a file?

 

Default Value: Error