File Processor Agent Example – TOA5

<< Click to Display Table of Contents >>

 >Live > Agents > File Agents > File Processor > Examples >

File Processor Agent Example – TOA5

 

Setting

Value

Description

TOA5.dateTimeColumnHeaderRegex

TIMESTAMP

DT_LOGGER_DATUM.DATUM_UTC_DT date; column header text contains TIMESTAMP.

TOA5.delimiters

&#09;,

The fields are separated by tabs and/or commas.

TOA5.folderWatcherPath

C:\EarthSoft\Live\TOA5


TOA5.headerLinesRegex

TIMESTAMP\n.*\n.*

The header has 3 lines that look like this:

1.contains TIMESTAMP

2.anything (.*)

3.anything (.*)

TOA5.ignoreColumnHeadersRegex

RECORD

Do not add series or datum for columns whose header text contains RECORD.

TOA5.loggerCodeHeaderLinesRegexGroups

^&quot;*TOA5&quot;*[\t,]&quot;*(?'a'.*?)&quot;*([\t,].*){4}[\t,]&quot;*(?'c'.*?)&quot;*[\t,]&quot;*(?'b'.*?)&quot;*$

DT_LOGGER.LOGGER_CODE; the named group values are ordered alphabetically, based on the group names: a:b:c
(e.g., ABC-03:Min_60:22222).

TOA5.seriesNameColumnHeaderRegexGroups

^(?'a'.*)\n

DT_LOGGER_SERIES.SERIES_NAME, SERIES_UNIT, and SERIES_FUNCTION (e.g., Veloc_ms_Avg, m/s, Avg).

TOA5.seriesUnitColumnHeaderRegexGroups

\n(?'a'.*)\n

TOA5.seriesFunctionColumnHeaderRegexGroups

(?'a'.*)$

 

And default (non-TOA5) settings:

 

Setting

Value

Description

dateTimeFormats


Empty; determined automatically.

utcOffsetHrs

0

DT_LOGGER.UTC_OFFSET_HRS

 

 

"TOA5","ABC-03","CR1000","12345","CR1000.Std.27","CPU:FM6_101012.CR1","22222","Min_60"

"TIMESTAMP","RECORD","Veloc_ms_Avg","Direction_Deg_Avg","Temp_C_Avg","Solar_Rad_Tot","Evaporation_mm_Smp"

"TS","RN","m/s","Deg","C","MJ/m2","mm"

"","","Avg","Avg","Avg","Tot","Smp"

"2017-06-22 16:00:00",3812,1.918,358.5,26.4,1.847365,0.258

"2017-06-22 17:00:00",3813,2.179,21.56,26.17,1.29014,0.257

"2017-06-22 18:00:00",3814,2.844,42.54,24.73,0.5120003,0.311

 

 

Note: The Campbell Scientific LoggerNet Agent can also be used to load data from Campbell Scientific LoggerNet logger ('TOA5') files. It has some additional functionality (e.g., it adds DT_EQUIPMENT rows) and can watch individual files, in addition to folders.