Archival (short interval) data files

Archival files contain processed and edited data. The file format is tab-separated ASCII. These short interval files are in month blocks. Intervals occurring in our archival data files are: one, five, ten, fifteen, or sixty minutes long. Current data is all at one minute time intervals. Older data files contain larger time intervals.

The first line of each file is a header that contains the monitoring station ID code, the year in which the data were obtained, and a series of element numbers. These element numbers describe the data in each column. Each data value is followed by a data quality flag. The element numbers for the flag columns are a zero.

Data begins on the second line. The left most column is day of the year.
For example,
January 1 is 1,
February 1 is 32,
December 31 is 365 (for non-leap years).

The next column indicates the ending time of the measurement in military time format. For example, 105 would be 1:05 a.m. and 1535 would be 3:35 p.m. Data values on a given line are understood to "occur" during the interval extending from the ending time on the previous line to the ending time on the line in which they are listed. All times are listed in local standard time (never daylight savings time).

Following the day-of-year and time are the data and flag column pairs. Some data values may be averages over the time interval in which they occur, but others may be totals over the same interval. The element number for each column identifies how that column was computed.

Below is an example file from Hermiston January 1, 1997.

    94169 1997  1000  0     2010  0     1002  0
    1     100   0     12    0     12    0     12
    1     200   0     12    0     12    0     12
    1     300   0     12    0     12    0     12
    1     400   0     12    0     12    0     12
    1     500   0     12    0     12    0     12
    1     600   0     12    0     12    0     12
    1     700   0     12    0     12    0     12
    1     800   1     12    0     12    2     12
    1     900   31    12    0     12    30    12
    1     1000  79    12    1     12    73    12
    1     1100  125   12    0     12    120   12
    1     1200  132   12    1     12    125   12

This example is from HEHR9701.txt. The first line gives the location ("94169" is Hermiston), the year ("1997"), and the element numbers: "1000" is global irradiance, "2010" is direct normal or beam irradiance, and "1002" is a second instrument measuring global irradiance.

The first data line provides the year-day ("1" is January 1), time of day ("100" is 1:00 a.m.), and an alternating sequence of data values and flags. The first data value is the global irradiance: 0 watt hours per square meter per hour, and its associated flag is "12", which stands for processed data. Next is the direct normal irradiance value followed by its flag, and then the second global value and its flag. The file contains hourly data for all 31 days of the month.