Supplemental/General dataset features

Overview of features common to all Archive datasets.

Date range of data
Each dataset is split into a full file and an incremental file which together comprise all available data from January 1, 2016 up to the date the incremental file was last created. Below is a table describing which data fall in the full and incremental file for each dataset, based on the first day of the calendar month prior to when the file was created (PriorMonthStart ).

File names
Each dataset is split into a full file and an incremental file.

Full files
The naming convention for full files is dataset_Full_date. Examples:
 * Demographics_Full_12022020
 * Activity_Full_03152021

Incremental files
The naming convention for incremental files is dataset_Incremental_date. Examples:
 * Demographics_Incremental_12212020
 * Activity_Incremental_03172021

Column headings and delimeter
Each column value in each file is separated by a semicolon (;) with the column headers in the first row.

Refresh frequency
The incremental and full versions of each dataset are regularly updated each weekend. In the event of an upgrade or bug fix, a given file may be refreshed more frequently. The refresh date of each file is always appended to the end of the filename. See file names section for details on filenaming.

Date formatting
All dates are in the form YYYY-MM-DD. For example, January 1, 2021 is shown as 2021-01-31 and April 1st, 2019 is shown as 2019-04-01

DateTime formatting
Datetimes are in the form YYYY-MM-DD HH:MI 2019-03-06 21:51, 2018-01-12 09:49
 * Examples