Releases

A running description of all bug fixes and improvements to the Archive.

Subscribe/unsubscribe to email notifications

Pending
''Not yet released. Some changes may be modified or withdrawn before release.''
 * Added StaffCovidTests table
 * Vitals data removed from ResidentData/Comorbidity dataset and into a new Vitals dataset
 * Added death due to Covid for staff

2.7
Released May 7, 2022

NightlyHousing dataset split into the four separate datasets: All users with access to the original NightlyHousing dataset now have access to these four datasets. All new files are named, stored, and updated as described in Supplemental/General_dataset_features. Please note that RoomCensus and BunkCensus will now need to be calculated on the user end by joining NightlyHousing on itself by ResidentId, Night, and Room/BunkId. Likewise, InfectedRoommates can be calculated by adding a join on CovidInfection.
 * ResidentData/NightlyHousing
 * ResidentData/LocationStatus
 * ResidentData/QuarantineIsolation
 * ResidentData/Devices

2.6
Released Feb 21, 2022
 * Added ResidentData/CovidHospitalization dataset, which lists all hospitalizations due to Covid for residents.
 * Updated TB logic in ResidentData/Comorbidity dataset.

2.5
Released Feb 7, 2022
 * More explicit labeling added for each detail element in the Details column of the CovidTests and StaffCovidInfection datasets
 * CovidInfection.Sequence column removed as it had been previously deprecated
 * ViralTestStatus,ViralTestType, and ViralTestResultDate data removed from CovidInfection.Elements as they were redunant: this information continues to be available via the CovidTests dataset.
 * ViralTestSpecimen data removed from CovidInfection.Elements as it is no longer deemed relevant and retaining it is computationally expensive.

2.4
Released January 10, 2022
 * Interpreter removed as a demographic value from Demographics dataset due to this data element no longer being available. See PrimaryLanguage value to determine resident's primary language.
 * Pango lineage added to CovidTests dataset, in cases where it is available.
 * Corrected bug in Comorbidity dataset wherein CVD was not showing for residents who also met criteria for high-severity HTN and high-severity CVD.
 * New Covid-related treatments added to Treatments dataset.
 * SxOnset and ViralTestSpecimen removed as elements from CovidTests due to unreliability

2.3
Released November 22, 2021
 * Redundant columns removed from StaffCovidInfection dataset.
 * Details column displaying Ct values and variant detected, if recorded, added to StaffCovidInfection dataset.
 * Bug fixed wherein 84 activities with activityminutes>720 had activityminutes set to NULL. Activity with duration>720 are likely due to inaccurate data entry and therefore these durations are set to NULL.
 * Activites dataset now starts on January 1, 2018. Activity data from before this time had excessive missingness.
 * Systemic dexamethasone added to Treatment dataset.

2.2
Released November 1, 2021
 * Bug fix in CovidTests wherein false positive test results were not showing. About 884 test results changed to false positive after bug fix.
 * Third vaccine dose for staff added to StaffCovidVaccination dataset. (Third doses for residents already included in Immunization dataset).
 * Removed SpO2 values from Comorbidities dataset that were explicitly recorded as not being on room air.

2.1
Released September 6, 2021
 * Filter removed from Date column of StaffCovidVaccinations such that any and all dates entered for received vaccinations will show, even if they may be data entry errors. This change was made to provide more information to end users so that they may make more accurate adjustements/imputations to illogical values.
 * Bug wherein CovidInfection.Hospitalization was showing diagnosis codes for in-prison care fixed so that only information on community hospital visits is given.
 * CovidInfection.Hospitalization no longer shows admitting diagnoses and instead now shows the highest level of care for any hospital visit initiated on a given day. See dataset description for details.

2.0
Released August 23, 2021
 * Incremental and Full files combined into a single file for each dataset except NightlyHousing, which remains as two files. See Supplemental/General_dataset_features page for date range and file naming details.


 * "FalsePositive" added as a result value to CovidTests dataset.


 * Casirivimab + imdevimab and unspecific MCAB for Covid-19 added to Treatments dataset

1.50
Released August 16, 2021
 * Bug wherein ResidentId for the same resident differed across datasets was corrected.
 * Unit column in StaffWork dataset now populated with a unique anonymized integer that represents the staff's work area for each record.

1.49
Released July 26, 2021
 * "Housed in a prison in another state" added as an Institution value in NightlyHousing
 * Missing OutToCourt and OutToMedical values added to NightlyHousing
 * Ethnicity description lengthened in Demographics.

1.48
Released June 21, 2021
 * CovidTransmission dataset replaced by NightlyHousing dataset. See ResidentData/NightlyHousing for details on new dataset and Supplemental/General dataset features for information on its flat files.
 * StaffWork position now equals "Unkown" instead of "Other" when position information is unavailable.

1.47
Released June 14, 2021
 * Ili in CovidInfection now equals 0 on any day when temp or spo2 was collected and neither was abnormal (temp>=37.8C, SpO2<94), 1 when either was. Null values mean no measurements were taken that day.
 * Min/Max temperature, SpO2, respiratory rate, systolic blood pressure, and pulse per day added to Comorbidities.

1.46
Released June 7, 2021
 * Gaps in Covidtransmission filled (bug #116290)

1.45
Released May 31, 2021
 * Semicolons removed from all values in Details column and files restored.
 * CovidTests now contains one record per resident per day per test outcome (positive, negative, inconclusive). See data dictionary for details.
 * Details for multiple tests for the same resident on the same day with the same result now separated by | and redundant values removed. See data dictionary for details.

1.44
Released May 24, 2021
 * CovidTests logic updated. CollectionDate values that were likely data entry errors have been set to equal ReceivedDate. In these cases the term "CollectionDate adjusted" appears at the end of the Details string. Additionally, in cases where the ReceivedDate precedes a valid CollectionDate, ReceivedDate is set to CollectionDate. These updates led to the additional of about 1,000 tests to the CovidTests dataset.
 * CovidInfection logic updated. Day values that were likely test collection date data entry errors have been adjusted by setting them equal to the test's received date.  Additionally, the Value column for element='ViralTestType' records now include additional information.

1.43
Released May 17, 2021
 * BoundedBirthYear added to StaffRoster. This the staff member's birthyear with the following exceptions: for all birth years < 1949, boundedbirthyear=1949; for all birth years>2000, boundedbirthyear=2000. Note that BoundedBirthDecade adds no additional information and will be removed in a future release.
 * Data from the California Immunization Registry added to StaffCovidVaccination to capture staff vaccinations received in the community for individuals who gave permission for these data to be shared with other government agencies.

1.42
Released May 3, 2021
 * CovidInfection.CovidLOC column values simplified to "Quarantine", "Isolation", and "Died". Other values were no longer reliable. In cases where one of these three remaining values does not apply to the resident, the column is now NULL. See wiki page for this dataset for details.

1.41
Released April 26, 2021
 * Brand added to StaffCovidVaccination dataset. See wiki page for this dataset for details.
 * In cases where a given staff in StaffRoster had multiple BoundedBirthDecades due to data entry error, the modal birth decade is now used.
 * Gaps filled in daily records fro some residents in CovidTransmission dataset.

1.4
Released April 19, 2021
 * New StaffRoster dataset added which lists all active staff each month. See wiki page on this dataset for details.
 * RoomCapacity and BunkCapacity in CovidTransmission show NULL when this value is not available. Previously, these columns showed 0 when the value was unknown.

1.3
Released April 12, 2021
 * New CovidTests dataset added which provides results of all completed Covid-related tests on residents, when data are available. See wiki page on this dataset for details.
 * FloorNumber and BedLevel added to CovidTransmission dataset. See wiki page for this dataset for details.
 * Some duplicate appointments removed from Activity and durations of activities with a recorded duration over 720 minutes set to NULL as they are likely data entry errors.
 * CovidInfection.Sequence column set to NULL as it was problematic. This column will be removed in a future release. To get all values for any given test, joining on ResidentId + Day is sufficient.  See wiki page for this dataset for further details.
 * Set Activity.PersonContacts and Activity.PersonContactMinutes to 0 for all educational activities on or after April 8, 2021 because all such activities have been conducted in-residence from that point to the present.

1.23
Released April 5, 2021
 * StaffCovidInfection.Gender now shows NULL if not "Male" or "Female".
 * Removed records in StaffWork where there were multiple records per staff per day per shift. StaffWork now contains only one record maximum per staff per day per shift.
 * ILI removed from Comorbidity dataset as it is already included in CovidInfection dataset.
 * Removed errant semicolon from CovidInfection dataset
 * StaffWork.Institution and StaffCovidVaccination columns now show "Other" if work/vaccination location is not a prison.

1.22
Released March 29, 2021
 * Starting and Ending columns in Demographics, Comorbidity, and Disability updated such that each record spans the period [Starting, Ending), with the Ending date of one record equal to the Starting date of the next for the same patient and date element.

1.21
Released March 22, 2021


 * Bug fix wherein Sequence value for CovidInfection records where element="TestResultDate" was incorrect. Corrected by setting Day value of these records to equal the collection date of the test.  Value column of these records still shows the date the test result was received, which may be the same as the collection date or may be a later date.


 * Bug fix wherein demographic values were missing from the demographics dataset. Corrected by setting the minimum startdate of all demographic values to January 1, 2016.


 * Warning added to description of CovidInfection.SxOnset stating that since the Covid-19 surge starting in December, 2020, SxOnset data are not be complete.

1.2
Released on March 15, 2021
 * Full and incremental files for each of the following datasets were restored to the SFTP site:
 * 1) StaffWork
 * 2) StaffCovidVaccination
 * 3) StaffCovidInfection


 * "Hospitalized" removed as a value from Comorbidity dataset as this information is already and more appropriately provided via the LocationStarus and OutToMedical columns of the CovidTransmission dataset.

1.1
Released on March 1, 2021

Note: All staff datasets (StaffWork, StaffCovidInfection, StaffCovidVaccination) remain offline and will be restored in a future release once all privacy safeguards have been implemented.


 * CovidInfection dataset normalized to reduce file size. No longer one record per resident per day.  See ResidentData/CovidInfection for details.
 * Addition of Hospitalization element in CovidInfection dataset.
 * Additional values included in CovidLOC element in CovidInfection dataset.
 * Treatment dataset containing Tamiflu and Bamlanivimab data added.
 * Dates for historical comorbidities in Comorbidity dataset now start at beginning of month instead of end of month.
 * Replaced truncated ethnicity values in Demographics dataset with full values
 * Fixed bug in CovidInfection wherein Ili dates were not correct.
 * Fixed bug in Activity wherein there was a semicolon in some job descriptions

1.01
Released February 17, 2021


 * Split each dataset into full and incremental files.

1.0
Released on February 8, 2021

The is the initial deployment of the research datamart SFTP files

The following zipped files were deployed to the SFTP site. Each zipped file contains a semicolon separated file of relevant data from January 1, 2016 through February 8, 2021. Filenames follow the convention of foldername+"_"+MMDDYYYY. Example: "Demographics_02082021". The suffix date represents the date the data were last compiled.


 * Activity\Activity.zip
 * Comorbidity\Comorbidity.zip
 * CovidInfection\CovidInfection.zip
 * CovidTransmission\CovidTransmission.zip
 * Demographics\Demographics.zip
 * Disability\Disability.zip
 * Immunization\Immunization.zip
 * StaffCovidInfection\StaffCovidInfection.zip
 * StaffCovidVaccination\StaffCovidVaccination.zip
 * StaffWork\StaffWork.zip