OHDSI Home | Forums | Wiki | Github

Supporting datetime calculations in cohort definitions

We have submitted (and funded) an enhancement request to enable use of datetime in cohort definitions. The intent of this forum post is to facilitate community discussion about this topic. Although this feature was added as a milestone for Atlas 2.15, we’ve heard recent requests for more discussion to ensure that this would not break existing functionality.

The details of the need and request are here. That link includes discussions about details of implementation options. Below is an excerpt of the enhancement request.

Problem Statement

Multiple US electronic Clinical Quality Measure (eCQM) require datetime calculations when doing computations from electronic health records. Public domain examples are published here. The trend for needing datetime logic appears to be increasing.

In many cases, it is possible to create versions of those eCQM as Atlas cohorts, and then adapt the SQL to use datetime calculations instead of datetime. Although this may work for single institutions, it does not lend itself to developing these as phenotypes that can be run in a network study.

Examples:

  1. Hospital Harm - Severe Hyperglycemia. Checks for days when very high glucose measurements are present, but based upon rolling 24 hour periods starting from the time of ED or hospital admission (instead of calendar dates). Thus, the index date is actually a datetime.
  2. Hospital Harm - Severe Hypoglycemia. Checks whether follow-up glucose measurements occurred within 5 minutes after critically low measurements.
  3. Hospital Harm - Opiate-Related Adverse Events. Checks whether opioid antagonists had to be administered within 12 hours after administration of an opioid.

Current Behavior

The Atlas GUI for selecting timespans (e.g. between two dates) only supports whole-number date logic.

Desired behavior

Augment the Atlas GUI to allow for whole number datetime interval logic, with options to specify “minutes”, “hours”, or “days” instead of only “days”.

For simplicity to the users, the internal logic should know to use datetime interval logic instead of date logic whenever “minutes”, or “hours” are selected. This would eliminate the need for cohort authors to choose between “index start date” and “index start datetime”.

For example, if you want to know that an event occurred within 24 hours of admission, you would use an interval of 24 hours (which would use datetime logic) rather than 1 day (which would use date logic).

Here is example where I’d want to use 24 hours:

And here is example where I’d want to use minutes:

Feature Request Scope

  1. Make the word “days” a drop-down box like “Before/After” than has choices {days, hours, minutes)
  2. Augment the JSON to support this. I presume you want backwards compatibility. So, perhaps keep the existing syntax, but modify it to add optional “TimeUnit” and “TimeUnitValue” fields, where “TimeUnit” can have values “Days”, “Hours”, “Minutes”; and “TimeUnitValue” would have the desired value (that is currently show in the “Days” field? Below is example of how such time windows are currently represented in JSON:
                "StartWindow": {
                  "Start": {
                    "Days": 9,
                    "Coeff": -1
                  },
                  "End": {
                    "Days": 1,
                    "Coeff": -1
                  },
  1. Augment the generated SQL to use time interval logic whenever a TimeUnit other than “Days” is selected. Retain the current logic when “Days” is selected. Note. I have opened a feature enhancement issue with SqlRender to see if are able to generate interval time translations across all supported databases. Per GPT-4, the translations looks pretty straight forward.

Note, although not all data source have datetime-level data, the 5.3 OMOP data model and above all require datetime fields. By convention, those are populated with the same value that are in the matching data field. So, if this enhancement is added, phenotypes using seconds/minutes/hours should work (without breaking) on any 5.3 and above OMOP datasets. Data contributors would need to clarify which subset (if any) of their data has true datetime values, and Researchers would need to take that into consideration.

It would be possible to augment Data Quality Dashboard to test which data sources have actual datetime values, plus internal consistency between those datetime values and the regular date values.

You request makes perfect sense to me. It is hard to have one platform (OHDSI tools) that works great for days or more granularity but for hours - to use a different platform (SQL against OMOPed data that do utilize the more granular time (not just day)).

Perhaps establishing a community of OMOP sites that do have granular inpatient data and can provide more use cases that require hours/minutes granularity is a good goal. Also, coming up with network study that would utilize this feature would be nice. I know that digital health wearable sensors also record data with hourly frequency (when aggregated from 80 Hz frequency; 80 rows per second would strain the tables quite a lot for sure).

In summary, I want to give support to your call for hourly reasoning within OHDSI/OMOP. A CDM/toolkit should be stable but also not too rigid.

Using Capr and defining cohort with hourly granularity that would would a good bridge to this domain. So users would not use Atlas but Capr and achieve interoperability of cohorts that way.

Also, if you share any SQL that uses hourly logic, would also be a good next step for the community.

Having more documentation around circe-be is crucial for that.

I just looked at Capr documentation and it is also using only days. So support in JSON first, then Capr and perhaps later in Atlas.

There seem to be a Capr Cohort object that is made into Json with toCirce() function.

So if you don’t get your way with JSON, you can resort to using that Capr Cohort object that you enhance with what is needed for hourly reasoning.

Thank you for bringing this up. For those that are interested, we discussed this today in the CDM WG, here is the link to the recording.

1 Like

We need this (and other highly granular temporal functionality) to support critical care research. Development of support for that is being driven by work for a couple of large multisite projects and the OMOP version of MIMIC. All that is intended to build out support for critical care focused research for the whole OHDSI community.

Clair and Katy we will contribute to DQD and other related efforts to ensure that a standardized approach is verifiable and consistent and embedded in community-wide tools, schema, and other resources. We look forward to connecting with you about that. Those conversations should include Jared and Polina. We will check out the Dec '23 meeting recording to get up to speed before that.

t