OHDSI Home | Forums | Wiki | Github

DQD Results mismatch between Overview and checkResults when missing specific checkNames

General
#1

Hi,

I recently ran the DQD dashboard Rscript with CDM v5.3. Initially, I had missed to add cdmTable in our checkNames which resulted in mismatch in the data in checkResults and Overview objects in the produced results.json file. The checkResults object had 0 for passed column for all checks while the overview object showed a 97% pass rate.

Upon checking, I noticed that in this method, the code checks for the presence of a specific 3 cdmChecks - cdmTable, cdmField, measureValueCompleteness in order to trigger the calculateNotApplicableStatus method. The passed variable gets updated inside this method and without this method being triggered, it is set to the default value of 0 which is the source of discrepancy.

Can anyone please help me with my questions on this regard,

  1. What is the process to be followed when executing DQD Dashboards? In this link, for checkNames the script refers to Names can be found in inst/csv/OMOP_CDM_v5.3_Check_Descriptions.csv, but no mention of any mandatory checks to be included.
  2. What is the logic behind choosing these 3 specific checks to trigger calculatingNotApplicableStatus?

Thanks in advance!

#2

Can you please clarify what you mean here? A screenshot of your results viewer may be helpful.

Please see this documentation for more information about Not Applicable: Check Status Definitions • DataQualityDashboard

#3

@katy-sadowski
Below are the screenshots from the result viewer.

image
image858×387 25.5 KB

image
image1158×322 26.4 KB

But the overview has the correct count

image

#4

Sorry for the trouble, but would you actually mind filing this bug report in the DQD GitHub repo as an Issue here: Issues · OHDSI/DataQualityDashboard · GitHub

It’s easier for us to keep track of these things all in one place in GitHub :slight_smile:

In your report, please add everything you’ve shared here plus, the version of the package you are running. Thanks so much!

#5

No worries. Thanks Katy for the suggestion. I just submitted an issue in OHDSI DQD Dashboard - Overview and Checkresults counts are not matching when missing specific checkNames · Issue #565 · OHDSI/DataQualityDashboard · GitHub

1 Like
t