NOTE_NLP CDM Versioning or Duplicate CDM Concepts

JohnOsborne · January 27, 2023, 5:46pm

Folks,

We have been working on referencing the NOTE_NLP and its columns, but it appears there are multiple concepts which are identical but only differ in VALID_START_DATE and CDM Concept Code. Is this an intentional versioning issue or are these duplicates?

Any information appreciated.

https://athena.ohdsi.org/search-terms/terms?query=note_nlp.note_id&boosts&page=1

dmitry.buralkin · January 31, 2023, 5:26am

Hello, @JohnOsborne. There are concepts seem to be identical but they can regard to slightly different situations

Alexdavv · February 1, 2023, 8:24am

Here you go:

github.com/OHDSI/Vocabulary-v5.0

Duplicate CDM table and field concepts

opened 06:36PM - 21 Nov 19 UTC

closed 01:51PM - 29 Dec 22 UTC

don-torok

Example: concept_id | concept_name | domain_id | vocabulary_id | concept_clas…s_id | standard_concept | concept_code | valid_start_date | valid_end_date | invalid_reason -- | -- | -- | -- | -- | -- | -- | -- | -- | -- 1147195 | care_site.care_site_id | Metadata | CDM | Field | S | CDM251 | 2014-11-11 | 2099-12-31 1147654 | care_site.care_site_id | Metadata | CDM | Field | S | CDM700 | 2018-10-11 | 2099-12-31 Query to get the others select c2.concept_code, c1.* from concept c1 JOIN concept c2 ON c1.concept_name = c2.concept_name AND c1.domain_id = c2.domain_id and c1.concept_class_id = c2.concept_class_id AND c1.concept_id > c2.concept_id WHERE c1.vocabulary_id = 'CDM' -- and c1.concept_class_id = 'Table' AND c1. standard_concept = 'S' AND c2.standard_concept = 'S';