Move local mappings from Source_to_concept_map to Concepts

CDM Builders
14

Question: What is the overall process for putting local mapping codes into Concept and Concept_Relationship?

  1. Usagi_stage
    – Usagi CSV files as source of truth
    – Add additional information fields in Usagi
    – Maintain mappings in Usagi
    – Store >2B concept_ids in Usagi
    – Load into Concept and Concept_Relationship with R scripts.

  2. Table_stage
    – Map using Usagi or Athena
    – Add additional information columns (concept_id, domain, relationship_ids (from and to), etc.)
    – Store mappings in secure tables, one for each mapping. Maintain as needed.
    – Create >2B concept_id in stage tables.
    – Load into Concept and Concept_Relationships from the same file. (ids pre-created in stage tables)

  3. STCM_stage
    – Map using Athena, Usagi, or manual.
    – Store in the Source_to_concept_map table.
    – Copy into Concept_stage and Concept_relationships_stage, creating >2B concept_ids.
    – Use SQL and Concept table to supply additional information (domain)
    – Append to Concept and Concept_relationships

Are there any others?