OHDSI Home | Forums | Wiki | Github

OHDSI Study: Comparative effectiveness of alendronate and raloxifene in reducing the risk of hip fracture

Hi @msuchard,

I am a data scientist from a data analysis company in China named “Palan DataRX”, I have lead several real world projects, and have some experience in comparative effectiveness. Currently, four of research work have been submitted to ISPOR and accepted. I would love to join this study and contribute to the statistical analysis work. :grinning:

Thank you!

Hi @SCYou!

As you can see in the current definition of the target cohort, we select new-users based on the ingredient, so including combinations.

However, it is important to remember that drugs prescribed on the index date will be available for inclusion in the propensity model. If it is truly the case that alendronate and cholecalciferol go hand-in-hand in your data, I would expect cholecalciferol to be a strong predictor in the propensity model and any bias this might cause would be adjusted for by our propensity score adjustment. We actually have two good diagnostics to verify this happens correctly: the covariate balance plots (which will include the covariate for cholecalciferol) and the negative control distribution plot (which will show if residual bias exists after adjustement).

Thanks for the response, @schuemie

I don’t worry about matching power of CohortMethod itself.

We need to add drug of alendronate into ‘excluded concept set’ for the variables matched. Then, aren’t combination drugs of alendronate + cholecaciferol excluded for the variables matched either?

Good question!

On of the sources of covariates for the propensity model is the drug_era table. In this table, information about exposure is aggregated to the ingredient level. As you point out, information about alendronate will be discarded when building covariates, but all information about cholecaciferol will remain because the drug_era table does not contain information on combination products, just about the ingredients that may or may not be in combination products.

Hi all, we have reformatted the protocol for our IPCI governance board and have submitted this.
The meeting of our board is next week (we did a last minute submission).

Hope we can contribute to the study.

Peter

@schuemie
Yes, that’s what I wonder. Thanks for answering.

Hi

I am from ZS associates and we will like to contribute on the statistical analysis part of the work. Do let us know what is required

Thanks
Manish

Our claims data (recently converted to OMOP) spans only 365 days and the study requires at least 365+90 - so we cannot participate. :disappointed:


Before the study gets executed, perhaps this OHDSI study could be the first that in addition to table 1 (overview of population) also presents data on data quality.

A paper by Kahn at al argued for a table 1a that would present data for observational studies.
See it here.

The current code in terms of metadata only gets

createMetaData <- function(connectionDetails, cdmDatabaseSchema, exportFolder) {
    conn <- DatabaseConnector::connect(connectionDetails)
    sql <- "SELECT * FROM @cdm_database_schema.cdm_source"

Perhaps this could be extended (before final execution). (and I would be happy to contribute to coding that, since I am suggesting it)

The OHDSI [DataQuality]
(StudyProtocolSandbox/DataQuality at master · OHDSI/StudyProtocolSandbox · GitHub) package tries to reduce the number of attributes about a dataset (instead of all Achilles results data it has a much reduced subset of parameters) that a site could share and that is vastly less “sensitive”.
This could also be be just a tiny handful of parameters: (1) size of dataset population (as a size category [not exact size]) (perhaps just patients with at least 365+90 days in at least one obs period) (2) “level of inpatient-ness (% of outpatient visits out of all visits recorded); (3) level of claims-ness vs EHR-ness(e.g., % of patients with weight recorded) and some temporal span measures. I recently made a proposal to Data Quality Collaborative for MIAD (minimum information about a dataset) (as a similar concept to MIAME (minimum information about a microarray experiment).

Feedback from Yiting Wang, a colleague at Janssen who has previous publications on the effects of bisphosphonates:

The protocol is very concise, still better to call out a couple specifics such as
Comparative effectiveness study in postmenopausal women (reflected in the cohort creation algorithm but not updated in the protocol, e.g., “gender” on page 6 of the 26-page PDF initially made me wonder if men were included)

“The target cohort and comparator cohorts will be stratified into 5 quantiles” (quintiles?) of the propensity score distribution (after trimming off the top and bottom 10% from the preference score distribution?)

• The extra 4-year age band of 46-49 (assuming standard 5-y age bands of 50-54, 55-59, …) likely contribute negligible number of hip fracture cases, while raising doubts on post-menopausal status, and whether hip fracture was osteoporotic or high-impact. Why not use age 50 and above? After all, osteoporotic hip fracture cases typically are ~70+ years old, and menopause typically occurs at age ~48-55.

• What is the rationale for requiring index date before 2012-02-01? How far before 2012-02-01? This does not seem to be related with proton pump inhibitors going OTC in the US, or osteonecrosis of the jaw being given an ICD-9 code.

• “Patients were excluded from consideration is (if) they qualified for both the target cohort and comparator cohort at any time in their record”. Does this exclusion criterion apply to post-index period, i.e., decision in the past based on info from the future?

• Hip fracture outcome restricted to inpatient diagnosis as either primary or sensitivity analysis?

• Non-hip, non-vert fractures that are more likely related to osteoporosis rather than accident for example, commonly include the following sites: rib, clavicle, humerus, radius/ulna, wrist, pelvis, or tibia/fibula. Fractures in fingers and toes may be included in sensitivity analysis.

• Vertebral compression fracture (VCF) outcome has to be interpreted with caution due to misclassification. E.g., Curtis (https://www.ncbi.nlm.nih.gov/pubmed/?term=19106733 ) found that more than half of incident VCFs were misclassified based a VCF diagnosis on any claim.

Hi Marc,

This is Yonghui from UTHealth. We would like to join this research. We have the Cerner HealthFacts data and patient claim data from Blue Cross.

Thanks,
Yonghui

Hi Vojtech,

Data quality remains very important. Could you make a git branch with a patch? At minimum, we could collect this information at a couple of sites.

best, M

1 Like

Hi Manish,

Great to have you involved. We’ll have R objects back from data partners shortly. Are there some specific analyses you’d like to undertake? Maybe you have some ideas about better meta-analyses across databases? You can take a look at the CohortMethod vignette to get an idea of the artifacts that each data partner returns.

best, Marc

Study was apparently moved from sandbox folder to a Protocols “folder”.

Link that works is: https://github.com/OHDSI/StudyProtocols/tree/master/AlendronateVsRaloxifene

@msuchard. I know Christian is a participant, but I would like to get our team involved. Can we join by running the study on our data?

@mvanzandt:

I bring you in offline.

Hi @msuchard,

I am Dr Kang, an orthopaedic surgeon working in Asan Medical Center, Seoul, Korea. My research colleague (professor Yu Rang Park) and I want to join the project with the data from our center.
Before participation, I want to ask this question. Although we, in Asan Medical Center, are currently converting the recent-5-years clinical data into the format of OMOP CDM version 5, it’s not finished yet. Can we join the project with only the data required by the present project?

Hi @msuchard,

We’re trying to start Korean version of ‘Save Our Sisyphus’ challenge with collaborating Korean hospitals.
I wonder how you resolved problem with IRB on the study about alendronate and raloxifen. Did you get individual IRB approval from all collaborating sites?

Hi @SCYou!

In all OHDSI studies each site has to get individual IRB approval, and so this was also the case with the alendronate and raloxifen study.

We found it helps greatly when a full protocol is made available that can be used by each site as the basis for requesting IRB approval. (I imagine in Korea it would help to have a Korean version :wink: )

Thank you for the reply @schuemie

Since one of the major obstacles of multi-site multi-national collaborative study in OHDSI is individual IRB issue, we’re reviewing Korean law on biomedical research and IRB now. Various views about IRBs exist depending on the interpretation of the law.
Currently, individual IRB approval should be approved in each Korean medical institution. But we’re proposing a revision of the relevant laws to the Korean government.

@msuchard
Korean OHDSI data network will start Korean ‘Save Our Sisyphus’ challenge soon.
So far, four tertiary hospitals in Korea have announced their intention to participate as supporters. (spanning from 2005-2015, more than 7 million patients)

We will seek good research questions from Korean researchers. Korean OHDSI data network will provide support through every step of the process, working with the researcher to design an appropriate protocol, implement a network analysis package, execute across supporters, and prepare a manuscript for publication, just as what SOS challenge did.

Korean OHDSI data network is still in its newborn stage. Through this challenge, we will prove that we, Korean OHDSI data network, can stand on our feet. Then, we will walk, run and actively participate in the journey.

I think there will be tremendous difficulties in this challenge. I ask for your help as experienced one.

Thank you,
Chan

1 Like
t