Welcome to the Method Evaluation Task Force! You are here because you responded to the call for collaborators. Just as a reminder, the objectives of this task force are:
- Develop the methodology for evaluating methods
- Use the developed methodology to systematically evaluate a large set of study designs and design choices.
By ‘methods’ I mean population-level effect estimation methods, such as a particular new-user cohort design or a case-control design, and by ‘evaluation’ I mean an empirical evaluation, where a gold standard set of exposure-outcome pairs with know effect sizes is used to evaluate whether the method produces the expected result. Compulsory reading is the main OMOP Experiment paper.
How the task force will work
Since we’re spread across the globe, we will use the forums as our primary mode of communications. We will identify one or more papers that we want to write, and people can contribute by either helping design the experiments, write the analysis code, run the experiment on their data, or write the paper. Authorships will be rewarded to those who actively contribute to these tasks, but only for substantial contributions (not just forum posts). OHDSI will not provide funding for participation, but task force members are free to seek funding (possibly together) for these activities. The goal is to have completed the research by the OHDSI Symposium in October.