I went through this interesting study which assessed the impact of different analytic methods and choices on the obtained results, entitled “Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results” (Preprint and Published article).
While the experiment is not explicitly relevant with the kind of data that we elaborate in OHDSI, I think it is worth taking a look.
Of course, relevant reading is this OMOP Experiment.
This might be interesting for the Method Evaluation Taskforce.