PheValuator 2.1.13 has been released. This is the first release of this package that has all the requirements for HADES.
PheValuator is an R package built using many other HADES packages including PatientLevelPrediction. The package is used to determine the performance characteristics, i.e., sensitivity, specificity, and positive and negative predictive value.
PheValuator follows a multi-step process to determine the performance characteristics of phenotype algorithms. In the first step, phenotype algorithms must be developed manually to identify subjects very likely with and those very likely without the health condition of interest. Those algorithms are used to generate highly accurate labels for subjects in the next step of the process, where a diagnostic predictive model is trained for the health condition. The diagnostic predictive model is next applied to a large, random sample of subjects from the database to determine the probability of each of these subjects of having the health condition. We refer to this set of subjects as the “probabilistic gold standard” dataset. In the final step, we evaluate potential research phenotype algorithms against the probabilistic gold standard and, based on the estimated probabilities, determine the performance characteristics of the tested algorithm. PheValuator has been used on many different type of phenotype algorithms, both those for acute health conditions as well as chronic health conditions.