OHDSI Home | Forums | Wiki | Github

FDA Challenge to parse product labels to identify adverse reactions

(Patrick Ryan) #1

@tbergvall just pointed me to this ongoing challenge: https://sites.mitre.org/adeeval/

Per the challenge, “OSE is interested in a tool that would enable pharmacovigilance safety evaluators to automate the identification of labeled AEs which could facilitate triage, review and processing of safety case reports.” Basically, they want to know what is ‘known’ on the product labels, so that they can only flag ‘unknown’ signals that arise in their signal detection and clinical adjudication phase. I know this is a shared interest at Uppsala Monitoring Centre, and of interest to various safety organizations within the pharmaceutical industry.

Given the work by @jon_duke on SPLICER, @rkboyce on LAERTES, @ericaVoss on the common evidence model, @Chunhua_Weng’s lab in parsing CT.gov, as well as the expertise within the NLP workgroup (@HuaXu @noemie @nigam ) , this seems like a great opportunity for the OHDSI community to showcase its expertise and collaborate as a group to make an important contribution.

They’ve made a reference dataset available for training your model, which you can download once you register on their site now. It appears submissions will be due end of January, based on a testset that will be released at a later time.

If anyone is interested in collaborating, we can use this forum threads to keep the conversation going.

(Hamed Abedtash) #2

@Patrick_Ryan Great opportunity! Would like to join the effort.

(Jon Duke) #3

Thanks for the heads up @Patrick_Ryan! We are on the case. @abedtash_hamed I will reach out to you. If anyone else is interesting in participating, let me know!


(Erica Voss) #4

I’m interested.

@schuemie and I had been working with Rave Harpez on a similar competition that occurred earlier which Rave presented his work at OHDSI late last year.

We (including @PaolaSaroufim & @rkboyce) were currently comparing his results to what we currently have in CEM from SPLICER so see if we can learn anything from that (i.e. what are the difference). Maybe that work can be informative for this work as well?

(Susant Mallick, Amazon Digital Evangelist, HCLS) #5

Hi Patrick, I am interested, We are doing similar things in Amazon using our SageMaker, but had training data challenges… would love to support…

(Alex) #6

This sounds interesting. Yes I am interested. It is a great opportunity