OHDSI Home | Forums | Wiki | Github

Distributed In-Memory Cache to accelerate OMOP CDM SQL queries

(Ken Cottrell) #1

Hello everyone,
This is a followup post to one I made earlier when I first joined this group. I am currently doing some research / development work with Apache Ignite, which is an open-source distributed cache with full SQL support. Typically Ignite is used to speed up RDBMS systems (in my case Postgres) by providing massive parallel search and query in front of the RDBMS.

From my initial work with OMOP CDM I see lots of opportunities to map the OMOP terminology lookups to a parallel processing platform that makes the lookup much more scaleable. To any one who is dealing with SQL bottle necks within a single RDBMS system and open to discussing distributed SQL cache to speed up workflows and Machine learning, I’d love to hear from you.