ATLAS-Search-RC and DRC are populated as 0

[Chris_Knoll]

Ok, thanks for confirming. Initially, we were only showing record counts for standard concepts in the output, however, my understanding is that recent changes have looked at both the standard concept field (condition_concept_id) and the non-standard concept field (condition_source_concept_id), although I’m not exactly certain where those changes were made (if it’s a new version of Achilles, or if it is some additional script that does that).

@AnthonyMolinaro: do you have this information, or @Ajit_Londhe?

[Ajit_Londhe]

Achilles does have analyses that characterize source_concept_id fields. For example, analysis id 425, counts condition_source_concept_id values.

[CSC (Chetan)]

Hello @Ajit_Londhe,

We are using Atlas version 2.7.4 with WebAPI version 2.7.4.

We indeed had run Achilles analysis. I checked for analysis-id 425 and for condition_source_concept_id=‘44834715’ in achilles_results table in results schema and found a non-zero value. Below is the screenshot -

I checked for the SQL script (from here)that is used for analysis-id 425 and executed against my database.Below is the screenshot-

I am still unsure why the values are still 0(zero) when being displayed in Atlas
Please help.

Thanks in advance.

[Ajit_Londhe]

Hmm. Do you have the concept_hierarchy table?

[CSC (Chetan)]

Hello @Ajit_Londhe,

Yes, it’s there under results schema.

[CSC (Chetan)]

Hello @Ajit_Londhe, @Chris_Knoll,

We did some more analysis and executed few more queries on the database to ensure that we have proper data in the tables.
We executed the query of getConceptRecordCount on our database and it returned a non-zero count.

We also tried refreshing cache for the data source from the Configuration tab/page of Atlas and executed the loadConceptRecordCountCache query to ensure that non-zero counts are present. But still the count on Atlas is being displayed as 0 (zero).

While refreshing the Atlas->Search page we found that the call through WebAPI to URL https://servername/WebAPI/cdmresults/omop_cdm/conceptRecordCount doesn’t return any response.

Can you please help us in identifying the cause of this issue?

Thanks.

[Ajit_Londhe]

Has the WebAPI server been restarted since you finished running Achilles? Perhaps the vocab cache in WebAPI hasn’t been refreshed.

[CSC (Chetan)]

Hello @Ajit_Londhe,
We had restarted Tomcat service but not the physical server.
Thanks.

[Ajit_Londhe]

Oh that’s fine then. I was just referring to Tomcat.

[Ajit_Londhe]

@Chris_Knoll – I’m at a loss here. From an Achilles perspective, nothing has changed recently with any of the codebase. I’ve recently run it and added a CDM to Atlas and all the record counts come through.

@CSC – have you set up your source correctly in WebAPI? That is, does the source daimon for the results have a priority of 1?

[CSC (Chetan)]

Hello @Ajit_Londhe, @Chris_Knoll
The priority was set to 2 for results in webapi’s source_daimon table.
I changed it to 1, logged-in to Atlas again and performed the search for ‘hypertension’ but still zero count under RC and DRC.
Should I 'Refresh Cache’ for the data source from the Configuration page in Atlas?

Thanks.

[Ajit_Londhe]

I would restart Tomcat, then in Atlas, refresh the cache in config.

[Chris_Knoll]

I’m not sure either. The getConceptRecordCount query is the query that is executed at the conceptRecordCount endpoint. However, that endpiont is a POST, so you can’t just go to the URL and look for a result (it should give you something like ‘not allowed’).

When I search on my local system, and look at the console, I see the request, and the payload:

The response is shwoing non-zero values:

My only hypothesis is that the source configuration is looking at the wrong schema and the wrong schema just has empty tables in it. I can’t understand why you’d get results out of a raw sql query to the DB, but the server’s doing the same thing (supposedly) and getting nothing…

[CSC (Chetan)]

Hello @Ajit_Londhe,

As suggested, I restarted Tomcat and then performed the ‘Refresh cache’ in Atlas from Configuration tab.

I am still getting zero counts.

Thanks.

[Ajit_Londhe]

Can you post your source and source_daimon tables — but abstracted of all login/server info?

[CSC (Chetan)]

Hello @Ajit_Londhe,

Here are the screenshots of source and source_daimon tables -
source

source_daimon

Thanks.

[Ajit_Londhe]

Can you change priority to 0 for source_daimon_id 2 and 4? And then restart Tomcat, clear Atlas cache.

[CSC (Chetan)]

Hello @Ajit_Londhe,

As suggested, I changed the priority to 0 (zero) for source_daimon_id =2 and 4.
Restarted Tomcat.
Performed ‘Refresh Cache’ from Configuration page of Atlas.

The counts are still 0.

Thanks.

[Ajit_Londhe]

Any console errors in Chrome?

[CSC (Chetan)]

Hello @Ajit_Londhe,

We are using Firefox. There are few ‘Cross Origin Request Blocked’ errors.

Thanks.