We are running ETL-CDMBuilder to convert Truven CCAE data to CDM format and in the 4th step (Conversion from RAW to CDM), it stopped because SQL server tables were not accessible. The batch# that was being processed at that time was 57156. After resources became available, CDM Builder started processing batch#57156 and did it successfully. It has been running for 4 days to process the remaining batches.
We have some questions related to ETL CDM Builder’s conversion process.
- If CDM Builder stops because of unavailability of resources and starts from the same batch#, will it process all the records present in that batch?
- If CDM Builder stops because of some error and we restart it without making any changes in the Builder database so that it starts from the same batch number, will it process all the records present in that batch?