Records processing optimization test report
This section provides a test report to help you set the optimum value for the Queue capacity field in an Advanced Database Target for optimizing the processing of high volume of records. ****
Environment setup
The following table contains the environment setup details for the test.
| CPU | 16 core |
|---|---|
| Memory | 18 GB |
| --- | --- |
| Solution Database | Oracle |
| --- | --- |
| Application version | Adeptia Connect v3.7.3 |
| --- | --- |
Advanced Database Performance Execution report
The following table contains the test results.
 | The test has been performed with the following Mapping Settings: • Split Data- enabled • Split Number Of Records- 1000 • Parallel Processing- enabled • Maximum Concurrent Processor- 2 |
|---|
| Number of records in the source file | Number of Process Flows using the source file | Optimize Processing setting | Execution time | Execution time | Execution time | CPU/Memory usage |
|---|---|---|---|---|---|---|
| At Mapping | At Target | Total | ||||
| --- | --- | --- | ||||
| 1300000 | 1 | Not Enable | 5min 12sec | 13min 18sec | 19min 11sec | CPU- 4% |
| Memory- 1.9GB | ||||||
| 1300000 | 1 | Enable (Queue Capacity= 500) | 3min 57sec | 1min 10sec | 5min 32sec | CPU- 5% |
| Memory- 2.3GB | ||||||
| 1300000 | 1 | Enable (Queue Capacity= 1000) | 3min 53sec | 1min 11sec | 5min 36sec | CPU- 6% |
| Memory- 2.32GB | ||||||
| 1300000 | 1 | Enable (Queue Capacity= 15000) | 4min 01sec | 1min 05sec | 5min 31sec | CPU- 6% |
| Memory- 2.3GB | ||||||
| 1300000 | 5 | Enable (Queue Capacity= 10000) | 4min 31sec | 1min 24sec | 5min 31sec | CPU- 32% |
| Memory- 4.3GB | ||||||
| 1300000 | 10 | Enable (Queue Capacity= 10000) | 4min 21sec | 6min 25sec | 11min 19sec | CPU- 58% |
| Memory- 7.3GB |