Records processing optimization test report

This section provides a test report to help you set the optimum value for the Queue capacity field in an Advanced Database Target for optimizing the processing of high volume of records.  

Environment setup 

The following table contains the environment setup details for the test. 

CPU	Request: 2 CPU
	Limit. : 3 CPU
Memory	Request: 4 GB
	Limit. : 8 GB
JVM Settings	-Xms4096M -Xmx6144M
Backend DB Connection	Min Idle: 10
	Max Active: 50
Log DB Connection	Min Idle: 10
	Max Active: 50
Solution Database	Oracle
Application Version	Adeptia Connect v4.5

Advanced Database Performance Execution report

The following table contains the test results. 

The test has been performed with the following Mapping Settings: Split Data- enabled Split Number Of Records- 1000 Parallel Processing- enabled Maximum Concurrent Processor- 2

Number of records in the source file	Number of Process Flows using the source file	Optimize Processing setting	Execution time			Runtime CPU/Memory usage (Peak value)
			At Mapping	At Target	Total
1300000	1	Not Enabled	5min 12sec	13min 18sec	19min 11sec	CPU- 2CPU
						Memory- 1.9GB
1300000	1	Enabled (Queue Capacity= 500)	5min 4sec	1min 37sec	5min 32sec	CPU- 2CPU
						Memory- 1.9GB
1300000	1	Enable (Queue Capacity= 1000)	5min 7sec	1min 32sec	7min 15sec	CPU- 2CPU
						Memory- 1.8GB
1300000	1	Enabled (Queue Capacity= 5000)	5min 10sec	1min 28sec	7min 13sec	CPU- 2.1CPU
						Memory- 1.9GB
1300000	1	Enable (Queue Capacity= 10000)	5min 15sec	1min 37sec	7min 37sec	CPU- 2.2CPU
						Memory- 2GB
1300000	1	Enabled (Queue Capacity= 15000)	5min 13sec	1min 36sec	7min 36sec	CPU- 2CPU
						Memory- 1.9GB
1300000	10	Not Enabled	13min 25sec	42min 36sec	57min 37sec	CPU- 3CPU
						Memory- 2.6GB
1300000	10	Enabled (Queue Capacity= 1000)	13min 28sec	7min 17sec	22min 21sec	CPU- 3CPU
						Memory- 2.6GB
1300000	10	Enabled (Queue Capacity= 10000)	13min 31sec	7min 49sec	22min 48sec	CPU- 3CPU
						Memory- 2.7GB