Assemble Job performance

[dkelly]

I encountered a significant bottleneck with Switch's Assemble Job element. I needed to watch for 2 to 8 input files which shared a common filename part. The problem is that Switch will not submit any files until after a long period of time. This time period gets longer and longer as the number of input files increases. I've seen 5-7 minutes pass before a single file is processed.



This isn't really a bug in Switch. It's the way Assemble Job was designed.



My client could not wait this long so I developed a custom Assemble Job script that performs the same task in seconds. If anyone else is experiencing this problem, please contact me for details.



Dwight Kelly

Apago, Inc.

dkelly@apago.com

[wilsonj]

I have a flow using the 'Merge PDF pages' tool - which appears to use the Assemble Jobs element (according to the Debug log) to associate PDFs for assembly into a single result - and this tool is creating significant delays in the workflow.



Do you think the script you referenced in your post would be of any benefit for the merge function where I'm experiencing delays, or is this another animal entirely?

[dkelly]

Hello, do you know the number of files that you need to merge? Is it just all of the PDFs in a job folder?

[wilsonj]

The number of files will vary, though I saw a long delay when four PDFs were moving through the flow. The files are submitted to the function in a job folder created by the Ungroup job tool.

[dkelly]

Do you have Assemble Job set to use "Ungrouped Job" scheme?

[foxpalace]

Hi - I use Assemble Jobs with Ungroup Jobs - i can get results with more than 1000 Files to assemble. The time to assemble is more then three hours

[dkelly]

That process could be speedup with a custom script. I've had great success with several customer's flows.