Assemble Job performance

Post Reply
dkelly
TOP CONTRIBUTOR
Posts: 628
Joined: Mon Nov 29, 2010 8:45 pm
Location: Alpharetta GA USA
Contact:

Assemble Job performance

Post by dkelly »

I encountered a significant bottleneck with Switch's Assemble Job element. I needed to watch for 2 to 8 input files which shared a common filename part. The problem is that Switch will not submit any files until after a long period of time. This time period gets longer and longer as the number of input files increases. I've seen 5-7 minutes pass before a single file is processed.



This isn't really a bug in Switch. It's the way Assemble Job was designed.



My client could not wait this long so I developed a custom Assemble Job script that performs the same task in seconds. If anyone else is experiencing this problem, please contact me for details.



Dwight Kelly

Apago, Inc.

dkelly@apago.com
User avatar
wilsonj
Newbie
Posts: 19
Joined: Mon Apr 04, 2011 9:55 pm

Assemble Job performance

Post by wilsonj »

I have a flow using the 'Merge PDF pages' tool - which appears to use the Assemble Jobs element (according to the Debug log) to associate PDFs for assembly into a single result - and this tool is creating significant delays in the workflow.



Do you think the script you referenced in your post would be of any benefit for the merge function where I'm experiencing delays, or is this another animal entirely?
dkelly
TOP CONTRIBUTOR
Posts: 628
Joined: Mon Nov 29, 2010 8:45 pm
Location: Alpharetta GA USA
Contact:

Assemble Job performance

Post by dkelly »

Hello, do you know the number of files that you need to merge? Is it just all of the PDFs in a job folder?
User avatar
wilsonj
Newbie
Posts: 19
Joined: Mon Apr 04, 2011 9:55 pm

Assemble Job performance

Post by wilsonj »

The number of files will vary, though I saw a long delay when four PDFs were moving through the flow. The files are submitted to the function in a job folder created by the Ungroup job tool.
dkelly
TOP CONTRIBUTOR
Posts: 628
Joined: Mon Nov 29, 2010 8:45 pm
Location: Alpharetta GA USA
Contact:

Assemble Job performance

Post by dkelly »

Do you have Assemble Job set to use "Ungrouped Job" scheme?
foxpalace
Newbie
Posts: 12
Joined: Fri Jan 14, 2011 12:25 pm

Assemble Job performance

Post by foxpalace »

Hi - I use Assemble Jobs with Ungroup Jobs - i can get results with more than 1000 Files to assemble. The time to assemble is more then three hours :(
dkelly
TOP CONTRIBUTOR
Posts: 628
Joined: Mon Nov 29, 2010 8:45 pm
Location: Alpharetta GA USA
Contact:

Assemble Job performance

Post by dkelly »

That process could be speedup with a custom script. I've had great success with several customer's flows.
Post Reply