Performance Test Results

Warning: Technical Content Below

 This article is a bunch of numbers and semi-technical specs.  If this is not your thing, please navigate away!


Raw Flow and Rule Engine Testing

These tests are tests of the engine – with no or constrained processing.  The actual performance figures in a production environment are influenced by a number of factors, which include:

  • Network speed
  • Storage (if any) speed
  • External systems
  • Database configuration and performance
  • Target utilization of the servers.  
  • What the flows or rules are actually doing.  

The purpose of these tests are to provide a baseline of the speed of running the rule or workflow engine in an isolated environment.  Specifically, what overhead does the engine incur when executing.


Server Specifications

These tests were done on a system with 2  i7-3770 Processors and 16gb of RAM, however; The server process never utilized more than 500 MB. These tests fully utilized the processor.  

Tests were run on Decisions Platform Build 3.0.0 rev 15933M


Flow Performance Tests

Simple Flow

This is a flow containing only a start and end step.  

10K flow executions completed per second/processor

288M flow executions completed per hour/server

Flow with 10 steps

Executes a simple flow with 10 steps in it.  

3K flow executions completed per second/processor

83M flow executions completed per hour/server

Flow Execution Manipulating Data In List

This flow creates a list, creates and adds 50 items to it (104 step executions total).

1.9K flow executions completed per second/processor

55M flow executions completed per hour/server

5.8B flow steps per hour/server 

Flow Execution With Sub Flow

This flow creates a list, runs a subflow 50 times (104 step executions total).

137 Flow With SubFlows (51 flows run total) main flow executions complete per second/Processor

3.9M main flow flow executions per hour/server

201M total flow executions per hour/server (including sub flows)

Flow with Assignment

 * Note, This test was constrained to 2 processors given the limitations of the database that was being tested against.  This test was not designed to test the scalability of the database but to test the overhead the workflow engine added in putting items into it.

22 flows completed with assignment per second/processor

158K flows completed with assignment per hour/server

Read in CSV and iterate its items (Files/Second)

This test is to load and iterate files of 1000 records.  Included in this is 2002 step executions per file.

11 files per second/processor

316K files per hour/server

632M flow steps executed per hour/server

Read in CSV and iterate its items (Lines/Second)

This test is to load and iterate files of 1000 records.  Included in this is 2 step executions per row.

11k lines per second/processor

316M lines per hour/server

632M flow steps executed per hour/server


Rule Performance Tests

Simple Rules 

50K rule executions completed per second/processor

1B rule executions completed per hour/server

Rule With 10 Conditions:

12.5K rule executions completed per second/processor

360M rule executions completed per hour/server