Marcelo R.N. Mendes. What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;

FINCoS Framework Tutorial

FINCoS Framework TutorialMarcelo R.N. Mendes

1What is FINCoS?A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;Main Characteristics:Flexible;Independent of particular workloads;Not bound to any specific CEP product;Scalable.2CISUC, University of Coimbra - [email protected], 20122

FINCoS: Architecture3CISUC, University of Coimbra - [email protected], 20123FINCoS: ComponentsDriverSimulates external sources of events;Submits load to the SUT;Includes data generation mechanism;SinkReceives query results from CEP engine;Stores output events in log files for subsequent validation.

4CISUC, University of Coimbra - [email protected], 2012

4FINCoS: ComponentsControllerMain Interface with the user. Allows to:Create reusable test setups;Control Drivers and Sinks (e.g., load, start, stop);Alter workload parameters on-the-fly (e.g., event submission rates, switch phases)


5FINCoS: ComponentsPerformance MonitorCollect Metrics of Performance RunsTwo Modes:Online (integrated into FINCoS Controller);Offline (log files).


6Lesson 1: Creating a Test SetupConfigure a DriverDecomposable WorkloadSynthetic vs. Thirdy-Party DatasetData Generation OptionsEvent Arrival ProcessConfigure a SinkJuly, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]

8July, 2012CISUC, University of Coimbra - [email protected]


unique identifiernumber of threads used for load generationsave generated data to disk?to where Driver send the eventsmachine that hosts the Driver10July, 2012CISUC, University of Coimbra - [email protected]

Workload can be split in independent phases 11July, 2012CISUC, University of Coimbra - [email protected]


Chooses the type of workload for this phaseSets events arrival processEvent MixEvents are generated in a ordered wayWhen data generation happensTo ensure repeatability13July, 2012CISUC, University of Coimbra - [email protected]

Configure event types14July, 2012CISUC, University of Coimbra - [email protected]



Configure Event Type Schema17July, 2012CISUC, University of Coimbra - [email protected]



Column Name


Column Type


Data Generation Options


Add Values23July, 2012CISUC, University of Coimbra - [email protected]














unique identifierList of event types this Sink subscribes tofrom where Sink receive eventsmachine that hosts the Sinksave generated data to disk?37July, 2012CISUC, University of Coimbra - [email protected]




Done!41Lesson 2: Configuring a new ConnectionConfigure a reusable connection with a CEP engine or JMS ProviderJuly, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]




unique identifiername of the CEP engine (out-of-the-box support for Esper)Properties used to connect with the CEP enginetype of the connection46July, 2012CISUC, University of Coimbra - [email protected]

* supporting new CEP engines requires coding47July, 2012CISUC, University of Coimbra - [email protected]

Done!48Lesson 3: Running TestsLoad Drivers and SinksStart Load SubmissionControl Load Submission

NOTE: At this point the following steps must have been completed:Creation of a test setup;Initialization of the FINCoS Daemon Service at the machines where Drivers and Sinks are intended to run;July, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]

Load components50July, 2012CISUC, University of Coimbra - [email protected]


Start Load Submission52July, 2012CISUC, University of Coimbra - [email protected]

Sent/Received counts53July, 2012CISUC, University of Coimbra - [email protected]



56Lesson 4: Collecting Performance MetricsOnline Performance MeasurementDuring tests

Offline Performance MeasurementAfter test completion, use FINCoS Performance Monitor to process log files

July, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]


July, 2012CISUC, University of Coimbra - [email protected]

60Lesson 4: Collecting Performance Metrics (...cont)Online Performance MeasurementDuring tests

Offline Performance MeasurementAfter test completion, use FINCoS Performance Monitor to process log files

July, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]



Configure M.I. here:Optionally, save collected metrics to a fileJuly, 2012CISUC, University of Coimbra - [email protected]


Select the stream66July, 2012CISUC, University of Coimbra - [email protected]

Select the metric67July, 2012CISUC, University of Coimbra - [email protected]

Select exhibition scale68July, 2012CISUC, University of Coimbra - [email protected]

Add Metrics to the Chart69July, 2012CISUC, University of Coimbra - [email protected]

Change Visualization Options70Lesson 5: Setting Test OptionsResponse Time MeasurementJuly, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]



74Response Time Measurement ModeJuly, 2012CISUC, University of Coimbra - [email protected] ENGINESINKADAPTER234sendconvertinputconvertoutputprocessinputforwardgenerate resultforwardsend175Response Time Measurement ModeJuly, 2012CISUC, University of Coimbra - [email protected] ENGINESINKADAPTERsendconvertinputconvertoutputprocessinputforwardgenerate resultforwardsendt = t4 t1End-to-end:From Driver up to Sink 234176Response Time Measurement ModeJuly, 2012CISUC, University of Coimbra - [email protected] ENGINESINKADAPTERsendconvertinputconvertoutputprocessinputforwardgenerate resultforwardsendt = t3 t2Process Time:From immediately before the input event is forwarded to CEP engine to immediately after the result is received.234177Download and FeedbackFINCoS is available at:http://code.google.com/p/fincos/

Any suggestions or bug reports:[email protected]


Marcelo R.N. Mendes. What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;

Documents

university of coimbra

load submission

type of workload

event type schema17july

load generationsave

event types14july

column type

event submission rates