Sikuli Demo + NoVaTAIG Presentation June 8, 2012 Raghavendra University of JNTU
Sikuli Demo + NoVaTAIG Presentation
June 8, 2012Raghavendra
University of JNTU
Outline• Sikuli User Experience at OMB (Rudy and Dan)
– Sikuli environment diagram– Sikuli workflow– Recording a Sample Script– Tool Settings
• Fuzzy Logic Pattern matching
– Flow Control Features• Loops, delays, etc• Assertions, interfacing with Jython
– Record a script and playback• Sikuli Current Status (Dr. Yeh)
– Sikuli history – User Communities– New Developments and future direction
Sikuli Environment Diagram
Sikuli Proof Of Concept @ OMB BSB
Shared Desktop App – similar to Adobe Connect
What Shared Desktop does
• Can open a personal or group room for sharing• Person who opens a room is the room owner• Room owner sends URL invitations to attendees• Room owner can accept attendees individually or
automatically• Room owner can change attendees permissions –
view only, mouse only, keyboard/mouse, host (full permissions including changing other attendee permissions)
What we did @ OMB• Wrote two Sikuli scripts:
– One represented the actions of the room owner– One represented the actions of an attendee
• The two scripts simulated how a room works, and were launched at the same time:– The room owner opened his room and waited for the attendee to
enter– The attendee sent the room URL and waited for the room to open– Once the room was opened the room owner accepted the attendee– The room owner gave the attendee Host permission– The attendee opened up a Word document and the room and
entered text– The room owner also entered text into the same Word document
NoVaTAIG Demo Outline
1) How to record Sikuli script using IDEa) Sikuli syntax - keywordsb) Image Pattern Matching
2) How to call Sikuli from Watir-Webdriver/ Cucumbera) Feature file b) Scenarios/ Scenario Outline c) Step Definitionsd) HTML output
Start by Using Sikuli IDE to record
Verify the images are recognized
Verify, then migrate sikuli images to Cucumber/ Watir-Webdriver folder structure
Feature file
Step definitions
Supporting ruby methods
Run the cucumber (happy cuking!)
All Green
Failure scenario
References http://www.software-testing.com.au/blog/2010/08/16/automating-flash-ajax-popups-and-more-using-ruby-watir-and-sikuli/http://catherinedevlin.pythoneers.com/presentations/sikuli/sikuli.htmlhttp://bob.igo.name/wp-content/uploads/2010/10/Bob_Igo_Sikuli_cposc2010.pdfhttp://www.cuberick.com/2010/06/testing-image-generation-with-cucumber.html
For a copy of the cucumber/watir-webdriver/sikuli scripts that were demo’d, please contactFor a copy of the prototype sikuli storyboard and runner that was demo’d, please [email protected]