Sikuli

Discontinued

Country: Switzerland (CH)
Founded: 2011
Developer: RaiMan (Switzerland)
Pricing: Free (open-source)
Open source: Yes
Platforms: Windows, macOS, Linux

Indexes

Automation

Overview

Sikuli is a visual automation tool that uses image recognition to identify and interact with GUI elements on the screen, enabling automation of desktop applications, web pages, and flash objects without relying on object identifiers.¹²³ It scripting in Jython (Python for Java) and targets testers, developers, and users needing to automate repetitive tasks or create documentation, standing out for its platform independence and ability to handle elements not accessible via traditional methods like Selenium.⁴⁵⁸

Key Features

Image Recognition - Detects and interacts with screen elements using screenshots via OpenCV engine.
GUI Automation - Automates mouse clicks, keyboard inputs, and drags on visible screen images.
Cross-Platform Support - Runs on Windows, macOS, and Linux without platform-specific changes.
Jython Scripting - Uses Python-like syntax for scripting automation workflows.
Flash and Desktop Apps - Automates Flash objects and native desktop applications.
Remote Testing - Supports testing via remote desktop or VNC by viewing shared screens.
Selenium Integration - Integrates with Selenium for hybrid web and GUI automation.
Simple API - Provides straightforward methods for common automation actions.

Pricing

Plan	Price	Includes
Community Edition	Free	Full open-source features, scripting, image recognition, cross-platform support

Platforms & Requirements

SikuliX runs on Windows, macOS, and Linux, requiring Java and OpenCV libraries; it uses screen capture so performs best on local displays but supports remote via VNC or RDP with potential latency issues.²⁴⁵ No mobile support; minimum requirements include Java 8+ and sufficient screen resolution for image matching.

Integrations & Ecosystem

Selenium
Appium (via extensions)
Python/Jython scripts
OpenCV for vision
VNC/RDP for remote
Java libraries
Windows API via Robot class
Custom automation frameworks

Alternatives

App	Difference
SikuliX	Active fork by RaiMan with ongoing development and Oculix transition.
AutoIt	Windows-only scripting tool with native API access, less visual focus.
PyAutoGUI	Pure Python library for cross-platform pixel/image-based automation.
Robot Framework	Keyword-driven framework supporting image plugins but more structured.

Reputation

Sikuli is praised for its innovative image-based approach that simplifies GUI automation where traditional tools fail, especially for desktop and Flash apps, and its ease of integration with Selenium.¹³⁴ Criticisms include sensitivity to UI changes causing brittle scripts, dependency on exact screen matches, and development halt on original project with users migrating to SikuliX.⁸⁹ It remains valued in testing communities for niche visual automation needs despite limitations in dynamic environments.²⁵

Sources (9)