NEW – AI Visual Testing Beta Release

AI Visual Testing has arrived in TestOps. Katalon’s new AI expands on our existing pixel comparison visual testing with two additional AI-enabled visual tests: content-based and layout-based These additional visual testing options greatly improve the speed and efficacy of UI quality testing. They allow software quality teams to automatically analyze, differentiate, and identify valid visual UI differences from minor visual infractions, reducing manual visual validation efforts by hundreds or thousands of hours per year. 

Testers can select from two AI Visual Testing options:

Layout-based testing

Instead of simply identifying when individual pixels are not the same, layout-based AI Visual Testing analyzes the layout of images and visual objects in relation to each other and compares those relative differences between baseline and test results. When the relative differences are significant, the test fails. However,  when an image, object, or line of text differs by only a few pixels or lines, where a standard visual test would flag a failure, AI Visual Testing intelligently deduces that there is only a minor difference in layout and passes the test. This strategy significantly reduces false positives and wasted manual review effort.

Content-based testing

When visual quality is rated by the completeness and accuracy of text content rather than the layout and existence of images and UI elements, content-based AI Visual Testing is the best option. Content-based AI Visual Testing prioritizes the review and validation of text within a UI regardless of font, layout, color, or changes in its background. Like the layout-based comparison, this also increases the efficacy of content testing and reduces manual validation efforts by hundreds or thousands of hours per year.

With this update, Visual Testing now has its own section in the project menu bar:

Learn more about Katalon’s AI Visual Testing, review the documentation here

Updated Project Dashboard

The TestOps dashboard now has an updated look and additional dashboard reports. There are seven distinct sections on the dashboard:

• Test Activities: A view of all testing activities for a period of time
• Release Readiness: An at-a-glance look at status of development, testing, and build progress of the two most recent releases
• Productivity: Measure of test case creation over a period of time
• Quality (Beta): Test quality based on flakiness distribution
• Platform Coverage: Quality of test runs or results in each corresponding OS and browser
• Requirement Coverage: Heat map of requirements readiness based on requirement and corresponding test results
• Local Test Environment: Number and status of local test environments

More information & a visual overview of the dashboard can be found here

Other Updates

• Updated TestOps Jira integration to support Jira version 8.19.1 
• The “Test Runs” tab in Reports > Test Runs adds “Operating System” and “Browser” filters, plus the corresponding columns to the “All Test Runs” grid

For a complete list of the new features, improvements, and fixes, please visit the release notes.

In Case You Missed It

• Check out this and other release blogs to review previous TestOps and Katalon product releases.

• Learn more about TestOps and how it helps you orchestrate your DevOps environment with full visibility, speed, and efficiency.
• Visit the TestOps documentation.

For a complete list of the new features, improvements, and fixes, please visit the release notes.

As always, please post any questions, ideas, or concerns in our community. We are eager to hear from you.