Integrations
Pricing

Supercharge testing with AI,
write better tests faster.

We've embedded Al across our entire platform to test faster, see clearer, and streamline test automation with fewer bottlenecks.

What's new

AI Testing Monthly: Keep up with AI best practices from across the industry, primers on the latest tech, and Katalon's R&D and beta announcements. One email per month, no spam.
Subscribe

AI is already
transforming testing

Devs with AI mean more code, at more speed... and more quality challenges.
AI unleashes the productivity of developers, helping teams create more software, even faster... but the demands on quality are increasing accordingly, so testers must transform their practice to keep up.
Testers need AI too.
Testers deserve the absolute best technologies available to ensure quality, especially as the speed of development and complexity of applications continues to accelerate. AI-augmented capabilities are increasingly essential.
AI won't replace testers - it'll supercharge them.
It's not magic and it doesn't work on its own, so AI's best use is in concert with testers. Our deep testing experience positions us well to know where to best apply AI to reduce redundant work, how to shift testing from reactive from proactive, and where deferring to skilled human testers is absolutely critical for quality.
AI is fuel to go faster, see clearer, and scale better.
We've already shipped significant AI capabilities, and see the most practical, highest impacts are by giving teams:
Accelerators, so testers can create and maintain tests faster.
Insights, so teams can see more clearly and make better decisions.
Optimizations, to streamline the overall testing process to run more efficiently and at lower cost.
Incorporate the latest AI tech.
Whether it's GPT or the latest machine learning method, we research and apply the latest tech where it makes the biggest impact.
Apply AI across the entire platform.
AI's not a feature; it's foundational to our platform. We apply AI across the full testing process to remove bottlenecks and make each phase of testing easier.
Drive innovation with our R&D.
Testing's biggest challenges require testing-specific solutions, so we invest in creating innovations like autonomous testing to transform the testing practice.
Empower the entire organization with AI,
but start with Testers.
We apply AI to the entire end-to-end quality lifecycle, but it all starts with Testers and transforming the front lines of testing.
AI's not an enterprise-only capability. We've baked AI into our core platform, for teams of all sizes and capabilities.

Katalon's
approach to AI

AI-augmented features for supercharged testing

Frequently Asked Questions

Will my data be used in training Katalon's generative AI models that can potentially cause data leakage for sensitive data?

+

No, Katalon leverages OpenAI's GPT models to generate test scripts (StudioAssist) and manual test cases (Jira plugin). According to OpenAI's API data usage policies, "OpenAI will not use data submitted by customers via your API to train or improve our models, unless you explicitly decide to share your data with us for this purpose. You can opt-in to share data." Katalon does not opt-in to share data to train GPT models, ensuring that your data remains confidential and secure.

How the data is governed?

+

Data governance in Katalon StudioAssist ensures that no user data is used to train AI models. The data is processed with strict adherence to data protection regulations like GDPR and CCPA. Katalon does not store, transfer, or process sensitive data​​​​.

Where is the data / input is stored?

+

Data input by users in StudioAssist is processed through OpenAI's GPT models. This data is transmitted securely to OpenAI for processing. Katalon does not retain any user data used for generating or explaining code through StudioAssist​​​​.

What certification do we hold with OpenAI?

+

Katalon adheres to OpenAI's API data usage policies, which include not using customer data to train or improve their models unless explicitly opted-in. While specific certifications with OpenAI are not mentioned, compliance with these policies ensures data security and privacy​​​​.

Does Katalon guarantee the accuracy of the generated outcomes, eg. test scripts, test cases, data analytic insights?

+

Katalon leverages generative AI models to generate code and tests. Even the best generative AI models such as OpenAI's GPT (behind ChatGPT) have inherent limitations. These limitations arise from several factors:

  • Inaccuracy in Complex Scenarios: Generative models may sometimes produce code that looks syntactically correct but may not function as intended, especially in complex scenarios requiring deep domain knowledge.
  • Lack of Context Awareness: The AI model might not fully understand the specific context of your project, leading to potential misalignment with project requirements or coding standards.
  • Knowledge Cut-off Date: The information embedded in the model is frozen at a certain point in time, which means that the generated code may not include the latest techniques, methodologies, or keywords.
  • Potential Bias or Inconsistency: Models like ChatGPT are trained on diverse datasets and may inadvertently introduce biases or inconsistencies that are not suitable for your particular application.

For these reasons, it is highly advisable not to rely solely on Katalon's generated code and tests. While the tool can significantly accelerate development and testing processes, human oversight is essential. It is strongly recommended to review and revise the generated results carefully before integrating them into your project to ensure they meet the specific needs and quality standards.

Katalon is committed to enhancing the capabilities of its AI-driven features, but the collaboration between human expertise and AI remains vital for achieving the best possible outcomes.

Given that GPT's knowledge cut-off was September 2021, will my generated code include the latest Katalon keywords?

+

In the current version of StudioAssist, the newly released keywords after GPT's knowledge cut-off will not be included in generated code. This is a known limitation. However, we are committed to improving this aspect, and the ability to include new keywords will be part of future releases.

Does Katalon StudioAssist generate code based on my current coding style?

+

Currently, StudioAssist does not have the ability to leverage your existing coding style for generating new code. It adheres to a standardized coding style. We recognize the importance of personalized code generation and are actively working on incorporating this feature in later releases.

Does Katalon StudioAssist generate code using my test objects and variables?

+

At present, StudioAssist is not capable of automatically recognizing the test object library, existing test cases, variables, or test data. You need to specify what should be used in the comments for code generation. We understand the importance of this functionality and are planning enhancements in future releases to make the process more intuitive and aligned with your specific requirements.