Softwr

Testing · head to head

CloudBees Smart Tests vs Xray Test Management

CloudBees Smart Tests logo

CloudBees Smart Tests

Testing

Test intelligence tool, formerly Launchable, that selects tests relevant to each change

From
On request
Free plan
No
Xray Test Management logo

Xray Test Management

Testing

Native test management for Jira, licensed per Jira user rather than per tester

From
On request
Free plan
No

The short version

  • Xray Test Management starts at $10/mo; CloudBees Smart Tests prices on request.
  • Only CloudBees Smart Tests lists quarantine of noisy tests; only Xray Test Management lists native Jira issue types.
  • Where CloudBees Smart Tests falls short: no published pricing; Smart Tests is sold as part of CloudBees Unify on request.
  • Where Xray Test Management falls short: it only exists as a Jira add-on, so a team that is not already on Jira gains nothing by evaluating it; there is no standalone product.
  • Prices and features on this page were last checked on 20 November 2026.

How do CloudBees Smart Tests and Xray Test Management differ?

CloudBees Smart Tests and Xray Test Management differ on pricing model. Only the attributes on which CloudBees Smart Tests and Xray Test Management actually diverge.

Attributes where CloudBees Smart Tests and Xray Test Management differ
AttributeCloudBees Smart TestsXray Test Management
Pricing modelQuotePer Jira user per month, tiered to total instance size

Identical on both: starting price (On request), free tier (No), platforms (Web), category (Testing).

Which features does each one have?

They share no listed features; 8 appear only for CloudBees Smart Tests and 6 only for Xray Test Management. Drawn from each product's published feature list. An absence here means we hold no record of it - not that the product lacks it.

Only in CloudBees Smart Tests

  • Test prioritisation per code change
  • Visibility of ran and skipped tests with reasons
  • Flaky and long running test identification
  • Quarantine of noisy tests
  • AI grouping and classification of failures
  • Observation mode alongside existing pipelines
  • Works with Jenkins and CloudBees CI
  • Works without replacing test frameworks

Only in Xray Test Management

  • Native Jira issue types
  • Requirement traceability
  • BDD support
  • CI integration
  • Test repository and reuse
  • Data Center edition

What is each one used for?

CloudBees Smart Tests is most often brought in for cutting test run time on large suites. The jobs each tool is most often brought in to do.

CloudBees Smart Tests

  • Cutting test run time on large suitesnot Xray Test Management
  • Identifying and quarantining flaky testsnot Xray Test Management
  • Triaging test failures with AI groupingnot Xray Test Management
  • Adding test intelligence to Jenkins pipelinesnot Xray Test Management
  • Observing test results before changing pipelinesnot Xray Test Management

Xray Test Management

  • A QA team already standardised on Jira that wants traceability from requirement to test to defect without a second toolnot CloudBees Smart Tests
  • An organisation running Jira Data Center for compliance reasons that needs test management to matchnot CloudBees Smart Tests
  • A team doing BDD that wants Gherkin scenarios linked to Jira issues rather than kept in a separate repositorynot CloudBees Smart Tests
  • A company importing automated CI results into the same tracker developers already use for triagenot CloudBees Smart Tests

Where do CloudBees Smart Tests and Xray Test Management fall short?

CloudBees Smart Tests's most cited limit: no published pricing; Smart Tests is sold as part of CloudBees Unify on request. Documented limitations, not opinions. Every one is a constraint you would hit in normal use.

CloudBees Smart Tests

  • No published pricing; Smart Tests is sold as part of CloudBees Unify on request
  • The vendor does not specify a cloud or self hosted deployment model on its product page
  • Selects and analyses tests only; it does not run tests or replace a CI server
  • Product name changed from Launchable, so older documentation and reviews use the previous name

Xray Test Management

  • Pricing follows total Jira user count, not Xray user count, so a large company with a small QA team pays for hundreds of seats it does not use for testing
  • Since October 2025 billing is based on peak users within the period, so a temporary contractor surge or acquisition-driven headcount bump can push the account into a costlier tier retroactively
  • It only exists as a Jira add-on, so a team that is not already on Jira gains nothing by evaluating it; there is no standalone product
  • Cloud and Data Center are separately licensed and diverge in feature timing, so a company migrating from self-hosted Jira to Cloud has to re-evaluate the Xray purchase, not just move data
  • Heavy customisation of test workflows inside Jira increases the risk that a Jira version upgrade or a Xray version upgrade breaks configured automation rules

How much do CloudBees Smart Tests and Xray Test Management cost?

CloudBees Smart Tests is priced on request; Xray Test Management starts at $10/mo. Plan by plan below, from each vendor's own pricing page.

CloudBees Smart Tests

On request

No published plan breakdown. See the CloudBees Smart Tests review.

Xray Test Management

On request
  • Xray Cloud Standard$10/mo
    • Up to 10 Jira users
    • Manual and automated test management
    • Requirement traceability
  • Xray CloudOn request
    • Priced per Jira user, tier follows total instance headcount
    • Billed on peak user count within the billing period since October 2025
    • Rate per user declines at higher tiers but total spend still rises with headcount
  • Xray Data CenterOn request
    • Licensed against Jira Data Center tier
    • Separate purchase and upgrade cycle from Cloud

Which should you pick?

Choose CloudBees Smart Tests if

  • You need test prioritisation per code change.
  • You also want visibility of ran and skipped tests with reasons.

Choose Xray Test Management if

  • You need native jira issue types.
  • You also want requirement traceability.

Questions people ask

Is CloudBees Smart Tests or Xray Test Management better?
Neither clearly leads. CloudBees Smart Tests starts at On request and Xray Test Management at On request, and user ratings are close enough to be indistinguishable. Choose on capability and platform support.
Which is cheaper, CloudBees Smart Tests or Xray Test Management?
CloudBees Smart Tests starts at On request and Xray Test Management at On request.
Does CloudBees Smart Tests or Xray Test Management run on more platforms?
Both run on Web, so platform support will not decide this one for you.
What is CloudBees Smart Tests best used for?
CloudBees Smart Tests is most often used for cutting test run time on large suites, identifying and quarantining flaky tests, triaging test failures with ai grouping, adding test intelligence to jenkins pipelines. Of those, cutting test run time on large suites and identifying and quarantining flaky tests are not what Xray Test Management is typically brought in for.
What can CloudBees Smart Tests do that Xray Test Management cannot?
CloudBees Smart Tests covers Test prioritisation per code change, Visibility of ran and skipped tests with reasons, Flaky and long running test identification, Quarantine of noisy tests. Xray Test Management covers Native Jira issue types, Requirement traceability, BDD support, CI integration.

Answered from the vendors’ own pages

CloudBees Smart Tests: Is Launchable still available?

It continues under a new name. The CloudBees page states that Launchable is now CloudBees Smart Tests, and the launchableinc.com site redirects there.

Source
Xray Test Management: Is Xray priced per tester?

No. It is priced per user on the Jira instance it is installed into, regardless of how many of those users actually work in Xray.

CloudBees Smart Tests: What does Smart Tests do?

It prioritises the tests most relevant to each code change, shows what ran and what was skipped, and flags flaky and long running tests. It also groups and classifies failures with AI.

Source
Xray Test Management: Who owns Xray?

Xblend, the company that grew out of the original XpandIT project, which Idera, Inc. acquired in 2021 along with the Xporter reporting tool.

CloudBees Smart Tests: How much does CloudBees Smart Tests cost?

No price is published. The CloudBees pricing page lists no plans and presents Smart Tests as a capability of CloudBees Unify, with recommendations based on a team's setup.

Source
Xray Test Management: Is there a free tier?

No published free tier exists for either Cloud or Data Center editions.

CloudBees Smart Tests: When did CloudBees acquire Launchable?

CloudBees announced the acquisition on 7 August 2024, and financial terms were not disclosed. Launchable's co-founders are Kohsuke Kawaguchi and Harpreet Singh.

Source
Share

Related pages

Other head to heads