Softwr

Testing · head to head

CloudBees Smart Tests vs Split

CloudBees Smart Tests logo

CloudBees Smart Tests

Testing

Test intelligence tool, formerly Launchable, that selects tests relevant to each change

From
On request
Free plan
No
Split logo

Split

Testing

Feature flags tied to a metrics pipeline that attributes production impact to each release, now Harness FME

From
On request
Free plan
No

The short version

  • Only CloudBees Smart Tests lists test prioritisation per code change; only Split lists metrics impact engine.
  • Where CloudBees Smart Tests falls short: no published pricing; Smart Tests is sold as part of CloudBees Unify on request.
  • Prices and features on this page were last checked on 20 November 2026.

How do CloudBees Smart Tests and Split differ?

CloudBees Smart Tests and Split differ on platforms. Only the attributes on which CloudBees Smart Tests and Split actually diverge.

Attributes where CloudBees Smart Tests and Split differ
AttributeCloudBees Smart TestsSplit
PlatformsWebWeb, API, iOS, Android, Windows

Identical on both: starting price (On request), pricing model (Quote), free tier (No), category (Testing).

Which features does each one have?

They share no listed features; 8 appear only for CloudBees Smart Tests and 8 only for Split. Drawn from each product's published feature list. An absence here means we hold no record of it - not that the product lacks it.

Only in CloudBees Smart Tests

  • Test prioritisation per code change
  • Visibility of ran and skipped tests with reasons
  • Flaky and long running test identification
  • Quarantine of noisy tests
  • AI grouping and classification of failures
  • Observation mode alongside existing pipelines
  • Works with Jenkins and CloudBees CI
  • Works without replacing test frameworks

Only in Split

  • Feature flags with targeting
  • Metrics impact engine
  • Guardrail metrics
  • Statistical significance testing
  • Event ingestion
  • SDKs and streaming updates
  • Audit and approvals
  • Harness platform integration

What is each one used for?

CloudBees Smart Tests is most often brought in for cutting test run time on large suites. The jobs each tool is most often brought in to do.

CloudBees Smart Tests

  • Cutting test run time on large suitesnot Split
  • Identifying and quarantining flaky testsnot Split
  • Triaging test failures with AI groupingnot Split
  • Adding test intelligence to Jenkins pipelinesnot Split
  • Observing test results before changing pipelinesnot Split

Split

  • A product organisation that wants every release measured against conversion and latency by default, not only deliberate experimentsnot CloudBees Smart Tests
  • Running A/B tests with real statistical significance rather than comparing two dashboard linesnot CloudBees Smart Tests
  • Catching a regression at five per cent rollout because a guardrail metric fires before the change reaches everyonenot CloudBees Smart Tests
  • A team already committed to Harness for CI and CD that wants flags in the same platform and contractnot CloudBees Smart Tests

Where do CloudBees Smart Tests and Split fall short?

CloudBees Smart Tests's most cited limit: no published pricing; Smart Tests is sold as part of CloudBees Unify on request. Documented limitations, not opinions. Every one is a constraint you would hit in normal use.

CloudBees Smart Tests

  • No published pricing; Smart Tests is sold as part of CloudBees Unify on request
  • The vendor does not specify a cloud or self hosted deployment model on its product page
  • Selects and analyses tests only; it does not run tests or replace a CI server
  • Product name changed from Launchable, so older documentation and reviews use the previous name

Split

  • Split is now a module of the Harness platform and split.io redirects to harness.io, so buying it means entering a Harness commercial relationship rather than a standalone flag vendor contract
  • Harness no longer publishes per-module prices, so an organisation that wants only feature management cannot get a list price and must negotiate a module out of a platform bundle
  • The measurement engine needs traffic volume to reach significance, so a product with modest usage gets flags with an experimentation layer it will rarely be able to conclude anything from
  • Metric attribution depends on correctly instrumented events flowing into Split, which is an integration project in its own right; without it you have paid for an experimentation platform and are using it as a flag switch
  • As part of a larger DevOps suite the roadmap now competes with CI, CD, security and cloud cost modules for attention, so feature management is no longer the company’s single focus the way it was as an independent product

How much do CloudBees Smart Tests and Split cost?

CloudBees Smart Tests is priced on request; Split is priced on request. Plan by plan below, from each vendor's own pricing page.

CloudBees Smart Tests

On request

No published plan breakdown. See the CloudBees Smart Tests review.

Split

On request
  • Harness FreeFree
    • Harness Open Source and community support
    • Intended for individuals and small teams
    • Feature management capability limited at this tier
  • Harness EssentialsOn request
    • Bundled DevOps modules including CI, CD, IaC and security testing
    • Standard support
    • Pricing requires contacting sales
  • Harness EnterpriseOn request
    • Mix and match from 15 or more modules including Feature Management and Experimentation
    • Premier support with a dedicated account manager
    • Higher pipeline concurrency and organisation limits

Which should you pick?

Choose CloudBees Smart Tests if

  • You need test prioritisation per code change.
  • You also want visibility of ran and skipped tests with reasons.

Choose Split if

  • You need feature flags with targeting.
  • You work on Web, API, iOS, Android, Windows.
  • You also want metrics impact engine.

Questions people ask

Is CloudBees Smart Tests or Split better?
Neither clearly leads. CloudBees Smart Tests starts at On request and Split at On request, and user ratings are close enough to be indistinguishable. Choose on capability and platform support.
Which is cheaper, CloudBees Smart Tests or Split?
CloudBees Smart Tests starts at On request and Split at On request.
Does CloudBees Smart Tests or Split run on more platforms?
CloudBees Smart Tests runs on Web. Split runs on Web, API, iOS, Android, Windows.
What is CloudBees Smart Tests best used for?
CloudBees Smart Tests is most often used for cutting test run time on large suites, identifying and quarantining flaky tests, triaging test failures with ai grouping, adding test intelligence to jenkins pipelines. Of those, cutting test run time on large suites and identifying and quarantining flaky tests are not what Split is typically brought in for.
What can CloudBees Smart Tests do that Split cannot?
CloudBees Smart Tests covers Test prioritisation per code change, Visibility of ran and skipped tests with reasons, Flaky and long running test identification, Quarantine of noisy tests. Split covers Feature flags with targeting, Metrics impact engine, Guardrail metrics, Statistical significance testing.

Answered from the vendors’ own pages

CloudBees Smart Tests: Is Launchable still available?

It continues under a new name. The CloudBees page states that Launchable is now CloudBees Smart Tests, and the launchableinc.com site redirects there.

Source
Split: Is Split still called Split?

It is now sold as Harness Feature Management and Experimentation after the Harness acquisition, and split.io redirects to harness.io.

CloudBees Smart Tests: What does Smart Tests do?

It prioritises the tests most relevant to each code change, shows what ran and what was skipped, and flags flaky and long running tests. It also groups and classifies failures with AI.

Source
Split: Can I buy just feature flags?

Not from a price list. Harness publishes bundle tiers and directs single-module buyers to sales.

CloudBees Smart Tests: How much does CloudBees Smart Tests cost?

No price is published. The CloudBees pricing page lists no plans and presents Smart Tests as a capability of CloudBees Unify, with recommendations based on a team's setup.

Source
Split: What does it do that a plain flag service does not?

It attributes changes in your product metrics to specific flags with statistical significance testing and alerts on guardrail metrics.

CloudBees Smart Tests: When did CloudBees acquire Launchable?

CloudBees announced the acquisition on 7 August 2024, and financial terms were not disclosed. Launchable's co-founders are Kohsuke Kawaguchi and Harpreet Singh.

Source
Split: Do we need a lot of traffic?

Yes. Statistical tests need volume to conclude, so low-traffic products get limited value from the measurement layer.

Share

Related pages

Other head to heads