Softwr

Developer Tools · head to head

Earthly vs CloudBees Smart Tests

Earthly logo

Earthly

Developer Tools

Engineering guardrails for the AI era

From
Free
Free plan
Yes
CloudBees Smart Tests logo

CloudBees Smart Tests

Testing

Test intelligence tool, formerly Launchable, that selects tests relevant to each change

From
On request
Free plan
No

The short version

  • Earthly is free; CloudBees Smart Tests prices on request.
  • Only Earthly lists multi-stage enforcement; only CloudBees Smart Tests lists quarantine of noisy tests.
  • Where Earthly falls short: pricing model not published; requires sales contact.
  • Where CloudBees Smart Tests falls short: no published pricing; Smart Tests is sold as part of CloudBees Unify on request.
  • Prices and features on this page were last checked on 20 November 2026.

How do Earthly and CloudBees Smart Tests differ?

Earthly and CloudBees Smart Tests differ on starting price (Free against On request), pricing model and free tier (Yes against No). Only the attributes on which Earthly and CloudBees Smart Tests actually diverge.

Attributes where Earthly and CloudBees Smart Tests differ
AttributeEarthlyCloudBees Smart Tests
Starting priceFreeOn request
Pricing modelNo pricing published on websiteQuote
Free tierYesNo
PlatformsWeb, APIWeb
CategoryDeveloper ToolsTesting

Not yet recorded: founded for CloudBees Smart Tests.

Which features does each one have?

They share no listed features; 8 appear only for Earthly and 8 only for CloudBees Smart Tests. Drawn from each product's published feature list. An absence here means we hold no record of it - not that the product lacks it.

Only in Earthly

  • Policy as code
  • Multi-stage enforcement
  • AI agent governance
  • Repository-wide policies
  • Incident response automation
  • Compliance management
  • Earthfiles build tool
  • Satellites

Only in CloudBees Smart Tests

  • Test prioritisation per code change
  • Visibility of ran and skipped tests with reasons
  • Flaky and long running test identification
  • Quarantine of noisy tests
  • AI grouping and classification of failures
  • Observation mode alongside existing pipelines
  • Works with Jenkins and CloudBees CI
  • Works without replacing test frameworks

What is each one used for?

Earthly is most often brought in for enforcing engineering standards across AI and human developers; CloudBees Smart Tests for cutting test run time on large suites. The jobs each tool is most often brought in to do.

Earthly

  • Enforcing engineering standards across AI and human developersnot CloudBees Smart Tests
  • Automating incident response procedures across all repositoriesnot CloudBees Smart Tests
  • Embedding compliance requirements into development workflowsnot CloudBees Smart Tests
  • Standardizing build processes with Earthfilesnot CloudBees Smart Tests

CloudBees Smart Tests

  • Cutting test run time on large suitesnot Earthly
  • Identifying and quarantining flaky testsnot Earthly
  • Triaging test failures with AI groupingnot Earthly
  • Adding test intelligence to Jenkins pipelinesnot Earthly
  • Observing test results before changing pipelinesnot Earthly

Where do Earthly and CloudBees Smart Tests fall short?

Earthly's most cited limit: pricing model not published; requires sales contact. CloudBees Smart Tests's: no published pricing; Smart Tests is sold as part of CloudBees Unify on request. Documented limitations, not opinions. Every one is a constraint you would hit in normal use.

Earthly

  • Pricing model not published; requires sales contact
  • Earthly Lunar is a recent launch (2025) with limited track record
  • Primarily GitHub-focused; limited integration with other platforms
  • No public documentation on pricing or feature tiers

CloudBees Smart Tests

  • No published pricing; Smart Tests is sold as part of CloudBees Unify on request
  • The vendor does not specify a cloud or self hosted deployment model on its product page
  • Selects and analyses tests only; it does not run tests or replace a CI server
  • Product name changed from Launchable, so older documentation and reviews use the previous name

How much do Earthly and CloudBees Smart Tests cost?

Earthly is free to use; CloudBees Smart Tests is priced on request. Plan by plan below, from each vendor's own pricing page.

Earthly

Free

No published plan breakdown. See the Earthly review.

CloudBees Smart Tests

On request

No published plan breakdown. See the CloudBees Smart Tests review.

Which should you pick?

Choose Earthly if

  • You need policy as code.
  • You want to start without paying.
  • You work on Web, API.
  • You also want multi-stage enforcement.

Choose CloudBees Smart Tests if

  • You need test prioritisation per code change.
  • You also want visibility of ran and skipped tests with reasons.

Questions people ask

Is Earthly or CloudBees Smart Tests better?
Neither clearly leads. Earthly starts at Free and CloudBees Smart Tests at On request, and user ratings are close enough to be indistinguishable. Choose on capability and platform support.
Which is cheaper, Earthly or CloudBees Smart Tests?
Earthly has a free tier; the other does not. Paid plans start at Free for Earthly and On request for CloudBees Smart Tests.
Does Earthly or CloudBees Smart Tests run on more platforms?
Earthly runs on Web, API. CloudBees Smart Tests runs on Web.
Can I use Earthly for free?
Yes. Earthly has a free tier, so you can try it without paying. CloudBees Smart Tests starts at On request.
What is Earthly best used for?
Earthly is most often used for enforcing engineering standards across ai and human developers, automating incident response procedures across all repositories, embedding compliance requirements into development workflows, standardizing build processes with earthfiles. Of those, enforcing engineering standards across ai and human developers and automating incident response procedures across all repositories are not what CloudBees Smart Tests is typically brought in for.
What can Earthly do that CloudBees Smart Tests cannot?
Earthly covers Policy as code, Multi-stage enforcement, AI agent governance, Repository-wide policies. CloudBees Smart Tests covers Test prioritisation per code change, Visibility of ran and skipped tests with reasons, Flaky and long running test identification, Quarantine of noisy tests.

Answered from the vendors’ own pages

Earthly: What is the difference between Earthfiles and Earthly Lunar?

Earthfiles is an open-source build tool that reached 12,000 GitHub stars and is used by companies like NVIDIA, Intel, and Databricks. Earthly Lunar is a separate governance platform launched in 2025 for enforcing standards across development workflows.

Source
CloudBees Smart Tests: Is Launchable still available?

It continues under a new name. The CloudBees page states that Launchable is now CloudBees Smart Tests, and the launchableinc.com site redirects there.

Source
Earthly: How does Earthly Lunar enforce standards?

Lunar converts engineering standards, compliance requirements, and processes documented in AGENTS.md files, wikis, and incident postmortems into enforceable guardrails that apply consistently across repositories and development stages.

Source
CloudBees Smart Tests: What does Smart Tests do?

It prioritises the tests most relevant to each code change, shows what ran and what was skipped, and flags flaky and long running tests. It also groups and classifies failures with AI.

Source
Earthly: What is the pricing for Earthly Lunar?

Pricing is not published on the website. Interested customers should contact Earthly's sales team for current pricing and feature tiers.

Source
CloudBees Smart Tests: How much does CloudBees Smart Tests cost?

No price is published. The CloudBees pricing page lists no plans and presents Smart Tests as a capability of CloudBees Unify, with recommendations based on a team's setup.

Source
CloudBees Smart Tests: When did CloudBees acquire Launchable?

CloudBees announced the acquisition on 7 August 2024, and financial terms were not disclosed. Launchable's co-founders are Kohsuke Kawaguchi and Harpreet Singh.

Source
Share

Related pages

Other head to heads