Developer Tools · head to head
Envoy vs CloudBees Smart Tests

Envoy
Developer Tools
A high-performance L7 proxy written in C++ that is configured by an API rather than a config file, and is usually deployed under a control plane.
- From
- Free
- Free plan
- Yes

CloudBees Smart Tests
Testing
Test intelligence tool, formerly Launchable, that selects tests relevant to each change
- From
- On request
- Free plan
- No
The short version
- Envoy is free; CloudBees Smart Tests prices on request.
- Only Envoy lists xDS dynamic configuration; only CloudBees Smart Tests lists test prioritisation per code change.
- Where CloudBees Smart Tests falls short: no published pricing; Smart Tests is sold as part of CloudBees Unify on request.
- Prices and features on this page were last checked on 20 November 2026.
How do Envoy and CloudBees Smart Tests differ?
Envoy and CloudBees Smart Tests differ on starting price (Free against On request), pricing model (Open-source against Quote) and free tier (Yes against No). Only the attributes on which Envoy and CloudBees Smart Tests actually diverge.
| Attribute | Envoy | CloudBees Smart Tests |
|---|---|---|
| Starting price | Free | On request |
| Pricing model | Open-source | Quote |
| Free tier | Yes | No |
| Category | Developer Tools | Testing |
Identical on both: platforms (Web).
Which features does each one have?
They share no listed features; 8 appear only for Envoy and 8 only for CloudBees Smart Tests. Drawn from each product's published feature list. An absence here means we hold no record of it - not that the product lacks it.
Only in Envoy
- xDS dynamic configuration
- Protocol breadth
- Filter chain architecture
- Observability by default
- Outlier detection
- Traffic shaping
- mTLS termination and origination
- Hot restart
Only in CloudBees Smart Tests
- Test prioritisation per code change
- Visibility of ran and skipped tests with reasons
- Flaky and long running test identification
- Quarantine of noisy tests
- AI grouping and classification of failures
- Observation mode alongside existing pipelines
- Works with Jenkins and CloudBees CI
- Works without replacing test frameworks
What is each one used for?
CloudBees Smart Tests is most often brought in for cutting test run time on large suites. The jobs each tool is most often brought in to do.
Envoy
- Acting as the data plane under a service mesh or Gateway API implementation, which is how the overwhelming majority of deployments use itnot CloudBees Smart Tests
- An edge or API gateway that needs per-route retry budgets, circuit breaking and outlier detection rather than round-robin proxyingnot CloudBees Smart Tests
- Migrating traffic between service versions or between a monolith and its replacement, using weighted splits and shadow trafficnot CloudBees Smart Tests
- Standardising observability across a polyglot estate, so that latency, error rates and tracing look the same regardless of the language a service is written innot CloudBees Smart Tests
CloudBees Smart Tests
- Cutting test run time on large suitesnot Envoy
- Identifying and quarantining flaky testsnot Envoy
- Triaging test failures with AI groupingnot Envoy
- Adding test intelligence to Jenkins pipelinesnot Envoy
- Observing test results before changing pipelinesnot Envoy
Where do Envoy and CloudBees Smart Tests fall short?
CloudBees Smart Tests's most cited limit: no published pricing; Smart Tests is sold as part of CloudBees Unify on request. Documented limitations, not opinions. Every one is a constraint you would hit in normal use.
Envoy
- The configuration surface is very large and hand-written bootstrap YAML runs to hundreds of lines for routing that Nginx expresses in twenty, which is why nearly every production deployment sits under a control plane and inherits that control plane's constraints as well
- xDS is the real API and it is not stable in the comfortable sense; the v2 API set was removed outright, resource types continue to be deprecated, and your control plane and Envoy binaries have to be upgraded roughly in step or the proxies stop accepting configuration
- Extending it properly means writing a C++ filter and building and maintaining your own Envoy binary; the alternatives are Lua, which adds per-request overhead, and proxy-wasm, whose ABI has remained effectively experimental for years with a real performance cost
- At sidecar density the per-proxy memory and CPU footprint is a measurable share of cluster capacity, since thousands of workloads each carry a full proxy, and this is precisely the cost that has pushed mesh projects towards node-level or ambient architectures
- There is no single vendor selling support for Envoy itself; you get the community plus control-plane vendors such as Solo.io and Tetrate, so an Envoy-level production bug is your own engineers in a C++ codebase unless a support contract happens to cover it
- Diagnosing why a request got a particular response involves reading config dumps, the stats endpoint and the RESPONSE_FLAGS codes in access logs rather than a readable error, which is a specific skill you must hire or spend months growing
CloudBees Smart Tests
- No published pricing; Smart Tests is sold as part of CloudBees Unify on request
- The vendor does not specify a cloud or self hosted deployment model on its product page
- Selects and analyses tests only; it does not run tests or replace a CI server
- Product name changed from Launchable, so older documentation and reviews use the previous name
How much do Envoy and CloudBees Smart Tests cost?
Envoy is free to use; CloudBees Smart Tests is priced on request. Plan by plan below, from each vendor's own pricing page.
Envoy
FreeNo published plan breakdown. See the Envoy review.
CloudBees Smart Tests
On requestNo published plan breakdown. See the CloudBees Smart Tests review.
Which should you pick?
Choose Envoy if
- You need xds dynamic configuration.
- You want to start without paying.
- You also want protocol breadth.
Choose CloudBees Smart Tests if
- You need test prioritisation per code change.
- You also want visibility of ran and skipped tests with reasons.
Questions people ask
- Is Envoy or CloudBees Smart Tests better?
- Neither clearly leads. Envoy starts at Free and CloudBees Smart Tests at On request, and user ratings are close enough to be indistinguishable. Choose on capability and platform support.
- Which is cheaper, Envoy or CloudBees Smart Tests?
- Envoy has a free tier; the other does not. Paid plans start at Free for Envoy and On request for CloudBees Smart Tests.
- Does Envoy or CloudBees Smart Tests run on more platforms?
- Both run on Web, so platform support will not decide this one for you.
- Can I use Envoy for free?
- Yes. Envoy has a free tier, so you can try it without paying. CloudBees Smart Tests starts at On request.
- What is Envoy best used for?
- Envoy is most often used for acting as the data plane under a service mesh or gateway api implementation, which is how the overwhelming majority of deployments use it, an edge or api gateway that needs per-route retry budgets, circuit breaking and outlier detection rather than round-robin proxying, migrating traffic between service versions or between a monolith and its replacement, using weighted splits and shadow traffic, standardising observability across a polyglot estate, so that latency, error rates and tracing look the same regardless of the language a service is written in. Of those, acting as the data plane under a service mesh or gateway api implementation, which is how the overwhelming majority of deployments use it and an edge or api gateway that needs per-route retry budgets, circuit breaking and outlier detection rather than round-robin proxying are not what CloudBees Smart Tests is typically brought in for.
- What can Envoy do that CloudBees Smart Tests cannot?
- Envoy covers xDS dynamic configuration, Protocol breadth, Filter chain architecture, Observability by default. CloudBees Smart Tests covers Test prioritisation per code change, Visibility of ran and skipped tests with reasons, Flaky and long running test identification, Quarantine of noisy tests.
Answered from the vendors’ own pages
Envoy: Should I run Envoy on its own, or under a control plane?
Almost always under one. Directly authoring xDS or static bootstrap configuration is viable for a handful of routes and becomes unmanageable beyond that. Envoy Gateway, Istio, Contour, Gloo and Consul all exist to generate that configuration for you.
CloudBees Smart Tests: Is Launchable still available?
It continues under a new name. The CloudBees page states that Launchable is now CloudBees Smart Tests, and the launchableinc.com site redirects there.
SourceEnvoy: How does it compare with Nginx or HAProxy?
Envoy is dynamically configured over an API and instrumented far more heavily; Nginx and HAProxy are faster to configure and lighter for straightforward reverse proxying. If you never need to change routing without a reload, Envoy is more machinery than the problem requires.
CloudBees Smart Tests: What does Smart Tests do?
It prioritises the tests most relevant to each code change, shows what ran and what was skipped, and flags flaky and long running tests. It also groups and classifies failures with AI.
SourceEnvoy: What does it cost?
Nothing to licence; it is Apache 2.0 and there is no paid edition. The cost is engineering time and, for most organisations, a commercial control plane or cloud service that packages it.
CloudBees Smart Tests: How much does CloudBees Smart Tests cost?
No price is published. The CloudBees pricing page lists no plans and presents Smart Tests as a capability of CloudBees Unify, with recommendations based on a team's setup.
SourceEnvoy: Can I write extensions without C++?
You can write Lua filters or proxy-wasm modules in Rust, Go, C++ or AssemblyScript. Both carry per-request overhead compared with a native filter, and the Wasm path has been slower to stabilise than the project originally projected.
CloudBees Smart Tests: When did CloudBees acquire Launchable?
CloudBees announced the acquisition on 7 August 2024, and financial terms were not disclosed. Launchable's co-founders are Kohsuke Kawaguchi and Harpreet Singh.
SourceEnvoy: Is it a CNCF project?
Yes, it is a graduated CNCF project licensed under Apache 2.0, which means the trademark and governance sit with the foundation rather than with Lyft or any vendor.
Related pages
More on CloudBees Smart Tests
Other head to heads
- Envoy vs Istio
- Envoy vs Ona (formerly Gitpod)
- Envoy vs Spacelift
- Envoy vs Jenkins
- Envoy vs Hookdeck
- Envoy vs Atlantis
- Envoy vs Restate
- Envoy vs Turborepo
- Envoy vs Helix
- Envoy vs Git
- Envoy vs Okteto
- Envoy vs StackBlitz
- Envoy vs CodeSandbox
- Envoy vs Cody
- Envoy vs Depot
- Envoy vs Neovim
- Envoy vs Azure DevOps
- Envoy vs Bitbucket
- Envoy vs GitHub Actions
- Envoy vs CircleCI
- Envoy vs Detox
- Envoy vs Ranorex
- Envoy vs Split
- Envoy vs Jest
- Envoy vs Katalon
- Envoy vs Testsigma
- Envoy vs GrowthBook
- Envoy vs mabl
- Envoy vs Robot Framework
- Envoy vs Cypress
- Envoy vs BrowserStack
- Envoy vs Xray Test Management
- Envoy vs Insomnia
- Envoy vs Puppeteer
- Envoy vs WebdriverIO
- Envoy vs Appium
- CloudBees Smart Tests vs Istio
- CloudBees Smart Tests vs Ona (formerly Gitpod)
- CloudBees Smart Tests vs Spacelift
- CloudBees Smart Tests vs Jenkins
- CloudBees Smart Tests vs Hookdeck
- CloudBees Smart Tests vs Atlantis
- CloudBees Smart Tests vs Restate
- CloudBees Smart Tests vs Turborepo
- CloudBees Smart Tests vs Helix
- CloudBees Smart Tests vs Git
- CloudBees Smart Tests vs Okteto
- CloudBees Smart Tests vs StackBlitz
- CloudBees Smart Tests vs CodeSandbox
- CloudBees Smart Tests vs Cody
- CloudBees Smart Tests vs Depot
- CloudBees Smart Tests vs Neovim
- CloudBees Smart Tests vs Azure DevOps
- CloudBees Smart Tests vs Bitbucket
- CloudBees Smart Tests vs GitHub Actions
- CloudBees Smart Tests vs CircleCI
- CloudBees Smart Tests vs Detox
- CloudBees Smart Tests vs Ranorex
- CloudBees Smart Tests vs Split
- CloudBees Smart Tests vs Jest
- CloudBees Smart Tests vs Katalon
- CloudBees Smart Tests vs Testsigma
- CloudBees Smart Tests vs GrowthBook
- CloudBees Smart Tests vs mabl
- CloudBees Smart Tests vs Robot Framework
- CloudBees Smart Tests vs Cypress
- CloudBees Smart Tests vs BrowserStack
- CloudBees Smart Tests vs Xray Test Management
- CloudBees Smart Tests vs Insomnia
- CloudBees Smart Tests vs Puppeteer
- CloudBees Smart Tests vs WebdriverIO
- CloudBees Smart Tests vs Appium
