Developer Tools · head to head
Blacksmith vs Split

Blacksmith
Developer Tools
2x faster GitHub Actions with 60% cost savings
- From
- Free
- Free plan
- Yes

Split
Testing
Feature flags tied to a metrics pipeline that attributes production impact to each release, now Harness FME
- From
- On request
- Free plan
- No
The short version
- Blacksmith is a GitHub Actions runner service.
- Blacksmith starts at $0.004/mo; Split prices on request.
- Only Blacksmith lists bare metal runners; only Split lists feature flags with targeting.
- Where Blacksmith falls short: per-minute pricing model requires estimating usage to predict costs.
- Prices and features on this page were last checked on 20 November 2026.
How do Blacksmith and Split differ?
Blacksmith and Split differ on starting price (Free against On request), free tier (Yes against No) and platforms. Only the attributes on which Blacksmith and Split actually diverge.
| Attribute | Blacksmith | Split |
|---|---|---|
| Starting price | Free | On request |
| Free tier | Yes | No |
| Platforms | GitHub Actions, Linux, Windows, macOS | Web, API, iOS, Android, Windows |
| Category | Developer Tools | Testing |
Not yet recorded: pricing model for Blacksmith, founded for Split.
Which features does each one have?
They share no listed features; 8 appear only for Blacksmith and 8 only for Split. Drawn from each product's published feature list. An absence here means we hold no record of it - not that the product lacks it.
Only in Blacksmith
- Bare metal runners
- Multiple OS support
- ARM support
- Docker layer caching
- Sticky disks
- GitHub Actions observability
- Free tier
- Static IPs
Only in Split
- Feature flags with targeting
- Metrics impact engine
- Guardrail metrics
- Statistical significance testing
- Event ingestion
- SDKs and streaming updates
- Audit and approvals
- Harness platform integration
What is each one used for?
Blacksmith is most often brought in for replacing GitHub Actions runners with faster, cheaper infrastructure. The jobs each tool is most often brought in to do.
Blacksmith
- Replacing GitHub Actions runners with faster, cheaper infrastructurenot Split
- Accelerating CI build times for organizations with heavy CI loadnot Split
- Reducing cloud spend on GitHub Actions by 60% or morenot Split
- Supporting ARM architecture builds without GitHub runnersnot Split
Split
- A product organisation that wants every release measured against conversion and latency by default, not only deliberate experimentsnot Blacksmith
- Running A/B tests with real statistical significance rather than comparing two dashboard linesnot Blacksmith
- Catching a regression at five per cent rollout because a guardrail metric fires before the change reaches everyonenot Blacksmith
- A team already committed to Harness for CI and CD that wants flags in the same platform and contractnot Blacksmith
Where do Blacksmith and Split fall short?
Blacksmith's most cited limit: per-minute pricing model requires estimating usage to predict costs. Documented limitations, not opinions. Every one is a constraint you would hit in normal use.
Blacksmith
- Per-minute pricing model requires estimating usage to predict costs
- macOS M4 pricing ($0.08/min) is significantly higher than GitHub Actions
- Docker layer caching and sticky disks are paid add-ons at $0.50/GB/mo
- Static IP add-on costs $100/IP/mo
Split
- Split is now a module of the Harness platform and split.io redirects to harness.io, so buying it means entering a Harness commercial relationship rather than a standalone flag vendor contract
- Harness no longer publishes per-module prices, so an organisation that wants only feature management cannot get a list price and must negotiate a module out of a platform bundle
- The measurement engine needs traffic volume to reach significance, so a product with modest usage gets flags with an experimentation layer it will rarely be able to conclude anything from
- Metric attribution depends on correctly instrumented events flowing into Split, which is an integration project in its own right; without it you have paid for an experimentation platform and are using it as a flag switch
- As part of a larger DevOps suite the roadmap now competes with CI, CD, security and cloud cost modules for attention, so feature management is no longer the company’s single focus the way it was as an independent product
How much do Blacksmith and Split cost?
Blacksmith has a free plan, with paid plans from $0.004/mo; Split is priced on request. Plan by plan below, from each vendor's own pricing page.
Blacksmith
Free- Ubuntu x64$0.004/minute
- 3,000 free minutes per month
- 2x faster hardware
- 4x faster cache downloads
- Ubuntu ARM$0.0025/minute
- 3,000 free minutes per month
- 2x faster hardware
- 4x faster cache downloads
- Windows x64$0.008/minute
- 3,000 free minutes per month
- 2x faster hardware
- 4x faster cache downloads
- macOS M4$0.08/minute
- 3,000 free minutes per month
- 2x faster hardware
- 4x faster cache downloads
Split
On request- Harness FreeFree
- Harness Open Source and community support
- Intended for individuals and small teams
- Feature management capability limited at this tier
- Harness EssentialsOn request
- Bundled DevOps modules including CI, CD, IaC and security testing
- Standard support
- Pricing requires contacting sales
- Harness EnterpriseOn request
- Mix and match from 15 or more modules including Feature Management and Experimentation
- Premier support with a dedicated account manager
- Higher pipeline concurrency and organisation limits
Which should you pick?
Choose Blacksmith if
- You need bare metal runners.
- You want to start without paying.
- You work on GitHub Actions, Linux, Windows, macOS.
- You also want multiple os support.
Choose Split if
- You need feature flags with targeting.
- You work on Web, API, iOS, Android, Windows.
- You also want metrics impact engine.
Questions people ask
- Is Blacksmith or Split better?
- Neither clearly leads. Blacksmith starts at Free and Split at On request, and user ratings are close enough to be indistinguishable. Choose on capability and platform support.
- Which is cheaper, Blacksmith or Split?
- Blacksmith has a free tier; the other does not. Paid plans start at Free for Blacksmith and On request for Split.
- Does Blacksmith or Split run on more platforms?
- Blacksmith runs on GitHub Actions, Linux, Windows, macOS. Split runs on Web, API, iOS, Android, Windows.
- Can I use Blacksmith for free?
- Yes. Blacksmith has a free tier, so you can try it without paying. Split starts at On request.
- What is Blacksmith best used for?
- Blacksmith is most often used for replacing github actions runners with faster, cheaper infrastructure, accelerating ci build times for organizations with heavy ci load, reducing cloud spend on github actions by 60% or more, supporting arm architecture builds without github runners. Of those, replacing github actions runners with faster, cheaper infrastructure and accelerating ci build times for organizations with heavy ci load are not what Split is typically brought in for.
- What can Blacksmith do that Split cannot?
- Blacksmith covers Bare metal runners, Multiple OS support, ARM support, Docker layer caching. Split covers Feature flags with targeting, Metrics impact engine, Guardrail metrics, Statistical significance testing.
Answered from the vendors’ own pages
Blacksmith: How much do Blacksmith runners cost compared to GitHub Actions?
Blacksmith offers 60-75% cost savings depending on OS. Ubuntu x64 costs $0.004/min vs GitHub at $0.012/min. All plans include 3,000 free minutes monthly.
SourceSplit: Is Split still called Split?
It is now sold as Harness Feature Management and Experimentation after the Harness acquisition, and split.io redirects to harness.io.
Blacksmith: Can I use Docker layer caching with Blacksmith?
Yes, Docker layer caching is available as an add-on at $0.50/GB/mo. Managed Docker layer persistence is included with the base service.
SourceSplit: Can I buy just feature flags?
Not from a price list. Harness publishes bundle tiers and directs single-module buyers to sales.
Blacksmith: What is the SLA for Enterprise plans?
Enterprise Blacksmith plans include a 99.9% SLA guarantee along with 24/7 priority support, dedicated Slack channels, white-glove onboarding, and CI optimization support.
SourceSplit: What does it do that a plain flag service does not?
It attributes changes in your product metrics to specific flags with statistical significance testing and alerts on guardrail metrics.
Split: Do we need a lot of traffic?
Yes. Statistical tests need volume to conclude, so low-traffic products get limited value from the measurement layer.
Related pages
Other head to heads
- Blacksmith vs WarpBuild
- Blacksmith vs Depot
- Blacksmith vs Namespace
- Blacksmith vs Jenkins
- Blacksmith vs Kubernetes
- Blacksmith vs GitLab
- Blacksmith vs Earthly
- Blacksmith vs Nx Cloud
- Blacksmith vs OpsLevel
- Blacksmith vs Terraform
- Blacksmith vs GitHub
- Blacksmith vs LaunchDarkly
- Blacksmith vs Coder
- Blacksmith vs Envoy
- Blacksmith vs JetBrains IntelliJ IDEA
- Blacksmith vs Keycloak
- Blacksmith vs Penpot
- Blacksmith vs Argo CD
- Blacksmith vs GrowthBook
- Blacksmith vs Kameleoon
- Blacksmith vs Eppo
- Blacksmith vs Katalon
- Blacksmith vs Selenium
- Blacksmith vs Sauce Labs
- Blacksmith vs TestRail
- Blacksmith vs Applitools
- Blacksmith vs CloudBees Smart Tests
- Blacksmith vs QA Wolf
- Blacksmith vs CircleCI
- Blacksmith vs BrowserStack
- Blacksmith vs BugHerd
- Blacksmith vs SoapUI
- Blacksmith vs Playwright
- Blacksmith vs GitHub Actions
- Blacksmith vs Cypress
- Blacksmith vs Appium
- Split vs WarpBuild
- Split vs Depot
- Split vs Namespace
- Split vs Jenkins
- Split vs Kubernetes
- Split vs GitLab
- Split vs Earthly
- Split vs Nx Cloud
- Split vs OpsLevel
- Split vs Terraform
- Split vs GitHub
- Split vs LaunchDarkly
- Split vs Coder
- Split vs Envoy
- Split vs JetBrains IntelliJ IDEA
- Split vs Keycloak
- Split vs Penpot
- Split vs Argo CD
- Split vs GrowthBook
- Split vs Kameleoon
- Split vs Eppo
- Split vs Katalon
- Split vs Selenium
- Split vs Sauce Labs
- Split vs TestRail
- Split vs Applitools
- Split vs CloudBees Smart Tests
- Split vs QA Wolf
- Split vs CircleCI
- Split vs BrowserStack
- Split vs BugHerd
- Split vs SoapUI
- Split vs Playwright
- Split vs GitHub Actions
- Split vs Cypress
- Split vs Appium
