Softwr

APIs · head to head

Convoy vs TestNG

Convoy logo

Convoy

APIs

Open source webhooks gateway you self-host, handling both sending and receiving

From
Free
Rated
-
Full reviewWebsite
TestNG logo

TestNG

Testing

Java testing framework created by Cedric Beust, still actively maintained but effectively a single-lead project

From
Free
Rated
-
Full reviewWebsite

The short version

  • Each has a real cost: Convoy the default deployment is self-hosted, so you operate Convoy plus Postgres and Redis and carry the on-call burden for the system that delivers your customers' events.; TestNG maintainership is concentrated around creator Cedric Beust rather than a broad team or foundation, which is a real continuity risk compared to JUnit's independent team or Jest's foundation backing.
  • They diverge on capability: Convoy covers Inbound and outbound, TestNG covers Test dependencies.
  • Prices and features above were last checked on 1 September 2026.

Where they differ

Only the attributes on which Convoy and TestNG actually diverge.

Attributes where Convoy and TestNG differ
AttributeConvoyTestNG
Pricing modelPer month, flat rate regardless of volumeOpen source, no licence fee
PlatformsLinux, Docker, Kubernetes, CloudLinux, macOS, Windows
CategoryAPIsTesting

Identical on both: starting price (Free), free tier (Yes), user rating (Not yet rated).

What each one covers

Drawn from each product's published feature list. An absence here means we hold no record of it - not that the product lacks it.

Only in Convoy

  • Inbound and outbound
  • Broker-driven ingestion
  • Payload transformation
  • Portal links
  • Circuit breaking
  • Retry policies
  • OpenTelemetry export
  • Role-based access control

Only in TestNG

  • Test dependencies
  • XML suite configuration
  • Native parallel execution
  • Data providers
  • Grouping
  • Flexible reporting

What people use each for

The jobs each tool is most often brought in to do.

Convoy

  • A fintech that cannot route customer webhook traffic through a third-party SaaS for compliance reasonsnot TestNG
  • A high-volume platform for which per-message webhook pricing costs more than the flat premium licencenot TestNG
  • A team that also receives webhooks from many providers and wants ingestion, verification and deduplication in the same gatewaynot TestNG
  • An engineering group that wants webhook delivery driven directly from an existing Kafka or SQS topicnot TestNG

TestNG

  • A Java integration test suite that needs to skip dependent tests automatically when a prerequisite test failsnot Convoy
  • A team wanting XML-based suite configuration to manage large, grouped test suites without touching code for each runnot Convoy
  • A project needing native parallel test execution at the class or method level without adding a separate pluginnot Convoy
  • A Selenium-based UI test suite that uses TestNG as the underlying runner for grouping and parallelisationnot Convoy

Where each one falls short

Documented limitations, not opinions. Every one is a constraint you would hit in normal use.

Convoy

  • The default deployment is self-hosted, so you operate Convoy plus Postgres and Redis and carry the on-call burden for the system that delivers your customers' events.
  • Frain Technologies is a small startup, and putting customer-facing delivery infrastructure on it means accepting real vendor continuity risk on a component that is hard to swap out quickly.
  • The premium tier at a flat 999 US dollars a month is poor value below substantial volume, while the community edition omits the portal, transformations and RBAC that most production deployments end up wanting.
  • The hosted cloud trial is capped at one project and 100 events a day, which is too small to properly evaluate the service before committing.
  • Documentation and the third-party ecosystem are thinner than the established webhook services, so unusual configurations often mean reading the Go source.

TestNG

  • Maintainership is concentrated around creator Cedric Beust rather than a broad team or foundation, which is a real continuity risk compared to JUnit's independent team or Jest's foundation backing.
  • It is a smaller ecosystem than JUnit, so fewer third-party integrations, tutorials and Stack Overflow answers exist for edge cases.
  • XML-based suite configuration, while powerful, is an extra file and syntax to maintain alongside the codebase, which some teams find adds friction JUnit's more code-centric model avoids.
  • There is no commercial support tier or vendor relationship of any kind, unlike JUnit's OpenElements arrangement, so an enterprise wanting a support contract has no route to buy one.
  • Release cadence, while active, is slower and less frequent than JUnit 5's, since it depends on a much smaller pool of active maintainers.

Pricing, plan by plan

Convoy

Free
  • CommunityFree
    • Self-hosted open source gateway
    • Inbound and outbound webhooks
    • Automatic retries and message broker support
  • Premium$999/month
    • Flat rate irrespective of message volume
    • Portal links and payload transformation
    • RBAC, circuit breaking and white labelling
  • Enterprise$undefined/year
    • SAML SSO
    • Dedicated support with SLA
    • On-premises deployment assistance
  • Cloud$undefined/month
    • Hosted by Convoy
    • 14 day trial limited to one project and 100 events a day
    • Usage-based tiers above the trial

TestNG

Free
  • TestNGFree
    • Full functionality, no usage limits
    • Community support via GitHub
    • No commercial support tier exists

Which should you pick?

Choose Convoy if

  • You need inbound and outbound.
  • You want to start without paying.
  • You work on Linux, Docker, Kubernetes, Cloud.
  • You also want broker-driven ingestion.
Convoy review

Choose TestNG if

  • You need test dependencies.
  • You want to start without paying.
  • You work on Linux, macOS, Windows.
  • You also want xml suite configuration.
TestNG review

Questions people ask

Is Convoy or TestNG better?
Neither clearly leads. Convoy starts at Free and TestNG at Free, and user ratings are close enough to be indistinguishable. Choose on capability and platform support.
Which is cheaper, Convoy or TestNG?
Convoy starts at Free and TestNG at Free.
Does Convoy or TestNG run on more platforms?
Convoy runs on Linux, Docker, Kubernetes, Cloud. TestNG runs on Linux, macOS, Windows.
Can I use Convoy for free?
Both have a free tier, so you can try either at no cost before committing.
What is Convoy best used for?
Convoy is most often used for a fintech that cannot route customer webhook traffic through a third-party saas for compliance reasons, a high-volume platform for which per-message webhook pricing costs more than the flat premium licence, a team that also receives webhooks from many providers and wants ingestion, verification and deduplication in the same gateway, an engineering group that wants webhook delivery driven directly from an existing kafka or sqs topic. Of those, a fintech that cannot route customer webhook traffic through a third-party saas for compliance reasons and a high-volume platform for which per-message webhook pricing costs more than the flat premium licence are not what TestNG is typically brought in for.
What can Convoy do that TestNG cannot?
Convoy covers Inbound and outbound, Broker-driven ingestion, Payload transformation, Portal links. TestNG covers Test dependencies, XML suite configuration, Native parallel execution, Data providers.

Answered from the vendors’ own pages

Convoy: Is Convoy really open source?

Yes, the community edition is open source and self-hostable, covering both inbound and outbound webhooks with retries.

TestNG: Is TestNG still actively maintained in 2026?

Yes, it continues to receive releases in its 7.x line with support for current Java versions, though maintenance is concentrated around a small team led by its creator.

Convoy: What does premium cost?

A flat 999 US dollars a month, self-hosted, regardless of message volume.

TestNG: What does TestNG offer that JUnit does not?

Native test dependencies, XML-based suite configuration and built-in parallel execution without needing external plugins, all of which JUnit users typically add via separate libraries.

Convoy: Does it receive webhooks as well as send them?

Yes, inbound ingestion with verification and deduplication is a first-class feature, unlike most webhook services.

TestNG: Is there a commercial support option for TestNG?

No, unlike JUnit there is no commercial support arrangement; support is purely community-based through GitHub.

Convoy: Do I have to self-host?

No, there is a hosted cloud, but the trial is capped at 100 events a day and self-hosting is the primary model.

Share

Related pages

More on Convoy

More on TestNG

Keep looking

Other head to heads