Shadowgraph
TrendingBuzzTop stargazers
Chrome extension
Sign in

traceloop/jest-opentelemetry

Easily run integration tests for your backends

JavaScript

254

157 commits

updated Nov 16, 2023

www.traceloop.com

See the code

See what people are saying

SourceMessageScoreDate

Traceloop Is Joining ServiceNow

3

Mar 2, 2026

I've been keeping a rolling list of LLMOps/AI agent observability products funded by YC. What problems does Lucidic solve that the others do not? https://hegel-ai.com https://www.vellum.ai/ https://www.parea.ai http://baserun.ai https://www.traceloop.com https://www.trychatter.ai https://talc.ai…

on Launch HN: Lucidic (YC W25) – Debug, test, and evaluate AI agents in production

0

Jul 30, 2025

I tend to find classic NLP metric more predictable and stable than "LLM as a judge" metrics so I'd try to see if you rely on them more. We've written a couple of blog posts about some of them: https://www.traceloop.com/blog

on Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry

0

Jul 17, 2024

We trained our own models for some of them, and we combined some well known NLP metrics (like Gruen [1]) to make this work. You're right that it's hard to figure out how to "trust" these metrics. But you shouldn't look at them as a way to get an objective number about your app's performance.…

on Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry

0

Jul 17, 2024

From what I can see, Openllmetry asks you to manually call tracer for non-default OpenAI libraries (i.e. not Python/Node.js) [1] OpenLIT might be easier to integrate with any language that supports OTEL for HTTP clients — you just trace your HTTP calls to OpenAI. [1]…

on Show HN: OpenLIT – Open-Source LLM Observability with OpenTelemetry

0

Apr 28, 2024

Lessons Learned from Using LLMs to Evaluate LLMs

4

Mar 20, 2024

You don't need to create an account in 2 services - you can just connect the SDK directly to Grafana - https://traceloop.com/docs/integration/grafana Happy to assist if needed over slack - https://traceloop.com/slack

on Show HN: You don't need to adopt new tools for LLM observability

0

Feb 15, 2024

Thanks for the issues - I'll fix it! :sweat_smile: Reg. Grafana and others - it's simple, just set the env vars - https://www.traceloop.com/docs/openllmetry/integrations/intr...

on Show HN: You don't need to adopt new tools for LLM observability

0

Feb 14, 2024

Super easy - you can just use the standalone instrumentations directly - https://www.traceloop.com/docs/openllmetry/tracing/without-s...

on Show HN: You don't need to adopt new tools for LLM observability

0

Feb 14, 2024

Observability for LLM's with Opentelemetry

4

Dec 7, 2023

README

Jest OpenTelemetry

Integeration tests with 10 lines of code

Get started »

Slack | Docs | Examples | Website

Jest OpenTelemetry is released under the Apache-2.0 License PRs welcome! git commit activity Slack community channel Traceloop Twitter

Jest OpenTelemetry allows you to write, build and run integration tests based on OpenTelemetry traces with Jest-like syntax. You can:

  • 🕵️ Test any side-effect in your system: an email was sent, a database was updated, a BI event was reported, etc.
  • 👩‍💻 Run your tests and connect to a local or remote test environment.

All with just a few lines of code.

It's built and maintained by Traceloop under the Apache 2.0 license.

🚀 Getting Started

npm i --save-dev @traceloop/jest-opentelemetry

Then, you can start testing your microservices:

const traceloop = new TraceLoop();

await traceloop.axiosInstance.post('http://my.awesome.website/orders/create');
await traceloop.fetchTraces();

expectTrace(traceloop.serviceByName('emails-service'))
  .toReceiveHttpRequest()
  .ofMethod('POST')
  .withBody({ emailTemplate: 'orderCreated', itemId: '123' });

More info can be found in our docs.

What can you test?

Jest OpenTelemetry can be used to test anything that's happening in your system. We're constantly adding more, and you're welcome to suggest yours.

Service Assertions

Database Assertions

Analytics Reporting Assertions

  • Segment
  • Snowflake
  • BigQuery
  • Posthog

External Systems Assertions

  • SendGrid
  • Stripe

🌱 Contributing

Whether it's big or small, we love contributions ❤️ Check out our guide to see how to get started.

Not sure where to get started? You can:

💚 Community & Support

  • Slack (For live discussion with the community and the Traceloop team)
  • GitHub Discussions (For help with building and deeper conversations about features)
  • GitHub Issues (For any bugs and errors you encounter using Jest OpenTelemetry)
  • Twitter (Get news fast)
api-testing
e2e-testing
integration-testing
javascript
jest
open-telemetry
otel
reliability
test-automation
testing
tracing
typescript

Project health

npm

@traceloop/jest-opentelemetry

Latest release

0.8.0 · Jun 20, 2023

Releases this year

0

Significant stargazers

hackerman

2,065 followers · starred Mar 2023

Jérémy Benoist

282 followers · starred Mar 2023

Daniel González Lopes

97 followers · starred Feb 2023

Luke Harries

459 followers · starred Feb 2023

Similar repos

traceloop/openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM…

412

same org

traceloop/openllmetry

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

7,501

same org

kubeshop/tracetest

🔭 Tracetest - Build integration and end-to-end tests in minutes, instead of days, using…

1,329

open-telemetry/opentelemetry-js

OpenTelemetry JavaScript Client

3,495

goldbergyoni/nodejs-testing-best-practices

Beyond the basics of Node.js testing. Including a super-comprehensive best practices list and an…

4,402

jest-community/awesome-jest

🕶 Awesome Jest packages and resources

1,550

tracewayapp/traceway

The only tool you need to know what is happening and how to fix it.

1,726

magsther/awesome-opentelemetry

A curated list of OpenTelemetry resources

986

traceloop/jest-opentelemetry

Easily run integration tests for your backends

JavaScript

254

157 commits

updated Nov 16, 2023

www.traceloop.com

See the code

See what people are saying

SourceMessageScoreDate

Traceloop Is Joining ServiceNow

3

Mar 2, 2026

I've been keeping a rolling list of LLMOps/AI agent observability products funded by YC. What problems does Lucidic solve that the others do not? https://hegel-ai.com https://www.vellum.ai/ https://www.parea.ai http://baserun.ai https://www.traceloop.com https://www.trychatter.ai https://talc.ai…

on Launch HN: Lucidic (YC W25) – Debug, test, and evaluate AI agents in production

0

Jul 30, 2025

I tend to find classic NLP metric more predictable and stable than "LLM as a judge" metrics so I'd try to see if you rely on them more. We've written a couple of blog posts about some of them: https://www.traceloop.com/blog

on Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry

0

Jul 17, 2024

We trained our own models for some of them, and we combined some well known NLP metrics (like Gruen [1]) to make this work. You're right that it's hard to figure out how to "trust" these metrics. But you shouldn't look at them as a way to get an objective number about your app's performance.…

on Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry

0

Jul 17, 2024

From what I can see, Openllmetry asks you to manually call tracer for non-default OpenAI libraries (i.e. not Python/Node.js) [1] OpenLIT might be easier to integrate with any language that supports OTEL for HTTP clients — you just trace your HTTP calls to OpenAI. [1]…

on Show HN: OpenLIT – Open-Source LLM Observability with OpenTelemetry

0

Apr 28, 2024

Lessons Learned from Using LLMs to Evaluate LLMs

4

Mar 20, 2024

You don't need to create an account in 2 services - you can just connect the SDK directly to Grafana - https://traceloop.com/docs/integration/grafana Happy to assist if needed over slack - https://traceloop.com/slack

on Show HN: You don't need to adopt new tools for LLM observability

0

Feb 15, 2024

Thanks for the issues - I'll fix it! :sweat_smile: Reg. Grafana and others - it's simple, just set the env vars - https://www.traceloop.com/docs/openllmetry/integrations/intr...

on Show HN: You don't need to adopt new tools for LLM observability

0

Feb 14, 2024

Super easy - you can just use the standalone instrumentations directly - https://www.traceloop.com/docs/openllmetry/tracing/without-s...

on Show HN: You don't need to adopt new tools for LLM observability

0

Feb 14, 2024

Observability for LLM's with Opentelemetry

4

Dec 7, 2023

README

Jest OpenTelemetry

Integeration tests with 10 lines of code

Get started »

Slack | Docs | Examples | Website

Jest OpenTelemetry is released under the Apache-2.0 License PRs welcome! git commit activity Slack community channel Traceloop Twitter

Jest OpenTelemetry allows you to write, build and run integration tests based on OpenTelemetry traces with Jest-like syntax. You can:

  • 🕵️ Test any side-effect in your system: an email was sent, a database was updated, a BI event was reported, etc.
  • 👩‍💻 Run your tests and connect to a local or remote test environment.

All with just a few lines of code.

It's built and maintained by Traceloop under the Apache 2.0 license.

🚀 Getting Started

npm i --save-dev @traceloop/jest-opentelemetry

Then, you can start testing your microservices:

const traceloop = new TraceLoop();

await traceloop.axiosInstance.post('http://my.awesome.website/orders/create');
await traceloop.fetchTraces();

expectTrace(traceloop.serviceByName('emails-service'))
  .toReceiveHttpRequest()
  .ofMethod('POST')
  .withBody({ emailTemplate: 'orderCreated', itemId: '123' });

More info can be found in our docs.

What can you test?

Jest OpenTelemetry can be used to test anything that's happening in your system. We're constantly adding more, and you're welcome to suggest yours.

Service Assertions

Database Assertions

Analytics Reporting Assertions

  • Segment
  • Snowflake
  • BigQuery
  • Posthog

External Systems Assertions

  • SendGrid
  • Stripe

🌱 Contributing

Whether it's big or small, we love contributions ❤️ Check out our guide to see how to get started.

Not sure where to get started? You can:

💚 Community & Support

  • Slack (For live discussion with the community and the Traceloop team)
  • GitHub Discussions (For help with building and deeper conversations about features)
  • GitHub Issues (For any bugs and errors you encounter using Jest OpenTelemetry)
  • Twitter (Get news fast)
api-testing
e2e-testing
integration-testing
javascript
jest
open-telemetry
otel
reliability
test-automation
testing
tracing
typescript

Project health

npm

@traceloop/jest-opentelemetry

Latest release

0.8.0 · Jun 20, 2023

Releases this year

0

Significant stargazers

hackerman

2,065 followers · starred Mar 2023

Jérémy Benoist

282 followers · starred Mar 2023

Daniel González Lopes

97 followers · starred Feb 2023

Luke Harries

459 followers · starred Feb 2023

Similar repos

traceloop/openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM…

412

same org

traceloop/openllmetry

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

7,501

same org

kubeshop/tracetest

🔭 Tracetest - Build integration and end-to-end tests in minutes, instead of days, using…

1,329

open-telemetry/opentelemetry-js

OpenTelemetry JavaScript Client

3,495

goldbergyoni/nodejs-testing-best-practices

Beyond the basics of Node.js testing. Including a super-comprehensive best practices list and an…

4,402

jest-community/awesome-jest

🕶 Awesome Jest packages and resources

1,550

tracewayapp/traceway

The only tool you need to know what is happening and how to fix it.

1,726

magsther/awesome-opentelemetry

A curated list of OpenTelemetry resources

986