Skip to content

Add InMemoryReader to expose otel counter information on demand #782

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed

Conversation

benjipelletier
Copy link
Contributor

Summary:
Add a new otel reader type InMemoryReader

  • impls ManualReader and stores global ManualReader instance so we can get metrics during hyperactor program runs.

  • provides getters to cumulative counters. Will add more metrics later

  • ‼️ Uses cumulative temporality so metrics are stored in the SDK rather than in hyperactor. This might be something we iterate on if collection and transforming to a hashmap each time is too costly

  • also changes macros in lib.rs to use $crate eliothedeman

Reviewed By: eliothedeman

Differential Revision: D79658641

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Aug 6, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79658641

benjipelletier added a commit to benjipelletier/monarch-1 that referenced this pull request Aug 7, 2025
…-pytorch#782)

Summary:

Add a new otel reader type `InMemoryReader`
* impls `ManualReader` and stores global ManualReader instance so we can get metrics during hyperactor program runs.
* provides getters to cumulative counters. Will add more metrics later
* ‼️ Uses cumulative temporality so metrics are stored in the SDK rather than in hyperactor. This might be something we iterate on if collection and transforming to a hashmap each time is too costly


* also changes macros in lib.rs to use $crate eliothedeman

Reviewed By: eliothedeman

Differential Revision: D79658641
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79658641

benjipelletier added a commit to benjipelletier/monarch-1 that referenced this pull request Aug 8, 2025
…-pytorch#782)

Summary:

Add a new otel reader type `InMemoryReader`
* impls `ManualReader` and stores global ManualReader instance so we can get metrics during hyperactor program runs.
* provides getters to cumulative counters. Will add more metrics later
* ‼️ Uses cumulative temporality so metrics are stored in the SDK rather than in hyperactor. This might be something we iterate on if collection and transforming to a hashmap each time is too costly


* also changes macros in lib.rs to use $crate eliothedeman

Reviewed By: eliothedeman

Differential Revision: D79658641
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79658641

…-pytorch#782)

Summary:

Add a new otel reader type `InMemoryReader`
* impls `ManualReader` and stores global ManualReader instance so we can get metrics during hyperactor program runs.
* provides getters to cumulative counters. Will add more metrics later
* ‼️ Uses cumulative temporality so metrics are stored in the SDK rather than in hyperactor. This might be something we iterate on if collection and transforming to a hashmap each time is too costly


* also changes macros in lib.rs to use $crate eliothedeman

Reviewed By: eliothedeman

Differential Revision: D79658641
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79658641

benjipelletier added a commit to benjipelletier/monarch-1 that referenced this pull request Aug 8, 2025
…-pytorch#782)

Summary:

Add a new otel reader type `InMemoryReader`
* impls `ManualReader` and stores global ManualReader instance so we can get metrics during hyperactor program runs.
* provides getters to cumulative counters. Will add more metrics later
* ‼️ Uses cumulative temporality so metrics are stored in the SDK rather than in hyperactor. This might be something we iterate on if collection and transforming to a hashmap each time is too costly


* also changes macros in lib.rs to use $crate eliothedeman

Reviewed By: eliothedeman

Differential Revision: D79658641
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in d905ba2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants