Skip to content

[Enhancement] Update categories for packages #14571

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

trisch-me
Copy link

@trisch-me trisch-me commented Jul 16, 2025

We are using categories of packages in telemetry and it seems that categories of packages are not reliable as I found a few of security packages not marked as such, for example aws etc.

I took advantage of LLM to update the list of categories according to the readme in each integration and using this list of available categories

I have verified it as much as I could but as it touches a lot of integrations it would be great to have more eyes on it.
Every new category has justification

p.s. I am new to the integrations development so it might be I’m missing some of the usages of categories and current changes might break something. If so - I am happy to update the PR

FYI @vglagoleva @andrewkroh

@trisch-me trisch-me added the enhancement New feature or request label Jul 16, 2025
@trisch-me trisch-me requested review from a team as code owners July 16, 2025 16:28
@trisch-me trisch-me requested review from rdner and leehinman July 16, 2025 16:28
Copy link
Contributor

@leehinman leehinman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just reviewed the changes to "windows" package since that is the only one owned by elastic-agent-data-plane.

Copy link
Member

@susan-shu-c susan-shu-c left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The addition of the network_security category in packages/beaconing should work; cc @sodhikirti07

@elastic-vault-github-plugin-prod
Copy link

elastic-vault-github-plugin-prod bot commented Jul 16, 2025

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

Copy link
Member

@andrewkroh andrewkroh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Without elastic/package-spec providing any description of the category meanings, there is some subjectivity to the labeling. I have brought my own assumptions to this review.

Overall looks good, it probably would be good for PMs that know these products to also have a look.

@andrewkroh andrewkroh added Team:Elastic-Agent-Data-Plane Agent Data Plane team [elastic/elastic-agent-data-plane] Team:Security-Deployment and Devices Deployment and Devices Security team [elastic/sec-deployment-and-devices] Team:Security-Applied ML Elastic Security Protections Machine Learning (ML) team [elastic/sec-applied-ml] Team:obs-ds-hosted-services Observability Hosted Services team [elastic/obs-ds-hosted-services] Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations] Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations] Team:Security-Windows Platform Security Windows Platform team [elastic/sec-windows-platform] Integration:All Applies to all integrations [Integration not found in source] labels Jul 16, 2025
@elasticmachine
Copy link

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

@elasticmachine
Copy link

Pinging @elastic/sec-deployment-and-devices (Team:Security-Deployment and Devices)

@elasticmachine
Copy link

Pinging @elastic/sec-applied-ml (Team:Security-Applied ML)

@elasticmachine
Copy link

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

@elasticmachine
Copy link

Pinging @elastic/sec-windows-platform (Team:Security-Windows Platform)

@lalit-satapathy
Copy link
Contributor

Added @daniela-elastic to help review the o11y package changes.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What about universal_profiling_collector and universal_profiling_symbolizer?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you suggest to update categories to include observability?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have updated it

@trisch-me trisch-me requested a review from a team as a code owner July 17, 2025 10:23
@trisch-me trisch-me requested a review from shmsr July 17, 2025 10:24

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we say that ActiveMQ is part of the infrastructure stack and what is the definition of infra stack? Asking because we have an integration Kafka which one could argue is an alternative to ActiveMQ (minus the streaming part) however today Kafka integration doesn't have infra category. Perhaps we should look into conformity between the various similar family of services to make sure they are categorized in the same way.

Copy link

@daniela-elastic daniela-elastic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking the initiative to update the categories! It's been long overdue. Provided some suggestions, hopefully those make sense and can be easily addressed

@trisch-me
Copy link
Author

@daniela-elastic I have updated code according to your comments

@elasticmachine
Copy link

elasticmachine commented Jul 18, 2025

💔 Build Failed

Failed CI Steps

History

Copy link
Member

@florianl florianl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes to universal_profiling_* packages look good to me. For the rest of the packages the respective people have to speak up.

Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Integration:All Applies to all integrations [Integration not found in source] Team:Elastic-Agent-Data-Plane Agent Data Plane team [elastic/elastic-agent-data-plane] Team:obs-ds-hosted-services Observability Hosted Services team [elastic/obs-ds-hosted-services] Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations] Team:Security-Applied ML Elastic Security Protections Machine Learning (ML) team [elastic/sec-applied-ml] Team:Security-Deployment and Devices Deployment and Devices Security team [elastic/sec-deployment-and-devices] Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations] Team:Security-Windows Platform Security Windows Platform team [elastic/sec-windows-platform]
Projects
None yet
Development

Successfully merging this pull request may close these issues.

10 participants