Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OPCT-226: opct adm parsers for etcd and metrics #102

Merged
merged 6 commits into from
Jul 26, 2024

Conversation

mtulio
Copy link
Contributor

@mtulio mtulio commented Mar 8, 2024

Introducing the following commands to consume subset of features introduced on opct report (v0.5+, #76):

  • opct adm parse-etcd-logs: parse logs from etcd pod logs from must-gather providing a summary w/ timers from the cluster opration
  • opct adm parse-metrics: parse metrics read from Prometheus collected by OPCT and generate charts in HTML files

The commands are a subset of improvements in UI (CLI and Web) of opct report that is planning to be available in the stable of v0.5. This subset of changes were extracted from under development OPCT report PR: #76

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Mar 8, 2024
@mtulio mtulio force-pushed the feat-report-opct-adm branch from 0943488 to ea8f0f2 Compare March 8, 2024 03:23
@mtulio mtulio changed the title opct adm parsers for etcd and metrics OPCT-226: opct adm parsers for etcd and metrics Mar 8, 2024
@mtulio mtulio force-pushed the feat-report-opct-adm branch 3 times, most recently from 003f171 to 5c6fb33 Compare March 8, 2024 03:53
@mtulio mtulio marked this pull request as ready for review March 8, 2024 04:10
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Mar 8, 2024
@mtulio mtulio requested a review from jcpowermac March 8, 2024 04:10
@openshift-ci openshift-ci bot requested review from faermanj and rvanderp3 March 8, 2024 04:10
@mtulio mtulio added kind/feature Categorizes issue or PR as related to a new feature. kind/dependency-change Categorizes issue or PR as related to changing dependencies kind/documentation Categorizes issue or PR as related to documentation. component/CI labels Mar 8, 2024
@mtulio
Copy link
Contributor Author

mtulio commented Mar 8, 2024

/assign @jcpowermac @rvanderp3

Copy link

openshift-ci bot commented Jul 10, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from jcpowermac. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@mtulio
Copy link
Contributor Author

mtulio commented Jul 10, 2024

Converting to draft to rebase, improve CI workflow to bump to 1.22 - and convert the go version into variable.

/hold

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jul 10, 2024
@mtulio mtulio marked this pull request as draft July 10, 2024 17:50
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jul 10, 2024
@mtulio mtulio force-pushed the feat-report-opct-adm branch 2 times, most recently from 3f439e7 to 3d3d425 Compare July 10, 2024 18:12
mtulio added 4 commits July 10, 2024 15:20
Introduce 'adm' subcommand support, with parser as a child to allow
users to consume subset of features from 'report' command individually
when need to explore individual archives, like must-gather, metrics,
etc.
Create the libraries used to extract, process, and create reports
for the 'opct adm parse-*' commands.

Those libraries are extracted from 'opct report' (WIP redhat-openshift-ecosystem#26) created to produce the
final report when processing the result archive.
Introduce VFS and test data to be consumed by CI/e2e and unit tests.
@mtulio mtulio force-pushed the feat-report-opct-adm branch from 3d3d425 to d57af0e Compare July 10, 2024 18:24
@mtulio mtulio marked this pull request as ready for review July 10, 2024 18:27
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jul 10, 2024
@mtulio mtulio force-pushed the feat-report-opct-adm branch 6 times, most recently from 16fd08d to a208098 Compare July 10, 2024 19:18
mtulio added 2 commits July 25, 2024 01:47
Introduce new CI/GHA jobs to test new opct adm commands.

Standarize/upgrade old action images to prevent deprecation warnings.
@mtulio mtulio force-pushed the feat-report-opct-adm branch from a208098 to 7084c4a Compare July 25, 2024 05:06
@mtulio
Copy link
Contributor Author

mtulio commented Jul 26, 2024

Considering the amount of pending tasks/workload in this project, specially for v0.5, and the current bandwith to review, I am moving on this PR and merge it. This PR is introduce new command and capabilities to parse data, introducing new e2e using test data which isn't yet available, it may provides good signal to proceed.

This PR is blocking v0.5, and it is a subset of #76.

@mtulio
Copy link
Contributor Author

mtulio commented Jul 26, 2024

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jul 26, 2024
@mtulio mtulio merged commit 48eb4cf into redhat-openshift-ecosystem:main Jul 26, 2024
8 of 9 checks passed
@mtulio mtulio deleted the feat-report-opct-adm branch July 26, 2024 20:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/CI kind/dependency-change Categorizes issue or PR as related to changing dependencies kind/documentation Categorizes issue or PR as related to documentation. kind/feature Categorizes issue or PR as related to a new feature.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants