Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add support to metrics calculation #196

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

shengfukevin
Copy link
Contributor

@shengfukevin shengfukevin commented Jan 10, 2025

Add support to metrics calculation.

  1. Iteration E2E time
  2. bandwidth

This is the copy of #195 for importing it into Meta.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 10, 2025
@facebook-github-bot
Copy link
Contributor

@shengfukevin has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

Summary:
Add support to metrics calculation.

1. Iteration E2E time
2. bandwidth

This is the copy of #195 for importing it into Meta.


Differential Revision: D68038126

Pulled By: shengfukevin
@facebook-github-bot
Copy link
Contributor

@shengfukevin has updated the pull request. You must reimport the pull request before landing.

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D68038126

and not len(args.output_path)
):
raise ValueError('"--output-path" is not set for profiler trace dumping')
"""

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why you comment out this check here?

_torch_profiler = None


def startProfiler(

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where to invoke this?

return True
else:
logger.debug("Internal profiler is not available, skip...")
logger.debug("GPU Trace Profiler: Fail to start")
return False


def sampleProfiler(stop: bool = False) -> None:

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where to invoke this function with stop=true?

@sanshang-nv
Copy link

Hi, @shengfukevin
I don't think use global variable here and mix meta internal feature with public feature is good design.
Let's have a meeting to discuss this before you try to merge this PR.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants