Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Definition of number successful run #289

Open
gordonwatts opened this issue Jul 14, 2023 · 2 comments
Open

Definition of number successful run #289

gordonwatts opened this issue Jul 14, 2023 · 2 comments

Comments

@gordonwatts
Copy link
Collaborator

If any of the files are marked as failed then the whole run is marked as failed and should not be in the cache.

List of files in cli should always show completed files not the full list from dataset

@gordonwatts gordonwatts added this to the 3.0 Release milestone Jul 14, 2023
@BenGalewsky BenGalewsky moved this to Ready in ServiceX Aug 24, 2023
@alexander-held
Copy link

For partial results in particular it would be important to propagate the metadata corresponding to the initial number of events in the files that were processed succesfully to allow for correct normalization of the results.

@ponyisi
Copy link
Collaborator

ponyisi commented Nov 6, 2024

So we don't actually have a simple way at the moment of propagating any file metadata like the number of input rows, although this is something that we know (sometimes, depends on the transformation).

A step towards this is #516.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants