Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update SPDL Image Classification Example with Dataloader #289

Merged

Conversation

vbourgin
Copy link
Contributor

@vbourgin vbourgin commented Dec 3, 2024

Summary:
Update SPDL image classification example to use Dataloader instead of Pipeline.

The dataloader builds a Pipeline when converted to an iterable.

Minor difference: the default concurrency is used in the Dataloader aggregator

Differential Revision: D66724034

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Dec 3, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66724034

vbourgin pushed a commit to vbourgin/spdl that referenced this pull request Dec 3, 2024
…earch#289)

Summary:

Update SPDL image classification example to use Dataloader instead of Pipeline.

The dataloader builds a Pipeline when converted to an iterable.

Minor difference: the default concurrency is used in the Dataloader aggregator

Differential Revision: D66724034
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66724034

@@ -43,7 +43,7 @@
import spdl.io
import spdl.utils
import torch
from spdl.pipeline import Pipeline, PipelineBuilder
from spdl.dataloader._dataloader import DataLoader
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
from spdl.dataloader._dataloader import DataLoader
from spdl.dataloader import DataLoader

vbourgin pushed a commit to vbourgin/spdl that referenced this pull request Dec 13, 2024
…earch#289)

Summary:

Update SPDL image classification example to use Dataloader instead of Pipeline.

The dataloader builds a Pipeline when converted to an iterable.

Minor difference: the default concurrency is used in the Dataloader aggregator

Reviewed By: moto-meta

Differential Revision: D66724034
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66724034

vbourgin pushed a commit to vbourgin/spdl that referenced this pull request Dec 14, 2024
…earch#289)

Summary:

Update SPDL image classification example to use Dataloader instead of Pipeline.

The dataloader builds a Pipeline when converted to an iterable.

Minor difference: the default concurrency is used in the Dataloader aggregator

Reviewed By: moto-meta

Differential Revision: D66724034
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66724034

vbourgin pushed a commit to vbourgin/spdl that referenced this pull request Dec 14, 2024
…earch#289)

Summary:

Update SPDL image classification example to use Dataloader instead of Pipeline.

The dataloader builds a Pipeline when converted to an iterable.

Minor difference: the default concurrency is used in the Dataloader aggregator

Reviewed By: moto-meta

Differential Revision: D66724034
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66724034

vbourgin pushed a commit to vbourgin/spdl that referenced this pull request Dec 23, 2024
…earch#289)

Summary:

Update SPDL image classification example to use Dataloader instead of Pipeline.

The dataloader builds a Pipeline when converted to an iterable.

Minor difference: the default concurrency is used in the Dataloader aggregator

Reviewed By: moto-meta

Differential Revision: D66724034
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66724034

…earch#289)

Summary:

Update SPDL image classification example to use Dataloader instead of Pipeline.

The dataloader builds a Pipeline when converted to an iterable.

Minor difference: the default concurrency is used in the Dataloader aggregator

Reviewed By: moto-meta

Differential Revision: D66724034
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66724034

@facebook-github-bot facebook-github-bot merged commit 1eda64b into facebookresearch:main Dec 23, 2024
5 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants