Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get missing values and dtype without re-opening the dataset #180

Merged
merged 15 commits into from
Feb 12, 2024

Conversation

davidhassell
Copy link
Collaborator

@davidhassell davidhassell commented Feb 8, 2024

Description

Get missing values and dtype without re-opening the dataset

Closes #179

Before you get started

Checklist

  • This pull request has a descriptive title and labels
  • This pull request has a minimal description (most was discussed in the issue, but a two-liner description is still desirable)
  • Unit tests have been added (if codecov test fails)
  • Any changed dependencies have been added or removed correctly (if need be)
  • All tests pass

Copy link

codecov bot commented Feb 9, 2024

Codecov Report

Attention: 4 lines in your changes are missing coverage. Please review.

Comparison is base (b31ca82) 86.93% compared to head (53f4ed4) 87.11%.

Files Patch % Lines
activestorage/active.py 95.00% 2 Missing ⚠️
activestorage/netcdf_to_zarr.py 80.00% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #180      +/-   ##
==========================================
+ Coverage   86.93%   87.11%   +0.17%     
==========================================
  Files           8        8              
  Lines         620      613       -7     
==========================================
- Hits          539      534       -5     
+ Misses         81       79       -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@valeriupredoi valeriupredoi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @davidhassell - many thanks for this, bud! Great progress! Unfortunately it's not there just yet - a bit of a hiccup wrt S3 file reading and tests, see eg failed test suite on S3 - mostly related to the "missing/missing values" API still needing a bit of tweaking for the S3 storage type, but also (interestingly) a certain file that can not be opened now anymore. I fixed a couple POSIX tests so we can get a quote on coverage, a few statements need tests, but I can add those after you've addressed the S3-related issues. Cheers 🍺

@davidhassell davidhassell marked this pull request as draft February 9, 2024 17:58
@davidhassell davidhassell marked this pull request as ready for review February 9, 2024 17:58
@davidhassell
Copy link
Collaborator Author

OK - tests passing :)

@valeriupredoi
Copy link
Collaborator

valiant effort @davidhassell ! Let me write us a couple tests for the missing statements, then will merge 👍 🍻

Copy link
Collaborator

@valeriupredoi valeriupredoi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

brilliant, cheers very much @davidhassell 🍻 I'll fix the loader test in netcdf to zarr for better cov when we have the next PR ready about 👍

@valeriupredoi valeriupredoi merged commit bb769e5 into main Feb 12, 2024
5 of 6 checks passed
@valeriupredoi valeriupredoi deleted the missing-dtype branch February 12, 2024 15:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Get missing values and dtype without re-opening the dataset
2 participants