Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for reading files with modular encryption #154

Open
jorgecarleitao opened this issue Jun 27, 2022 · 2 comments
Open

Add support for reading files with modular encryption #154

jorgecarleitao opened this issue Jun 27, 2022 · 2 comments
Labels
feature A new feature

Comments

@jorgecarleitao
Copy link
Owner

See https://github.com/apache/parquet-format/blob/master/Encryption.md for motivation and technical details.

@jorgecarleitao jorgecarleitao added the feature A new feature label Jun 27, 2022
@jorgecarleitao
Copy link
Owner Author

A starting point could be to generate an encrypted file using pyarrow e.g. a new parameter of the matrix in https://github.com/jorgecarleitao/parquet2/blob/main/tests/write_pyarrow.py, and try to read it on the integration tests. This should hint us into

  • which APIs we need to change
  • which parameters need to be passed
  • which dependencies we need to add

@jorgecarleitao
Copy link
Owner Author

cc @shicholas , based on pola-rs/polars#3766

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature A new feature
Projects
None yet
Development

No branches or pull requests

1 participant