Skip to content

Commit

Permalink
Ignoring ipython checkpointing files
Browse files Browse the repository at this point in the history
  • Loading branch information
Rommel Anatoli Quintanilla Cruz committed Oct 9, 2020
1 parent aa0626f commit 68e320d
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion engine/src/io/data_provider/UriDataProvider.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -153,7 +153,12 @@ data_handle uri_data_provider::get_next(bool open_file) {
// sometimes parquet directories have somes files that
// have not the same schema as the *.parquet files
// we don't want the data provider handle this ones
std::vector<std::string> ignored_suffixes{".crc", "_metadata", "_SUCCESS"};
std::vector<std::string> ignored_suffixes {
".crc",
"_metadata",
"_SUCCESS",
".ipynb_checkpoints"
};

std::vector<Uri> new_uris;
for(int i = 0; i < this->directory_uris.size(); i++) {
Expand Down

0 comments on commit 68e320d

Please sign in to comment.