Skip to content

Commit

Permalink
No public description
Browse files Browse the repository at this point in the history
PiperOrigin-RevId: 642015810
  • Loading branch information
Markus Kusano authored and copybara-github committed Jun 10, 2024
1 parent b0db749 commit 5bdc70f
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions centipede/centipede.cc
Original file line number Diff line number Diff line change
Expand Up @@ -147,6 +147,7 @@ void Centipede::CorpusFromFiles(const Environment &env, std::string_view dir) {
std::vector<std::string> paths;
size_t total_paths = 0;
for (const std::string &path : RemoteListFiles(dir, /*recursively=*/true)) {
LOG(INFO) << "Reading file: " << path;
size_t filename_hash = std::hash<std::string>{}(path);
sharded_paths[filename_hash % env.total_shards].push_back(path);
++total_paths;
Expand Down Expand Up @@ -178,6 +179,7 @@ void Centipede::CorpusFromFiles(const Environment &env, std::string_view dir) {
std::string input;
RemoteFileGetContents(path, input);
if (input.empty() || existing_hashes.contains(Hash(input))) {
LOG(INFO) << "Ignoring input: " << input << " from path " << path;
++inputs_ignored;
continue;
}
Expand Down

0 comments on commit 5bdc70f

Please sign in to comment.