Skip to content

v1.0.2
Compare
Choose a tag to compare
@s0md3v s0md3v released this 23 Jul 13:54
· 286 commits to master since this release
v1.0.2
83b2e2a
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
  • Proper handling of null response from robots.txt & sitemap.xml
  • Python2 compatibility
  • Proper handling of non-ascii chars
  • Added ability to specify custom regex pattern
  • Display total time taken and average time per request
Assets 2
Loading