Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: switching to requests_html #67

Merged
merged 4 commits into from
Sep 21, 2022
Merged

refactor: switching to requests_html #67

merged 4 commits into from
Sep 21, 2022

Conversation

pythonbrad
Copy link
Member

@pythonbrad pythonbrad commented Sep 14, 2022

Added support for dynamic webpage

Removed multi-checking

  • Problem in using requests_html with threading.

@pythonbrad pythonbrad self-assigned this Sep 14, 2022
@pythonbrad pythonbrad linked an issue Sep 14, 2022 that may be closed by this pull request
@pythonbrad pythonbrad force-pushed the patch branch 2 times, most recently from 6987466 to 122a7b0 Compare September 21, 2022 09:37
Added support for dynamic webpage
Removed multi-checking
Added cleaning of URL to remove the unwanted part
@pythonbrad pythonbrad force-pushed the patch branch 4 times, most recently from 5a2bd1b to 649ac45 Compare September 21, 2022 16:46
@pythonbrad pythonbrad merged commit 1ab3d8a into main Sep 21, 2022
@pythonbrad pythonbrad deleted the patch branch September 21, 2022 18:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

feat: full fetch even for js generated websites
1 participant