feat: full fetch even for js generated websites

[Sanix-Darker]

We should have these informations :

• all the links tested
• all the links succeeded
• all the links failed

Asking this because some websites like osscameroon.com is built using React, therefore, the requests.get is not going to "load" the page and its links... just some small html and a div like

(as far as i can remember, didn't touch react since a long time) where the JS binding file is supposed to render the SPA.

PS: "NOT TESTED on my end", I may be wrong, but i think you should check the 'content' result you fetch from PWA.

How to deal with this ?
using a JScrawler... or if you want to don't change your actual code loggic, use requests_html is your way to go... (it will download a chromium binary that will be called to render pages in background).

Not sure i may available this night for a session of live coding, but feel free to share your questions here in the chat @pythonbrad !

Good job so far