[IDEA] HOw could one change the python code runner to alllow internet access.

[baditaflorin]

Describe the feature you'd like

reading the documentation shows that
NO network nor internet access (this is a current design choice and could be changed in the future)

I would want to be able to use requests and get online data

[debanjum]

Hey @baditaflorin , can you describe in more detail what you want? Khoj is allowed internet access. You just need to configure it to use the appropriate online search and web scraping tools like Jina, Serper.dev, Olostep, Firecrawl or Direct.

If you want to specifically make Khoj use the requests library to read webpages, you can add a Direct type web scraper via your admin settings.

Please look at the documentation at https://docs.khoj.dev/features/online_search/ for more details

[nesretep-anp1]

That's an interesting answer. Unfortunately within the code it is shown, that there are always special conditions do prevent using the direct web scraper.

(Seen an is_internal_url on the one hand and something like is_debug on the other. So in fact, using direct is not possible to "get into internet") ;)

[debanjum]

Converting this into a discussion for now