Skip to content

A simple web scraper that scrapes the title and body of a webpage separately, from a list of URLs in a csv file.

Notifications You must be signed in to change notification settings

markmcrg/web-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

web-scraper

A simple web scraper that scrapes the title, body, meta description, and the alt text of a webpage separately to a CSV file, from a list of URLs in a CSV file.

Usage

To use this Python script on your local machine:

$scrapy crawl shopify_scraper -o <filename>.csv

To use this script in Google Colab:

!scrapy crawl shopify_scraper -o <filename>.csv

About

A simple web scraper that scrapes the title and body of a webpage separately, from a list of URLs in a csv file.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages