Pokemon data scraping

Collecting comprehensive Pokemon data, from their abilities and stats to their name etymology. It's a one-stop resource for Pokemon enthusiasts

View Demo - Report Bug - Request Feature

About The Project

The Pokemon Data Scraping project is a comprehensive data collection effort aimed at gathering valuable information about Pokemon creatures. Through web scraping techniques, this project extracts and organizes data from the PokemonDB to create a detailed dataset of Pokemon attributes and characteristics.

Project Scope

The project offers two main data collection modes:

1. Full Dataset: Scrapes data for all available Pokemon species, providing an extensive dataset that covers the entire Pokemon universe.
2. Partial Dataset: Allows for focused scraping, which is useful for testing.

Data Output

The gathered data is structured into five tables which are interconnected:

• Pokemon Details: Includes essential information such as Pokemon ID, name, description, image, species, height, weight, types, abilities, EV yield, catch rate, base experience, growth rate, gender distribution, generation, and name etymology.
• Pokemon Stats: Provides detailed statistics on HP, Attack, Defense, Special Attack, Special Defense, and Speed. This information is valuable for analyzing the combat capabilities of each Pokemon.
• Pokemon League: Collects data about Pokemon leagues and their associated regions, offering insights into the competitive Pokemon gaming scene.
• Pokemon region details: Contains detailed information on the regions like, professors, villians and starter pokemons.
• Pokemon region coordinates: This is a manual dataset made with cbistudio to calculate the X and Y Coordinates to plot the regions into a custom made map.

Why This Project?

This project serves as a valuable resource for Pokemon enthusiasts, researchers, and developers who require comprehensive and structured Pokemon data. Whether you're building a Pokemon-related application, conducting research, or simply exploring the vast world of Pokemon, this dataset can save you hours of manual data collection and organization.

This project is one of many I made to master python for data, others can be found in my portfolio.

Contributions and suggestions from the community to enhance and expand this project are always welcome. Feel free to fork the repository, create pull requests, or open issues to help us improve this valuable resource.

Built With

(back to top)

Getting Started

This is an example of how you may give instructions on setting up your project locally. To get a local copy up and running follow these simple example steps.

Prerequisites

Before you begin, ensure you have the following prerequisites installed:

• Python: This project is written in Python, so you'll need Python installed on your machine. You can download the latest version from the official website.

Installation

Follow these steps to get a local copy of the project up and running:

1. Clone the repository to your local machine:

   git clone https://github.com/christian-jaimes/pokemon-data-scraping.git
   
   

2. Install necessary the libraries:

   pip install pandas
   pip install beautifulsoup4
   

3. You can find the Jupyter notebook file in the notebooks folder

4. Have fun 😁

(back to top)

License

Distributed under the MIT License. See LICENSE.txt for more information.

Contact

Credits

Use this space to list resources you find helpful and would like to give credit to. I've included a few of my favorites to kick things off!

• Choose an Open Source License
• Img Shields
• Simple Icons
• GitHub Pages
• Pokemon DB

(back to top)