An app that classifies file lists through crawling.
xfloor
is an application that classifies file lists and retrieves additional information through web crawling. It fetches the file list from a given directory, classifies the files based on their extensions, and retrieves additional information from specific websites.
- Fetch file list from a directory
- Classify files based on their extensions
- Retrieve additional information about files through web crawling
- Set environment variables through a JSON file
- Handle exceptions for reliable network requests
-
Clone this repository:
git clone https://github.com/week-end-manufacture/xfloor.git cd xfloor
-
Install the required packages:
pip install -r requirements.txt
-
Set up the
config.json
file. Example:{ "FLIB_VERSION": "1.0.0", "URL_LIST": ["http://example.com", "http://example.org"] }
-
Run the application:
python main.py -i <source_directory> -o <destination_directory>
Example:
python main.py -i ./src -o ./dst
You can set environment variables through the config.json
file. Example:
{
"FLIB_VERSION": "1.0.0",
"URL_LIST": ["http://example.com", "http://example.org"]
}