The Bilibili Scraper is a web scraping tool designed to extract all the video names by keyword from the Chineses famous video website Bilibili in a csv file. With this tool, users can quickly and efficiently gather data from Bilibili without having to manually search for and record video titles.
- Make sure you have Python version 3.8 or greater installed
- Install selenium library
- run
pip3 install selenium
- Download the tool's repository using the command:
- run
git clone https://github.com/yixiangyin/bilibili-scraper
- Move to the tool's directory
- run
cd bilibili-scraper
- Inside the project directory, run
python main.py <keyword> [page limit] - keyword can be anything
- page limit is optional and it has to be greater than 0
- The scraped data will be stored in a csv file named
scraped_data_keyword.csv.
- Make sure you have a fast internet because if you have a slow one, for the code to work as expect, you might need to adjust waiting time longer for the browser to load the content. Next steps:
- create a graphical user interface
- add functionality to extract user names for a given search