Skip to content

Rudimentary pipeline to web scrape data, organise into tables and insert into MySQL database. Exercise was good foundation for more advanced and complex pipelines I have built since in a professional environment. Other .sql files are to showcase proficiency in MySQL.

Notifications You must be signed in to change notification settings

olliecorbisiero/basic-pipeline-into-mysql-database-and-some-other-sql-queries

Repository files navigation

basic-pipeline-into-mysql-database

Rudimentary pipeline using Python to web scrape coding school information, clean and organise this into panda dataframes before inserting into MySQL database as tables where they can be queried for analytical purposes.

Note: you need to create your own local MySQL database and update credentials in the last section of code to match.

Note: advanced-sql-solutions.sql, basic-sql-queries-and-answers.sql, mysql-select-solution.sql are unrelated and just included to demonstrate MySQL proficiency.

About

Rudimentary pipeline to web scrape data, organise into tables and insert into MySQL database. Exercise was good foundation for more advanced and complex pipelines I have built since in a professional environment. Other .sql files are to showcase proficiency in MySQL.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages