Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dates Scraper #82

Merged
merged 11 commits into from
May 16, 2016
Merged

Dates Scraper #82

merged 11 commits into from
May 16, 2016

Conversation

kashav
Copy link
Member

@kashav kashav commented May 16, 2016

  • UTMCalendar changed to UTMDates
  • Add UTSGDates
    • ArtSciDates - http://www.artsci.utoronto.ca/current/course/timetable/
    • EngDates - http://www.undergrad.engineering.utoronto.ca/About/Dates_Deadlines.htm
      • Sometimes this calendar throws a "cannot find content" error (while scraping), but response status is still 200. Right now, it makes 5 attempts and ignores that month if those fail. Could it be the request headers?

      • I was unsure what the session should be for this scraper – it's currently <YEAR> ENGINEERING. We could choose a session (fall/winter/summer) based on the month, but we may run into some odd cases (this is completely hypothetical):

        {
          "date": "2016-04-05",
          "events": [{
            "end_date": "2016-04-05",
            "session": "2016 WINTER",
            "campus": "UTSG",
            "description": "First day for course enrolment for the summer term." // in ArtSci, UTM this would fall under the `2016 SUMMER` session.
          }]
        }

@qasim qasim merged commit 46a0904 into cobalt-uoft:master May 16, 2016
@kashav kashav deleted the add-utsg-dates branch October 21, 2016 16:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants