Week 5: Prototype Development
Learning goals
- Improve extraction design for your web scraping projects.
- Evaluate data extraction plans on the basis of the suggestions in “Fields of Gold”
Lecture
- During the lecture, teams will present their data extraction plans.
Coaching session
- Please check out the project page.
After the lecture and coaching session
Keep on refining your project. For example, your team can work on the implementation of the scraping/API extraction while the instructor is providing feedback and help whenever required.
- Start fiddling around with accessing your chosen website or API.
- Start building an initial prototype to extract some data (doesn’t need to be the “final” data yet!)
Looking for a challenge or working on a website or API requiring a more advanced skillset? [optional]
If you feel you don’t just want to stick with the basics but would like to learn more, then you can choose to follow some of the tutorials below. This material will not be covered on the exam, but you can certainly use it for your projects.
- Advanced Web Scraping
- Advanced APIs
- Check out Hannes’ YouTube channel for any added screencasts/coaching sessions with other students, either from this year, or from previous years.