Online Data Collection and Management (oDCM)

Instructor: dr. Hannes Datta LinkedIn GitHub X

This edition: August - October 2024 (328060-M3) | Next edition: January - April 2025

Learn how to mine the web

Welcome to the course website of oDCM.

This course teaches you the nuts and bolts about collecting web data. You learn about the technicalities of web scraping and Application Programming Interfaces (APIs), but also how to design your data collection for use in empirical (marketing) research projects¹.

Please use the navigation bar and buttons below to access the course material.

Course schedule and modules Syllabus & learning objectives Enroll now!

Why should you take this course?

Ever had this fantastic research idea but didn’t have the data to study it?

Well, it’s high time you get familiar with web data gathered by web scraping and APIs! Web data is ideally suited to study questions for which commercial datasets are either unavailable or too expensive to purchase. Yes, we’re talking TikTok, Instagram, Socialblade - literally any website you can open in your browser!

Of course, you could just follow some technical tutorials on the web. But researchers face unique challenges as they select data sources for extraction, design their scrapers, and ultimately proceed to turn their prototype into a productive software tool. In this course, you will learn how to solve each of these challenges, and put your scraping and API skills into practice.