• Home
  • About
  • AI Projects
  • DE Projects
  • DA Projects
  • Interest
  • Contact

Data Scraper and Pipeline on Social Platform




For the 2020 National College Business Case competition, my team developed a data scraper and pipeline for Taiwan's leading college student social media platform. This automated solution reduced data collection time from 4 weeks to minutes, enabling us to efficiently analyze key insights for a company's market expansion strategy. Our project earned us a spot as finalists in the competition.

My Contribution



  • Conducted web scraping on Taiwan’s leading college student social media platform, to collect and analyze data, identifying key insights for a company's market expansion strategy.
  • Built a data scraping pipeline for Taiwan’s largest social forum, reducing manual data collection time from 4 weeks to just a few minutes.


Final Presentation

Data Ingestions

  • This project gave me my first experience with data crawling and gradually expanded my knowledge.

Database Pipeline

  • Through this project, I developed my first automated data fetching pipeline.

Data Cleansing

  • This project starts in 2020, when the start of my data experience began.



Copyright © Vanessa Huang, modified by Caslow Chien, 2024.