Event PAST

Scalable Data Harvesting for AI

28 May Online

About this event

Every AI pipeline starts with one question: where does the data come from?

In this hands-on workshop, we'll answer that question using Scrapy, one of Python's most powerful web scraping frameworks. You'll go from a blank project to a working spider that harvests structured data from the web, ready to feed into your next AI or data science project.

We'll cover:
• Scrapy vs. lighter tools (Requests & Beautiful Soup), and when each makes sense
• Extracting data from HTML using CSS selectors
• Following links and handling pagination at scale
• Writing clean, structured output to a file
• The ethical and legal side of web scraping

Bonus (Gold Star): a chapter on scraping JavaScript-rendered pages for those who want to go further.

🐍 Python basics assumed — no prior scraping experience needed

Agenda
- 18:00 Doors Open
- 18:30 Start of the Workshop
- 20:15 Workshop Closing & Announcements
- 20:30 Networking
- 21:00 Event Closing

GitHub Repo
Scalable Data Harvesting for AI

Stream
YouTube Stream

​📧 Contact
Are you interested in speaking at one of our events? Have a good idea for a Meetup? Get in touch with us at [email protected]

​💬 Find us on the PyLadies Global workspace:

  1. ​https://slackin.pyladies.com enter your email address. Accept the email invitation
  2. ​Go to workspace https://pyladies.slack.com
  3. ​Join channel #city-amsterdam
  4. Scalable

Want to find AI jobs?

Join thousands of AI professionals finding their next opportunity

We respect your inbox. Unsubscribe at any time.

© 2026 DevFound.ai. All rights reserved.

Common Questions

Frequently asked questions

Quick answers about how DevFound's AI matching, resumes, and referrals work.

DevFound's AI Copilot ingests your profile, goals, and live job data to deliver curated matches in seconds. Every match includes a resume variant, suggested referrals, and interview prep so you can act immediately. The more feedback you provide, the sharper the Copilot becomes.

AI-led job searches shrink the hours spent sifting through boards and formatting resumes. DevFound pairs automation with your personal outreach, so you reserve energy for interviews and negotiation. Traditional networking still matters, but AI gives you a lift before you even send a message.

Modern AI roles expect comfort with production-grade code, data fluency, and practical ML tooling. The strongest candidates pair deep technical chops with storytelling—translating model impact to product, GTM, and exec partners. Continuous learning keeps you ahead as stacks evolve.

DevFound rewards active seekers. Keep your profile fresh, respond to match quality prompts, and enable alerts so you never miss a role. The AI prioritizes companies and teams that align with your feedback, accelerating both introductions and interview invites.

High-density tech hubs continue to host the deepest AI talent pools, yet distributed teams are catching up fast. Use DevFound filters to hone in on onsite, hybrid, or fully remote roles and watch openings expand across time zones.

DevFound aggregates thousands of remote AI openings and flags the nuances—core hours, async culture, and visa needs—up front. The Copilot also recommends how to position your distributed work experience so hiring managers know you can thrive on a remote team.