Extract Summit 2024 Coding Competition
Put your skills to the test! Extract all the critical data from an exceptionally challenging website, and if you're the fastest, you’ll take home bragging rights and some amazing prizes!
Think you can scrape the hardest website?
Prove it and win amazing prizes!
Whats new?
This year, we’ve raised the stakes, making our challenge more demanding than ever before. The increased difficulty means you’ll likely need to leverage 3rd party unblocker or web scraping APIs to successfully complete the task. But don’t let that intimidate you – you’re free to use any tools and techniques at your disposal.
2 ways to Get Started
To kick things off, we’ll provide you with starter code that utilizes the Zyte API. All you need to do is sign up for a Zyte API account to access this code, giving you a solid foundation to build upon.
Use any 3rd party tools you like, be creative.
Showcase Your Skills
This advanced challenge is the perfect opportunity to showcase your problem-solving skills and creativity in overcoming complex web scraping obstacles. We’re excited to see how you tackle it!
Compete for Glory and Prizes
Put your skills to the test, and you could win bragging rights and exciting prizes.
Good luck, and may the best scraper win!
How to participate
Scrapy Cloud Account
Join Extract Data Discord
Register for the contest
Prizes for the Top 3 Winners!
#1 First Place
Apple Studio Display (Worth $1,599)
#2 Second Place
AirPods Max (Worth $549)
#3 Third Place
Minilo Keyboard (Worth $150)
Contest Outline
Here’s how the contest will go:
The URL of the target website will be revealed on Discord. There will be a specification of the item fields that need to be extracted.
You must write a spider that extracts all items with the specified fields and run it in Scrapy Cloud.
Once the Scrapy Cloud job finishes, you must submit the job ID to a bot in the Extract Data Discord server.
The bot will let you know if you have managed to extract all items with complete data.
If you failed, update your code and try again with a new Scrapy Cloud job. The bot accepts unlimited job submissions for the duration of the contest.
To win, be the first to submit a job that successfully extracts all expected data.