25th October 2023 5:30pm - 6:30pm (Irish Standard Time - UTC +1)
Online / Free
What is the Extract Summit 2023 coding contest?
Calling all data lovers and web data enthusiasts! We’re excited to be back in person at the Extract Summit 2023—and what better way to get things rolling than with a coding contest?
This is the time to let your web scraping skills shine. Crawl and scrape all expected items from a given website using Scrapy Cloud. The first to succeed claims bragging rights and an exclusive grand prize.
Don’t fret if you don’t win—lucky participants will get some cool prizes too!
How to participate
Scrapy Cloud Account
Register for a Scrapy Cloud account if you do not already have one.
There is a forever free plan.
Scrapy Discord Access
Join the Scrapy Discord. The target website’s URL will be revealed
through Discord.
Register for the contest
Fill up the form to register.
We will need the information to ensure that you are correctly enrolled for the contest.
Contest Outline
The contest is free to join and open to everyone.
Make sure that you’ve registered your Scrapy Cloud account and have Scrapy Discord access. You’ll need to submit your registration form as well.
Once these are in place, you’re ready to take part in the contest when it launches on 25th October.
Here’s how the contest will go:
- The URL of the target website will be revealed on Discord. There will be a specification of the item fields that need to be extracted.
- You must write a spider that extracts all items with the specified fields and run it in Scrapy Cloud.
- Once the Scrapy Cloud job finishes, you must submit the job ID to a bot in the Scrapy Discord server.
- The bot will let you know if you have managed to extract all items with complete data.
- If you failed, update your code and try again with a new Scrapy Cloud job. The bot accepts unlimited job submissions for the duration of the contest.
- To win, be the first to submit a job that successfully extracts all expected data.
- The website does not ban clients, so you will not need a proxy. But crawling the website and extracting item data will not be straightforward, so do not expect to get a working spider on your first run.
Join the Discord community to prepare for the Coding Contest
For a few days before the contest, we will enable a testing website so you can practice and prepare a code base.
So to learn more about how this will work, join the Scrapy community on Discord, there all information and doubts will be clarified.
Good luck, and may the data be ever in your favour!
Web Data Extraction Summit is organised by web scraping experts, Zyte.
Zyte delivers world class web data extraction products and services.