aboutsummaryrefslogtreecommitdiff

Scrapy Presentation

Slides

This repo contains all my code from my scrapy presentation. It's a very simple project with a couple example spiders created.

  • LinkFinderSpider: Crawls a codyhiar.com and prints all the urls found for codyhiar.com
  • BlogItemsSpider: Crawls a specific /tags/ page and saves the blog posts found on that page as items through the pipeline setup