Janson's Blog

Random things I want to talk about

Blog About

Scrapy Cloud - Storing Results in Google Cloud Storage

While building my pet project, I found the need to scrape files from certain websites. Using scrapy library in Python, I wanted to download all files in the website pages to Google Cloud Storage (GCS).

Read More