Having Issue While Downloading All Pdf Files On .asp Website Using Scrapy

I am having an issue while downloading multiple pdf files on .asp website using Scrapy. This is the URL of the website: https://ceo.maharashtra.gov.in/searchlist/SearchRollPDF.aspx

Solution 1:

It's very likely that every request for downloading a PDF is changing the ASP session state. So in order to download all PDFs, you need to do the downloading sequentially:

1. create request for downloading PDF 1
2. make sure you updated cookies etc that came with the PDF download
3. create request for downloading PDF 2 ... etc