Wednesday, July 31, 2019

Changelog 2019-07-31 - Two Fixes

Fixed Amazon Regex

Amazon changed their website so the regex needed to be updated. The new regex is much more efficient than before so Amazon scraping should see some mild improvements in overall runtime.

Addeed Dryscrape Request Headers

Dryscrape requests never used headers previously. Headers are useful for tricking websites into believing a request is a legit request. Amazon started giving the scraper a captcha when I made too many requests at once (testing the above fix) so I added some headers to the request in order for the requests to go through properly.

No comments:

Post a Comment

Hot Cash Give Away Jan 2021

  Hey everyone! Time for another round of Hot Cash codes! Hot Cash ends soon so be sure to use these ASAP! Comment below with the codes you ...