4 Commits

Author	SHA1	Message	Date
NMerz	ee04a06e0e	Chaining, retries, and general scraping durability ... Make the scraping infrastructure more durable since the scraping service often fails to deliver	2020-11-01 11:30:03 -05:00
NMerz	79598bf9e9	Lambdaify Kohls scraping ... Move to Lambda function setup and add orchestration and word lists for full runs. Credit for the word lists goes to: http://www.desiquintans.com/nounlist	2020-10-18 17:51:08 -04:00
NMerz	7dbea8f805	Add Kohls data to database ... Place data in the database when scraped Also include loading credentials from config files	2020-10-18 14:10:41 -04:00
NMerz	8e6dbac183	Kohl's scraping outline ... Create an outline with some of the initial work needed to pull in data from Kohl's for populating the database, specifically, a non-durable extraction prototype and integration with a web requesting/scraping service	2020-10-17 22:56:25 -04:00