Lambdaify Kohls scraping

Move to Lambda function setup and add orchestration and word lists for full runs. Credit for the word lists goes to: http://www.desiquintans.com/nounlist
This commit is contained in:
NMerz
2020-10-18 17:51:08 -04:00
parent 7dbea8f805
commit 79598bf9e9
9 changed files with 6927 additions and 55 deletions

View File

@@ -0,0 +1,7 @@
#!/bin/bash
#Currently to be run only from the Scraping directory
mkdir build
pip3 install --target build requests
pip3 install --target build PyMySQL
pip3 install --target build beautifulsoup4
mkdir artifacts