mirror of
https://github.com/ClaytonWWilson/Listify.git
synced 2026-03-10 18:55:03 +00:00
Lambdaify Kohls scraping
Move to Lambda function setup and add orchestration and word lists for full runs. Credit for the word lists goes to: http://www.desiquintans.com/nounlist
This commit is contained in:
7
Lambdas/Scraping/setupBuildFolder.sh
Normal file
7
Lambdas/Scraping/setupBuildFolder.sh
Normal file
@@ -0,0 +1,7 @@
|
||||
#!/bin/bash
|
||||
#Currently to be run only from the Scraping directory
|
||||
mkdir build
|
||||
pip3 install --target build requests
|
||||
pip3 install --target build PyMySQL
|
||||
pip3 install --target build beautifulsoup4
|
||||
mkdir artifacts
|
||||
Reference in New Issue
Block a user