Registry of Social Beneficiaries (PUB) Monthly Catalog Service Pipeline
To run this, you will need:
- Python and a recent
pip
- The AWS CLI (
pip install awscli
) - Serverless framework (
npm install -g serverless
) - Plugin existing-s3, overcomes the CloudFormation limitation (
npm install serverless-plugin-existing-s3
)
serverless config credentials --provider aws --key $AWS_ACCESS_KEY_ID --secret $AWS_SECRET_ACCESS_KEY_ID
sls deploy
sls s3deploy
sls remove
- First lambda function to query Athena for monthly Pub Metadata Update
- Second lambda function to trigger elasticsearch update