This is an image-based AWS Lambda, using ndr_parquet to generate parquet files from numerous filetypes.
To install Apache Arrow on a mac using homebrew, run:
$ brew install apache-arrow
and then run:
$ bundle install
To make the AWS Linux docker container with Apache Arrow, run:
$ make image
and then run:
$ make install
To convert the sample collection spreadsheet ABC_Collection-June-2020_03.xlsm to parquet format, using the national_collection.yml mapping file, run:
$ ruby import.rb
or to convert the spreadsheet in the docker container, run:
$ make import
Bug reports and pull requests are welcome on GitHub at https://github.com/timgentry/ndr_import-parquet-example. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the code of conduct.
The gem is available as open source under the terms of the MIT License.
Everyone interacting in the ndr_import-parquet-example project's codebases, issue trackers, chat rooms and mailing lists is expected to follow the code of conduct.