Snowflake Snowpipe Terraform Module

Terraform module that creates Snowflake resources to receive data from Snowpipe.

Usage

module "snowpipe" {
  source  = "Infostrux-Solutions/snowpipe/snowflake"
  database                 = "DEV_INGEST"
  schema                   = "PUBLIC"
  table                    = "CUSTOMERS"
  pipe_name                = "DEV_ANALYTICS_PIPE"
  stage_name               = "DEV_ANALYTICS_STAGE"
  stage_url                = "s3://analysis/encrypted_files/"
  file_format              = "CSV"
  bucket_id                = "stage-bucket-8913276-fake"
  storage_integration_name = "Example Integration"
}

Requirements

Name	Version
terraform	>= 0.13.1
aws	>=4.25.0
snowflake	>=0.40.0

Providers

Name	Version
aws	>=4.25.0
snowflake	>=0.40.0

Modules

No modules.

Resources

Name	Type
aws_s3_bucket_notification.notification	resource
snowflake_pipe.pipe	resource
snowflake_stage.stage	resource

Inputs

Name	Description	Type	Default	Required
bucket_id	Pipe's bucket where to fetch the data	string	n/a	yes
database	Database for the pipe and the stage	string	n/a	yes
file_format	Table for the pipe and the stage	string	n/a	yes
pipe_copy_statement	Pipe sql query to copy the data from S3 to the ingest table	string	""	no
pipe_name	Object for the pipe's stage configuration	string	n/a	yes
schema	Schema for the pipe and the stage	string	n/a	yes
stage_name	Stage name in capital letter	string	n/a	yes
stage_url	S3 full url ex: s3_id/path	string	n/a	yes
storage_integration_name	Name of the storage integration that the external stage will use	string	n/a	yes
table	Table for the pipe and the stage	string	n/a	yes

Outputs

Name	Description
pipe_id	ID of the pipe
stage_id	ID of the stage

Authors

Module is maintained by Infostrux Solutions with help from these awesome contributors.

License

Apache 2 Licensed. See LICENSE for full details.