Prepare for release

Co-authored-by: Emiel Verkade <emiel@snowplowanalytics.com>

Author: rlh1994

CHANGELOG

@@ -1,14 +1,18 @@
-snowplow-web 0.16.0 (2023-0X-XX)
+snowplow-web 0.16.0-rc1 (2023-08-31)
 ---------------------------------------
 ## Summary
-TBC
+This release candidate adds a load of new features, powered by a complete refactor of the core processing of the package by moving it out to the new `base` macro functionality provided in `snowplow_utils`. This enables users to now specify custom fields for sessionization and user identification, to add custom entities/SDEs fields to the base events table for redshift/postgres, and to add passthrough fields to the derived tables so you can now more easily add your own fields to our tables. In addition we've increased the flexibility of how you apply user stitching, and made it available on the page views table! 
+
+As always with a release candidate please feedback any issues you find, either via [Github](https://github.com/snowplow/dbt-snowplow-web/issues/new/choose) or [Discourse](https://discourse.snowplow.io/), and the new docs for this version of the package are available at a temporary [preview docs site](https://deploy-preview-445--snowplow-docs.netlify.app/docs/modeling-your-data/modeling-your-data-with-dbt/dbt-models/dbt-web-data-model/) before they are deployed to the main site when the full version of the package is released.
+
+From this release onwards, the package is being released under the [Snowplow Community License, Version 1.0](https://docs.snowplow.io/community-license-1.0/). If you are uncertain how it applies to your use case, check our answers to [frequently asked questions](https://docs.snowplow.io/docs/contributing/community-license-faq/).
 
 ## 🚨 Breaking Changes 🚨
 - Bumped required dbt version to 1.5.0
 - Added new fields (`original_domain_sessionid` and `original_domain_userid`) to all tables to support custom identifiers
 - Bumped snowplow_utils required version to 0.15.0
 - Altered entity/self-describing table variables to only be table names, instead of source strings
-- Renamed columns in quarantined sessions and sessions lifecycle manifest table (please run the ALTER TABLE statements or do a full-refresh)
+- Renamed columns in quarantined sessions and sessions lifecycle manifest table (please run the ALTER TABLE statements in the migration guide or do a full-refresh)
 - Seeds have been renamed to be prefixed with `snowplow_web_*` to align with the rest of the package, and now you can use your own seed files or tables in their place (see the package config)
 
 ## Features
@@ -18,13 +22,14 @@ TBC
 - Add new fields `original_domain_sessionid` and `original_domain_userid` to derived tables (where applicable) 
 - Add ability to pass fields through to derived page views, sessions, and user tables
 - Add option to choose the logged `user_id` field that session stitching uses 
+- Add ability to run user stitching on the derived page views table
 
 ## Under the hood
 - Aligned variables to follow the public docs
 - Contexts are now joined and de-duped via a macro for Postgres/Redshift
 
 ## Upgrading
-Bump the snowplow-web version in your `packages.yml` file.
+Bump the snowplow-web version in your `packages.yml` file and follow all the other steps in our [migration guide](https://deploy-preview-445--snowplow-docs.netlify.app/docs/modeling-your-data/modeling-your-data-with-dbt/migration-guides/web/).
 
 
 snowplow-web 0.15.2 (2023-07-28)

README.md

@@ -65,7 +65,7 @@ If you find a bug, please report an issue on GitHub.
 
 # Copyright and license
 
-The snowplow-web package is Copyright 2021-present Snowplow Analytics Ltd.
+The snowplow-web package is Copyright 2020-present Snowplow Analytics Ltd.
 
 This distribution is all licensed under the [Snowplow Community License, Version 1.0][license] . (If you are uncertain how it applies to your use case, check our answers to [frequently asked questions](https://docs.snowplow.io/docs/contributing/community-license-faq/).)
 

custom_example/dbt_project.yml

@@ -1,5 +1,5 @@
 name: 'snowplow_custom_example'
-version: '0.15.2'
+version: '0.16.0-rc1'
 config-version: 2
 
 dispatch:

dbt_project.yml

@@ -1,5 +1,5 @@
 name: 'snowplow_web'
-version: '0.15.2'
+version: '0.16.0-rc1'
 config-version: 2
 
 require-dbt-version: [">=1.5.0", "<2.0.0"]
@@ -111,7 +111,7 @@ on-run-end:
   - "{{ snowplow_utils.snowplow_incremental_post_hook('snowplow_web') }}"
 
 
-# Tag 'snowplow_web_incremental' allows snowplow_incremental_post_hook to identify Snowplow models and add their last sucessfull collector_tstamp to the manifest.
+# Tag 'snowplow_web_incremental' allows snowplow_incremental_post_hook to identify Snowplow models and add their last sucessful collector_tstamp to the manifest.
 
 
 # Please only add those that you change the values of to your root dbt_project.yml file, do not copy all values as this can lead to unexpected issues

docs/markdown/snowplow_web_overview.md

@@ -36,7 +36,7 @@ If you find a bug, please report an issue on GitHub.
 
 # Copyright and license
 
-The snowplow-web package is Copyright 2021-2023 Snowplow Analytics Ltd.
+The snowplow-web package is Copyright 2020-present Snowplow Analytics Ltd.
 
 This distribution is all licensed under the [Snowplow Community License, Version 1.0][license] . (If you are uncertain how it applies to your use case, check our answers to [frequently asked questions](https://docs.snowplow.io/docs/contributing/community-license-faq/).)
 

integration_tests/dbt_project.yml

@@ -1,5 +1,5 @@
 name: 'snowplow_web_integration_tests'
-version: '0.15.2'
+version: '0.16.0-rc1'
 config-version: 2
 
 profile: 'integration_tests'

models/base/manifest/snowplow_web_base_sessions_lifecycle_manifest.sql

@@ -29,10 +29,10 @@ You may obtain a copy of the Snowplow Community License Version 1.0 at https://d
 }}
 
 {% set sessions_lifecycle_manifest_query = snowplow_utils.base_create_snowplow_sessions_lifecycle_manifest(
-    session_identifiers=var('snowplow__session_identifiers', [{"table" : "events", "field" : "domain_sessionid"}]),
+    session_identifiers=var('snowplow__session_identifiers', [{"schema" : "atomic", "field" : "domain_sessionid"}]),
     session_sql=var('snowplow__session_sql', none),
     session_timestamp=var('snowplow__session_timestamp', 'collector_tstamp'),
-    user_identifiers=var('snowplow__user_identifiers', [{"table": "events", "field" : "domain_userid"}]),
+    user_identifiers=var('snowplow__user_identifiers', [{"schema": "atomic", "field" : "domain_userid"}]),
     user_sql=var('snowplow__user_sql', none),
     quarantined_sessions='snowplow_web_base_quarantined_sessions',
     derived_tstamp_partitioned=var('snowplow__derived_tstamp_partitioned', true),

models/base/scratch/bigquery/snowplow_web_base_events_this_run.sql

@@ -13,7 +13,7 @@ You may obtain a copy of the Snowplow Community License Version 1.0 at https://d
 
 {% set base_events_query = snowplow_utils.base_create_snowplow_events_this_run(
     sessions_this_run_table='snowplow_web_base_sessions_this_run',
-    session_identifiers=var('snowplow__session_identifiers', [{"table" : "events", "field" : "domain_sessionid"}]),
+    session_identifiers=var('snowplow__session_identifiers', [{"schema" : "atomic", "field" : "domain_sessionid"}]),
     session_sql=var('snowplow__session_sql', none),
     session_timestamp=var('snowplow__session_timestamp', 'collector_tstamp'),
     derived_tstamp_partitioned=var('snowplow__derived_tstamp_partitioned', true),

models/base/scratch/databricks/snowplow_web_base_events_this_run.sql

@@ -14,7 +14,7 @@ You may obtain a copy of the Snowplow Community License Version 1.0 at https://d
 
 {% set base_events_query = snowplow_utils.base_create_snowplow_events_this_run(
     sessions_this_run_table='snowplow_web_base_sessions_this_run',
-    session_identifiers=var('snowplow__session_identifiers', [{"table" : "events", "field" : "domain_sessionid"}]),
+    session_identifiers=var('snowplow__session_identifiers', [{"schema" : "atomic", "field" : "domain_sessionid"}]),
     session_sql=var('snowplow__session_sql', none),
     session_timestamp=var('snowplow__session_timestamp', 'collector_tstamp'),
     derived_tstamp_partitioned=var('snowplow__derived_tstamp_partitioned', true),

models/base/scratch/default/snowplow_web_base_events_this_run.sql

@@ -42,7 +42,7 @@ You may obtain a copy of the Snowplow Community License Version 1.0 at https://d
 
 {% set base_events_query = snowplow_utils.base_create_snowplow_events_this_run(
     sessions_this_run_table='snowplow_web_base_sessions_this_run',
-    session_identifiers=var('snowplow__session_identifiers', [{"table" : "events", "field" : "domain_sessionid"}]),
+    session_identifiers=var('snowplow__session_identifiers', [{"schema" : "atomic", "field" : "domain_sessionid"}]),
     session_sql=var('snowplow__session_sql', none),
     session_timestamp=var('snowplow__session_timestamp', 'collector_tstamp'),
     derived_tstamp_partitioned=var('snowplow__derived_tstamp_partitioned', true),

models/base/scratch/snowflake/snowplow_web_base_events_this_run.sql

@@ -14,7 +14,7 @@ You may obtain a copy of the Snowplow Community License Version 1.0 at https://d
 
 {% set base_events_query = snowplow_utils.base_create_snowplow_events_this_run(
     sessions_this_run_table='snowplow_web_base_sessions_this_run',
-    session_identifiers=var('snowplow__session_identifiers', [{"table" : "events", "field" : "domain_sessionid"}]),
+    session_identifiers=var('snowplow__session_identifiers', [{"schema" : "atomic", "field" : "domain_sessionid"}]),
     session_sql=var('snowplow__session_sql', none),
     session_timestamp=var('snowplow__session_timestamp', 'collector_tstamp'),
     derived_tstamp_partitioned=var('snowplow__derived_tstamp_partitioned', true),

packages.yml

@@ -1,5 +1,4 @@
 packages:
-  # - package: snowplow/snowplow_utils
-  #   version: [">=0.14.3", "<0.15.0"]
-  - git: https://github.com/snowplow/dbt-snowplow-utils.git
-    revision: feature/create-base-table
+  - package: snowplow/snowplow_utils
+    version: 0.15.0-rc1
+    # version: [">=0.15.0", "<0.16.0"]