Skip to content

Commit

Permalink
using transformation_id instead of event_subtype`
Browse files Browse the repository at this point in the history
  • Loading branch information
fivetran-joemarkiewicz committed Apr 18, 2022
1 parent 4c5c5e0 commit b6eda29
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# dbt_fivetran_log v0.5.4
## Fixes
- The unique combination of columns test within the `fivetran_log__schema_changelog` model has been updated to also check the `message_data` field. This is needed as schema changelog events may now sync at the same time. ([#51](https://github.com/fivetran/dbt_fivetran_log/pull/51))
- The `fivetran_log__connector_status` model has been adjusted to filter out all `TRANSFORMATION` event_subtype logs. Transformation logs are not always synced as a JSON object and thus the package may encounter errors on Snowflake warehouses when parsing non-JSON fields. Since transformation records are not used in this end model, they have been filtered out. ([#51](https://github.com/fivetran/dbt_fivetran_log/pull/51))
- The `fivetran_log__connector_status` model has been adjusted to filter out all logs that contain a `transformation_id`. Transformation logs are not always synced as a JSON object and thus the package may encounter errors on Snowflake warehouses when parsing non-JSON fields. Since transformation records are not used in this end model, they have been filtered out. ([#51](https://github.com/fivetran/dbt_fivetran_log/pull/51))
# dbt_fivetran_log v0.5.3
## Fixes
- Per the [Fivetran Log December 2021 Release Notes](https://fivetran.com/docs/logs/changelog#december2021) every sync results in a final `sync_end` event. In the previous version of this package, a successful sync was identified via a `sync_end` event while anything else was a version of broken. Since all syncs result in a `sync_end` event now, the package has been updated to account for this change within the connector.
Expand Down
2 changes: 1 addition & 1 deletion models/fivetran_log__connector_status.sql
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ with transformation_removal as (

select *
from {{ ref('stg_fivetran_log__log') }}
where event_subtype != 'TRANSFORMATION'
where transformation_id is null

),

Expand Down

0 comments on commit b6eda29

Please sign in to comment.