-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unify web and mobile model #3
Conversation
9df2c51
to
e349747
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks really good!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM (at least from what I can review), amazing work!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
While we're tidying things, just as few ideas:
- We don't really need the cluster_by macros anymore now the models are all a single file, we could just add them directly to the config?
- I really don't get why
allow_refresh
is not part of the utils package at this point... - Once it's settled I'd like to just have a look at all our macros and work out if there's any we could combine, make more flexible, combine in file only (to make it clearer where things are maybe), or pull back into the models now that we don't have 4 versions of each file (where they don't differ by warehouse). Also just consistency things like we should make sure all columns don't have trailing commas etc.
models/base/manifest/snowplow_unified_base_quarantined_sessions.sql
Outdated
Show resolved
Hide resolved
|
Update on the state: Thanks for all the feedback so far! Things should solidify from now as everything has been added including integration tests and even the optional modules from both web and mobile that was not even planned at this stage. The app errors module still needs revision as it does not come with integration tests and I merged the this run tables for it. Other than that I consider it done (minus a final revision on wording and local final redshift tests). |
2c113df
to
51505e9
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nothing in my review is actually blocking, pretty much entirely nitpicks to try and find a single thing wrong, this is amazing work
integration_tests/models/expected/snowplow_unified_sessions_expected_stg.sql
Outdated
Show resolved
Hide resolved
tests/page_screen_views/snowplow_tests_page_screen_view_in_session_values.sql
Outdated
Show resolved
Hide resolved
c1adc6c
to
3ae6bac
Compare
3ae6bac
to
0d5f67e
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
0d5f67e
to
ce14afa
Compare
Status:
Integration tests are added (Redshift tested locally). Not expecting more changes apart from PR points.
optional modules:
Internal Documentation PR:
-snowplow/documentation#631 (comment)