Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix installation process for Serverless #150

Merged
merged 28 commits into from
Feb 13, 2025
Merged

Conversation

mwojtyczka
Copy link
Contributor

@mwojtyczka mwojtyczka commented Feb 4, 2025

Changes

  • Removed pyspark dependency from the library. Enable it for testing and cli only.
  • Updated Databricks CLI version requirement
  • Added nightly CI
  • Refactored ci commands

Requires PR for supporting extras in Databricks CLI to be merged and released: databricks/cli#2288

Linked issues

Resolves #139

Tests

  • manually tested
  • added unit tests
  • added integration tests

@mwojtyczka
Copy link
Contributor Author

mwojtyczka commented Feb 4, 2025

Not to be merged until #139 is resolved.

Copy link

github-actions bot commented Feb 4, 2025

✅ 126/126 passed, 1 skipped, 32m17s total

Running from acceptance #496

@mwojtyczka mwojtyczka requested a review from alexott February 4, 2025 16:40
@mwojtyczka mwojtyczka merged commit 6e4bcdc into main Feb 13, 2025
9 checks passed
@mwojtyczka mwojtyczka deleted the dependencies_update branch February 13, 2025 16:40
mwojtyczka added a commit that referenced this pull request Feb 13, 2025
* Fixed installation process for Serverless ([#150](#150)). This commit removes the pyspark dependency from the librar to avoid spark version conflicts in Serverless and future DBR versions. CLI has been updated to install pyspark for local command execution.
* Updated demos and documentation ([#169](#169)). In this release, the quality checks in the demos have been updated to better showcase the capabilities of DQX. Documentation has been updated in various places for increase clarity. Additional contributing guides have been added.
@mwojtyczka mwojtyczka mentioned this pull request Feb 13, 2025
mwojtyczka added a commit that referenced this pull request Feb 13, 2025
* Fixed installation process for Serverless
([#150](#150)). This commit
removes the pyspark dependency from the library to avoid spark version
conflicts in Serverless and future DBR versions. CLI has been updated to
install pyspark for local command execution.
* Updated demos and documentation
([#169](#169)). In this
release, the quality checks in the demos have been updated to better
showcase the capabilities of DQX. Documentation has been updated in
various places for increased clarity. Additional contributing guides
have been added.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG]: Installation process fails in Serverless Environment version 1
2 participants