hydro_cli v0.1.0

Chore

• Cargo.toml documentation and description
• set hydroflow_cli_integration version
• bump versions to 0.1.0 for release
  For release on crates.io for v0.1

New Features

• finish up WebSocket chat example and avoid deadlocks in network setup

Bug Fixes

• don't create file copies on when deploying to localhost
  This causes issues on M1, likely due to some signing issue?
• mismatched package name in CLI build and attempt to really fix crashes
• Prepare action logic to publish CLI to PyPi and eliminate GIL acquires
  Hopefully this will work on the first try? Not really a good way to test it. It seems that acquiring the GIL in async/await code is asking for trouble, so this also eliminates those.

Other

• initialize hydro_cli/CHANGELOG.md
• publish hydro_cli
  Will bump versions for python deploy.
  Update build-cli.yml to publish on hydro_cli release

Style

• Warn lint unused_qualifications
• rustfmt group imports
• rustfmt prescribe flat-module use format

Commit Statistics

• 70 commits contributed to the release over the course of 101 calendar days.
• 12 commits were understood as conventional.
• 63 unique issues were worked on: #390, #397, #410, #411, #417, #420, #433, #436, #437, #445, #446, #451, #452, #460, #461, #462, #466, #473, #474, #477, #479, #481, #484, #492, #494, #498, #503, #513, #515, #525, #527, #531, #532, #533, #534, #535, #537, #542, #557, #560, #576, #582, #586, #596, #600, #612, #617, #620, #626, #627, #628, #631, #647, #656, #660, #679, #681, #684, #694, #699, #708, #712, #715

Commit Details

view details

• #390
  • Introduce initial Hydro CLI architecture (52aa6e0)
• #397
  • Add basic support for connecting services with Unix/TCP sockets (dbdad61)
• #410
  • Fixup! Initial support for GCP deployments (8695b5d)
  • Initial support for GCP deployments (f10a54f)
• #411
  • Fix non-unix (windows) build referencing unix sockets (5dac7e4)
• #417
  • Add API for defining custom services in deployment (2fb8871)
• #420
  • Update clap (4be709f)
• #433
  • Package CLI as a Python wheel to simplify distribution (b952257)
• #436
  • Support passing through extra arguments to deployment scripts (f40009c)
• #437
  • Extract common logic for establishing CLI-configured connections (44cce72)
• #445
  • Add demux operator to Hydro CLI to map node IDs to connections (886d00f)
• #446
  • Support running example deployment script without CLI (4b3233a)
• #451
  • Enable local deployments on non-Linux hosts (74c8d3d)
• #452
  • Build CLI wheels in CI and minimize CLI dependencies (3e33d0c)
• #460
  • Allow specifying args to launch HydroflowCrate with (3575fd3)
• #461
  • Support networking topologies that mix local and cloud through SSH tunneling (0ec6d88)
• #462
  • Directly expose Rust bindings as Python APIs (b94413a)
• #466
  • Add APIs for sending data to a Hydroflow service from Python (c2203a1)
• #473
  • Fixup! Add initial VPC configuration API and improve interrupt handling (7f21514)
  • Add initial VPC configuration API and improve interrupt handling (c729fc0)
• #474
  • Extract common SSH host logic into a separate module (5cc884e)
• #477
  • Properly handle interrupts and fix non-flushing demux (00ea017)
• #479
  • Allow custom ports to be used as sinks (8da15b7)
• #481
  • Display Anyhow traces when using directly using CLI APIs (0f19fa4)
• #484
  • Add merge API to CLI to have multiple sources for one sink (e09b567)
• #492
  • Add API to gracefully shutdown services (eda517a)
• #494
  • Fixup! Add initial VPC configuration API and improve interrupt handling (7f21514)
• #498
  • Add API to get CLI connection config as JSON (323e0f0)
• #503
  • Allow redeployment in CLI with updated services and hosts (967df05)
• #513
  • Add hydro.null API to connect no-op sources and sinks (9b2a4a6)
• #515
  • Initial TopoloTree actor implementation for binary tree (e9fcc24)
• #525
  • Add existing parameter to GCPNetwork to use existing VPCs (33249e4)
• #527
  • Actually return a GCPComputeEngineHost when creating one (0eef370)
• #531
  • Provision hosts even if they are not being used by a service (abdf61d)
• #532
  • Generalize null source support into SourcePath abstraction (835ba3b)
• #533
  • Add hydro.mux operator and initial API tests (c25272b)
• #534
  • Allow specifying the user to sign in as on a GCP machine (ad1609d)
• #535
  • Ignore GCP port requests for ports that have already been allocated (c948ab8)
• #537
  • Use the correct user account (86135f4)
• #542
  • Avoid deadlock in port loading when a service connects to itself (559f115)
• #557
  • Have Python drive CLI cancellations to support interrupting loops (f3e57c9)
• #560
  • Refactor hydro.mux to source.tagged(id) and support connections where the tagged source is the server (3f0ecc9)
• #576
  • Add classic counter CRDT benchmark to compare against (2f3bf04)
• #582
  • Add a global cache for Cargo builds initiated by the CLI (83c1df7)
• #586
  • Bump pinned nightly and fix build failures on latest nightly (84a831e)
• #596
  • Improve CLI interrupt handling when subtasks are spawned (93fb340)
• #600
  • Display rich progress for deployment tasks in console (467e2fb)
• #612
  • Fix lints on windows (2f8d3e2)
• #617
  • Update Cargo.tomls for publishing (a78ff9a)
• #620
  • Replace using cargo as a library to shell out with cargo-metadata instead (5f2e8f3)
• #626
  • Print logs from services with a prefix identifying the service (79dda6a)
• #627
  • Display cargo build status formatted next to a progress bar (5cbe43a)
• #628
  • Handle Terraform printing a log about reading existing resources (6bf7b71)
• #631
  • Avoid clobbering Rust errors with the progress bar (6f3cf4b)
• #647
  • Fix Hydro CLI builds failing due to breaking Maturin change (ffee23f)
• #656
  • Add WebSocket with CLI example and simplify init API (1015980)
• #660
  • Warn lint unused_qualifications (cd0a86d)
  • Rustfmt group imports (20a1b2c)
  • Rustfmt prescribe flat-module use format (1eda91a)
• #679
  • Only load converters helper module once in the CLI (860d74f)
• #681
  • Migrate playground to new docs site (4d16bd2)
• #684
  • Bump versions to 0.1.0 for release (52ee8f8)
• #694
  • Prepare action logic to publish CLI to PyPi and eliminate GIL acquires (508b00e)
• #699
  • Mismatched package name in CLI build and attempt to really fix crashes (268f837)
• #708
  • Finish up WebSocket chat example and avoid deadlocks in network setup (4536ac6)
• #712
  • Publish hydro_cli (2bd8517)
• #715
  • Don't create file copies on when deploying to localhost (1c06b3b)
• Uncategorized
  • Cargo.toml documentation and description (665ad20)
  • Initialize hydro_cli/CHANGELOG.md (51a3a9e)
  • Set hydroflow_cli_integration version (382a83c)
  • Update pinned nightly rust version 2023-04-18 (6ced3c1)