Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use env vars in Docker compose and swarm mode #20

Merged
merged 19 commits into from
Feb 22, 2025
Merged

Conversation

a-earthperson
Copy link
Member

  • deployment seems stable
  • reverting to fewer containers for review branches
  • add placement constraints
  • update CODEOWNERS
  • app is buildable (a) locally, (b) using docker-compose, and (c) with docker-swarm.
  • split .env into local, compose, and stack
  • add support for multiple brokers in swarm mode
  • persist rabbitmq data in compose mode
  • add secrets and configs in compose mode
  • update CD steps to expose and scale brokers, workers using Space UI
  • fix a bug where NumWorkers was force-set to 1.
  • increase healthcheck start interval to 5min for very slow hosts in swarm mode
  • remove unusable test, include a stub test
  • include a deployment config for swarm mode
  • expose env vars to stack, compose, and local dev environment
  • update CD pipeline to use new configs
  • add health-checks in compose
  • cleanup stack file
  • remove unused env vars
  • expose RMQ runtime params as env vars
  • read and use env vars as config, with fallback
  • refactor microservices to not use hardcoded paths
  • remove unneed files
  • gracefully handle exposing and using JWT secrets as env vars or secret file
  • added a stress test file for the microservice.

rasheeqqua and others added 19 commits February 20, 2025 12:51
`docker compose -f docker-compose.yml up -d`
in the project root directory.
- Added a stress test file for the microservice.
- Added log message support for quantification producer and consumer.
- Removed storage queue from the quantification workflow. Workers can send the output directly to the database now.
- Added prefetch limit for both quantification (32) and executable (1).
- Converted the queuing method to sync from async.
- Increased the request body limit to 50 mb for the microservice.
- Quantification consumer will be compiled inside the /dist/packages/microservice/job-broker-consumer folder instead of the /dist/packages/microservice/job-broker/consumer folder.
…send requests to the `v2-app` that has already been deployed instead of `localhost`.
`docker compose -f docker-compose.yml up -d`
in the project root directory.
- Added a stress test file for the microservice.
- Added log message support for quantification producer and consumer.
- Removed storage queue from the quantification workflow. Workers can send the output directly to the database now.
- Added prefetch limit for both quantification (32) and executable (1).
- Converted the queuing method to sync from async.
- Increased the request body limit to 50 mb for the microservice.
- Quantification consumer will be compiled inside the /dist/packages/microservice/job-broker-consumer folder instead of the /dist/packages/microservice/job-broker/consumer folder.
…send requests to the `v2-app` that has already been deployed instead of `localhost`.
- read and use env vars as config, with fallback
- refactor microservices to not use hardcoded paths
- remove unneed files
- update CD pipeline to use new configs
- add health-checks in compose
- cleanup stack file
- remove unused env vars
- add support for multiple brokers in swarm mode
- persist rabbitmq data in compose mode
- add secrets and configs in compose mode
- update CD steps to expose and scale brokers, workers using Space UI
- fix a bug where NumWorkers was force-set to 1.
- reverting to fewer containers for review branches
@a-earthperson a-earthperson linked an issue Feb 22, 2025 that may be closed by this pull request
@a-earthperson a-earthperson added the bug Something isn't working label Feb 22, 2025
@a-earthperson a-earthperson merged commit 8c2bfc5 into main Feb 22, 2025
@a-earthperson a-earthperson deleted the temp-169-branch branch February 22, 2025 19:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

App not working for Docker Compose
2 participants