Deploy local network #1324

bernokl · 2024-06-06T18:07:51Z

This is a partner PR to lace-ops/pull/142 which helps us set up the new core stack all of these services needs to connect to

github-actions · 2024-06-06T18:18:26Z

dev-sanchonet@us-east-1@v1 would change:

dev-sanchonet, dev-sanchonet-cardanojs-v1-backend, Deployment (apps) would change:

  # Source: cardanojs/templates/backend-deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: backend
      network: sanchonet
      release: dev-sanchonet-cardanojs-v1
    name: dev-sanchonet-cardanojs-v1-backend
  spec:
    selector:
      matchLabels:
        app: backend
        network: sanchonet
        release: dev-sanchonet-cardanojs-v1
    template:
      metadata:
        labels:
          app: backend
          network: sanchonet
          release: dev-sanchonet-cardanojs-v1
      spec:
        containers:
        - args:
          - start-provider-server
          env:
          - name: ALLOWED_ORIGINS
            value: chrome-extension://gafhhkghbfjjkeiendhlofajokpaflmk,chrome-extension://efeiemlfnahiidnjglmehaihacglceia,chrome-extension://bjlhpephaokolembmpdcbobbpkjnoheb,chrome-extension://djcdfchkaijggdjokfomholkalbffgil,http://localhost/,http://localhost
          - name: BUILD_INFO
-           value: '{"extra":{"narHash":"sha256-Pk2Z4QEAGRfSHONnjAfGYxLEMck3zvGJGE/lXMAVhmg=","path":"/nix/store/9lfgk3kdvf8nmxisdk1xpj9wj91jg72s-source","sourceInfo":"/nix/store/9lfgk3kdvf8nmxisdk1xpj9wj91jg72s-source"},"lastModified":1718187935,"lastModifiedDate":"20240612102535","rev":"e66686a55a6850719c81335921611463b7e13e6a","shortRev":"e66686a"}'
+           value: '{"extra":{"narHash":"sha256-on2MgYOhhCn4+NleIWsk7xsD6ip+nvNf+L4omJvQlRs=","path":"/nix/store/fxvq9lgbasknczk49mv6hy40vax3s9w5-source","sourceInfo":"/nix/store/fxvq9lgbasknczk49mv6hy40vax3s9w5-source"},"lastModified":1718795985,"lastModifiedDate":"20240619111945","rev":"af4b58f011c35c7fae266fa800e386199e188673","shortRev":"af4b58f"}'
          - name: DISABLE_STAKE_POOL_METRIC_APY
            value: "true"
          - name: ENABLE_METRICS
            value: "true"
          - name: HANDLE_POLICY_IDS
            value: f0ff48bbb7bbe9d59a40f1ce90e9e9d0ff5002ec48f232b49ca0fb9a
          - name: HANDLE_PROVIDER_SERVER_URL
            value: https://sanchonet.api.handle.me
          - name: LOGGER_MIN_SEVERITY
            value: info
          - name: NETWORK
            value: sanchonet
          - name: OGMIOS_SRV_SERVICE_NAME
            value: dev-sanchonet-cardano-core.dev-sanchonet.svc.cluster.local
          - name: PAGINATION_PAGE_SIZE_LIMIT
            value: "5500"
          - name: POSTGRES_DB_DB_SYNC
            value: cardano
          - name: POSTGRES_DB_HANDLE
            value: handle
          - name: POSTGRES_HOST_DB_SYNC
            value: dev-sanchonet-postgresql
          - name: POSTGRES_HOST_HANDLE
            value: dev-sanchonet-postgresql
          - name: POSTGRES_PASSWORD_DB_SYNC
            valueFrom:
              secretKeyRef:
                key: password
                name: cardano-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: POSTGRES_PASSWORD_HANDLE
            valueFrom:
              secretKeyRef:
                key: password
                name: handle-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: POSTGRES_POOL_MAX_DB_SYNC
            value: "50"
          - name: POSTGRES_POOL_MAX_HANDLE
            value: "10"
          - name: POSTGRES_PORT_DB_SYNC
            value: "5432"
          - name: POSTGRES_PORT_HANDLE
            value: "5432"
          - name: POSTGRES_SSL_CA_FILE_DB_SYNC
            value: /tls/ca.crt
          - name: POSTGRES_SSL_CA_FILE_HANDLE
            value: /tls/ca.crt
          - name: POSTGRES_SSL_DB_SYNC
            value: "true"
          - name: POSTGRES_SSL_HANDLE
            value: "true"
          - name: POSTGRES_USER_DB_SYNC
            valueFrom:
              secretKeyRef:
                key: username
                name: cardano-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: POSTGRES_USER_HANDLE
            valueFrom:
              secretKeyRef:
                key: username
                name: handle-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: SERVICE_NAMES
            value: asset,chain-history,network-info,rewards,stake-pool,tx-submit,utxo
          - name: SUBMIT_API_URL
            value: http://dev-sanchonet-cardano-stack.dev-sanchonet.svc.cluster.local:8090
          - name: TOKEN_METADATA_SERVER_URL
            value: http://dev-sanchonet-cardano-stack-metadata.dev-sanchonet.svc.cluster.local
          - name: USE_BLOCKFROST
            value: "false"
          - name: USE_KORA_LABS
            value: "true"
          - name: USE_SUBMIT_API
            value: "true"
-         image: 926093910549.dkr.ecr.us-east-1.amazonaws.com/cardano-services:r9jxwzb0kapxi9d02b29qa6a8sl11lp5
+         image: 926093910549.dkr.ecr.us-east-1.amazonaws.com/cardano-services:vhi7xg9s7rshs1crq5i2mdwwsfxjz35z
          livenessProbe:
            httpGet:
              path: /v1.0.0/health
              port: 3000
            timeoutSeconds: 20
          name: backend
          ports:
          - containerPort: 3000
            name: http
          resources:
            limits:
              cpu: 1500m
              memory: 512Mi
            requests:
              cpu: 1000m
              memory: 350Mi
          securityContext:
            runAsGroup: 0
            runAsUser: 0
          volumeMounts:
          - mountPath: /tls
            name: tls
+         - mountPath: /config
+           name: s3-config-mount
        imagePullSecrets:
        - name: dockerconfigjson
        volumes:
        - name: tls
          secret:
            secretName: postgresql-server-cert
+       - name: s3-config-mount
+         persistentVolumeClaim:
+           claimName: dev-sanchonet-local-conifig-s3-pvc

dev-sanchonet, dev-sanchonet-cardanojs-v1-pg-boss-worker, Deployment (apps) would change:

  # Source: cardanojs/templates/pgboss-deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: pg-boss-worker
      network: sanchonet
      release: dev-sanchonet-cardanojs-v1
    name: dev-sanchonet-cardanojs-v1-pg-boss-worker
  spec:
    selector:
      matchLabels:
        app: pg-boss-worker
        network: sanchonet
        release: dev-sanchonet-cardanojs-v1
    template:
      metadata:
        labels:
          app: pg-boss-worker
          network: sanchonet
          release: dev-sanchonet-cardanojs-v1
      spec:
        containers:
        - args:
          - start-pg-boss-worker
          env:
          - name: LOGGER_MIN_SEVERITY
            value: info
          - name: METADATA_FETCH_MODE
            value: smash
          - name: NETWORK
            value: sanchonet
          - name: NETWORK_INFO_PROVIDER_URL
            value: http://dev-sanchonet-cardanojs-v1-backend.dev-sanchonet.svc.cluster.local
          - name: POSTGRES_DB_DB_SYNC
            value: cardano
          - name: POSTGRES_DB_STAKE_POOL
            value: stakepool
          - name: POSTGRES_HOST_DB_SYNC
            value: dev-sanchonet-postgresql
          - name: POSTGRES_HOST_STAKE_POOL
            value: dev-sanchonet-postgresql
          - name: POSTGRES_PASSWORD_DB_SYNC
            valueFrom:
              secretKeyRef:
                key: password
                name: cardano-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: POSTGRES_PASSWORD_STAKE_POOL
            valueFrom:
              secretKeyRef:
                key: password
                name: stakepool-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: POSTGRES_POOL_MAX_DB_SYNC
            value: "5"
          - name: POSTGRES_POOL_MAX_STAKE_POOL
            value: "5"
          - name: POSTGRES_PORT_DB_SYNC
            value: "5432"
          - name: POSTGRES_PORT_STAKE_POOL
            value: "5432"
          - name: POSTGRES_SSL_CA_FILE_DB_SYNC
            value: /tls/ca.crt
          - name: POSTGRES_SSL_CA_FILE_STAKE_POOL
            value: /tls/ca.crt
          - name: POSTGRES_SSL_DB_SYNC
            value: "true"
          - name: POSTGRES_SSL_STAKE_POOL
            value: "true"
          - name: POSTGRES_USER_DB_SYNC
            valueFrom:
              secretKeyRef:
                key: username
                name: cardano-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: POSTGRES_USER_STAKE_POOL
            valueFrom:
              secretKeyRef:
                key: username
                name: stakepool-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: QUEUES
            value: pool-delist-schedule,pool-metadata,pool-metrics,pool-rewards
          - name: SMASH_URL
            value: https://sanchonet-smash.world.dev.cardano.org/api/v1
          - name: STAKE_POOL_PROVIDER_URL
            value: http://dev-sanchonet-cardanojs-v1-backend.dev-sanchonet.svc.cluster.local
-         image: 926093910549.dkr.ecr.us-east-1.amazonaws.com/cardano-services:r9jxwzb0kapxi9d02b29qa6a8sl11lp5
+         image: 926093910549.dkr.ecr.us-east-1.amazonaws.com/cardano-services:vhi7xg9s7rshs1crq5i2mdwwsfxjz35z
          livenessProbe:
            httpGet:
              path: /v1.0.0/health
              port: 3000
          name: pg-boss-worker
          ports:
          - containerPort: 3000
            name: http
          resources:
            limits:
              cpu: 300m
              memory: 300Mi
            requests:
              cpu: 200m
              memory: 150Mi
          securityContext:
            runAsGroup: 0
            runAsUser: 0
          startupProbe:
            httpGet:
              path: /v1.0.0/ready
              port: 3000
            initialDelaySeconds: 80
            periodSeconds: 5
          volumeMounts:
          - mountPath: /tls
            name: tls
        imagePullSecrets:
        - name: dockerconfigjson
        volumes:
        - name: tls
          secret:
            secretName: postgresql-server-cert

dev-sanchonet, dev-sanchonet-cardanojs-v1-stake-pool-projector, Deployment (apps) would change:

  # Source: cardanojs/templates/stake-pool-projector-deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: stake-pool-projector
      network: sanchonet
      release: dev-sanchonet-cardanojs-v1
    name: dev-sanchonet-cardanojs-v1-stake-pool-projector
  spec:
    selector:
      matchLabels:
        app: stake-pool-projector
        network: sanchonet
        release: dev-sanchonet-cardanojs-v1
    template:
      metadata:
        labels:
          app: stake-pool-projector
          network: sanchonet
          release: dev-sanchonet-cardanojs-v1
      spec:
        containers:
        - args:
          - start-projector
          env:
          - name: LOGGER_MIN_SEVERITY
            value: info
          - name: NETWORK
            value: sanchonet
          - name: OGMIOS_SRV_SERVICE_NAME
            value: dev-sanchonet-cardano-core.dev-sanchonet.svc.cluster.local
          - name: POSTGRES_DB
            value: stakepool
          - name: POSTGRES_HOST
            value: dev-sanchonet-postgresql
          - name: POSTGRES_PASSWORD
            valueFrom:
              secretKeyRef:
                key: password
                name: stakepool-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: POSTGRES_POOL_MAX
            value: "2"
          - name: POSTGRES_PORT
            value: "5432"
          - name: POSTGRES_SSL
            value: "true"
          - name: POSTGRES_SSL_CA_FILE
            value: /tls/ca.crt
          - name: POSTGRES_USER
            valueFrom:
              secretKeyRef:
                key: username
                name: stakepool-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: PROJECTION_NAMES
            value: stake-pool,stake-pool-metadata-job,stake-pool-metrics-job,stake-pool-rewards-job
-         image: 926093910549.dkr.ecr.us-east-1.amazonaws.com/cardano-services:r9jxwzb0kapxi9d02b29qa6a8sl11lp5
+         image: 926093910549.dkr.ecr.us-east-1.amazonaws.com/cardano-services:vhi7xg9s7rshs1crq5i2mdwwsfxjz35z
          livenessProbe:
            httpGet:
              path: /v1.0.0/health
              port: 3000
            timeoutSeconds: 5
          name: stake-pool-projector
          ports:
          - containerPort: 3000
            name: http
          resources:
            limits:
              cpu: 700m
              memory: 300Mi
            requests:
              cpu: 700m
              memory: 150Mi
          securityContext:
            runAsGroup: 0
            runAsUser: 0
          volumeMounts:
          - mountPath: /tls
            name: tls
        imagePullSecrets:
        - name: dockerconfigjson
        volumes:
        - name: tls
          secret:
            secretName: postgresql-server-cert

dev-sanchonet, dev-sanchonet-cardanojs-v1-stake-pool-provider, Deployment (apps) would change:

  # Source: cardanojs/templates/stake-pool-provider-deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: stake-pool-provider
      network: sanchonet
      release: dev-sanchonet-cardanojs-v1
    name: dev-sanchonet-cardanojs-v1-stake-pool-provider
  spec:
    selector:
      matchLabels:
        app: stake-pool-provider
        network: sanchonet
        release: dev-sanchonet-cardanojs-v1
    template:
      metadata:
        labels:
          app: stake-pool-provider
          network: sanchonet
          release: dev-sanchonet-cardanojs-v1
      spec:
        containers:
        - args:
          - start-provider-server
          env:
          - name: ALLOWED_ORIGINS
            value: chrome-extension://gafhhkghbfjjkeiendhlofajokpaflmk,chrome-extension://efeiemlfnahiidnjglmehaihacglceia,chrome-extension://bjlhpephaokolembmpdcbobbpkjnoheb,chrome-extension://djcdfchkaijggdjokfomholkalbffgil,http://localhost/,http://localhost
          - name: DISABLE_STAKE_POOL_METRIC_APY
            value: "true"
          - name: ENABLE_METRICS
            value: "true"
          - name: LOGGER_MIN_SEVERITY
            value: info
          - name: NETWORK
            value: sanchonet
          - name: OGMIOS_SRV_SERVICE_NAME
            value: dev-sanchonet-cardano-core.dev-sanchonet.svc.cluster.local
          - name: OVERRIDE_FUZZY_OPTIONS
            value: "true"
          - name: PAGINATION_PAGE_SIZE_LIMIT
            value: "5500"
          - name: POSTGRES_DB_STAKE_POOL
            value: stakepool
          - name: POSTGRES_HOST_STAKE_POOL
            value: dev-sanchonet-postgresql
          - name: POSTGRES_PASSWORD_STAKE_POOL
            valueFrom:
              secretKeyRef:
                key: password
                name: stakepool-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: POSTGRES_POOL_MAX_STAKE_POOL
            value: "10"
          - name: POSTGRES_PORT_STAKE_POOL
            value: "5432"
          - name: POSTGRES_SSL_CA_FILE_STAKE_POOL
            value: /tls/ca.crt
          - name: POSTGRES_SSL_STAKE_POOL
            value: "true"
          - name: POSTGRES_USER_STAKE_POOL
            valueFrom:
              secretKeyRef:
                key: username
                name: stakepool-owner-user.dev-sanchonet-postgresql.credentials.postgresql.acid.zalan.do
          - name: SERVICE_NAMES
            value: stake-pool
          - name: TOKEN_METADATA_SERVER_URL
            value: http://dev-sanchonet-cardano-stack-metadata.dev-sanchonet.svc.cluster.local
          - name: USE_TYPEORM_STAKE_POOL_PROVIDER
            value: "true"
-         image: 926093910549.dkr.ecr.us-east-1.amazonaws.com/cardano-services:r9jxwzb0kapxi9d02b29qa6a8sl11lp5
+         image: 926093910549.dkr.ecr.us-east-1.amazonaws.com/cardano-services:vhi7xg9s7rshs1crq5i2mdwwsfxjz35z
          livenessProbe:
            httpGet:
              path: /v1.0.0/health
              port: 3000
            timeoutSeconds: 5
          name: stake-pool-provider
          ports:
          - containerPort: 3000
            name: http
          resources:
            limits:
              cpu: 500m
              memory: 300Mi
            requests:
              cpu: 100m
              memory: 150Mi
          securityContext:
            runAsGroup: 0
            runAsUser: 0
          volumeMounts:
          - mountPath: /tls
            name: tls
        imagePullSecrets:
        - name: dockerconfigjson
        volumes:
        - name: tls
          secret:
            secretName: postgresql-server-cert

nix/cardano-services/operables.nix

…s build

mirceahasegan

LGTM! Lots of nix stuff, so I don't have much input, but the wallet-real-ada test suite passed, so it's good.
Fantastic work @bernokl 👏

bernokl changed the base branch from master to conway-era June 6, 2024 18:08

bernokl force-pushed the deploy_local_network branch from 40a2b39 to 8ee2983 Compare June 13, 2024 16:34

bernokl marked this pull request as ready for review June 18, 2024 18:34

bernokl requested review from michalrus, mchappell, iccicci, gytis-ivaskevicius, ce0la and mirceahasegan June 18, 2024 18:34

gytis-ivaskevicius approved these changes Jun 18, 2024

View reviewed changes

michalrus approved these changes Jun 19, 2024

View reviewed changes

nix/cardano-services/operables.nix Show resolved Hide resolved

bernokl and others added 8 commits June 19, 2024 14:19

chore: add local-network deploy

ced6207

chore: define volumes on backend

c9f8acd

chore: add configurable volumes to provider resource

ebca951

chore: update operables to accomodate local-config

3926464

chore: give operable new commit hash

e6bec69

chore: build the sdk with new cjs specific script in nix images build

3c44026

fixup! chore: build the sdk with new cjs specific script in nix image…

b37fdc1

…s build

chore: update SUBMIT_API_URL for local-network

1a8a067

gytis-ivaskevicius force-pushed the deploy_local_network branch from 12911d3 to 1a8a067 Compare June 19, 2024 11:19

mirceahasegan approved these changes Jun 19, 2024

View reviewed changes

bernokl merged commit e9da018 into conway-era Jun 19, 2024
11 of 12 checks passed

bernokl deleted the deploy_local_network branch June 19, 2024 13:44

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Deploy local network #1324

Deploy local network #1324

bernokl commented Jun 6, 2024 •

edited

Loading

github-actions bot commented Jun 6, 2024 •

edited

Loading

mirceahasegan left a comment

Deploy local network #1324

Deploy local network #1324

Conversation

bernokl commented Jun 6, 2024 • edited Loading

github-actions bot commented Jun 6, 2024 • edited Loading

mirceahasegan left a comment

Choose a reason for hiding this comment

bernokl commented Jun 6, 2024 •

edited

Loading

github-actions bot commented Jun 6, 2024 •

edited

Loading