IB Gateway Docker Deployment Timeout Error on EC2 Instance

[9834703848]

Hello everyone,

I am experiencing an issue with running IB Gateway in a Docker container on an EC2 instance, which works perfectly fine on my local machine. However, when deployed on EC2, I encounter a timeout error when sending API requests to the IB Gateway running inside the Docker container.

The logs of the docker container in EC2 instance

``(ubuntu@ip-172-31-34-58:~/ib-gateway-docker$ docker-compose up --build

[+] Building 36.7s (17/17) FINISHED docker:default

=> [ib-gateway internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 3.91kB 0.0s
=> [ib-gateway internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [ib-gateway internal] load metadata for docker.io/library/ubuntu:22.04 0.8s
=> [ib-gateway setup 1/6] FROM docker.io/library/ubuntu:22.04@sha256:adbb90115a21969d2fe6fa7f9af4253e16d45f8d4c1e930182610c4731962658 0.0s
=> [ib-gateway internal] load build context 0.0s
=> => transferring context: 49.40kB 0.0s
=> CACHED [ib-gateway setup 2/6] WORKDIR /tmp/setup 0.0s
=> CACHED [ib-gateway setup 3/6] RUN apt-get update -y && DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends --yes curl ca-certificates unzip && apt-get clean && rm - 0.0s
=> CACHED [ib-gateway setup 4/6] COPY ./config/ibgateway/jts.ini.tmpl /root/Jts/jts.ini.tmpl 0.0s
=> [ib-gateway setup 5/6] COPY ./config/ibc/config.ini.tmpl /root/ibc/config.ini.tmpl 0.1s
=> [ib-gateway setup 6/6] COPY ./scripts /root/scripts 0.0s
=> CACHED [ib-gateway stage-1 2/6] COPY --from=setup /usr/local/i4j_jres/ /usr/local/i4j_jres 0.0s
=> [ib-gateway stage-1 3/6] COPY --chown=1000:1000 --from=setup /root/ /home/ibgateway 2.4s
=> [ib-gateway stage-1 4/6] RUN apt-get update -y && apt-get upgrade -y && DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends --yes gettext-base socat xvfb x11vnc sshpass 24.6s
=> [ib-gateway stage-1 5/6] WORKDIR /home/ibgateway 0.1s
=> [ib-gateway stage-1 6/6] RUN sed -i 's/\r//' /home/ibgateway/scripts/.sh 0.5s
=> [ib-gateway] exporting to image 4.2s
=> => exporting layers 4.2s
=> => writing image sha256:5656074554a34805eb16ef1ff94de7a47b9805c9de3d73e4b3e8ad94090b83e2 0.0s
=> => naming to ghcr.io/gnzsnz/ib-gateway:latest 0.0s
=> [ib-gateway] resolving provenance for metadata file 0.0s
[+] Running 1/1
✔ Container ib-gateway-docker-ib-gateway-1 Recreated 0.2s
Attaching to ib-gateway-1
ib-gateway-1 | *************************************************************************
ib-gateway-1 | .> Starting IBC/IB gateway
ib-gateway-1 | *************************************************************************
ib-gateway-1 | .> Starting Xvfb server
ib-gateway-1 | .> SSH tunnel disabled
ib-gateway-1 | .> Usign default Java heap size 768m.
ib-gateway-1 | .> VNC server disabled
ib-gateway-1 | .> API_PORT set to: 4002
ib-gateway-1 | .> SOCAT_PORT set to: 4004
ib-gateway-1 | .> Appling settings to IBC's config.ini
ib-gateway-1 | .> Settings directory NOT set, defaulting to: /home/ibgateway/Jts
ib-gateway-1 | .> Setting timezone in /home/ibgateway/Jts/jts.ini
ib-gateway-1 | .> Starting Port Forwarding.
ib-gateway-1 | .> Starting socat
ib-gateway-1 | .> Starting IBC in paper mode, with params:
ib-gateway-1 | .> Version: 10.31.1i
ib-gateway-1 | .> program: gateway
ib-gateway-1 | .> tws-path: /home/ibgateway/Jts
ib-gateway-1 | .> ibc-path: /home/ibgateway/ibc
ib-gateway-1 | .> ibc-init: /home/ibgateway/ibc/config.ini
ib-gateway-1 | .> tws-settings-path: /home/ibgateway/Jts
ib-gateway-1 | .> on2fatimeout: exit
ib-gateway-1 | Forking :::4002 onto 0.0.0.0:4004 > trading mode paper
ib-gateway-1 |
ib-gateway-1 | ================================================================================
ib-gateway-1 |
ib-gateway-1 | _XSERVTransmkdir: ERROR: euid != 0,directory /tmp/.X11-unix will not be created.
ib-gateway-1 | Starting IBC version on 2024-09-14 at 12:38:48
ib-gateway-1 |
ib-gateway-1 | Operating system: Linux af7c87b2a115 6.8.0-1012-aws #13-Ubuntu SMP Mon Jul 15 13:40:27 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
ib-gateway-1 |
ib-gateway-1 | Arguments:
ib-gateway-1 |
ib-gateway-1 | TWS version = 10.31.1i
ib-gateway-1 | Program = Gateway
ib-gateway-1 | Entry point = ibcalpha.ibc.IbcGateway
ib-gateway-1 | --tws-path = /home/ibgateway/Jts
ib-gateway-1 | --tws-settings-path =
ib-gateway-1 | --ibc-path = /home/ibgateway/ibc
ib-gateway-1 | --ibc-ini = /home/ibgateway/ibc/config.ini
ib-gateway-1 | --mode =
ib-gateway-1 | --java-path =
ib-gateway-1 | --user =
ib-gateway-1 | --pw =
ib-gateway-1 | --fix-user =
ib-gateway-1 | --fix-pw =
ib-gateway-1 |
ib-gateway-1 | =================================
ib-gateway-1 | Generating the classpath
ib-gateway-1 | Classpath=/home/ibgateway/Jts/ibgateway/10.31.1i/jars/batik-all-1.16.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/commons-io-2.11.0.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/fop-2.8.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-annotations-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-core-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-databind-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jts4launch-1031.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-linux64-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-swing-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/locales.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/log4j-api-2.17.1.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/log4j-core-2.17.1.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/total-2023.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/twslaunch-1031.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/twslaunch-install4j-1.12.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/xmlgraphics-commons-2.8.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/.install4j/i4jruntime.jar:/home/ibgateway/ibc/IBC.jar
ib-gateway-1 |
ib-gateway-1 | Generating the JAVA VM options
ib-gateway-1 | autorestart file not found
ib-gateway-1 |
ib-gateway-1 | Java VM Options=-Xmx768m -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -XX:ParallelGCThreads=20 -XX:ConcGCThreads=5 -XX:InitiatingHeapOccupancyPercent=70 -Dtwslaunch.autoupdate.serviceImpl=com.ib.tws.twslaunch.install4j.Install4jAutoUpdateService -Dchannel=latest -Dexe4j.isInstall4j=true -Dinstall4jType=standalone -DjtsConfigDir=/home/ibgateway/Jts -Dibcsessionid=QMINMSOO
ib-gateway-1 |
ib-gateway-1 | Determining the location of java executable
ib-gateway-1 | Location of java executable=/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/bin
ib-gateway-1 |
ib-gateway-1 | Renaming IB's TWS or Gateway start script to prevent restart without IBC
ib-gateway-1 |
ib-gateway-1 | Starting Gateway with this command:
ib-gateway-1 | "/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/bin/java" -cp "/home/ibgateway/Jts/ibgateway/10.31.1i/jars/batik-all-1.16.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/commons-io-2.11.0.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/fop-2.8.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-annotations-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-core-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-databind-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jts4launch-1031.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-linux64-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-swing-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/locales.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/log4j-api-2.17.1.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/log4j-core-2.17.1.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/total-2023.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/twslaunch-1031.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/twslaunch-install4j-1.12.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/xmlgraphics-commons-2.8.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/.install4j/i4jruntime.jar:/home/ibgateway/ibc/IBC.jar" -Xmx768m -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -XX:ParallelGCThreads=20 -XX:ConcGCThreads=5 -XX:InitiatingHeapOccupancyPercent=70 -Dtwslaunch.autoupdate.serviceImpl=com.ib.tws.twslaunch.install4j.Install4jAutoUpdateService -Dchannel=latest -Dexe4j.isInstall4j=true -Dinstall4jType=standalone -DjtsConfigDir=/home/ibgateway/Jts -Dibcsessionid=QMINMSOO ibcalpha.ibc.IbcGateway "/home/ibgateway/ibc/config.ini"
ib-gateway-1 |
ib-gateway-1 | IBC Settings:
ib-gateway-1 | AcceptBidAskLastSizeDisplayUpdateNotification=accept
ib-gateway-1 | AcceptIncomingConnectionAction=accept
ib-gateway-1 | AcceptNonBrokerageAccountWarning=yes
ib-gateway-1 | AllowBlindTrading=no
ib-gateway-1 | AutoLogoffTime=
ib-gateway-1 | AutoRestartTime=
ib-gateway-1 | BindAddress=
ib-gateway-1 | BypassBondWarning=
ib-gateway-1 | BypassCalledBondWarning=
ib-gateway-1 | BypassNegativeYieldToWorstConfirmation=
ib-gateway-1 | BypassNoOverfillProtectionPrecaution=
ib-gateway-1 | BypassOrderPrecautions=
ib-gateway-1 | BypassPriceBasedVolatilityRiskWarning=
ib-gateway-1 | BypassRedirectOrderWarning=
ib-gateway-1 | BypassSameActionPairTradeWarning=
ib-gateway-1 | BypassUSStocksMarketDataInSharesWarning=
ib-gateway-1 | ClosedownAt=
ib-gateway-1 | ColdRestartTime=
ib-gateway-1 | CommandPrompt=
ib-gateway-1 | CommandServerPort=0
ib-gateway-1 | ConfirmCryptoCurrencyOrders=transmit
ib-gateway-1 | ConfirmOrderIdReset=
ib-gateway-1 | ControlFrom=
ib-gateway-1 | DismissNSEComplianceNotice=yes
ib-gateway-1 | DismissPasswordExpiryWarning=no
ib-gateway-1 | ExistingSessionDetectedAction=primary
ib-gateway-1 | ExitAfterSecondFactorAuthenticationTimeout=no
ib-gateway-1 | FIX=no
ib-gateway-1 | FIXLoginId=**
ib-gateway-1 | FIXPassword=***
ib-gateway-1 | IbDir=
ib-gateway-1 | IbLoginId=***
ib-gateway-1 | IbPassword=***
ib-gateway-1 | LogStructureScope=known
ib-gateway-1 | LogStructureWhen=never
ib-gateway-1 | LoginDialogDisplayTimeout=60
ib-gateway-1 | MinimizeMainWindow=no
ib-gateway-1 | OverrideTwsApiPort=
ib-gateway-1 | OverrideTwsMasterClientID=
ib-gateway-1 | ReadOnlyApi=no
ib-gateway-1 | ReadOnlyLogin=no
ib-gateway-1 | ReloginAfterSecondFactorAuthenticationTimeout=no
ib-gateway-1 | ResetOrderIdsAtStart=
ib-gateway-1 | SaveTwsSettingsAt=
ib-gateway-1 | SecondFactorAuthenticationExitInterval=60
ib-gateway-1 | SecondFactorAuthenticationTimeout=180
ib-gateway-1 | SecondFactorDevice=
ib-gateway-1 | SendMarketDataInLotsForUSstocks=
ib-gateway-1 | StoreSettingsOnServer=
ib-gateway-1 | SuppressInfoMessages=yes
ib-gateway-1 | TradingMode=paper
ib-gateway-1 | TrustedTwsApiClientIPs=0.0.0.0
ib-gateway-1 | End IBC Settings
ib-gateway-1 |
ib-gateway-1 | 2024-09-14 12:38:49:500 IBC: version: 3.20.0
ib-gateway-1 | System Properties
ib-gateway-1 | ------------------------------------------------------------
ib-gateway-1 | jtsConfigDir = /home/ibgateway/Jts
ib-gateway-1 | java.runtime.name = Java(TM) SE Runtime Environment
ib-gateway-1 | sun.boot.library.path = /usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/amd64
ib-gateway-1 | java.vm.version = 25.202-b08
ib-gateway-1 | java.vm.vendor = Oracle Corporation
ib-gateway-1 | java.vendor.url = http://java.oracle.com/
ib-gateway-1 | path.separator = :
ib-gateway-1 | java.vm.name = Java HotSpot(TM) 64-Bit Server VM
ib-gateway-1 | file.encoding.pkg = sun.io
ib-gateway-1 | user.country = US
ib-gateway-1 | sun.java.launcher = SUN_STANDARD
ib-gateway-1 | sun.os.patch.level = unknown
ib-gateway-1 | java.vm.specification.name = Java Virtual Machine Specification
ib-gateway-1 | user.dir = /home/ibgateway/Jts
ib-gateway-1 | java.runtime.version = 1.8.0_202-b08
ib-gateway-1 | ibcsessionid = QMINMSOO
ib-gateway-1 | java.awt.graphicsenv = sun.awt.X11GraphicsEnvironment
ib-gateway-1 | java.endorsed.dirs = /usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/endorsed
ib-gateway-1 | os.arch = amd64
ib-gateway-1 | java.io.tmpdir = /tmp
ib-gateway-1 | line.separator =
ib-gateway-1 |
ib-gateway-1 | java.vm.specification.vendor = Oracle Corporation
ib-gateway-1 | os.name = Linux
ib-gateway-1 | sun.jnu.encoding = ANSI_X3.4-1968
ib-gateway-1 | java.library.path = /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
ib-gateway-1 | java.specification.name = Java Platform API Specification
ib-gateway-1 | java.class.version = 52.0
ib-gateway-1 | sun.management.compiler = HotSpot 64-Bit Tiered Compilers
ib-gateway-1 | exe4j.isInstall4j = true
ib-gateway-1 | os.version = 6.8.0-1012-aws
ib-gateway-1 | user.home = /home/ibgateway
ib-gateway-1 | user.timezone = Etc/UTC
ib-gateway-1 | java.awt.printerjob = sun.print.PSPrinterJob
ib-gateway-1 | file.encoding = ANSI_X3.4-1968
ib-gateway-1 | java.specification.version = 1.8
ib-gateway-1 | java.class.path = /home/ibgateway/Jts/ibgateway/10.31.1i/jars/batik-all-1.16.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/commons-io-2.11.0.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/fop-2.8.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-annotations-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-core-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jackson-databind-2.12.3.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jts4launch-1031.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-linux64-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/jxbrowser-swing-7.29.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/locales.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/log4j-api-2.17.1.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/log4j-core-2.17.1.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/total-2023.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/twslaunch-1031.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/twslaunch-install4j-1.12.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/jars/xmlgraphics-commons-2.8.jar:/home/ibgateway/Jts/ibgateway/10.31.1i/.install4j/i4jruntime.jar:/home/ibgateway/ibc/IBC.jar
ib-gateway-1 | user.name = ibgateway
ib-gateway-1 | channel = latest
ib-gateway-1 | java.vm.specification.version = 1.8
ib-gateway-1 | sun.java.command = ibcalpha.ibc.IbcGateway /home/ibgateway/ibc/config.ini
ib-gateway-1 | java.home = /usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202
ib-gateway-1 | sun.arch.data.model = 64
ib-gateway-1 | user.language = en
ib-gateway-1 | java.specification.vendor = Oracle Corporation
ib-gateway-1 | awt.toolkit = sun.awt.X11.XToolkit
ib-gateway-1 | java.vm.info = mixed mode
ib-gateway-1 | java.version = 1.8.0_202
ib-gateway-1 | java.ext.dirs = /usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/ext:/usr/java/packages/lib/ext
ib-gateway-1 | sun.boot.class.path = /usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/resources.jar:/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/rt.jar:/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/sunrsasign.jar:/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/jsse.jar:/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/jce.jar:/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/charsets.jar:/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/lib/jfr.jar:/usr/local/i4j_jres/Oda-jK0QgTEmVssfllLP/1.8.0_202/classes
ib-gateway-1 | java.vendor = Oracle Corporation
ib-gateway-1 | file.separator = /
ib-gateway-1 | twslaunch.autoupdate.serviceImpl = com.ib.tws.twslaunch.install4j.Install4jAutoUpdateService
ib-gateway-1 | java.vendor.url.bug = http://bugreport.sun.com/bugreport/
ib-gateway-1 | install4jType = standalone
ib-gateway-1 | sun.io.unicode.encoding = UnicodeLittle
ib-gateway-1 | sun.cpu.endian = little
ib-gateway-1 | sun.cpu.isalist =
ib-gateway-1 | ------------------------------------------------------------
ib-gateway-1 | 2024-09-14 12:38:49:515 IBC: using default settings provider: ini file is /home/ibgateway/ibc/config.ini
ib-gateway-1 | 2024-09-14 12:38:49:516 IBC: using default login manager: will get username and password from settings; FIX username and password (if required) from settings
ib-gateway-1 | 2024-09-14 12:38:49:516 IBC: using default main window manager
ib-gateway-1 | 2024-09-14 12:38:49:516 IBC: using default trading mode manager: constructor parameter args but trading mode not present - will be taken from settings
ib-gateway-1 | 2024-09-14 12:38:49:519 IBC: using default config dialog manager
ib-gateway-1 | 2024-09-14 12:38:49:535 IBC: CommandServer is not started because the port is not configured
ib-gateway-1 | 2024-09-14 12:38:49:813 IBC: TWS Settings directory is: /home/ibgateway/Jts
ib-gateway-1 | 2024-09-14 12:38:49:813 IBC: Starting session: will exit if login dialog is not displayed within 60 seconds
ib-gateway-1 | 2024-09-14 12:38:49:839 IBC: Ensuring /home/ibgateway/Jts/jts.ini contains required minimal lines
ib-gateway-1 | 2024-09-14 12:38:49:840 IBC: Found setting: [Logon]/s3store=true
ib-gateway-1 | 2024-09-14 12:38:49:840 IBC: Found setting: [Logon]/Locale=en
ib-gateway-1 | 2024-09-14 12:38:49:840 IBC: Found setting: [Logon]/displayedproxymsg=1
ib-gateway-1 | 2024-09-14 12:38:49:840 IBC: Found setting: [Logon]/UseSSL=true
ib-gateway-1 | 2024-09-14 12:38:49:840 IBC: Found setting: [IBGateway]/ApiOnly=true
ib-gateway-1 | 2024-09-14 12:38:49:840 IBC: Found setting: [IBGateway]/TrustedIPs=0.0.0.0: updating value to 127.0.0.1,0.0.0.0
ib-gateway-1 | 2024-09-14 12:38:49:840 IBC: Some settings updated in /home/ibgateway/Jts/jts.ini
ib-gateway-1 | 2024-09-14 12:38:49:841 IBC: Rewriting existing /home/ibgateway/Jts/jts.ini
ib-gateway-1 | 2024-09-14 12:38:49:842 IBC: jts.ini: [IBGateway]
ib-gateway-1 | 2024-09-14 12:38:49:842 IBC: jts.ini: WriteDebug=false
ib-gateway-1 | 2024-09-14 12:38:49:842 IBC: jts.ini: TrustedIPs=127.0.0.1,0.0.0.0
ib-gateway-1 | 2024-09-14 12:38:49:842 IBC: jts.ini: ApiOnly=true
ib-gateway-1 | 2024-09-14 12:38:49:843 IBC: jts.ini:
ib-gateway-1 | 2024-09-14 12:38:49:844 IBC: jts.ini: [Logon]
ib-gateway-1 | 2024-09-14 12:38:49:844 IBC: jts.ini: Locale=en
ib-gateway-1 | 2024-09-14 12:38:49:845 IBC: jts.ini: TimeZone=Etc/UTC
ib-gateway-1 | 2024-09-14 12:38:49:845 IBC: jts.ini: displayedproxymsg=1
ib-gateway-1 | 2024-09-14 12:38:49:846 IBC: jts.ini: UseSSL=true
ib-gateway-1 | 2024-09-14 12:38:49:846 IBC: jts.ini: s3store=true
ib-gateway-1 | 2024-09-14 12:38:49:846 IBC: jts.ini:
ib-gateway-1 | 2024-09-14 12:38:49:846 IBC: jts.ini: [Communication]
ib-gateway-1 | 2024-09-14 12:38:49:876 IBC: Starting Gateway
ib-gateway-1 | 2024-09-14 12:38:52:700 IBC: Getting config dialog
ib-gateway-1 | 2024-09-14 12:38:52:700 IBC: Creating config dialog future
ib-gateway-1 | 2024-09-14 12:38:52:702 IBC: Getting main window
ib-gateway-1 | 2024-09-14 12:38:52:703 IBC: Creating main window future
ib-gateway-1 | 2024-09-14 12:38:54:894 IBC: detected frame entitled: IBKR Gateway; event=Opened
ib-gateway-1 | 2024-09-14 12:38:54:897 IBC: Login dialog WINDOW_OPENED: LoginState is LOGGED_OUT
ib-gateway-1 | 2024-09-14 12:38:54:899 IBC: trading mode from settings: tradingMode=paper
ib-gateway-1 | 2024-09-14 12:38:54:899 IBC: Setting Trading mode = paper
ib-gateway-1 | 2024-09-14 12:38:55:007 IBC: Setting user name
ib-gateway-1 | 2024-09-14 12:38:55:009 IBC: Setting password
ib-gateway-1 | 2024-09-14 12:38:55:011 IBC: Login attempt: 1
ib-gateway-1 | 2024-09-14 12:38:55:013 IBC: trading mode from settings: tradingMode=paper
ib-gateway-1 | 2024-09-14 12:38:55:037 IBC: detected frame entitled: IBKR Gateway; event=Activated
ib-gateway-1 | 2024-09-14 12:38:55:047 IBC: detected frame entitled: IBKR Gateway; event=Focused
ib-gateway-1 | 2024-09-14 12:38:55:050 IBC: Click button: Paper Log In
ib-gateway-1 | 2024-09-14 12:38:56:354 IBC: detected frame entitled: IBKR Gateway; event=Lost focus
ib-gateway-1 | 2024-09-14 12:38:56:355 IBC: detected frame entitled: IBKR Gateway; event=Deactivated
ib-gateway-1 | 2024-09-14 12:38:56:357 IBC: detected frame entitled: Loading...; event=Opened
ib-gateway-1 | 2024-09-14 12:38:56:360 IBC: Found Gateway main window
ib-gateway-1 | 2024-09-14 12:38:56:361 IBC: detected frame entitled: Loading...; event=Activated
ib-gateway-1 | 2024-09-14 12:38:56:365 IBC: Got main window from future
ib-gateway-1 | 2024-09-14 12:38:56:366 IBC: Invoking config dialog menu
ib-gateway-1 | 2024-09-14 12:38:56:382 IBC: detected frame entitled: Loading...; event=Focused
ib-gateway-1 | 2024-09-14 12:38:56:873 IBC: detected frame entitled: Authenticating...; event=Opened
ib-gateway-1 | 2024-09-14 12:38:57:046 IBC: detected frame entitled: Loading...; event=Lost focus
ib-gateway-1 | 2024-09-14 12:38:57:046 IBC: detected frame entitled: Loading...; event=Deactivated
ib-gateway-1 | 2024-09-14 12:38:57:047 IBC: detected frame entitled: Connecting to server...; event=Activated
ib-gateway-1 | 2024-09-14 12:38:57:049 IBC: detected frame entitled: Connecting to server...; event=Focused
ib-gateway-1 | LogModuleConfigurator-Init: Log4j Ver2.x found on classpath
ib-gateway-1 | LogModuleConfigurator-Init: LogModuleConfigurator initialized with Log4j Verd.x
ib-gateway-1 | 2024-09-14 12:39:05:929 IBC: detected frame entitled: Starting application...; event=Lost focus
ib-gateway-1 | 2024-09-14 12:39:06:078 IBC: detected frame entitled: Starting application...; event=Deactivated
ib-gateway-1 | 2024-09-14 12:39:06:079 IBC: detected dialog entitled: DU8169613 Trader Workstation Configuration (Simulated Trading); event=Activated
ib-gateway-1 | 2024-09-14 12:39:06:080 IBC: detected dialog entitled: DU8169613 Trader Workstation Configuration (Simulated Trading); event=Focused
ib-gateway-1 | 2024-09-14 12:39:06:080 IBC: detected dialog entitled: DU8169613 Trader Workstation Configuration (Simulated Trading); event=Opened
ib-gateway-1 | 2024-09-14 12:39:06:081 IBC: Got config dialog from future
ib-gateway-1 | 2024-09-14 12:39:06:082 IBC: detected dialog entitled: DU8169613 Trader Workstation Configuration (Simulated Trading); event=Lost focus
ib-gateway-1 | 2024-09-14 12:39:06:085 IBC: detected frame entitled: Starting application...; event=Closed
ib-gateway-1 | 2024-09-14 12:39:06:086 IBC: Login has completed
ib-gateway-1 | 2024-09-14 12:39:06:086 IBC: detected dialog entitled: Warning; event=Opened
ib-gateway-1 | 2024-09-14 12:39:06:089 IBC: Click button: I understand and accept
ib-gateway-1 | 2024-09-14 12:39:06:202 IBC: detected dialog entitled: DU8169613 Trader Workstation Configuration (Simulated Trading); event=Deactivated
ib-gateway-1 | 2024-09-14 12:39:06:202 IBC: detected dialog entitled: Warning; event=Activated
ib-gateway-1 | 2024-09-14 12:39:06:202 IBC: detected dialog entitled: Warning; event=Focused
ib-gateway-1 | 2024-09-14 12:39:06:266 IBC: Setting ReadOnlyApi
ib-gateway-1 | 2024-09-14 12:39:06:521 IBC: Read-Only API checkbox is now set to: false
ib-gateway-1 | 2024-09-14 12:39:06:632 IBC: Configuration tasks completed
ib-gateway-1 | 2024-09-14 12:39:06:633 IBC: Click button: OK
ib-gateway-1 | 2024-09-14 12:39:06:723 IBC: detected dialog entitled: Warning; event=Lost focus
ib-gateway-1 | 2024-09-14 12:39:06:723 IBC: detected dialog entitled: Warning; event=Deactivated
ib-gateway-1 | 2024-09-14 12:39:06:723 IBC: detected dialog entitled: Warning; event=Closed
ib-gateway-1 | 2024-09-14 12:39:06:749 IBC: detected dialog entitled: Pending Tasks; event=Closed
ib-gateway-1 | 2024-09-14 12:39:06:749 IBC: detected dialog entitled: DU8169613 Trader Workstation Configuration (Simulated Trading); event=Closed)

`

Possible Issue Identified by ChatGPT from the above log:

The automatic change of the TrustedIPs setting from 0.0.0.0 to 127.0.0.1,0.0.0.0 could be causing the gateway to only accept connections from localhost, blocking external requests.

ib-gateway-1 | 2024-09-14 12:38:49:840 IBC: Found setting: [IBGateway]/TrustedIPs=0.0.0.0: updating value to 127.0.0.1,0.0.0.0

The solutions I tried

Modified config.ini File: I adjusted the TrustedTwsApiClientIPs parameter in the stable/config/ibc/config.ini.tmpl file to ensure it was set to 0.0.0.0, allowing connections from all IPs.

`# Trusted API Client IPs
# ----------------------
# NB: THIS SETTING IS ONLY RELEVANT FOR THE GATEWAY, AND ONLY WHEN FIX=yes.
# In all other cases it is ignored.
#
# This is a list of IP addresses separated by commas. API clients with IP
# addresses in this list are able to connect to the API without Gateway
# generating the 'Incoming connection' popup.
#
# Note that 127.0.0.1 is always permitted to connect, so do not include it
# in this setting.

TrustedTwsApiClientIPs=0.0.0.0`

Updated jts.ini File: I also set TrustedIPs=0.0.0.0 in the stable/config/ibgateway/jts.ini.tmpl file to ensure the gateway is configured to accept external connections.

[IBGateway]
WriteDebug=false
TrustedIPs=0.0.0.0
ApiOnly=true

[Logon]
Locale=en
TimeZone=${TIME_ZONE}
displayedproxymsg=1
UseSSL=true
s3store=true

[Communication]

Can someone please help me? Thanks in advance

[gnzsnz]

I don't see anything wrong on the container, it build running and logged in. ports seems to be mapped correctly.

TrustedIPs AFAIK does not work, that's why socat is needed.

If you have a problem it must be between your code and your instance, the container is working fine. can you connect to VNC(after enabling it)?

[9834703848]

Hi, Thank you so much for your reply. Yes, I can connect to my container using VNC.

[9834703848]

I even tried GCP(Google cloud platform) but I am facing the same issue.

[9834703848]

Is my docker compose file correct?

`name: algo-trader
services:
ib-gateway:
restart: always
build:
context: ./latest
tags:
- "ghcr.io/gnzsnz/ib-gateway:latest"
image: ghcr.io/gnzsnz/ib-gateway:latest
environment:
TWS_USERID: ''
TWS_PASSWORD: ''
TRADING_MODE: paper
TWS_USERID_PAPER: ${TWS_USERID_PAPER:-}
TWS_PASSWORD_PAPER: ${TWS_PASSWORD_PAPER:-}
TWS_SETTINGS_PATH: ${TWS_SETTINGS_PATH:-}
TWS_ACCEPT_INCOMING: ${TWS_ACCEPT_INCOMING:-manual}
READ_ONLY_API: 'no'
VNC_SERVER_PASSWORD: "your_password" # Make sure to set the VNC password
TWOFA_TIMEOUT_ACTION: ${TWOFA_TIMEOUT_ACTION:-exit}
BYPASS_WARNING: ${BYPASS_WARNING:-}
AUTO_RESTART_TIME: ${AUTO_RESTART_TIME:-}
AUTO_LOGOFF_TIME: ${AUTO_LOGOFF_TIME:-}
TWS_COLD_RESTART: ${TWS_COLD_RESTART:-}
SAVE_TWS_SETTINGS: ${SAVE_TWS_SETTINGS:-}
RELOGIN_AFTER_TWOFA_TIMEOUT: ${RELOGIN_AFTER_TWOFA_TIMEOUT:-no}
TWOFA_EXIT_INTERVAL: ${TWOFA_EXIT_INTERVAL:-60}
TWOFA_DEVICE: ${TWOFA_DEVICE:-}
EXISTING_SESSION_DETECTED_ACTION: ${EXISTING_SESSION_DETECTED_ACTION:-primary}
ALLOW_BLIND_TRADING: ${ALLOW_BLIND_TRADING:-no}
TIME_ZONE: ${TIME_ZONE:-Etc/UTC}
TZ: ${TIME_ZONE:-Etc/UTC}
CUSTOM_CONFIG: ${CUSTOM_CONFIG:-NO}
JAVA_HEAP_SIZE: ${JAVA_HEAP_SIZE:-}
SSH_TUNNEL: ${SSH_TUNNEL:-}
SSH_OPTIONS: ${SSH_OPTIONS:-}
SSH_ALIVE_INTERVAL: ${SSH_ALIVE_INTERVAL:-}
SSH_ALIVE_COUNT: ${SSH_ALIVE_COUNT:-}
SSH_PASSPHRASE: ${SSH_PASSPHRASE:-}
SSH_REMOTE_PORT: ${SSH_REMOTE_PORT:-}
SSH_USER_TUNNEL: ${SSH_USER_TUNNEL:-}
SSH_RESTART: ${SSH_RESTART:-}
SSH_VNC_PORT: ${SSH_VNC_PORT:-}
ports:
- "4002:4002" # Mapping internal container port 4002 to host 4002
# Port for VNC server

# Uncomment and adjust these volumes as needed
#    volumes:
#      - ${PWD}/jts.ini:/home/ibgateway/Jts/jts.ini
#      - ${PWD}/config.ini:/home/ibgateway/ibc/config.ini
#      - ${PWD}/tws_settings/:${TWS_SETTINGS_PATH:-/home/ibgateway/Jts}
#      - ${PWD}/ssh/:/home/ibgateway/.ssh`

Thank you so much for your time.

[9834703848]

If it helps my code to connect to the `ibgateaway

from ib_insync import * ib = IB() ib.connect('34.44.19.163', 4002, clientId=1)

Error logs

`(ibkr) C:\shri_code\IBKR>python main.py
[WinError 64] The specified network name is no longer available
API connection failed: TimeoutError()
Traceback (most recent call last):
File "C:\Users\madde\anaconda3\envs\ibkr\lib\asyncio\tasks.py", line 688, in _wrap_awaitable
return (yield from awaitable.await())
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\madde\anaconda3\envs\ibkr\lib\asyncio\tasks.py", line 490, in wait_for
return fut.result()
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\shri_code\IBKR\main.py", line 5, in
ib.connect('34.44.19.163', 4002, clientId=1)
File "C:\Users\madde\anaconda3\envs\ibkr\lib\site-packages\ib_insync\ib.py", line 279, in connect
return self._run(self.connectAsync(
File "C:\Users\madde\anaconda3\envs\ibkr\lib\site-packages\ib_insync\ib.py", line 318, in _run
return util.run(*awaitables, timeout=self.RequestTimeout)
File "C:\Users\madde\anaconda3\envs\ibkr\lib\site-packages\ib_insync\util.py", line 341, in run
result = loop.run_until_complete(task)
File "C:\Users\madde\anaconda3\envs\ibkr\lib\asyncio\base_events.py", line 647, in run_until_complete
return future.result()
File "C:\Users\madde\anaconda3\envs\ibkr\lib\site-packages\ib_insync\ib.py", line 1748, in connectAsync
await self.client.connectAsync(host, port, clientId, timeout)
File "C:\Users\madde\anaconda3\envs\ibkr\lib\site-packages\ib_insync\client.py", line 217, in connectAsync
await asyncio.wait_for(self.apiStart, timeout)
File "C:\Users\madde\anaconda3\envs\ibkr\lib\asyncio\tasks.py", line 492, in wait_for
raise exceptions.TimeoutError() from exc
asyncio.exceptions.TimeoutError`

[gnzsnz]

Please don't take me wrong. What you are doing is not sound from a security stand point

Please read this https://github.com/gnzsnz/ib-gateway-docker?tab=readme-ov-file#security-considerations

[9834703848]

Thank you so much for your reply, I am able to figure out my problem, I used the ssh tunnel to connect to my running ib-gateway on the gcp.