Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change iscsid login timeout #1846

Merged

Conversation

Akrog
Copy link
Contributor

@Akrog Akrog commented Jun 6, 2024

This patch changes the time to fail an iSCSI login request in our deployments.

The default is 8 retries and 15 seconds for each one, so 120 seconds in total.

This default timeout is too large for our purposes, because it's greater than the default HAProxy or Apache timeouts. This will create problems creating an image when Glance is using Cinder as a backend and one of the paths to the storage is down.

This patch changes the OpenShift cluster default to 3 retries and 5 seconds each (15 seconds in total), which is convenient for testing, as any healthy deployment and backend should be able to login to the backend in that amount of time, and if there is a broken path it will not take 2 minutes to give up, just around 15 seconds.

This PR together with setting the HAProxy timeouts to 60 seconds (openstack-k8s-operators/architecture#275) shoud allow to use multipathing when glance is using cinder as a backend and there are failing paths.

The testing of the change was done using the equivalent LVM+iSCSI sample change in the cinder-operator (openstack-k8s-operators/cinder-operator#397) deploying it with install_yamls.

As a pull request owner and reviewers, I checked that:

  • Appropriate testing is done and actually running
  • Appropriate documentation exists and/or is up-to-date:
    • README in the role
    • Content of the docs/source is reflecting the changes

Jira: https://issues.redhat.com/browse/OSPRH-7393
Jira: https://issues.redhat.com/browse/OSPRH-7415

This patch changes the time to fail an iSCSI login request in our
deployments.

The default is 8 retries and 15 seconds for each one, so 120 seconds in
total.

This default timeout is too large for our purposes, because it's greater
than the default HAProxy or Apache timeouts.  This will create problems
creating an image when Glance is using Cinder as a backend and one of
the paths to the storage is down.

This patch changes the OpenShift cluster default to 3 retries and 5
seconds each (15 seconds in total), which is convenient for testing, as
any healthy deployment and backend should be able to login to the
backend in that amount of time, and if there is a broken path it will
not take 2 minutes to give up, just around 15 seconds.

Jira: https://issues.redhat.com/browse/OSPRH-7393
Jira: https://issues.redhat.com/browse/OSPRH-7415
@github-actions github-actions bot marked this pull request as draft June 6, 2024 15:52
Copy link

github-actions bot commented Jun 6, 2024

Thanks for the PR! ❤️
I'm marking it as a draft, once your happy with it merging and the PR is passing CI, click the "Ready for review" button below.

@Akrog Akrog marked this pull request as ready for review June 7, 2024 08:46
@Akrog
Copy link
Contributor Author

Akrog commented Jun 7, 2024

recheck

Copy link
Contributor

@fmount fmount left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm label Jun 13, 2024
@fmount fmount requested review from rebtoor and pablintino June 13, 2024 08:34
@cjeanner
Copy link
Contributor

/approve

Copy link
Contributor

openshift-ci bot commented Jun 13, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cjeanner

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@fmount fmount requested a review from cjeanner June 13, 2024 08:37
@openshift-merge-bot openshift-merge-bot bot merged commit e444756 into openstack-k8s-operators:main Jun 13, 2024
7 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants