Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

milvus-backup failure for Azure Blob Storage Account #496

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

gifi-siby
Copy link
Contributor

@gifi-siby gifi-siby commented Jan 6, 2025

When I try to backup using azure, I am getting multiple errors.
Related issue: #446

PRs worked together are:
#494
#495

Signed-off-by: “gifi-siby” <gifi.s@ibm.com>
@sre-ci-robot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: gifi-siby

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@mergify mergify bot added the dco-passed label Jan 6, 2025
@gifi-siby gifi-siby changed the title milvus-backup faileure for Azure Blob Storage Account milvus-backup failure for Azure Blob Storage Account Jan 6, 2025
@huanghaoyuanhhy
Copy link
Collaborator

It seems that a pager created using NewListBlobsFlatPager should not perceive any hierarchical structure, as it is designed to return a flat list of blobs. I’m not entirely sure why this error is occurring, so could you provide more details?

@gifi-siby
Copy link
Contributor Author

The encountered issues are described in the issue raised #446 . I have also included the configurations I used. Could you please review them and let me know if any additional details are needed?

@huanghaoyuanhhy
Copy link
Collaborator

huanghaoyuanhhy commented Jan 9, 2025

We have a similar implementation for deletion on Azure, but I haven’t encountered any issues like this. Moreover, Milvus doesn’t seem to use hierarchical deletion either. This error might be caused by other reasons. The hierarchical deletion approach doesn’t align well with the flat data structure used by object storage systems like S3. Let me double-check and get back to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants