Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[OSPP 2024] optimize image by prefetch analysis #1589

Open
imeoer opened this issue Jun 18, 2024 · 0 comments
Open

[OSPP 2024] optimize image by prefetch analysis #1589

imeoer opened this issue Jun 18, 2024 · 0 comments

Comments

@imeoer
Copy link
Collaborator

imeoer commented Jun 18, 2024

We can statically analyze the image entrypoint dependency, or use runtime dynamic analysis technologies such as ebpf, fanotify, metric, etc. to obtain the container file access pattern, and then build this part of data into an independent image layer:

  • preferentially fetch blob during the image startup phase to reduce network and disk IO.
  • avoid frequent image builds, allows for better local cache utilization.

Possible implementation steps:

  • follow the doc to get an accessed files list for a OCI / nydus image.
  • implement cat accessed-files.txt | nydusify optimize --policy separated-prefetch-blob --target $existed-nydus-image --output $new-nydus-image to generate a new image, which references a new blob included prefetch file chunks.
@imeoer imeoer changed the title [OSPP 2024] improve image build for prefetch [OSPP 2024] optimize image by prefetch analysis Jun 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant