Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read Multispectral data for Remote Sensing using LightlyDataset #1780

Open
imantha-das opened this issue Jan 13, 2025 · 1 comment
Open

Read Multispectral data for Remote Sensing using LightlyDataset #1780

imantha-das opened this issue Jan 13, 2025 · 1 comment

Comments

@imantha-das
Copy link

Not so much as an issue, but I am trying to use Self-Supervised Learning on a remote sensing dataset and wondering if there is a way to read Multispectral data which has beyond the 3 RGB Bands. The data I have compiled is from Sentinel2A and has 13 bands, so I believe that LightlyDataset cannot read these as they are loaded through PIL from what I understand.

Any idea how I can extend the LightlyDataset to more than the 3 RGB bands ?. Also if this is possible will it still cause issues with other functions such as transformations (e.g DinoTransforms) ?.
I am speculating here, but will things like color jitter or rotations be applicable in such cases.

@guarin
Copy link
Contributor

guarin commented Jan 13, 2025

Hi! I suggest to use TorchGeo for multispectral data. They have a example using SimCLR here: https://github.com/microsoft/torchgeo/blob/main/torchgeo/trainers/simclr.py I believe it is only needed for data loading/augmentations. The actual model implementation should not depend on the number of bands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants