Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Population-Density: Unable to download #32

Closed
Rikuoja opened this issue Jun 10, 2021 · 4 comments
Closed

Population-Density: Unable to download #32

Rikuoja opened this issue Jun 10, 2021 · 4 comments
Labels
bug Something isn't working pipeline/population-density Issues related to the population-density pipeline pipeline Issues related to pipelines

Comments

@Rikuoja
Copy link

Rikuoja commented Jun 10, 2021

Hello everybody, and thanks for creating a promising new tool! In the process of benchmarking such tools right now, just a quick tryout out of the box resulted in this issue

[z] IT - Italy
[0] Next page

Please select a country! [1...9, a...z, 0]: 2
Downloading data for Finland
Error: No data available for FIN
    at /opt/app/src/utils/countryPicker/index.js:19:17
    at new Promise (<anonymous>)
    at downloadFiles (/opt/app/src/utils/countryPicker/index.js:7:12)
    at /opt/app/src/utils/countryPicker/index.js:86:23
    at new Promise (<anonymous>)
    at Object.pick (/opt/app/src/utils/countryPicker/index.js:41:12)
    at /opt/app/src/data/processor/index.js:101:49
    at new Promise (<anonymous>)
    at Object.start (/opt/app/src/data/processor/index.js:99:12)
    at /opt/app/src/data/main.js:43:41
    at processTicksAndRejections (node:internal/process/task_queues:96:5)

The problem was mentioned in #23 (comment) , but that PR is already merged, so apparently it didn't resolve the issue for all users.

@Rikuoja Rikuoja changed the title Population-density: Unable to download Population-Density: Unable to download Jun 10, 2021
@mattigrthr
Copy link
Contributor

Hi @Rikuoja, thanks for posting this issue. I see that you tried to download the data for Finland. Unfortunately, there are still some countries that Facebook doesn't cover yet with their project. For Sweden, we know, for example, that due to the high latitude, the satellite image distortion posed a challenge in the beginning. Also, too cloudy satellite images have an impact. I guess it's a similar case with Finland. However, Facebook actively improves its coverage. They told us that they are about to release data for Sweden (and hopefully also Finland). They have an RSS feed you can follow to get the updates.

Nevertheless, I do get that it's a bad user experience to receive this error. We listed all countries using the i18n-iso-countries npm package. But we could use the AWS CLI to only list countries where data is available. I will create a separate issue for that. In the meantime, you can list the available countries in your terminal if you have the AWS CLI installed, running the following command:

aws s3 ls --no-sign-request s3://dataforgood-fb-data/csv/month=2019-06/

To test it out quickly, you can pick a small country like Malta.

@mattigrthr mattigrthr added bug Something isn't working pipeline Issues related to pipelines pipeline/population-density Issues related to the population-density pipeline labels Jun 10, 2021
@Rikuoja
Copy link
Author

Rikuoja commented Jun 11, 2021

@mattigrthr Thanks for the quick answer! Good to know that this is actually a real error, i.e. the reason I am not getting data from Finland is only that the data is not available yet :D I was afraid there was something else wrong.

@mattigrthr
Copy link
Contributor

Any time! I hope you can still do some tests with other countries as well. I'm going to close this issue and open a new one for the UX of this, as mentioned before.

@mattigrthr
Copy link
Contributor

The issue regarding the UX is #34

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working pipeline/population-density Issues related to the population-density pipeline pipeline Issues related to pipelines
Projects
None yet
Development

No branches or pull requests

2 participants