Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Try to convert the dataset from ZIP to NPY directly #1

Open
rmorel opened this issue May 29, 2019 · 1 comment
Open

Try to convert the dataset from ZIP to NPY directly #1

rmorel opened this issue May 29, 2019 · 1 comment
Labels
enhancement New feature or request

Comments

@rmorel
Copy link
Owner

rmorel commented May 29, 2019

By converting the dataset from ZIP to NPY directly there's no need to load the whole file into memory. The NPY arrays are lazy loaded, so this may enable the program to work with datasets bigger than the available RAM.
@rmorel rmorel added the enhancement New feature or request label May 29, 2019
@rmorel
Copy link
Owner Author

rmorel commented Jun 1, 2019

The function should read a subset of named columns from the zipped database file (plain text GDB file from Oasis montaj)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@rmorel