Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Substitute Phase1 csv steps for direct R read with pajengr #10

Open
llnns opened this issue Dec 5, 2019 · 1 comment
Open

Substitute Phase1 csv steps for direct R read with pajengr #10

llnns opened this issue Dec 5, 2019 · 1 comment

Comments

@llnns
Copy link
Collaborator

llnns commented Dec 5, 2019

After the paje sort, the following steps occur:
Use of pajeng to generate csv files.
Use of individual greps to split different Nature data.
Use of read_csv to read these files on R.

These three steps could be substituted by the use of pajengr.

@schnorr
Copy link
Owner

schnorr commented May 12, 2020

Problem is that in its current version, the pajengr package do not have support for --out-of-core capability of pj_dump, which basically means pajengr will load the whole trace in memory before returning. This is unfit for large traces.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants