Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP - DataFrames refactoring #612

Draft
wants to merge 12 commits into
base: main
Choose a base branch
from
Draft

Conversation

abelsiqueira
Copy link
Member

Describe the changes made in this pull request

List of related issues or pull requests

Closes #ISSUE_NUMBER

Collaboration confirmation

As a contributor I confirm

  • I read and followed the instructions in README.dev.md
  • The documentation is up to date with the changes introduced in this Pull Request (or NA)
  • Tests are passing
  • Lint is passing

@abelsiqueira abelsiqueira added the benchmark PR only - Run benchmark on PR label Apr 25, 2024
Copy link
Contributor

github-actions bot commented Apr 25, 2024

Benchmark Results

179f064... 1ac6ef4... 179f064.../1ac6ef440bc684...
energy_problem/create_model 0.108 ± 0.0045 h 0.109 ± 0.0061 h 0.989
energy_problem/input_and_constructor 15.7 ± 1 s 25.7 ± 0.036 s 0.61
time_to_load 2.65 ± 0.011 s 2.68 ± 0.029 s 0.988
179f064... 1ac6ef4... 179f064.../1ac6ef440bc684...
energy_problem/create_model 0.738 G allocs: 31 GB 0.738 G allocs: 30.7 GB 1.01
energy_problem/input_and_constructor 16.3 M allocs: 0.829 GB 16.5 M allocs: 2.08 GB 0.399
time_to_load 0.153 k allocs: 14.5 kB 0.153 k allocs: 14.5 kB 1

Benchmark Plots

A plot of the benchmark results have been uploaded as an artifact to the workflow run for this PR.
Go to "Actions"->"Benchmark a pull request"->[the most recent run]->"Artifacts" (at the bottom).

Copy link

codecov bot commented Apr 25, 2024

Codecov Report

Attention: Patch coverage is 92.20779% with 6 lines in your changes are missing coverage. Please review.

Project coverage is 99.05%. Comparing base (179f064) to head (1ac6ef4).

Files Patch % Lines
src/time-resolution.jl 86.66% 6 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##              main     #612      +/-   ##
===========================================
- Coverage   100.00%   99.05%   -0.95%     
===========================================
  Files           15       15              
  Lines          639      633       -6     
===========================================
- Hits           639      627      -12     
- Misses           0        6       +6     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@abelsiqueira abelsiqueira force-pushed the 611-construct-dataframes branch 2 times, most recently from e43d70a to 863f120 Compare April 30, 2024 09:53
The function to create graph et al from a csv folder has been split into
two functions. The first reads the csv folder into a new TableTree
structure. The second processes the TableTree structure into graph et
al.
Creates compute_constraints_partitions functions to use TableTree to
build the partitions of the constraints. This is done in two parts.

First, we create unrolled partitions, which will substitute the
individual partitions vectors stores in the graphs.

Second, we build constraints partitions still using
compute_rp_partitions, but using only DataFrames. The result is also
stored in a DataFrame, which should also serve as the final DataFrame to
be used instead of energy_problem.dataframes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
benchmark PR only - Run benchmark on PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant