Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP - DataFrames refactoring #612

Draft
wants to merge 12 commits into
base: main
Choose a base branch
from
Draft

WIP - DataFrames refactoring #612

wants to merge 12 commits into from

Commits on Apr 30, 2024

  1. Refactor io into reading and processing and create table tree structure 

    The function to create graph et al from a csv folder has been split into
two functions. The first reads the csv folder into a new TableTree
structure. The second processes the TableTree structure into graph et
al.
    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    fb06f11 View commit details
    Browse the repository at this point in the history

  2. Create constraints partitions as DataFrames 

    Creates compute_constraints_partitions functions to use TableTree to
build the partitions of the constraints. This is done in two parts.

First, we create unrolled partitions, which will substitute the
individual partitions vectors stores in the graphs.

Second, we build constraints partitions still using
compute_rp_partitions, but using only DataFrames. The result is also
stored in a DataFrame, which should also serve as the final DataFrame to
be used instead of energy_problem.dataframes.
    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    95f158b View commit details
    Browse the repository at this point in the history

  3. storage_level_inter_rp in dataframes

    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    f104193 View commit details
    Browse the repository at this point in the history

  4. Rename constrains in table_tree to variables_and_constraints

    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    ee0cd4a View commit details
    Browse the repository at this point in the history

  5. Replace EnergyProblem's dataframes with TableTree variables_and_const… 

    …raints
    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    fbac424 View commit details
    Browse the repository at this point in the history

  6. Remove old constraints_partitions

    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    9277078 View commit details
    Browse the repository at this point in the history

  7. Delete leftover code from early attempts

    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    4c33d9b View commit details
    Browse the repository at this point in the history

  8. Rename compute_constraints_partitions to compute_variable_and_constra… 

    …ints_dataframes
    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    07b3ed1 View commit details
    Browse the repository at this point in the history

  9. Move variables and constraints dataframes creation

    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    e82ffe9 View commit details
    Browse the repository at this point in the history

  10. Improvement to filtering

    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    15c09cb View commit details
    Browse the repository at this point in the history

  11. Remove partitions information from graph

    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    914d59b View commit details
    Browse the repository at this point in the history

  12. Update profiling

    @abelsiqueira
    abelsiqueira committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    1ac6ef4 View commit details
    Browse the repository at this point in the history