Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pass hyper params from client #21

Merged
merged 6 commits into from
May 13, 2024
Merged

Conversation

SamuelGabriel
Copy link
Collaborator

@SamuelGabriel SamuelGabriel commented May 4, 2024

Change Description

Brief (a few bullet points describing your changes, use full sentences and try to link lines in the code whenever needed)
In this PR, I start passing all arguments to the server. To make this simpler I removed the local tabpfn functionality for now but kept the main code s.t. we can easily re-enable it later on. This was simpler, because the local tabpfn has very different parameters from the server one.

DEPENDENCY: this PR depends on https://github.com/automl/tabpfn-server/pull/48/ to filter out the "model" kwarg

Standard Qs (leave questions that do not apply blank)

If you broke behavior: Please describe what behavior you broke and how you inform people to not get stuck trying to use the old behavior.

yes, i removed local

If you used new dependencies: Did you add them to requirements.txt?

no

Who did you ping on Mattermost to review your PR? Please ping that person again whenever you are ready for another review.
@liam-sbhoo @anshulg954 @davidotte


Please do not mark comments/conversations as resolved unless you are the assigned reviewer. This helps maintain clarity during the review process.

Copy link
Collaborator

@liam-sbhoo liam-sbhoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking great in overall!

Just some comments/questions:

  • regarding the model args, why not pop the model args in the client instead and keep the server untouched? Then we'll have one less change to make when we have the feature enabled.
  • can we add some test cases, concerning the presence of tabpfn_config? Just a very minimal safe guard to ensure that we take tabpfn_config

@SamuelGabriel
Copy link
Collaborator Author

SamuelGabriel commented May 6, 2024

Tests: yeah, good point. I will add a test ensuring the defaults are send.

"model" arg: at some point we will need this model arg anyways, as we will train new models and want users to be able to choose, so I thought why not now. I should make it backward compatible on the backend, though.
And a dependency this way around is not bad, right? We should always make sure that the server is updated first and backwards compatible, this way we can relatively easily make changes.

@SamuelGabriel
Copy link
Collaborator Author

i added a test and updated it to follow the new API. Can I merge @liam-sbhoo ?

@liam-sbhoo liam-sbhoo self-requested a review May 9, 2024 10:01
Copy link
Collaborator

@liam-sbhoo liam-sbhoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some issues on the validation_link.

tabpfn_client/prompt_agent.py Outdated Show resolved Hide resolved
@SamuelGabriel SamuelGabriel merged commit c4f25f0 into main May 13, 2024
1 check passed
@SamuelGabriel SamuelGabriel deleted the pass_params_from_client branch May 13, 2024 13:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants