Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to expose the default acquisition function being used by AxClient() #2411

Open
AndrewFalkowski opened this issue Apr 30, 2024 · 4 comments
Assignees
Labels
in progress question Further information is requested

Comments

@AndrewFalkowski
Copy link

I am wondering how to find the acquisition function being used in AxClient() with the Service API when it isn't specified manually? I'm sure its buried among the attributes somewhere, but I wasn't able to find it among the options in AxClient()._generation_strategy. Thanks in advance!

@AndrewFalkowski AndrewFalkowski changed the title How to expose the default acquisition function being used by ax_client() How to expose the default acquisition function being used by AxClient() Apr 30, 2024
@sgbaird
Copy link
Contributor

sgbaird commented May 1, 2024

On a related note, it might be nice to expose the specific model as a default INFO message. As-is, it outputs something like "Sobol + Botorch" which doesn't clarify e.g., use of (noisy) GPEI for single-objective optimization. Likewise for NEHVI in the multi-objective case.

@mgarrard mgarrard self-assigned this May 6, 2024
@mgarrard mgarrard added in progress question Further information is requested labels May 6, 2024
@mgarrard
Copy link
Contributor

mgarrard commented May 6, 2024

Hi @AndrewFalkowski - i'll put up a PR to expose the acquisition function as a property on GS, and once i find the keying sequence will paste it here for you as a workaround.

@sgbaird thanks for the request - we are actually trying to work on reducing our logs so that folks don't get overwhelmed and then read none of the log information. Could you describe a time when this would have been helpful -- trying to see if there is a workaround that isn't a log but instead something else we could expose instead :)

@sgbaird
Copy link
Contributor

sgbaird commented May 7, 2024

Hi @mgarrard, thanks for the prompt response! The use case may be somewhat niche. When using https://honegumi.readthedocs.io/, we want users to be able to know what is being used by default under the hood. In particular, we're changing the model row so that it says "Default" instead of GPEI, since, depending on the other rows selected the "default" model might be qNEHVI, etc. This came about while @AndrewFalkowski was creating some tutorial content and trying to describe what defaults were being chosen. Likewise, since we often are required to report details about the models we're using for publications, it's important to be able to access it.

In this instance, I'm not sure it would matter as much whether it's accessible via an attribute vs. contained in the logs so long as someone could find it relatively quickly. For example, the logs could be updated with short instructions for which attribute(s) to look at or link to docs or an issue.

The solution you described for @AndrewFalkowski is enough for us though.

@sgbaird
Copy link
Contributor

sgbaird commented May 24, 2024

@mgarrard any update on the workaround?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
in progress question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants