Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensemble docs #437

Merged

Conversation

amandarichardsonn
Copy link
Contributor

This Pr merges the Ensemble documentation into the feature branch

@amandarichardsonn amandarichardsonn marked this pull request as draft December 12, 2023 18:50
Copy link

codecov bot commented Dec 12, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (93b9ab2) 90.27% compared to head (7f603db) 90.47%.
Report is 10 commits behind head on smartsim-docs-refresh.

❗ Current head 7f603db differs from pull request most recent head d195a88. Consider uploading reports for the commit d195a88 to get more accurate results

Additional details and impacted files

Impacted file tree graph

@@                    Coverage Diff                    @@
##           smartsim-docs-refresh     #437      +/-   ##
=========================================================
+ Coverage                  90.27%   90.47%   +0.19%     
=========================================================
  Files                         60       60              
  Lines                       3857     3738     -119     
=========================================================
- Hits                        3482     3382     -100     
+ Misses                       375      356      -19     

see 10 files with indirect coverage changes

@amandarichardsonn amandarichardsonn marked this pull request as ready for review December 12, 2023 21:48
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated

Notice that `perm_strategy="step"` which means values of the `params` key will be
grouped into intervals and distributed across Ensemble members. Here there are two groups. Therefore,
the Ensemble will have two ``Model`` members.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had to read the code to be sure what step strategy did. Should we add a table to each strategy showing the expected groups?

doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated
------------------------------------------------------
In this example, we demonstrate how to instruct SmartSim to load
an in-memory ML model into the database at ensemble runtime. It's
important to note that in-memory ML models are supported for
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • "it's important to note..." could be a note/warning block

  • is it meant to say "in-memory ML models are supported for non-colo..." OR "in-memory ML models are supported ONLY for non-colo..."

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Could we just say "standard" instead of "non-colo"? It feels more readable to avoid the negation and just say what we mean.

The closing blurb says standard:

When the ensemble is started via ``Experiment.start()``, the ML model will be loaded to the standard orchestrator that is launched prior to the start of the ensemble.

doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated

In this integration, we provide the following details:

- `name`: "example_script" - key to store script under
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

typehints?

doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
Copy link
Contributor

@mellis13 mellis13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very small changes but otherwise I think we can merge soon. Thanks!

doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
doc/ensemble.rst Outdated Show resolved Hide resolved
Copy link
Contributor

@mellis13 mellis13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@amandarichardsonn amandarichardsonn merged commit 365442f into CrayLabs:smartsim-docs-refresh Jan 25, 2024
24 checks passed
@amandarichardsonn amandarichardsonn deleted the ensemble-docs branch January 25, 2024 17:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants