Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature(pu): add Sampled AlphaZero #76

Closed
wants to merge 47 commits into from
Closed

feature(pu): add Sampled AlphaZero #76

wants to merge 47 commits into from

Conversation

puyuan1996
Copy link
Collaborator

  • add sampled alphazero

@puyuan1996
feature(pu): add init league version of alphazero config and collecto…
1d43e5e 
…r for tictactoe and gomoku
@puyuan1996
sync code
473cfd6
@puyuan1996
fix(pu): fix eval_episode_return in self_play_mode
7355fc8
@puyuan1996
feature(pu): add rule_bot as the fist init historical_player in league
9502336
@puyuan1996
fix(pu): fix gomoku_rule_bot_v0
0897677
@puyuan1996
Merge branch 'main' of https://github.com/opendilab/LightZero into de…
43e3abf 
…v-league
@puyuan1996
Merge branch 'main' of https://github.com/opendilab/LightZero into de…
8d6490a 
…v-league
@puyuan1996
feature(pu): add snapshot_the_player_in_iter_zero and one_phase_step …
71d6eac 
…option, fix norm_type in az prediction net, fix temperature in az_league
@puyuan1996
fix(pu): only use the main_player transitions to tran main_player, po…
52b5d8c 
…lish league config
@puyuan1996
fix(pu): fix save transitions in battle_alphazero_collector
31376c6
@puyuan1996
fix(pu): fix new_data bug
0d38129
@puyuan1996
polish(pu): polish league config
cc3be43
@puyuan1996
Merge branch 'main' of https://github.com/opendilab/LightZero into de…
aed4f30 
…v-league
@puyuan1996
polish(pu): polish gomoku_alphazero_league_config
36ecf62
@puyuan1996
polish(pu): polish gomoku eval render
5dfa97c
@puyuan1996
feature(pu): add init version of go env and related alphazero sp config
73c18fd
@puyuan1996
feature(pu): add init version of go muzero config
aa41a55
@puyuan1996
poliah(pu): polish go alphazero/muzero configs
e10e849
@puyuan1996
feature(pu): add eval_go_mcts_bot_speed_win-rate.py, polish test_go_m…
b0509d4 
…cts_bot.py
@puyuan1996
feature(pu): add init versio of katago pure policy based bot (without…
689e1c7 
… mcts)
@puyuan1996
Merge branch 'main' of https://github.com/opendilab/LightZero into de…
34025e7 
…v-league
@puyuan1996
Merge branch 'dev-league' into dev-go-league
c9359a3
@puyuan1996
polish(pu): polish katago_policy, polish test_katago_bot, fix go_env …
51df0d5 
…reward bug
@puyuan1996
fix(pu): fix katago_policy cuda bug
5b68ba9
@puyuan1996
polish(pu): polish katago_policy init
b975913
@puyuan1996
polish katago python import
2349e28
@puyuan1996
Merge branch 'dev-go' into dev-go-league
2e62926
@puyuan1996
feature(pu): add alphazero ctree init version
d6083e4
@puyuan1996
feature(pu): add init version of alphazero ctree
0f4803c
@puyuan1996
polish(pu): ignore build directory
6ef40bd
@puyuan1996
feature(pu): add go_bot_policy_v0 and ao_alphazero_league_config, pol…
db6cca1 
…ish the update of katago_game_state
@puyuan1996
fix(pu): fix simulate_env_copy.battle_mode and polish softmax in mcts…
5372979 
…_alphazero.cpp
@puyuan1996
fix(pu): add reset_katago_game_state() method in go_env reset()
aec6805
@puyuan1996
polish(pu): polish visit_count_to_action_dist method, polish reset_ka…
bfeeaf5 
…tago_game_state, polish go_alphazero_league_config
@puyuan1996
sync code
d965be2
@puyuan1996
polish(pu): optimize the get_next_action method by replacing the deep…
3adc32b 
…copy operation on the env object with env.reset().
@puyuan1996
sync code
a696efd
@puyuan1996
Merge branch 'main' of https://github.com/opendilab/LightZero into de…
5138dfa 
…v-go-league-polish-copy
@puyuan1996
fix(pu): use would_be_suicide check in katago legal_action, fix Katag…
6bccaeb 
…oPolicy pos_len
@puyuan1996
feature(pu): add get_katago_statistics_for_dataset method
bca67bc
@puyuan1996
polish(pu): polish get_katago_statistics_for_dataset
475df17
@puyuan1996
fix(pu): fix katago game state reset bug
7e6a3f1
@puyuan1996
feature(pu): add the first version of sampled alphazero with ptree
c52b3cd
@puyuan1996
sync code
629f3ff
@puyuan1996
fix(pu): fix _calculate_policy_loss_disc in saz
b30d0ba
@puyuan1996
sync code
d78927d
@puyuan1996
Merge branch 'main' of https://github.com/opendilab/LightZero into de…
04bd426 
…v-az-sampled
@puyuan1996 puyuan1996 added enhancement New feature or request algorithm New algorithm config New or improved configuration labels Aug 22, 2023
@puyuan1996 puyuan1996 changed the title feature(pu): add sampled alphazero feature(pu): add Sampled AlphaZero Aug 22, 2023
@puyuan1996
Copy link
Collaborator Author

For clarity and conciseness, we have split the current PR into two separate PRs: #141 and #142.

@puyuan1996 puyuan1996 closed this Nov 13, 2023
@puyuan1996 puyuan1996 deleted the dev-az-sampled branch June 24, 2024 10:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
algorithm New algorithm config New or improved configuration enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@puyuan1996