Add stochastic muzero #78
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Added basic types.
Completed decision and chance recurrent functions.
ff_stochastic_mz.py running (see next steps below). mctx stochastic_muzero_policy working. Next steps to create: 1. The encoder model; 2. The stochastic muzero loss function.
|
Amazing, thanks so much for doing this. I will review the code and do the necessary modifications as soon as i can. It will most likely have to be after next week. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What?
Added minimal support to stochastic muzero by issue #77.
Why?
To be able to train stochastic environments like 2048, poker, ...
How?
Added Afterstate and Encoder models with configurations to be able to run it.
Only MLP models are created, not CNN.
Fixes necessary
And here:
The pseudocode too in the line 931
I don't know how to get the observation and to pass to the encoder in your code.
I don't know how to this in your code.