VedantDave/Curiosity
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Updating value model to be stochastic

Browse Source
This commit is contained in:
Vedant Dave 2023-03-31 19:12:46 +02:00
parent e6e11f90b7
commit 7c9e75030b
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
DPI/models.py
View File

@ -149,7 +149,8 @@ class ValueModel(nn.Module):
def forward(self, state): def forward(self, state):
value = self.value_model(state) value = self.value_model(state)
return value value_dist = torch.distributions.independent.Independent(torch.distributions.Normal(value, 1), 1)
return value_dist
class TransitionModel(nn.Module): class TransitionModel(nn.Module):