Questions tagged [deepmind]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
0answers
28 views

Is the “training loop” used in AlphaGo Zero the same as an “epoch”?

I am confused about the training stage of AlphaGo Zero using the data collected from the selfplay stage. According to an AlphaGo Zero Cheat Sheet I found, the training routine is: Loop from 1 to 1,...
2
votes
2answers
232 views

What does scaling a gradient do?

In the MuZero paper pseudocode, they have the following line of code: hidden_state = tf.scale_gradient(hidden_state, 0.5) What does this do? Why is it there? I'...
1
vote
1answer
184 views

AlphaGo Zero loss function

As far as I understood from the AlphaGo Zero system: During the self-play part, the MCTS algorithm stores a tuple ($s$, $\pi$, $z$) where $s$ is the state, $\pi$ is the distribution probability over ...
1
vote
0answers
25 views

temperature variable in boltzmmann-exploration in reinforcement learning

I have been using epsilon greedy action selection strategy and recently have come across boltzmann(softmax) action selection strategy. One thing I am not clear about boltzmann exploration is the ...
2
votes
1answer
516 views

DQN fails to find optimal policy

Based on DeepMind publication, I've recreated the environment and I am trying to make the DQN find and converge to an optimal policy. The task of an agent is to learn how to sustainably collect apples ...
3
votes
1answer
140 views

Game theory in Reinforcement Learning

In one of the recent blog post by Deepmind, they have used game theory in Alpha Star algorithm. Deep Mind Alpha-Star: Mastering this problem requires breakthroughs in several AI research challenges ...
3
votes
0answers
599 views

Deep Reinforcement Learning for dynamic pricing

I am trying to implement a Deep Q Network model for Dynamic pricing in Logistics. I can define State Space (Origin, Destination, type of the shipment, customer, Type of the product, Commodity of the ...
1
vote
0answers
82 views

Deepmind conditional neural process: evaluation

Going through the Deepmind jupyter notebook conditional neural processes, the plots at the bottom of the notebook show that the ground truth and the predicted distribution only overlap around the "...