Questions tagged [deepmind]

Google's DeepMind is an artificial intelligence company that works to conduct research and advance the state of the art in machine learning applications. Topics include, science, engineering, research, and ethics.

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

Unexpected keyword argument error in tensorflow-agents replay buffers

Following the tensorflow tutorial on deep reinforcement learning and DQN. Even after setting up the exact same libraries and running the same code, I am getting some error. ...
user avatar
  • 283
3 votes
1 answer
78 views

Question on embedding similarity / nearest neighbor methods [SCANN Paper]

Question on embedding similarity / nearest neighbor methods: In https://arxiv.org/abs/2112.04426 the DeepMind team writes: For a database of T elements, we can query the approximate nearest neighbors ...
user avatar
  • 2,390
2 votes
4 answers
1k views

Which AI algorithm is best for chess?

I'm working on my chess bot, and I would like to implement simple artificial intelligence for it. I'm new in it, so I'm unsure how to do it specifically on chess. I heard about Q-learning, Supervised/...
user avatar
  • 129
0 votes
1 answer
50 views

How to train a policy and a value network, implementing alphazero at chess

So, I'm trying to implement alphazero's logic on the game of chess. What I understand so far of the algorithm is: Load 2 models, one of which is the best model you have so far. Both these models have ...
user avatar
0 votes
0 answers
34 views

Why is stop-gradient used in Deep Mind's BYOL (Bootstrap Your Own Latent)?

I'm reading Grill's et al. paper regarding their self-supervised approach. I do not understand why the output of the target network is indicated as sg(z'ξ), rather then just (z'ξ), as would seem to ...
user avatar
  • 584
0 votes
1 answer
46 views

Any research on relationship between the dimensions of a (word2Vec) space and how the human mind constructs meaning (or reality) through language?

Neuroscience is still trying to "find" how the mind (and language) somehow "works". Is there any theory linking a (low-dimensionality) embedding space (like word2Vec) to a mind (...
user avatar
2 votes
1 answer
33 views

Which Policy Gradient Method was used by Google's Deep Mind to teach AI to walk

I just saw this video on Youtube. Which Policy Gradient method was used to train the AI to walk? Was it DDPG or D4PG or what?
user avatar
  • 23
1 vote
1 answer
38 views

On what principle did Google's DeepMind learn to walk?

I just saw this video on Youtube. On what principle did Google's DeepMind learn to walk? Was it Q-Learning or a Genetic Algorithm or Policy Gradient?
user avatar
  • 23
2 votes
1 answer
93 views

Is the "training loop" used in AlphaGo Zero the same as an "epoch"?

I am confused about the training stage of AlphaGo Zero using the data collected from the selfplay stage. According to an AlphaGo Zero Cheat Sheet I found, the training routine is: Loop from 1 to 1,...
user avatar
3 votes
2 answers
1k views

What does scaling a gradient do?

In the MuZero paper pseudocode, they have the following line of code: hidden_state = tf.scale_gradient(hidden_state, 0.5) What does this do? Why is it there? I'...
user avatar
  • 175
1 vote
1 answer
475 views

AlphaGo Zero loss function

As far as I understood from the AlphaGo Zero system: During the self-play part, the MCTS algorithm stores a tuple ($s$, $\pi$, $z$) where $s$ is the state, $\pi$ is the distribution probability over ...
user avatar
1 vote
0 answers
48 views

temperature variable in boltzmmann-exploration in reinforcement learning

I have been using epsilon greedy action selection strategy and recently have come across boltzmann(softmax) action selection strategy. One thing I am not clear about boltzmann exploration is the ...
user avatar
  • 515
3 votes
1 answer
904 views

DQN fails to find optimal policy

Based on DeepMind publication, I've recreated the environment and I am trying to make the DQN find and converge to an optimal policy. The task of an agent is to learn how to sustainably collect apples ...
user avatar
3 votes
1 answer
219 views

Game theory in Reinforcement Learning

In one of the recent blog post by Deepmind, they have used game theory in Alpha Star algorithm. Deep Mind Alpha-Star: Mastering this problem requires breakthroughs in several AI research challenges ...
user avatar
3 votes
0 answers
679 views

Deep Reinforcement Learning for dynamic pricing

I am trying to implement a Deep Q Network model for Dynamic pricing in Logistics. I can define State Space (Origin, Destination, type of the shipment, customer, Type of the product, Commodity of the ...
user avatar
1 vote
0 answers
99 views

Deepmind conditional neural process: evaluation

Going through the Deepmind jupyter notebook conditional neural processes, the plots at the bottom of the notebook show that the ground truth and the predicted distribution only overlap around the "...
user avatar
  • 203