Questions tagged [monte-carlo]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
21 views

How to formulate reward of an rl agent with two objectives

I have started learning reinforcement learning and trying to apply it for my use case. I am developing an rl agent which can maintain temperature at a particular value, and minimize the energy ...
2
votes
0answers
47 views

MCMC for finding Bayesian Neural Network

Is someone familiar with such an approach: Suppose I want to build a bayesian neural network, with distributions over my parameters instead of point estimates. First I train my network with standard ...
5
votes
1answer
121 views

Estimating the value of $\pi$ with a Monte Carlo dartboard: $<$ or $\leq$?

I'm trying to figure out which is the proper way to estimate $\pi$ using the Monte Carlo method randomly distributing points in a square that also contains an inscribed circle. Some sources say to ...
0
votes
0answers
16 views

Deep learning book: question about mixing of MCMC

I am reading the Deep learning book from Ian Goodfellow, etc. My question is about the example in section 17.5 The challenge of mixing between Seperated Modes. As a simple exampl, consider an energy-...
0
votes
0answers
12 views

is it possible to run a Monte Carlo simulation with a single sample? I guess not

I am learning data science through a series of HarvardX courses. to elaborate Sample Correlation, the professor assumes A less fortunate geneticist can only afford to take a random sample of 25 ...
1
vote
1answer
26 views

What is the intuition behind using Monte Carlo to solve a differential equation

Conceptually, I understand how a numerical method like Monte Carlo is used to solve a definite integral. Because integral of a function is the area bounded by the curve, the ratio of random points ...
1
vote
1answer
36 views

Evaluating value functions in RL

I'm working my way through the book Reinforcement Learning by Richar S. Sutton and Andrew G. Barto and I am stuck on the following question. The value of a state depends on the the values of the ...
0
votes
0answers
39 views

Organizing Results of a simulation (MC) in Pandas

I am running a simulation and finding a rank for several different products with each simulation. So for each simulation I will get a pandas dataframe looking something like this (my real example is ...
0
votes
0answers
13 views

sample n unique items from dataset

I have a dataset that has N of different unique items and each item appears Ai times (every item appears different times). This is mean that I have the ...
1
vote
1answer
65 views

Why not use max(returns) instead of average(returns) in off-policy Monte Carlo control?

As I understand it, in reinforcement learning, off-policy Monte Carlo control is when the state-action value function $Q(s,a)$ is estimated as a weighted average of the observed returns. However, in ...
0
votes
1answer
15 views

In first visit monte carlo are we assuming the environment is the same over episodes?

Watching this video (11:30) that presents the simplest algorithm for reinforcement learning: Monte Carlo Policy Evaluation, which says in general: The first time a sate is visited: increment N(s): N(...
1
vote
1answer
140 views

How is Importance-Sampling Used in Off-Policy Monte Carlo Prediction?

In the section, "Off-Policy Prediction via Importance Sampling", found in the chapter on monte carlo methods of the second edition of Sutton and Barto's, "Reinforcement Learning: An Introduction", the ...
1
vote
0answers
154 views

How to use pymc3 to sample the mean of a Pareto random variable?

I Have a variable which is Pareto-ly distributed 'x', with unknown alpha and m. I want to find out the distribution of its mean, so I use the following model: ...
-1
votes
1answer
897 views

Parameter estimation for a model with multiple input parameters

So I've this model that simulates an ecosystem and outputs its attributes, like its chemistry, temperature etc. There are lots of input parameters to the model. My job is to write a program to figure ...
3
votes
1answer
691 views

What visualization I should choose for Monte Carlo simulations in timeline events?

I wasn't sure if I should open this question in Cross Validated or here. But since the question belongs to a bigger project related with Data Science, I chose this one. I will present a simplified ...