Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 1330

Statistics is a scientific approach to inductive inference and prediction based on probabilistic models of the data. By extension, it covers the design of experiments and surveys to gather data for this purpose.

1 vote

scipy fit for t distribution seems broken for bi-modal data

The t-test has many assumptions. That dataset violates several of them: Data should be sufficiently large (>30 independent points) Data should be approximately normally distributed Given that the …
Brian Spiering's user avatar
0 votes

How do you pool data cross subjects?

One approach is analysis of variance (ANOVA) which is a framework for analyzing mean differences while controlling for those effects. Typically a mixed-effect model is applied that handles experimenta …
Brian Spiering's user avatar
0 votes

A/B testing with non-Gaussian distributions

One option is a permutation test. A permutation does not make any assumptions about the distribution of the data and allows for testing maximum change. For a permutation test, you randomly assign da …
Brian Spiering's user avatar
1 vote

Approaches to choosing number of bins in histogram

Another method is Bayesian Blocks from Studies in Astronomical Time Series Analysis. VI. Bayesian Block Representations by Scargle et al. Bayesian Blocks is a dynamic histogramming method which optim …
Brian Spiering's user avatar
0 votes

How to manage survivorship bias in conversion metrics?

One way to approach is the model conversion is survival analysis. In this case, time-to-event would be how many ads until they convert.
Brian Spiering's user avatar
0 votes

Problem with Median Absolute Deviation

If 50% or more of the values in a sample are identical, you'll have to switch to alternative method from MAD or drop values. "Alternatives to the Median Absolute Deviation" paper by Rousseeuw and Crou …
Brian Spiering's user avatar
0 votes

How to compute the size of a significant sample for manual validation in classification?

The unlabeled data will have to be labeled to calculate accuracy. How much data to label is an empirical question. Here are questions to answer to help guide that process: How close is the distributi …
Brian Spiering's user avatar
1 vote

How can I test the relationship between events and categorical data

One option is constructing a contingency table, aka crosstab, which displays the frequency distribution of categorical variables. From a contingency table, different measures of association can be fou …
Brian Spiering's user avatar
2 votes
Accepted

Normal distribution and QQ plot

The normal distribution is a theoretical model of data. Empirical data can be distributed more similarily or more dissimilarly to a normal distribution. That empirical data has a couple of notable di …
Brian Spiering's user avatar
2 votes

Best practice and starting point for designing a decomposable score metric

That is commonly called an index, an accumulation of scores from a variety of individual items. Creating indexes is very common in economic and financial fields (e.g., Consumer Purchasing Index and St …
Brian Spiering's user avatar
1 vote

Statistical inference on a very small datasets

There are two separate issues: Sampling - Picking the optional ingredient level for next experiment to run. Given you have only have 4 explanatory variables, just plot them. Either all pairwise or …
Brian Spiering's user avatar
1 vote
Accepted

Show distribution of users affected by outlier response times

One option would be look at conditional probability based on percentiles. First, find percentiles based on all the data. For example, 99th percentile is 1432 milliseconds. Then, find percent of a spec …
Brian Spiering's user avatar
0 votes

Showing standard deviation for training curve

One option is to plot fewer epochs. There is no useful information after 20 epochs because training and validation performance are the same after that point.
Brian Spiering's user avatar
0 votes

Suitable modelling approach to incorporate different signals

Combing multiple models together is called typically ensembling. You are describing hierarchical ensembling. There are simpler methods for ensembling, such as voting and weighted voting.
Brian Spiering's user avatar
1 vote
Accepted

What is the best way to cluster this kind of data?

In hierarchical clustering, both agglomerative and divisive, you do not have to pre-specify the number of clusters. You can create all possible clusters and then select the number cluster to use at th …
Brian Spiering's user avatar

15 30 50 per page