# Questions tagged [statistics]

Statistics is a scientific approach to inductive inference and prediction based on probabilistic models of the data. By extension, it covers the design of experiments and surveys to gather data for this purpose.

1,127 questions
Filter by
Sorted by
Tagged with
19 views

### Is there a measure to compare features on the basis of normality

I have a dataset of cars and it has many features including 'acceleration’, ‘horsepower’, and ‘mpg'. I am supposed to check which if these features is the most similar to a normal distribution, so I ...
4 views

### How to estimate the weights for a weighted average if not every weight is used in every example?

Say that you have a data set that contains $N$ examples. For each example, there are three main sections of important information. The first most important piece of information is the name of the ...
18 views

### statistical analysis of two data sets have different number of sampling

I have two datasets from my statistical fault analysis: one with 400 iterations and another with 500 iterations. Both datasets have the same maximum and minimum values, and some data points are ...
13 views

### Generate evenly space point geography along a linestring

I have the total number of poles in a location (a sample area) and the road geometry (linestring) of each road in the area. I can calculate the average distance between poles, I want to distribute ...
23 views

### How to calculate Pairwise Correlation Difference?

I was trying to implement the pairwise correlation difference (PCD) found in the following paper. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-020-00977-1 PCD measures the ...
41 views

### Very basic but how to understand data statistically for machine learning?

I’m trying to solidify my statistics so I really know how to use them in my analysis/models. However my concept of statistical testing gets completely messed up by context. I’m unsure defining exactly ...
15 views

### Alternative to partial dependence plots

In my understanding, to make the partial dependence plot, you select a feature of interest x and leave other features X unchanged, then for each example in the validation dataset you sample values in ...
15 views

### Standardizing my target vs not standardizing

I've heard from multiple sources that it depends on whether I should standardize or not. Most of the time, people would say it doesn't make sense to do so, some would say it's better if I standardize ...
11 views

### classification using simple relationships between time series data

I am looking to predict which courses are taught by which university professors at my school. More specifically, for each semester and professor I want to know the probability breakdown of which ...
1 vote
21 views

### Determining the start and stop of vehicle movement by GPS

There is a large fleet, slightly more than a million vehicles, which is constantly growing. Each vehicle sends GPS coordinates to the server, as well as events (ignition is on, door is open, parking ...
22 views

17 views

### Unclear point in outlier construction based on an heavy-tail distribution

The following is an example from a book (An Introduction to Pattern Recognition and Machine Learning by P. Fieguth, page 417) on random variables and random vectors. Please consider the following. ...
23 views

### Correlation in R between categorical and boolean variables

I want to use the data attached to see i there is correlation between a bootcamp that students attended and the job they end up getting. For example, does someone who attended a software engineering ...
40 views

### how to evaluate a model on our data when the model is imported from a library and thus not trained by us?

The company I work for has deployed a trained rule-based sentiment analyzer model vader to make predictions on customer's attitude. We import the model from nltk library directly, so we didn't train ...
19 views

### Approaches to dataset, whose elements have different size

I am working with a dataset where each elements is a square table of size m-by-n, where m (the number of rows) is the same for all the data points, while n (the number of columns) varies from tens to ...
30 views

### Is probabilities mean of predicted class (RandomForest) a consistent estimator of class recall?

I'm working on a classification problem in order to predict among 50 different classes. I'm using a Random Forest classifier and I'm using the predict_proba method ...
35 views

### How can we distinguish meta-analysis and statistical analysis?

The two terms are frequently used in statistical methods. I find that statistical reasoning/ theory support meta analysis. What is real relation between two terms? Help me to understand the two ...
13 views

### Bibliographic references on statistical analysis of classification results in machine learning

I am looking for a good must-have reference about statistical analysis of classification results in machine learning. What books do you recommend about it?
14 views

### Comparing multiple multivariate datasets

Take the two datasets below: default rate state age income asofdate 10 Texas 55 100,000 202309 14 Texas 35 97,000 202309 18 Texas 55 95,000 202308 22 Texas 35 95,000 202308 8 New York 21 55,000 ...
1 vote
81 views

### Which statistical procedure to use?

I'm new to Hypothesis testing. I can't really think of how to answer this - Five students take a test one year and another test the next year. Their overall grades(in %) are given below for the test-1 ...
371 views

### Parameter estimation in linear regression

Another test Q I couldn't answer - We have marks of students belonging to 3 sections - A,B,C and two genders - M & F. Which regression model will not be able to estimate all the parameters? 1 ) ...
39 views

### What is the distinction between clinical significance and statistical significance?

https://en.m.wikipedia.org/wiki/Clinical_significance The Link says "Jacobson-Truax is common method of calculating clinical significance. It involves calculating a Reliability Change Index (RCI)....
18 views

### How to detect a kick signal

Background: I am measuring the reflection signal from the pipe. First strong kick is called firing kick. The later small bumps ...
33 views

### Lack of imagination when creating projects

Whenever I find a set of data to carry out a project, I end up running out of ideas and don't know how to proceed with the project. I don't know how to proceed or what information to look for. How do ...
19 views

### Convert rank to percentage

If I have a series of counties ranked 1-95, 1 being the highest and 95 being the lowest and I want to convert that to percentage with 0 being the lowest and 100 being the highest. Would (1-(rank/95))*...
124 views

### What is a good metric for comparing a single value to a distribution?

I'd like to compare single values from one distribution to another distribution, effectively transforming the second distribution in such way, that its values reflect both datasets simultaneously, i.e....
47 views

### Creating well-separated bins

I want to distribute my hospital data into 4 tiers (bins) based on the score. Tier 1 (good hospitals) has the highest score and Tier 4 (not so good hospitals) has the lowest score. The tiers can be of ...
20 views

### A hypercube with side length 1 in d dimensions is defined to be the set of points

The Question: A hypercube with side length 1 in d dimensions is defined to be the set of points (x1, x2, ..., xd) such that for all j = 1, 2, ..., d. The boundary of the hypercube is defined to be ...
14 views

### Statistical aggregations for numerical features

Can someone explain why in a lot of machine learning competitions, many participants perform some statistical aggregations like mean and median aggregation for numerical features? How can this improve ...
39 views

### Statistical significance of classifier mean error rates

Given: Error rates of 3 classifier types (CT) of performing 10 times a 5-fold cross validation For each CT the mean error rate out of the 10*5=50 error rates is calculated Goal: Is the CT with the ...