Questions tagged [statistics]

Statistics is a scientific approach to inductive inference and prediction based on probabilistic models of the data. By extension, it covers the design of experiments and surveys to gather data for this purpose.

Filter by
Sorted by
Tagged with
1
vote
0answers
14 views

I am not sure if I used the right hypotheses test or made the right conclusions, could you give me a feedback?

I have just finish a basic statistic course and I decided to apply what I learned in a small project using the wine quality dataset. I am not sure if what I did was correct, so if possible, I would ...
0
votes
0answers
9 views

Creating a popularity index from multivariate data

I have some data from an ecommerce website with features like product_name, product_category product_link, product_id, free_delivery(1 or 0), price, discount, avg_rating, number of reviews, ...
2
votes
0answers
9 views

Why GP posterior variance is the worst-case error?(exact proof)

I am reading this paper, which explains the connecting idea Gaussian Process and Kernel methods in detail. I am impressed by the insightful explanation in this paper, but am stuck on one part in ...
-1
votes
0answers
11 views

How would you find the average number of phone calls a day given the date, weekday, the hour, and total calls from the previous month? [closed]

How would you find the average number of phone calls a day using this type of data? I am trying to do this for the previous month. This is just part the data that is displayed here. I want to try to ...
1
vote
1answer
20 views

What is the difference between a hypothese teste made with a normal distribution and a one sample t-test? And When to use each one?

I am studying statistics on my own and I am not understanding when to use a one sample t test or a test with a normal distribution. As I understand, both are comparing a population mean with a sample ...
0
votes
0answers
16 views

Correlation between continuous variables and multi class categorical variables in python

I was trying to figure out a way of finding a correlation between continuous variables and a non-binary target categorical label. The only thing I though of is by fitting the labels into Multinomial ...
0
votes
0answers
5 views

Mutiple binary classification for for best propensity to buy one of the product

Problem:- I have 5 products for sell and I can pitch only one product in a month to one customer.so I wants to know which product customer can buy. Proposed solution:- I build 5 binary logistic models ...
0
votes
0answers
8 views

Bayesian interference - interpretation of results of two groups

I'm trying to understand Bayesian interference on example the comparison of two groups from this source. It's not all too clear about interpretation of some parameters in summary, like: mcse_mean ...
0
votes
0answers
10 views

How to find the lag that shows highest correlation between two time series variables?

I have two variables in my time series data (X1,X2). I need to find the correlation between these two variables at different lags and identify the lag that shows the highest correlation. For e.g. I ...
0
votes
1answer
20 views

How do I conduct an experiment on the new pricing if it's impossible to conduct an A/B test?

We want to introduce a new price list for the customers of our international SaaS company. Beforehand we want to test this new price list in several countries. A/B test cannot be conducted here ...
0
votes
0answers
8 views

Hypothesis testing using permutation test method, how to reverse of null hypothesis?

My goal is to prove two groups A,B comes from the same distribution therefore I could use A as control and B as experimental for ABtest. KPI is set to CTR(#clicks/#impressions). Therefore need to ...
0
votes
1answer
28 views

which statistical parameters are more useful to detect anomalies and outlier? mean max min var?

This time series contains some time frame which each of them are 8K (frequencies)*151 (time samples) in 0.5 sec [overall 1.2288 millions samples per half a second) I need to find anomalous based on ...
0
votes
0answers
13 views

Find part of the signal that causes most of the noise

We are given around 20 time series. Each one of them is how many products were sold every day (and they have different volume, different mean and std). The main goal is to predict the total sum of ...
1
vote
1answer
12 views

Exogeneous, Endogenous Variables in Structural Causal Model

https://en.wikipedia.org/wiki/Causal_model#Definition Wikpedia defines causal models as: an ordered triple $\langle U, V, E\rangle$, where $U$ is a set of exogenous variables whose values are ...
0
votes
0answers
5 views

How to model multinomail logistic regression to get desired outcome?

I want to run multinomial logistic regression in SPSS. Dependent variable: Code=0 Cognitively normal(CN) Code=1 Mild cognitive normal(MCI) Code=3 Alzheimer’s(AD) Independent variable: Genotype.1=0 ...
0
votes
0answers
8 views

Causal Network Graph

I've been reading this blog (https://deepmind.com/blog/article/Causal_Bayesian_Networks) and am just getting into Causal inference. I have a question regarding causal network graphs. Let's say given ...
3
votes
1answer
25 views

How to generate synthetic text for LDA?

I am wanting to play around with LDA topic modelling, namely looking at the effects of document length, topic number etc all have on accuracy (I know it has been done elsewhere, but no one seems to ...
0
votes
0answers
36 views

How to quantify the influence of multiple variables on a time series data

I have three variables in my time series data ($X_1,X_2,X_3$). I then calculate $y = (X_1+X_2)-X_3$ for each time $t$. Now, I need to look at a time interval and come up with a quantitative measure ...
0
votes
0answers
11 views

Sales predictability based on date (Python)

I need to get statistics on how predictable are the sales of shopping centers based on the date of sales - is there a strong link between sales date and the sales 7 days ago. The data I have is the id ...
0
votes
0answers
6 views

Building User Affinity Scores - How To Deal With Data Skew?

I am trying to build some content affinity scoring for categorized content of a site. My current strategy is to count all of the category "hits" a subscriber has had over a window of time (...
0
votes
0answers
7 views

Approach for analyzing marketing campaign

Consider my users has to do "Action A" at their own pace to be able to continue using our service. Then, we run a campaign to push the user to do "Action A" at a quicker pace by ...
2
votes
1answer
10 views

How do I evaluate two classifies, one of which further classifies one of the previous category?

I am training a classifier (e.g, animals), and since many categories are too similar (e.g., insects), I am grouping some categories together (e.g., bugs and mosquitoes as insects). Then, I will train ...
1
vote
1answer
51 views

When is it meaningful to use ML on data without statistical statistical significance

I have a dataset with three columns, the number of days behind or ahead of the deadline a project was completed, the name of the department whose project it was and a user number for the employee. The ...
0
votes
0answers
18 views

Which is better KL- Divergence or Bhattacharya(Hellinger) Distance

I'm beginner in probability and statistics. I came across the concept of comparing two probability distributions. KL-Divergence and Bhattacharya(Hellinger) Distance are used to compare two probability ...
0
votes
0answers
75 views

Find variance from 2 variances of 2 datasets with difference sizes

In an attempt to find the mean number of hours his tutorial classmates spent per day preparing for tutorials, John collected data from 10 of his friends in the tutorial group and found that the mean ...
0
votes
1answer
13 views

CLT and Sample statistics

As far as I understood CLT(Central Limit Theorem) specifies that the means of various samples will be Normally distribution with mean=population_mean and std. dev=population_std_dev/n (where n is size ...
1
vote
1answer
36 views

Check if distribution per week is the same

I have sales by customer (b2b) and by date. I want to check if the distribution per day inside weeks remains the same from week to week. Initial dataset Customer Date Sales Alpha 2019-02-23 527 ...
2
votes
1answer
36 views

A deployed model has epistemic or aleatoric uncertainty?

Aleatoric uncertainty refers to the notion of randomness that there is in the outcome of an experiment that is due to inherently random effects. Epistemic uncertainty refers to the ignorance of the ...
0
votes
0answers
21 views

Combine several performance metrics from several datasets

We are developing and evaluating a multi knee/elbow point detection algorithm. For our evaluation, we have 200 sequences of real data. These sequences were annotated manually. For each algorithm and ...
0
votes
0answers
49 views

Null and 0 Values Handling - Basic Statistics [duplicate]

I am trying to do some descriptive statistics and basic graphs on relatively small data sets derived from environmental sample collection and/or chemical research. It turns out that sample points end ...
0
votes
0answers
16 views

Using multiple TF-IDF to create a feature

I have around 200k comments and I extracted the top 200 words (without stop words) out of their content. Each comment is linked to a specific date. I would like to ask a very stupid question: Is it ...
0
votes
0answers
17 views

How can I use a prediction model (e.g., ARMA model or LSTM) for multi-variate data?

I have had a dataset below: sensor1 sensor2 sensor3 ... 2021-01-01 1.32 2.2 1.0 2021-01-02 4.3 2.0 0.8 ... ... I know ...
0
votes
2answers
27 views

Unequal length arrays while calculating paired tests

I have two dfs: df1 and df2 1 3 2 3 2 4 4 6 6 7 7 9 I want to ...
0
votes
0answers
34 views

Agglomerative Clustering (average linkage) and Pearson Correlation

Does having a positive or negative correlation between features being clustered affect the agglomerative clustering result? I have three columns in my dataset, and I'm trying to figure out if I should ...
0
votes
0answers
14 views

Assisting image classifier with additional subjective expert knowledge without training data

This is a cross-posting from a different perspective of a question asked here: Converting weighted value to probability . For a disease classification problem, I trained a deep learning model to ...
1
vote
1answer
36 views

Plotting confidence intervals

For the following dataframe, I am trying to plot the means of a sample of 5 random rows . And also plot their respective confidence intervals using errorbars. I am unable to figure how to plot the ...
2
votes
1answer
23 views

Discrepency in 25th percentile of standard deviation calculation

For each of the following sample sizes [3,5,7,9], I Need to calculate the 25th percentile of the standard deviation for the values sampled. And the total number of trials will be 10. DataFrame ...
0
votes
0answers
11 views

Confusion on whether to use a statistical test

I'm currently doing a data science project using UK government COVID infection and deaths data from local authority districts. I'm looking to answer whether age of an area has an affect on COVID ...
0
votes
0answers
16 views

Mean Accuracy and Standard Error of the Accuracy for KNN Classification algorithm

The given below code snippet is from the assignment of online course IBM ML with Python. Here's the assignment. The used variable names :mean_acc and ...
2
votes
1answer
21 views

Reducing The Impact of Luck On My Training Data

I am new to this data science stuff and I am trying a project on my own to learn more about this field. So I have a project that has the goal of taking in a bunch of features and indicating whether a ...
1
vote
2answers
57 views

Normality score

Having the following distributions (actual and predicted), Hist 1 to 3 (left to right). I would like to get a score ranging from 0-1 of how close the actual distribution is to be normal. I've found a ...
2
votes
1answer
54 views

MOOC - for causal analysis - no statistics background [closed]

Am a software guy with no background in causal inference. While I am now familiar with prediction techniques due to the plethora of courses available online, I would like to seek recommendations from ...
1
vote
0answers
16 views

Using Z-test score to evaluate model performance

I think I know the answer to this question but I am looking for a sanity check here: Is it appropriate to use z-test scores in order to evaluate the performance of my model? I have a binary model that ...
0
votes
1answer
15 views

Normalize data between 0 and 95 instead of between 0 and 100

I want to normalize the data between 0 and 95 instead of 0 and 100. I am using this formula to normalize between 0 and 100, please let me know how to edit it. ...
1
vote
2answers
31 views

How to choose products based on Number of good, bad and total reviews?

Let us suppose, I have few scenarios for products with good and bad reviews. P1: 1000 Good, 1 bad P2: 100 good, 10 bad P3: 20 Good, 0 bad P4: 10000 good, 500 bad ...
1
vote
1answer
86 views

Neural network linearity and non linearity

Is it right on my part to call: A neural network with only input and output layer (sigmoid) as linear (since it is a logistic regression) A neural network with more than one hidden layer non-linear (...
3
votes
1answer
187 views

SAS Studio seems to imply that apparently non-normal data is normal

I have some data I'm trying to analyze in SAS Studio (university edition). I am using the Distribution Analysis feature to try to test some data for normality. It gives me the following histogram: ...
0
votes
0answers
10 views

What approach do I used to analyze this F&B sales data?

I work as a data analyst at a theme park (kind of like disney) but we operate only during 4-6 months in an year. I was asked to analyze the F&B sales at the different locations in the park and ...
0
votes
0answers
20 views

Can the same data set (dynamic) be described as Chaotic & Pareto?

I'm trying to abstract the mathematical part of the problem as much as possible before the details follow, There's this dynamic data set that's $O(2^{32})$, a recent result described it as a power-law ...
0
votes
1answer
25 views

Real-Time Outlier/Anomaly Detection?

My data is the usage/playing statistics for players of a specific game. One data point for a user is aggregated statistics for one week. The goal is to be able to detect when the account of the player ...

1
2 3 4 5
19