Questions tagged [data-analysis]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
-1
votes
0answers
17 views

Modeling Marketing Spend vs Sales

I am working on a problem in which I have daily Sales and daily Offline and Online Marketing Spends. I built a linear regression model were Sales = f(Online Spend, Offline Spend, Lag Sales) at rolled-...
0
votes
0answers
8 views

Storing event data in JSON vs. rows in another table

I want to better understand the constrains and considerations I need to keep in mind when processing site analytics. For example, let's say that I have a table that contains page view data. There is a ...
0
votes
1answer
22 views

Python and data analytics how to get the unique number of orders per seller using groupby?

I am totally new to data analytics and python. I took a good course on Machine learning. But I didn't really worked with real life data. I managed to get data from a store who wants to create a ...
1
vote
0answers
21 views

Test and Control analysis to measure the impact of Change in sales-rep for territories

I hope you all are doing well. Before I proceed with my problem statement, a few terminologies for reference - Territory = Sales Territory - Think of it like a county/region assigned to a particular ...
1
vote
1answer
28 views

Insights betwwen two columns/variables in Dataframe

I have data in two columns one is range of old credit score (Input score range) and new credit score (cvsc100). How do i find insights from both of them ? where the old is range of values and other ...
0
votes
2answers
20 views

Data Conversion to Time Series in R

I am having Sales data of 2018 and 19. I need to convert to time series. The data is not having daily sales View(df) Sales Date 75606 11/01/18 95620 16/01/18 55666 ...
1
vote
1answer
30 views

No statistical significance but observable trends

I have a general inference question regarding scenarios when results from data are not statistically significant but there appears to be an observable trend. For example, ...
0
votes
1answer
12 views

Python and Titanic competition how to get the median of specific range of values where class is 3

I am trying to solve Kaggle's titanic competition. In the test set, there is only 1 row having Fare value as null. It's so easy to replace it with median or average of all Fare values. But I am ...
1
vote
1answer
34 views

How to analyse player and enemy position for data analysis

I am trying to analyse a Serious Game for students learning. In one of the game levels, There are multiple positions like Player Position (x, y, z), enemy position (x, y, z), Player shot at position (...
3
votes
2answers
32 views

find most dense neighborhood of points in high dimensional space

I'm working on a project where I have many high-dimensional points and I want to find the most dense neighborhood of them. Ideally, out of my ~500 points that are each a 4x300 matrix (300 ms time ...
1
vote
0answers
24 views

Parameters to build a churn prediction engine

Let us assume that I’m working for some company A, and my manager has asked me to build a churn prediction engine given that the product to which the churn prediction is to be done is unknown. The ...
1
vote
0answers
30 views

Seeking advice: How would you define “top performer” with a set of data?

still consider myself a noobie in ds here, so I may be asking a very easy and stupid question, but would really appreciate some guidance. The hypothetical situation is that, you have a website where ...
1
vote
1answer
23 views

How is DS used in the case of Payment Gateways?

I know it's a general question but what type of analytics can be done in this case? How can we apply machine learning models here?
0
votes
1answer
16 views

How to order the data with respect to data type

I am having large data set (82 variables) Is there any way to arrange data such a way that I have to get all numerical variables firstly then categorical variables so that I can run hypothesis ...
0
votes
0answers
25 views

ValueError while Comparing with Multilevel Index

My dataframe - ncg_vol contains Multilevel index - 'Year' and 'Month' and single column 'std'. I used .apply() on std column to perform operation based on the number of days in that year. I used the ...
0
votes
0answers
21 views

R language - text.tree()'s pretty parameter

running the below R code to perform analysis on RoomOccupancy dataset ...
0
votes
1answer
23 views

how to know what my data are uninformative and that machine learning will not work with it?

following this question, I'm making a data analysis again because I tried to use machine learning algorithms like Random forest to predict a value from certain features but it didn't work for me. I ...
0
votes
1answer
85 views

How to create a score for a SWOT analysis (strengths, weaknesses, opportunities, and threats)?

I'm developing a participatory social environmental diagnostic. To do this, I'm using primary (qualitative data from interviews with stakeholders) and secondary data (local socioeconomic data). From ...
2
votes
1answer
25 views

is it a good idea to take the derivative or integral of some features and add them as new features in machine learning?

I'm learning how to do feature Engineering and come across some ideas in my head that's why I want to ask if I had some dataset with some features let's say 2 features and I have a timestamp column ...
0
votes
0answers
10 views

Rank impact of individual metrics on overall sales performance

I’m interested in learning about different methods to analyse sales data - at both store level and corporate. Essentially I have lots of performance metrics (~20) that break down the overall sales ...
0
votes
0answers
19 views

How can I compare continuous and non-binary categorical data in Excel?

I'm trying to find the correlation between vehicle days on lot vs different categorical variables (color, make, model, etc). I know it's possible with binary data, but I haven't found a simple way to ...
0
votes
0answers
11 views

What is an appropriate statistical method for determining correlations between variables with likert scale data?

I am conducting an exploratory analysis with a dataset of about 200 records (all likert scales (numeric)). I aim to determine the correlations between the different variables that the responses ...
0
votes
0answers
17 views

What types of variables are these? And what types of tests could I run?

So, I recently made a sheet of data collected from the 2010 Census on Cincinnati neighborhoods. The data is from demographics about the neighborhoods of the city such as median household income and ...
1
vote
0answers
42 views

Forecasting future close returns

I have end-of-day time-series dataset with following data Ticker Date Open High Low Close Volume I have calculated end-of-day closing returns ...
2
votes
1answer
51 views

Analysis of sales performance

This is my first question on this stackexchange - i hope i'm in the right place and i'm asking the right question. I work for a business, we sell certain products. We are running a trial currently on ...
0
votes
1answer
23 views

How to asses employees performance using their data? [closed]

I have some employees' data consisting of three variables - the name of the employee, a value denoting their positive behavior and a value denoting their negative behavior. How to score employees ...
0
votes
3answers
29 views

How to treat column with potentially meaningful NaNs

My data set has a column that indicates the time taken (in days) for members on a site - each with an ID - to sign up for an event. This can range between 1 to 300 days, with about half of the rows ...
0
votes
0answers
17 views

Detecting specific points in (noisy) dataset

In my recent work I've came across a problem where I need to find certain points in quickly oscillating data. Let's work with syntethic data instead of real measurements and ignore the noise for the ...
0
votes
1answer
16 views

Analysis for basic weight training analysis?

TL;DR: I'm doing a fairly basic project which involves exercise. It seems that descriptive statistics and basic data vis (ex: line graph) would be most appropriate for this project, but I wonder if ...
0
votes
0answers
31 views

Adaptive vs non-adaptive data analysis

I am new to data science and machine learning, and have recently come across the term 'adaptive data analysis'. One university course describes the difference between adaptive and non-adaptive data ...
0
votes
0answers
20 views

Best Method for Data Analysis on a 100 numerical IVs and 200 numerical DVs

I think I might need the help of this valuable community for a task. I have been given a dataset for 100 numerical independent variables (IVs) that predict output for 200 numerical values (from monte ...
0
votes
0answers
19 views

Plot line at X axis based on Values of Y axis - maplotlib/seaborn

I have made a dist plot and now I want to plot a line on the x-axis based on the value of the y-axis. ie. I want to plot a line at various maximas/peaks and also shade a portion of the x-axis between ...
0
votes
0answers
45 views

Filling 2 different values for missing/NaN columns

I am doing a binary classification problem (TARGET = 0 or 1). My dataset contains some NaN ...
0
votes
1answer
30 views

Best way for correlation analysis

I am looking for an alternative way of analysing my data which will be used for ML. I am using Matlab to implement my code. Using my code, I obtain arrays which are used to describe signals. Each ...
9
votes
4answers
375 views

Math PhD (Nonlinear Programming) switching to Data Science?

I am a math Ph.D. student who is interested in going to the industry as a Data Scientist after graduation. I will briefly give some background on my education before posing my question, so that it is ...
0
votes
0answers
7 views

Predicting when the State of a variable will change based on past behavior

I have a equipment which Has two possible states, Responding & Not Responding, I have with me the amount of time the equipment spent over the last couple of months being in both the states, for ...
0
votes
2answers
755 views

Plotting Stacked Histogram for Time-series data

Given the dataset: ...
0
votes
0answers
6 views

What could be a Replacement Level to calculate some sort of a Wins Above Replacements for an Ecommerce business

I'm trying to create a metric for an ecommerce business. Just like Wins Above Replacements is a metric used in baseball to assess the achievements of a player as compared to a standard replacement ...
0
votes
0answers
20 views

Sampling user IDs from a large data set for retention analysis

Let's say I have a data set with user identities and their respective orders, of the form: ...
0
votes
0answers
16 views

Ideas to derive new column or eliminate a column for Logistic Regression problem related to binary classification

I am working on a Logistic Regression problem to identify the leads that result into a student conversion for candidature. I have 2 columns in the dataset 'Last Activity' and 'Last Notable Activity' ...
1
vote
1answer
18 views

Causation vs correlation problem in case of fixing other parameters and changing only one

I have a game that players play. D7 retention is defined as percentage of players who installed my game and after exactly 7 days later they played my game. Now I am doing analytics and it shows that ...
-1
votes
1answer
137 views

How Retail Analytics Project Can Be Done?

I have a project and I couldn't understand what I have to do because I am new with retail analytics. They said "Our goal is to measure the effects of promotion on sales" and "Your goal is to model ...
0
votes
0answers
11 views

Smoothing a random noise causes undesirable results

I have some sample data with 7 features out of which only one feature is different. All other 6 features are same. But I add white noise to the data and multiply it with a factor to test some ML ...
1
vote
2answers
54 views

I have a 20.2 GB dataset which is entirely consisting of 1 file. Need help on how to open the file [closed]

Whenever I am dealing with datasets that have weird extensions that I have not encountered before, I typically open them with notepad to see how the data looks like before using pandas to analyze them....
0
votes
1answer
31 views

Handling unwanted negative numbers

With me is a dataset collected from IoT sensors with one column labeled “Soil Humidity” measured in percentage. It stands to reason then that all the values be positive percentages, however there’s a ...
0
votes
0answers
16 views

can macd be calculated for values other than 12 and 26?

I am working on time-series classification problem using CNN. The dataset used is financial stock market data(like yahoo finance). I am using some technical indicators calculated using raw values high,...
0
votes
1answer
127 views

counter vector fit transform cosine similarity memory error

count_matrix = count.fit_transform(off_data3['bag_of_words']) I have count_matrix shape with count_matrix.shape (476147, 482824) ...
1
vote
0answers
47 views

Is it possible retrive hourly data from daily weather data?

I'm a beginner, so sorry if my question could be basic. Reading on internet I've found example written in python that makes the reverse of my questions (covert from daily to monthly). My problem is ...
0
votes
0answers
10 views

How to process data quickly for users in a web app?

I am building a site that will let users add custom data. Users basically fill in various input/text fields as they are working on their projects. The data will go into a postgresql database (so it is ...
0
votes
0answers
8 views

Analysis on the 5 segment of the data to differentiate from each other using R

I have 1000 customers operational data which is already divided into segments. Now I have to do analysis on different segments to find out how they differ from each other. Why they fall into their ...