Questions tagged [data-analysis]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

Plot line at X axis based on Values of Y axis - maplotlib/seaborn

I have made a dist plot and now I want to plot a line on the x-axis based on the value of the y-axis. ie. I want to plot a line at various maximas/peaks and also shade a portion of the x-axis between ...
0
votes
0answers
16 views

Filling 2 different values for missing/NaN columns

I am doing a binary classification problem (TARGET = 0 or 1). My dataset contains some NaN ...
0
votes
1answer
21 views

Best way for correlation analysis

I am looking for an alternative way of analysing my data which will be used for ML. I am using Matlab to implement my code. Using my code, I obtain arrays which are used to describe signals. Each ...
8
votes
4answers
184 views

Math PhD (Nonlinear Programming) switching to Data Science?

I am a math Ph.D. student who is interested in going to the industry as a Data Scientist after graduation. I will briefly give some background on my education before posing my question, so that it is ...
0
votes
0answers
7 views

Predicting when the State of a variable will change based on past behavior

I have a equipment which Has two possible states, Responding & Not Responding, I have with me the amount of time the equipment spent over the last couple of months being in both the states, for ...
0
votes
2answers
63 views

Plotting Stacked Histogram for Time-series data

Given the dataset: ...
0
votes
0answers
6 views

What could be a Replacement Level to calculate some sort of a Wins Above Replacements for an Ecommerce business

I'm trying to create a metric for an ecommerce business. Just like Wins Above Replacements is a metric used in baseball to assess the achievements of a player as compared to a standard replacement ...
0
votes
0answers
17 views

Sampling user IDs from a large data set for retention analysis

Let's say I have a data set with user identities and their respective orders, of the form: ...
0
votes
0answers
11 views

Ideas to derive new column or eliminate a column for Logistic Regression problem related to binary classification

I am working on a Logistic Regression problem to identify the leads that result into a student conversion for candidature. I have 2 columns in the dataset 'Last Activity' and 'Last Notable Activity' ...
1
vote
1answer
17 views

Causation vs correlation problem in case of fixing other parameters and changing only one

I have a game that players play. D7 retention is defined as percentage of players who installed my game and after exactly 7 days later they played my game. Now I am doing analytics and it shows that ...
-1
votes
1answer
57 views

How Retail Analytics Project Can Be Done?

I have a project and I couldn't understand what I have to do because I am new with retail analytics. They said "Our goal is to measure the effects of promotion on sales" and "Your goal is to model ...
0
votes
0answers
7 views

Smoothing a random noise causes undesirable results

I have some sample data with 7 features out of which only one feature is different. All other 6 features are same. But I add white noise to the data and multiply it with a factor to test some ML ...
1
vote
2answers
47 views

I have a 20.2 GB dataset which is entirely consisting of 1 file. Need help on how to open the file [closed]

Whenever I am dealing with datasets that have weird extensions that I have not encountered before, I typically open them with notepad to see how the data looks like before using pandas to analyze them....
0
votes
1answer
25 views

Handling unwanted negative numbers

With me is a dataset collected from IoT sensors with one column labeled “Soil Humidity” measured in percentage. It stands to reason then that all the values be positive percentages, however there’s a ...
0
votes
0answers
13 views

can macd be calculated for values other than 12 and 26?

I am working on time-series classification problem using CNN. The dataset used is financial stock market data(like yahoo finance). I am using some technical indicators calculated using raw values high,...
0
votes
1answer
35 views

counter vector fit transform cosine similarity memory error

count_matrix = count.fit_transform(off_data3['bag_of_words']) I have count_matrix shape with count_matrix.shape (476147, 482824) ...
1
vote
1answer
23 views

Is it possible retrive hourly data from daily weather data?

I'm a beginner, so sorry if my question could be basic. Reading on internet I've found example written in python that makes the reverse of my questions (covert from daily to monthly). My problem is ...
0
votes
0answers
7 views

How to process data quickly for users in a web app?

I am building a site that will let users add custom data. Users basically fill in various input/text fields as they are working on their projects. The data will go into a postgresql database (so it is ...
0
votes
0answers
8 views

Analysis on the 5 segment of the data to differentiate from each other using R

I have 1000 customers operational data which is already divided into segments. Now I have to do analysis on different segments to find out how they differ from each other. Why they fall into their ...
0
votes
0answers
17 views

Class Size Imbalance for LDA or any other Content based analysis

I am running some content analysis studies on my dataset which has two different classes, and each class has a respective list of the document I am analyzing. I compare the LDA topic model inference ...
0
votes
1answer
30 views

Simple EDA: what to visualize?

I want to visualize a data set for EDA having 8 parameters and 2 class labels. I am confused which parameters to select and on what basis? Also is I want to know whether it would be better to apply ...
0
votes
1answer
369 views

ValueError: pos_label=1 is not a valid label: array(['N', 'Y'], dtype='<U1')

X = train_encoded_df.iloc[:, 1: ] y = train_encoded_df["Loan_Status"] print("Precision:",metrics.precision_score(y_test, y_pred)) My training data contains the ...
0
votes
0answers
9 views

Finding relative performance of products during certain hours?

Let's say I'm running a bar and I want to know what drinks sell better than normal during happy hour or during certain events. Is there a name for this problem? I'm sure this is a common problem, but ...
0
votes
1answer
36 views

Plot misclassfied values in matplotlib

I have two lists. One is target and another is predicted values in a binary classification. The target is always zero. And I have to plot the results of the prediction against target in such a way, ...
1
vote
1answer
34 views

Data analytics in road transportation

What kind of insights can we give from point A to point B transactions. A and B are two places, All I can think of is about descriptive statistics like how many transactions from A and what is count ...
0
votes
1answer
31 views

In which CRAN mirror is the quadprog package available?

I was trying to find the accuracy of some predicted data and I came to know that I can use the forecast package to do this. When I installed it and gave library(forecast), it said it needs quadprog ...
2
votes
2answers
22 views

why One-Hot Encoder can avoid the situation that the model will misunderstand the data to be in some kind of order if the data has been Label Encoding

We know that we prefer to using One-Hot Encoding not Label Encoding when processing with non-ordinal data. And I real a blog which give the difference between Label Encoding and One-Hot Encoding. So ...
0
votes
0answers
12 views

Automated Spatial data mining tools in python

How can spatial data raster be processed in order to apply random forest prediction algorithm on it using python programming language?
0
votes
1answer
27 views

comparing data from first quarter in two years

How can I compare data from two quarters? What software can I use to do it parallelly side by side so I can compare them. What kind of factors can I take into consideration, I'm posting a sample data ...
-1
votes
1answer
95 views

No target variable in my data

I have a list of transactions of bus route from place to place, I don't have any target variable here. I was asked to give meaningful insights from the data, what can I do here? I cleaned the data, ...
0
votes
2answers
36 views

White noise seasonality

Is the above graph a white noise? I'm confused by the spikes at certain places. The above plot has been obtained after doing a first order differencing on a time series. How can I justify whether ...
1
vote
0answers
47 views

Model for time series analysis

I'm new to data analysis and ML in general. I'm working with some friends on this problem: We're trying to predict when a component of a machine will stop working properly so the client can change it ...
0
votes
0answers
13 views

How to measure the success of a seasonal product or what should be the northstar KPI

Not sure if this is the right forum to post this question. This is more of a product management question, I searched all the communities in StackExchange and thought this might be the closest to ...
2
votes
1answer
25 views

How to figure out if the problem is time series Forecasting or not?

Recently I have encountered a time-series based, where I have a dataset which contains data for call-centers performance. The dataset contains information about the number of calls made by customers ...
2
votes
2answers
62 views

Possible Challenges for a Data Science Escape Room

Dear Data Science Community, as my project for my bachelorthesis I am working on a concept for a physical Data Science Escape Room. The goal of the escape room is to create awareness for data science ...
6
votes
1answer
107 views

Covariance as inner product

Why is covariance considered as inner product if there is no projection of one vector onto another? Right now I perceive this as just a multiplication of $x$ segment of vector($x_i - \bar{x}$) and $y$...
0
votes
2answers
1k views

how to create word2vec for phrases and then calculate cosine similarity

I have just started using word2vec and I have no idea how to create vectors (using word2vec) of two lists, each containing set of words and phrases and then how to calculate cosine similarity between ...
0
votes
0answers
22 views

Is there a better way to do run time analysis than this?

I currently have 2 different functions with options to vectorise them: acc_rej_sine(max_iter, algorithm=None) and ...
0
votes
2answers
34 views

How to get date columns in pandas?

I need a separate date column(in this format2018-10-08) in this table. please help. ...
3
votes
0answers
43 views

Fitting model to differenced time series

I have a time series on daily stock price of company(2013 data points).I took a first order difference and the following acf and pacf plots of the differenced series were obtained. However, I am ...
1
vote
1answer
49 views

How could I go about finding the weights or importance of inputs based on outputs?

I have a table who's inputs (sfm, fr, and doc) all affect the outputs (...
2
votes
1answer
22 views

Comparing rows in Data Studio

I'm using data studio for a project and I'm connecting to my big query table. My table contains following columns: Date, Store_name, Footfall I'd love to compare the footfall of two stores on data ...
0
votes
1answer
33 views

Which different visualizations to make for time series analysis?

I hope you're doing great. I have recently started working on a time series project and I have just finished preparing my data and calculating trends (daily, weekly, yearly) and I wonder what are the ...
1
vote
1answer
71 views

EDA for analysis of nominal variable with high cardinality

I have a nominal variable (car model) with very high cardinality (~8500 labels) and I would like to analyse its relation with a binary target variable. While I can create logical groups and compare ...
3
votes
2answers
1k views

Additive vs Multiplicative model in Time Series Data

The above time series plot is a daily closing stock index of a company. I want to know which model between additive and multiplicative best suits the above data. I know what the two models are, but i ...
2
votes
2answers
204 views

Analysis of Time Series data

The below graph is a scatterplot of daily stock price. My aim is to predict future stock price of the company. From the scatterplot it seems that it is a multiplicative model, so I tried to "...
0
votes
1answer
55 views

clustering with heterogeneous (quantitative and qualitative)data?

I'm a Phd student and I have the results of some approaches (algorithms) that I would like to analyze. Data (results) are stored in csv files as follows: - the lines describe each algorithm with its ...
1
vote
0answers
22 views

Learning Marketing Analytics

I'm a application developer and want to switch to Data Science field. I have done basic course in DS. I want to learn marketing analytics, which resources should I refer?
0
votes
0answers
5 views

Appropriate math for evaluating coverage/fit across multiple weighted many-to-many relationships

Generally speaking, my current problem involves assigning people to jobs. Each job entails a set of tasks, each task requires some array of skills, and each skill is possessed by some subset of people....
1
vote
1answer
29 views

Comparative Analysis of two sets of data

I have 2 sets of data which consist of marks of 60 students in a particular subject in year 1 and year 2 respectively. Year 1 : 86, 76, 87, 67, 89, 95.... so on (60 students) Year 2 : 82, 67, 99, 77,...