Questions tagged [data-analysis]

The tag has no usage guidance.

0
votes
0answers
12 views

Process Reliability implementation using Python [on hold]

i have some set of production data from a factory, its like [9989,9976,9951,9900,1000,8998...], is there any way to implement this weibull distribution (as shown in figure) using production data , i ...
0
votes
0answers
9 views

Finding relative performance of products during certain hours?

Let's say I'm running a bar and I want to know what drinks sell better than normal during happy hour or during certain events. Is there a name for this problem? I'm sure this is a common problem, but ...
-1
votes
0answers
31 views

Cohort analysis 3 months

I am struggling with a conditional groupby condition in pandas. I have a dataset as it follows : After grouping the data using the following code : ...
0
votes
1answer
27 views

Plot misclassfied values in matplotlib

I have two lists. One is target and another is predicted values in a binary classification. The target is always zero. And I have to plot the results of the prediction against target in such a way, ...
1
vote
1answer
32 views

Data analytics in road transportation

What kind of insights can we give from point A to point B transactions. A and B are two places, All I can think of is about descriptive statistics like how many transactions from A and what is count ...
0
votes
1answer
21 views

In which CRAN mirror is the quadprog package available?

I was trying to find the accuracy of some predicted data and I came to know that I can use the forecast package to do this. When I installed it and gave library(forecast), it said it needs quadprog ...
2
votes
2answers
16 views

why One-Hot Encoder can avoid the situation that the model will misunderstand the data to be in some kind of order if the data has been Label Encoding

We know that we prefer to using One-Hot Encoding not Label Encoding when processing with non-ordinal data. And I real a blog which give the difference between Label Encoding and One-Hot Encoding. So ...
0
votes
0answers
9 views

Automated Spatial data mining tools in python

How can spatial data raster be processed in order to apply random forest prediction algorithm on it using python programming language?
0
votes
1answer
21 views

comparing data from first quarter in two years

How can I compare data from two quarters? What software can I use to do it parallelly side by side so I can compare them. What kind of factors can I take into consideration, I'm posting a sample data ...
-1
votes
1answer
38 views

No target variable in my data

I have a list of transactions of bus route from place to place, I don't have any target variable here. I was asked to give meaningful insights from the data, what can I do here? I cleaned the data, ...
0
votes
2answers
28 views

White noise seasonality

Is the above graph a white noise? I'm confused by the spikes at certain places. The above plot has been obtained after doing a first order differencing on a time series. How can I justify whether ...
1
vote
0answers
41 views

Model for time series analysis

I'm new to data analysis and ML in general. I'm working with some friends on this problem: We're trying to predict when a component of a machine will stop working properly so the client can change it ...
0
votes
0answers
8 views

How to measure the success of a seasonal product or what should be the northstar KPI

Not sure if this is the right forum to post this question. This is more of a product management question, I searched all the communities in StackExchange and thought this might be the closest to ...
2
votes
1answer
20 views

How to figure out if the problem is time series Forecasting or not?

Recently I have encountered a time-series based, where I have a dataset which contains data for call-centers performance. The dataset contains information about the number of calls made by customers ...
2
votes
2answers
52 views

Possible Challenges for a Data Science Escape Room

Dear Data Science Community, as my project for my bachelorthesis I am working on a concept for a physical Data Science Escape Room. The goal of the escape room is to create awareness for data science ...
6
votes
1answer
44 views

Covariance as inner product

Why is covariance considered as inner product if there is no projection of one vector onto another? Right now I perceive this as just a multiplication of $x$ segment of vector($x_i - \bar{x}$) and $y$...
0
votes
2answers
213 views

how to create word2vec for phrases and then calculate cosine similarity

I have just started using word2vec and I have no idea how to create vectors (using word2vec) of two lists, each containing set of words and phrases and then how to calculate cosine similarity between ...
0
votes
0answers
19 views

Is there a better way to do run time analysis than this?

I currently have 2 different functions with options to vectorise them: acc_rej_sine(max_iter, algorithm=None) and ...
0
votes
2answers
25 views

How to get date columns in pandas?

I need a separate date column(in this format2018-10-08) in this table. please help. ...
3
votes
0answers
40 views

Fitting model to differenced time series

I have a time series on daily stock price of company(2013 data points).I took a first order difference and the following acf and pacf plots of the differenced series were obtained. However, I am ...
1
vote
1answer
43 views

How could I go about finding the weights or importance of inputs based on outputs?

I have a table who's inputs (sfm, fr, and doc) all affect the outputs (...
1
vote
1answer
14 views

Comparing rows in Data Studio

I'm using data studio for a project and I'm connecting to my big query table. My table contains following columns: Date, Store_name, Footfall I'd love to compare the footfall of two stores on data ...
0
votes
1answer
32 views

Which different visualizations to make for time series analysis?

I hope you're doing great. I have recently started working on a time series project and I have just finished preparing my data and calculating trends (daily, weekly, yearly) and I wonder what are the ...
1
vote
1answer
36 views

EDA for analysis of nominal variable with high cardinality

I have a nominal variable (car model) with very high cardinality (~8500 labels) and I would like to analyse its relation with a binary target variable. While I can create logical groups and compare ...
2
votes
2answers
342 views

Additive vs Multiplicative model in Time Series Data

The above time series plot is a daily closing stock index of a company. I want to know which model between additive and multiplicative best suits the above data. I know what the two models are, but i ...
2
votes
1answer
95 views

Analysis of Time Series data

The below graph is a scatterplot of daily stock price. My aim is to predict future stock price of the company. From the scatterplot it seems that it is a multiplicative model, so I tried to "...
0
votes
1answer
23 views

clustering with heterogeneous (quantitative and qualitative)data?

I'm a Phd student and I have the results of some approaches (algorithms) that I would like to analyze. Data (results) are stored in csv files as follows: - the lines describe each algorithm with its ...
1
vote
0answers
19 views

Learning Marketing Analytics

I'm a application developer and want to switch to Data Science field. I have done basic course in DS. I want to learn marketing analytics, which resources should I refer?
0
votes
0answers
5 views

Appropriate math for evaluating coverage/fit across multiple weighted many-to-many relationships

Generally speaking, my current problem involves assigning people to jobs. Each job entails a set of tasks, each task requires some array of skills, and each skill is possessed by some subset of people....
1
vote
1answer
29 views

Comparative Analysis of two sets of data

I have 2 sets of data which consist of marks of 60 students in a particular subject in year 1 and year 2 respectively. Year 1 : 86, 76, 87, 67, 89, 95.... so on (60 students) Year 2 : 82, 67, 99, 77,...
0
votes
0answers
19 views

Rate quality of sources

Sorry if the title is misleading, I don't know how to describe the issue correctly, which also makes it hard to google. Say we have historical weather predictions from three different sources. All ...
2
votes
2answers
53 views

Predicting missing data. Looking for good data predicting technique

I am analysing data for Countries Trade GDP. Some of the countries have missing GDP value for given a year. However, I have Grand Total for the entire region for that year. Is there a good data ...
0
votes
1answer
64 views

Will I be able to fetch a Data Analyst job if I learn everything in this image?

India Asking such a question because I am interested learn everything myself and I am confused about what to read. And I am interested by reading books, will that suffice? or should I compulsorily ...
1
vote
0answers
8 views

Finding change maximum change in the value using Redshift

Following is the problem I want to solve. But I don't know how to implement it. I am using Redshift to store data. Following is the format of the data stored in Redshift. It is sales history for ...
0
votes
2answers
47 views

Building predictive model with low correlated data [closed]

I have been working on a project with low features and only few entry fields ( 4 to be exact ). All the data in the dataset is barely correlated to each other. Is there some organized way or ...
1
vote
1answer
67 views

How to make a Power Spectral Density Plot in R

I have a time series point process representing neuron spikes. I have computed and plotted autocovariance using acf but now I need to plot the Power Spectral ...
2
votes
0answers
24 views

Dimension of the manifold on which my data sits

Suppose that I have data points, in the form of vectors with binary entries. We create a metric space, or Vietoris-Rips complex, using the Hamming distance between the data points. I would like to ...
2
votes
1answer
40 views

How to get the survival duration prediction for each individual in the data by using the Kaplan-Meier method?

I am trying to learn how to use the Kaplan-Meier survival estimator model in the lifelines package. The documentation says that the KaplanMeierFitter.fit function ...
0
votes
1answer
270 views

Sparse Representation vs Dense Representation

The one of the benefits of ReLUs is sparsity. Sparsity arises when a≤0 (a = wX+b). The more such units that exist in a layer the more sparse the resulting representation. Sigmoids on the other hand ...
1
vote
1answer
103 views

SVM model classifying into one class only, after standardization

I'm trying to use SVM in R (e1071 package) to classify samples as normal or tumor. I have two separate data sets - Training (~50 samples, 100 features) and Test (~60 samples). These data sets are ...
1
vote
1answer
25 views

Understanding a dataset (prior to applying ML models) with no metadata given

How do you understand a dataset when there is no metadata given (no details about the attributes given in the dataset)? It is difficult to comprehend the attribute names as only the short forms are ...
1
vote
2answers
41 views

What kind of machine learning can predict a probability rather than classification?

For example, I want to predict a probability of whether raining tomorrow, and I can't get the prob. of cloudy or sunny...etc day. I only get events(attributes of weather) like temperature, humidity, ...
1
vote
1answer
15 views

Different types of analysis which can be done with Webdata of users

I have rich customer data for site usage, particularly the web analytics data. Some of the data fields I have are: Product Usage details Geographic details Session data: Capture what all they did ...
0
votes
1answer
83 views

Exploratory Data Analysis

I am working on this dataset. Dataset has missing values. What would be the best method to impute the missing values. Also values are missing from target feature as well. So far I have dropped those ...
0
votes
1answer
27 views

which forecasting models could be chosen?

I'm new for data analysis. I got some data from the regional environmental center. Measurements: Datetime, PointID, SubstanceID, Value (substances concentrations in air), MeteoID ,NextValue ...
1
vote
0answers
35 views

How to measure retention statistics?

I have a dataset with the ID, name, joining date, leaving date as features. I was asked to measure employee retention and health of it. What can I derive from these? What are some latest trends and ...
0
votes
1answer
29 views

data analysis EDA issues, indent or type

I am a newbie in DS world, right now i am working on some EDA practice, and run into an issue here. Here is my code: Convert some columns to numeric values ...
7
votes
1answer
245 views

How far can one go with excel? [closed]

in my business we handle all analytics through Excel. This includes mostly scheduling, production planning and accounting operations. We currently are looking into adding a bit of predictive modelling ...
1
vote
1answer
14 views

Metrics/Methods for deciding duration of video retention for on-demand websites

This might be a general question but I thought this might be the best place to brainstorm. If I had a video website that only wants to retain videos on-demand for a certain number of days before ...
1
vote
0answers
23 views

What is the difference between 'if the data if of good quality' and 'if the data is tidy'?

I'm doing Data Analyst nanodegree from udacity. I'm confused between the difference even after going through the lecture a few times.