Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-science-model]

The tag has no usage guidance.

2
votes
1answer
18 views

Adding recommendations to the output of a classification model

I have built a binary classification model using: logit decision trees random forest bagging classifier gradientboost xgboost adaboost I have evaluated the above models and chose xgboost based on ...
0
votes
1answer
19 views

How to interpret partial dependence interaction plot for binary classification?

The plot below is an example from pdpbox library https://github.com/SauceCat/PDPbox/blob/master/tutorials/pdpbox_binary_classification.ipynb. The what does 0.900 color saturation to the right mean ...
1
vote
0answers
24 views

Solving correlation and covariance with MySQL

I am new to data science taking my first course in Data analysis. I am trying to figure out where to start with a problem solving the correlation and covariance with my sql. ...
0
votes
1answer
17 views

Print the prediction of convolutional neural network

I have designed a convolutional neural network using tensorflow which looks as follows ...
1
vote
2answers
18 views

How to model & predict user activity/presence time in a website

I need to make a prediction model based on some historical data from a website's user login system. Suppose my dataset has some features like user login time and logout time for each day for a ...
1
vote
1answer
43 views

What the good general regression technqiue for a problem with 50 independent varaibles [closed]

I am a newbie to data science and statistics. I came across this problem, which has 50 independent variables and one dependent variable and trying to identify the good regression technique to start ...
1
vote
1answer
23 views

How to speed up passing of images to a GPU

I am using Ubuntu 16.04 LTS installed on a 4TB HDD. I am working with a large dataset (more than 30 GB and 150,000 images). I have a single 11GB GTX 1080 Ti GPU card on my system. I am training a mask ...
0
votes
0answers
14 views

Distribution of Features

I am using a dataset. The aim is to predict the average monthly loss to the company. With feature enginnering I have introduced a feature loss using workload(given per day) and the absence (given per ...
0
votes
1answer
33 views

Feature Scaling both training and test data

It is said that for: Feature Normalization - The test set must use identical scaling to the training set. And the point given is that: Do not scale the training and test sets using different ...
3
votes
2answers
79 views

How can we use Neural Networks for Decision Making intead of Bayesian networks or Desicion Trees?

I am working on Decision Making in Self driving cars and I am wondering how I can use Neural networks (is there any type) ? that can repleace or mimic the bayesian networks or Decision Tree for ...
0
votes
1answer
40 views

Alternatives to doc2vec?

What are some alternatives to the doc2vec embedding model? I.e models that convert paragraphs/documents into vectors, not just models that take the mean/sum of the word embeddings of each word in the ...
0
votes
0answers
14 views

EDA : Model decision making

I am working on this dataset. Completely new to the machine learning. It seems to be a time series data. 1) Can I go for regression or classification modelling for this dataset? The target id in ...
0
votes
1answer
25 views

Generating a set of different scenarios based on some initial observations

I have a in my hands 3 different time series which model 3 different scenarios (base, downside, upside). Every of this time-series depends on a set of 11 different attributes, which take values for ...
0
votes
2answers
102 views

How to create a simple K-Means Cluster Algorithm in Python? [closed]

Hi I am new to Data Science and Python. I want to implement K-Means Cluster Algorithm. I am successfully implemented K-means algorithm on Array of elements. For this I did like # K-Means.py ...
0
votes
1answer
26 views

Target feature in training set or not?

If I analyse a random forest in python with scikit I do: ...
0
votes
1answer
57 views

Exploratory Data Analysis

I am working on this dataset. Dataset has missing values. What would be the best method to impute the missing values. Also values are missing from target feature as well. So far I have dropped those ...
2
votes
0answers
25 views

Differences between big data, data warehousing, business intelligence and data science?

I know they are four different áreas, but I would like to know what are the main differences between those disciplines, and how are them related to each other, if some of them depends of another, and ...
2
votes
2answers
61 views

How to generate a output like this?

can u please give an explanation for this ?
2
votes
0answers
19 views

detecting anomaly from cdr data

I need to find anomalies from this. The term anomaly in my case is in which square id and in which time the total activity goes higher, how can I detect anomalies with the help of machine learning ...
1
vote
2answers
57 views

huge doubt on anomaly detection

from the naked eye itself, we can tell in the region 5161 the network usage is high so that is the anomaly in my case, then why do we want to apply k-means and other machine learning algorithms to ...
0
votes
0answers
13 views

Inserting a feature in the training set made of a target variable

I have a timeseries that contain the daily price of items based on the stores , the manufacturers , and other attributes. Other than what we know about not including a signal from target variable in ...
2
votes
1answer
62 views

Python - Predicting data based on multidimensional array with Keras

I've a list of data which is so called 3D array. Each of 10350 rows contains a 2D matrix with size of 150x16 (elements are float) (x_train). Corresponding training data for this huge array a linear ...
-2
votes
1answer
49 views

Which algorithms are the best choices for my binary classification problem? [closed]

Which algorithms are the best choices for my binary classification problem? I have approximately 200 K samples in the training set and 18 attributes, including binary, numeric and categorical. I ...
1
vote
1answer
63 views

Capturing movement importance - logistic regression output

I'm studying some event for a set of objects that can be plotted on a square $[0, 100] ^ 2$. I have used logistic regression to calculate probabilities that event occur for different objects and the ...
1
vote
3answers
39 views

Data aggregation and split train test samples

I'm working on a data science project where the goal is to predict daily electricity consumption of a building based on some of its characteristics (e.g., size, location, etc.) and weather features (e....
6
votes
2answers
72 views

Is there any consensus on choosing an appropriate ML approach?

I am studying data science at the moment and we are taught a dizzying variety of basic regression/classification techniques (linear, logistic, trees, splines, ANN, SVM, MARS, and so on....), along ...
0
votes
0answers
19 views

How to deal with overfitting in Gradient boosting classification algorithm?

I am training my model on Gradient boosting algorithm with parameters as follows: learning rate: 0.1 number of iterations: 100 depth of tree: 12 I am not getting the output for cross-validation to ...
1
vote
0answers
56 views

How to implement one vs rest classifier in a multiclass classification problem?

I have a dataset which contains 750 data points with 8 classes in the target variable. I tried implementing simple machine learning models and also did hyperparameter tuning but they results were not ...
2
votes
2answers
85 views

Time-series decomposition to a base level and an effect of another feature

I've got a time-series data (let's denote it as y) and some feature (let's denote it as x). y...
0
votes
0answers
43 views

Mathematical Representation of a High Dimensional Data Set

I have a data set which is composed of 240 observations/signals and every observation/signal have 101 features/attributes. The data set is given in below Image: This is just a single Matrix, y shows ...
0
votes
1answer
72 views

NER: Extracting entities from an article

Description : I have dataset of categorised articles and to extract specific values from respective categorised article I have regex created for each category. Aiming for: Nlp techniques which ...
0
votes
0answers
21 views

Data Science : from handson person to manager

I am a data science hands on person with some experience in SAS/R/python/excel and exposure to techniques like regression, time series, clustering, decision tress etc to name a few. Now I have been ...
1
vote
0answers
16 views

Can anyone recommend some good books or articles on working with time series?

I've read a couple of guides such as this link. I'm having real trouble getting to grips with how to use time series data effectively. Anything to help with the intuition ideally with some case ...
1
vote
0answers
15 views

How do I develop a system to Recommend a marketing channel using data science? [closed]

I am working on a data science challenge. I would like some help on how to proceed in developing my solution. A snapshot of my dataset is shown below: This dataset is collected by a drug making ...
0
votes
0answers
66 views

Scorecard in R/Python, save in PMML format

Does anyone know how to build a Scorecard model in R/Python? and save it in PMML format? Is there any popular implementation in R/Python (or some other language)? Please feel free to respond even ...
1
vote
0answers
65 views

Linear approximation of the given equation with python3 [closed]

I was given a set of raw datum and have to model it by means of some machine learning techniques. After some research, I decided to do with the method of linear approximation. Description of the ...
0
votes
1answer
77 views

May the training set and validation set overlap?

May the training set and validation set overlap? Similarly, may the testing set and validation set overlap?
1
vote
0answers
30 views

Generalized Regression Neural Networks

I do not understand. Generalized Regression What is the purpose of the Neural Networks structure? And how it works.
2
votes
0answers
56 views

Own Implementation of Neural Networks heavily under fitting the data

I tried to implement a Basic Deep Neural Network Algorithm for a classification problem on my own. I have tried on the iris data set for this test but, my implementation has been giving me very poor ...
3
votes
1answer
29 views

What companies would be great for entry level data science/ machine learning programmers to help fight for a good cause? [closed]

I am just starting to learn about machine learning, and I have taken some intro classes in MATLAB and Python. I want to know about fulfilling careers and fields programmers can pursue to help me ...
3
votes
1answer
22 views

Should we identify outliers from population prior to taking sample?

I am revising undergrad statistics course via this course, where i am learning techniques to pull out sample from population. While ensuring that sample is a decent representative of the population, ...
2
votes
0answers
24 views

What kinds of statistical analyses and machine learning techniques are most useful for personal analytics projects? [closed]

I am just a beginner-level programmer in Python and MATLAB, and I have been looking at tutorials for Keras. Eventually, I want to make a project for my programming portfolio. Can you please share some ...
3
votes
1answer
56 views

What's a reasonable distribution to model views over time of… this question?

Sorry for the self-referential title ;) I'd be curious to know what's a curve that could be used to model - in the scale of (say) weeks* - the "engagement lifecycle" of a single news page of an ...
7
votes
5answers
278 views

When to remove correlated variables

Can somebody please suggest what is the correct stage to remove correlated variables before feature engineering or after feature engineering ?
0
votes
0answers
48 views

What all methodologies are there in Data Science/ML to predict the next transaction date of a customer?

I've a data-set with three columns: customer_id, transaction_date & sales_amount. Product data can also be added but to avoid complexity, I've not added that. The objective on which I'd like to ...
0
votes
0answers
21 views

Repurchase Model

I need help on predicting whether customer will repurchase or not. I am not able to prepare a framework on to how I should prepare this model(which technique) and how the data should look. As of now ...
0
votes
1answer
25 views

Finding the equation for a multiple and nonlinear regression model?

Regarding nonlinear and multivariable regression, I use R or Matlab. In the case where a regression with just two variables, I simply draw the graph Y with respect to X, and look for the equation of ...
0
votes
1answer
32 views

predict future sale from past 3 month data

I have the 3-month sale(branch wise) and I want to predict next month sale. There are huge differences between total sale in between months. The simple average of the month's to predict next month ...
1
vote
0answers
17 views

Rather use many linear classifiers than one complex one for numerical data?

I need to classify machine data (sampled by the second) and I need a prediction if a signal is good, medium or bad every ten seconds. The data that I got from the machine at the moment look like this:...
0
votes
0answers
16 views

Output Machine Learning Model

Fairly new to data science coming from traditional social science research If I use a machine learning algorithm like k-means or even a neural network, it eventually commits some kind of structured ...