Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
0
votes
0answers
7 views
Model and Type for Medication Impact
I have following 3 datasets from various patients:
Diagnosis Dataset: Patient_Key, Diagnosis Code,Diagnosis Date
Medication Dataset: Patient_Key, Medication Name, Dose, Fill Date
Lab Result Dataset:...
0
votes
0answers
10 views
How to create a SAS Library Folder
I am trying to create a folder to use in the SAS library. I have tried to do this many different ways. Every time I run the code it always says that the path does not exist.
Below is my error ...
0
votes
0answers
6 views
Is there a consensus on the best model for Antimicrobial Resistance (AMR) prediction?
Some classes of problem are best solved by a specific class of machine learning model, due to the structure of the data (e.g. Deep Learning for computer vision).
Prediction of bacterial resistance/...
1
vote
0answers
19 views
Lookup from time series panda dataframe
I have below reference table with date time series defined in 20 mins interval
...
0
votes
1answer
14 views
Looking for help calculating a probability formula
How do I put this into a calculator or a excel spreadsheet formula. I have never done this math before, but I want to figure it out.
0
votes
1answer
61 views
What Predictions can be done for Restroom/Washroom Data? [closed]
My company has installed sensors, which actually monitors the Restrooms/Washrooms in the Building. Currently the sensors collect data such as Ammonia, Nitrous and Visitors Count;
All the data ...
0
votes
0answers
11 views
Why use CRISP framework over other data science frameworks? [closed]
Why are some frameworks for data science workflow more popular and more used than others? Is there any reason why CRISP is used in a lot of data science projects than others?
1
vote
3answers
104 views
Forecasting ticket sales and city
I am learning data science. I have the following dataset for train tickets:
...
0
votes
1answer
20 views
General question on EDA, correlations, classification, ML
I am looking for a general best practices regarding classification and correlations. I created a new predictor feature call it B, based on a certain threshold in a feature A. Now I started to do EDA ...
1
vote
1answer
28 views
Difference between train, test split before preprocessing and after preprocessing
I am new to machine learning. I am bit confused in preprocessing. Generally,
Scenario-1: I am splitting the dataset into train,test and validation and applying the transformations like fit_transform ...
0
votes
0answers
18 views
Why derivatives are accumulated over all examples in back propagation?
In back propagation, why do we accumulate dJ/dW and dJ/db over all examples (J is cost). I understand the mathematics of back ...
0
votes
2answers
26 views
Machine Learning Validation Set
I have read that validation set is used for Hyper-parameter tuning and comparing models. But, what if my algorithm/model does not have any hyperparameter? Should I use validation set at all? Because ...
0
votes
0answers
10 views
Advice on advanced analysis for end term Project
I have an end of term project for a class in Applied Data Analytics. I am a software engineer of 18 years and I have learned a lot so far using R with little problems.
This question is less ...
0
votes
0answers
13 views
SVM radial kernel equation
Lets say i have two independent variables (P and Q) and a binary variable C. i use logistic regression to calculate individual coefficients of P and Q (m,n) plus a constant( b). The equation of ...
0
votes
3answers
47 views
How to predict future sales based upon last year sales data? [closed]
I have past 1 year of sales data and now i want to predict sales for next coming year.
How can i predict it.
0
votes
0answers
5 views
Prediction failure event using the Cox proportional hazard model
I'm new to data science and my task is to predict the next failure event (FE) given previous events.
Assume that I found a pattern that finishes with that failure event, for example:
...
0
votes
1answer
15 views
General question on the approach to optimise numbers
I have a huge huge model in SQL that nobody knows what it is doing. This model spits out some numbers and those numbers should be optimised to match another batch of 'correct' numbers as much as ...
0
votes
0answers
10 views
Xgboost prediction on Sagemaker's side
Good afternoon.
Simple .fit({'train': s3_train_data, 'validation': s3_validation_data}) is called on an Estimator to train it by pulling data from s3 as s3_input (hence the s3_train_data and ...
1
vote
1answer
13 views
Column header in XTS and Data frame in R
I used quandl function extract stock data with object type as xts.
...
1
vote
0answers
31 views
Anomaly detection on text data using one Class SVM
I am working on an Anomaly detection problem that is first of its kind for me. I am able to do data cleansing and train the model however I have no idea on predicting results, as it is new for me and ...
1
vote
1answer
32 views
Support Vector Machine Errors
What is the difference between SVM classification error, SVM margin error, and SVM total error ? Is there any clear definition for them ? And what is C parameter in SVM ? Its totally confusing me !!!
2
votes
1answer
14 views
In a residuals vs fitted plot, how do I interpret a homoscedastic variance that is not randomly distributed above/below the line?
I'm learning linear regression, and I ran a step function for linear regression and checked out the residuals vs fitted plot for the final equation. The residual looks homoscedastic but it's not ...
1
vote
0answers
22 views
DONUT- Anomaly detection Algorithm ignores the relationship between sliding windows?
I'm trying to understand the paper : https://netman.aiops.org/wp-content/uploads/2018/05/PID5338621.pdf about Robust and Rapid Clustering of KPIs for Large-Scale Anomaly Detection.
Clustering is done ...
1
vote
1answer
33 views
receive value error decision tree classifier after one-hot encoding
I am trying to build a decision tree model. After one-hot encoding, it seems somehow the data still has a problem. When I run the following code, I receive this error:
...
0
votes
0answers
13 views
Convert extracted text into short summary (Abstract summarisation)
I extracted some text from PDF and is in raw format (having lots of text)
I need to convert extracted text into meaningful short summary
Are there any algorthims available or pre_defined libraries ...
1
vote
0answers
62 views
Passing variable length sentences to Tensorflow LSTM
I have a tensorflow LSTM model for predicting the sentiment. I build the model with the maximum sequence length 150. (Maximum number of words) While making predictions, i have written the code as ...
1
vote
1answer
41 views
Can RNN work with just one input?
We have a time series data.Is it possible to create a RNN such that there is only dimenson(or feature) in data(as shown in fig1).If yes,will it identify the pattern in time series data correctly? The ...
1
vote
0answers
12 views
What kinds of math do I need to know to construct graph that preserve its directed simplicies at each time step? [closed]
First of all Thank you for taking your time to answer my questions.
Disclaimer: I am no where near expert. I am just an undergrad student who is planning to get PhD in Deep Learning.
I have been ...
0
votes
1answer
22 views
Converting dates to appropriate form to train machine learning model
I am trying apply linear regression on a dataset where the independent variable is a date formatted like '2-jan-08'. How should I convert the date so it can be used for model fitting?
0
votes
0answers
6 views
Identify if a given text belong to a particular context
I have a big corpus of sentences that belong to a particular context, for example
all of them denote "Restrictions" is some way or other. So for a given text, I need to find out if that text falls ...
1
vote
2answers
67 views
Reg. Pandas factorize()
-Hi Experts-
I just read about factorise() function in Pandas. Using this I'm able to encode (enumerate) my string values into numbers. But, now I'm not able to understand what numbers corresponds ...
0
votes
0answers
12 views
How to perform T-test and chi square test to my categorical variables like country, education and predict accuracy using logistic regression?
I'm new to Data science. I have been working on a classification project which has columns (Sex, Age, Occupation, Marital Status, education, country, relationship,capital gain, income). Here income('&...
1
vote
1answer
45 views
1
vote
1answer
31 views
Predicting for future date
How do I predict a category of data for a future date ?
Example: what will the Sales figure for region (or region wise) for a particular date in the future based on the sales person past data for a ...
1
vote
1answer
23 views
checking model stability - Performance for different class
I tried to do multi-class classification problem. The goal is to predict whether the match will be won by HomeTeam, AwayTeam or Draw. I did feature engineering from the attributes and finally came up ...
1
vote
1answer
53 views
What are the limitations while using XGboost algorithm? [closed]
Will XGBoost pose any problem while dealing with categorical variables with more than 2 levels.
For example, occupation variable can have values like doctor, engineer, lawyer, data scientist, farmer e....
0
votes
0answers
8 views
Probabilistic search engine user behavior markov models
I am considering the following probabilistic Markov model of actions of a user on the results page of a search engine.
The user examines the first result, with a probability $A$ he is satisfied with ...
1
vote
1answer
33 views
How to mathematically explain the translational and rotational invariance of PCA
There is a homework question for a course I am self studying (not a student) that is:
let our $n \times d$-dimensional data vectors be denoted by $x_1,\ldots,x_n$ and let $R$ be a $d \times d$ ...
1
vote
0answers
16 views
SMOTE caused my total nrows in train to fall to a very small proportion
I have a highly skewed dataset with minority class in target being just about 4%. I decided to apply SMOTE using library DMwR in R. Here is my target:
...
0
votes
0answers
6 views
Game Data Analysis (Stats)
Analyzing some game data and wanted some help to know how a specific column affects the game economy dynamics.
Game Scenario:
• This game data comes from a video game in which players earn items ...
1
vote
0answers
18 views
Keras - How to using Cnn trained model on video image.?
I have trained Cat and dog image using CNN with Python ( total 10K, 8K for training and 2K for testing ).
I want to make prediction in a video. Video Contain both cat and dog at a single moment. How ...
0
votes
0answers
24 views
How to classifying/Identify both cat and dog image in a single image?
I have trained cat and dog images and testing them using CNN model with python.
..
Ok..!
But I have one image in which both cat and dog present ...
.
Now question is how to make label cat and label ...
0
votes
2answers
601 views
What are Machine learning model characteristics? [closed]
This question I have received in some Machine Learning related interview and Here is the question
What questions would you ask to learn about machine learning model characteristics?
This is what ...
1
vote
2answers
38 views
Predicting missing data. Looking for good data predicting technique
I am analysing data for Countries Trade GDP. Some of the countries have missing GDP value for given a year. However, I have Grand Total for the entire region for that year. Is there a good data ...
0
votes
1answer
33 views
error while running lasso.py
The following is the error code generated while running lasso.py.
Can anybody help in fixing the same.
Here is the code:
...
-1
votes
0answers
29 views
Which industry has more interesting use cases and more room to learn for Data Scientist, between Retail and Banking?
I am posing this question here due to the active community of Data Scientist and people with real industry experience here. I did not put in career advice because here is where we have real Data ...
-2
votes
1answer
17 views
Converting int list to vector list
I want to train a text classifier using OnevsRestClassifier, but have problem getting a propper y. Currenly my y is a list of int, but I need it as a list of vectors.
My y:
...
-1
votes
1answer
27 views
Clustering Customers on transactional behavior
Objective:
Segment the accounts on their transactional behavior and find the accounts which are more likely to subscribe for loans.
Dataset:
1) Account_Number
2-91) Transaction amount ...
0
votes
1answer
20 views
Which model can solve the “sequence demand” problem?
I have a regression problem. When a truck comes, it influences the demand of employees for the next 30 days. Additionally the demand depends on the type of truck (when the truck is big, we need more ...
2
votes
1answer
31 views
Adding recommendations to the output of a classification model
I have built a binary classification model using:
logit
decision trees
random forest
bagging classifier
gradientboost
xgboost
adaboost
I have evaluated the above models and chose xgboost based on ...
