Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
470
questions
0
votes
0answers
6 views
Balanced target variable in KNN classification
In many places, I have seen it only mentioned that predict the label of the query point as the label with more than half of the labels of it's K nearest neighbours. However, I don't see it mentioned ...
0
votes
0answers
9 views
showing this error ValueError: shapes (1,400) and (10000,10) not aligned: 400 (dim 1) != 10000 (dim 0)
I am trying to run a network and get this error .I am a noob,can someone help me.
...
2
votes
1answer
23 views
Which Scikit-learn application should I use in order to process my data? (Python)
I am writing a program that will take a multitude of data, such as chlorophyll levels, water temperature, nitrogen/phosphorous levels, etc., in order to predict the growth of algae in a body of water. ...
0
votes
0answers
18 views
Handling repeating data from different individuals
I have a dataset that has some unique values but also includes information from multiple individuals that are repeating, meaning they are describing the same attributes and can have the same or ...
1
vote
1answer
27 views
What is meant by "a linear model applied to the output of the poly() function"?
Currently, I am studying the third chapter of An Introduction to Statistical Learning with Application in R which discusses linear regression. In section 3.6.5: Non-linear Transformations of the ...
-1
votes
0answers
18 views
Write the function regex_pattern that takes a string as input and returns first word and year in the string after pattern matching [closed]
import re
def regex_pattern(string):
return
if name == 'main':
string = input()
print(regex_pattern(string))
0
votes
0answers
17 views
Siamese netwroks - how to choose loss function?
I have read several articles about siamese netwroks, and I understand that there are 3 different types of loss functions:
...
0
votes
0answers
14 views
Threshold moving for classification - how can i assess the cost?
I have a binary classifier. When i used my model to make predictions about 4k out of 10k were predicted to be "Rich". I am predicting affluence. Normally in classification the cut off to ...
1
vote
0answers
14 views
Is python & tableau enough to become data analyst? [closed]
Currently, I working as SEO Analyst. I want to become a data analyst and so I have started learning python with data science from udemy course.
Can Anyone help me with guidance to learn data analytics?...
0
votes
0answers
19 views
Association rules - Interest of association rules [closed]
I came up with this equation:
Sup(xUy)=Sup(x) * Sup(y)
where x and y are some subsets ...
1
vote
0answers
23 views
Association rules - Find 100% confidence rules [closed]
Suppose there are 100 items, numbered 1 to 100, and also 100 baskets, also numbered 1 to 100. Item i is in basket b if and only ...
0
votes
0answers
29 views
Is it possible to derive anything useful from this piece of data?
Let's say you have online Profile A. Profile A is present on 3 websites: X, Y, Z.
...
1
vote
1answer
16 views
Create Period column based on a date column where the first month is 1, second 2, etc
I have a dataset with many project's monthly expendituries (cost curve), like this one:
Project
Date
Expenditure(USD)
Project A
12-2020
500
Project A
01-2021
1257
Project A
02-2021
125889
Project ...
1
vote
0answers
25 views
Legal issues with Machine Learning [closed]
I'm confused with why people claim that current legal system cannot handle any wrongdoings of algorithms that involve Machine Learning and Artificial Intelligence. The claim is that it is impossible ...
1
vote
1answer
38 views
Logistic Regression - Probabilistic intuition vs Geometric intuition
The Probabilistic approach of logistic regression involves the MLE (Maximum Likelihood Estimation) maximizing the likelihood function, or in other words, finding the best parameters for the best fit ...
1
vote
0answers
22 views
Single input and multiple outputs generating model in machine learning
am trying to build a air speed prediction system,
usecase - given air speed for a particular city in the US, I want to know the air speed inside the city within the buildings, with the help of ...
1
vote
1answer
14 views
reducing false positives with annotated named entity recognition model
I am training a NER model to detect mentioned phrases and slang words in a bias study conducted on court cases.
Essentially, I have packets of text that I scanned and these are the complete ...
-1
votes
1answer
81 views
ValueError:Input 0 of layer sequential is incompatible with the layer
i represented each row in my dateset as a 15552 cell which is spectrogram colored image(72723), that is represent the audio features, 72*72 is the size of spectrogram image and 3 referred to the 3 ...
0
votes
0answers
25 views
what tool or theory should I use to analyse Baccarat roadmap?
I am going to write a program to analyze the result of the Baccarat game.
In Baccarat, there will be two results, banker win, and player win.
People use a roadmap to record the results, it's like this:...
1
vote
1answer
21 views
Order by commonness of words: Sentence matching
I'm trying to compare two sentences which might or might not be about the same theme (product). I've tried a few metrics like cosine similarity, distance etc. but the results are not very impressive. ...
1
vote
0answers
12 views
Is it possible to see the output for each layer in a mlp? using SKLearn
I have a simple NN which I have made with SKLearn.
I have extracted:
The weights sent to each node
The bias assigned to each activation function
But I can't see a way to get the output of the ...
1
vote
0answers
20 views
How Can we build the Machine Learning model for Incorrect information [closed]
I have a huge dataset of all hotels across the world who are our
prospective customers. However, the address details available on these
accounts are generally incomplete or has incorrect information. ...
1
vote
0answers
9 views
How can we optimize a model to predict in the no shortest possible time (real time production model)?
I need to put a model in production and I have some questions:
How can we measure the time it takes to predict? Let's consider data is ready (real time) and we need first to transform data than to ...
1
vote
2answers
86 views
inconsistency between y and x numbers in the Split into train and test sets
I am new to the field to the data science, and need help in the following:
I am working on a data set that consists of both categorical and numerical values, first I have concatenate the two files (...
0
votes
0answers
27 views
Which type of Reinforcement Learning to use?
First of all, I am new to the topic of machine learning, AI, etc.
However, I would like to create a sophisticated decision algorithm. The decision is a Boolean decision and you can suppose the result ...
1
vote
0answers
20 views
How to Scrape Website Usage/User Data for a Website that Does Not Have an API [closed]
I am an aspiring Data Analyst and I was wondering how do I web scrape website usage/user data such as:
total people who visited that website,
total visitors per page,
how long did each visitor stay ...
1
vote
1answer
22 views
One predictor variable and 3 response variable (categorical and continuous) [closed]
If I have predictor variables which are a mixture of continuous and categorical, and a response variable that is continuous.
What approach should I apply? Linear regression, logistic regression or k ...
3
votes
2answers
3k views
My data is highly overlapping, but when I apply logistic regression, it is giving an impressive accuracy of 79%. Why?
Logistic regression is supposed to work well only on data that is linearly separable. As we can see in the pair plot, the data points heavily overlap. The logistic regression model is in fact showing ...
1
vote
0answers
9 views
Identifying the best group that are most productive
can you please give some idea to solve this problem, Below is my data, I want to identify the best inventory based on the CPM(target value) .. For example: I want to be able to say - Business section, ...
0
votes
0answers
19 views
Comments Moderation/Profanity Filtering
Just a brief background. I am working on a project for a live-streaming app and we want to improve our live comments moderation using machine learning. The problem is that it over filter/block words ...
0
votes
0answers
17 views
Predict the best Day and time to call model
Hi, I want to build a classification model. The task is to build a model which will predict the best day and the best time to call a client. My data includes the following details. Here time_connect(...
0
votes
0answers
8 views
Split data using existing model's performance
For splitting of the data into train/test/val I use stratified sampling. Then I confirm that metadata distributions represent the original dataset well enough.
I want to start considering error of an ...
3
votes
1answer
48 views
Using output of ML algorithms as an input to different ML algorithm (Ensemble Learning)
I want to assign weights to multiple models and make an single ensemble model. I want to use my outputs as the input to a new machine learning algorithm and the algorithm will learn the correct ...
1
vote
0answers
3 views
What is the algorithm for reading computerized text and handwritten numeric text from a tabular image using Python?
I want to read this image text
0
votes
0answers
35 views
Q value is estimated under state V value and action A value for DDQN
How Q value is estimated under state V value and action A value.
Given the below DDQN algorithm, the deep network is divided into two parts on the end layer, including state value function V(s) which ...
0
votes
1answer
12 views
How to set coefficient limit in lasso regression in Python?
I'm working on a regression problem where I want to use Lasso model. With the help of Lasso and LassoCV, we can provide different alpha values and get the best parameter and coefficients however I ...
0
votes
1answer
23 views
can I use the pre trained model with different input channel size?
The pretrained model accepts the input shape like this;
[batch_Size, Channels, Depth, Height, Width]
[32, 3, 16, 224,224]
I want to give it;
...
1
vote
2answers
44 views
Why cant we further tune/change the model after evaluating on the test set?
Every thread on stackexchange that I've found says that you can only use the test set once and thats it. So for instance, if you used a linear regression model and got poor results on the test set, ...
0
votes
1answer
11 views
Regression prediction for HVAC unit Best way to utilize available data?
I am starting to investigate machine learning applications for HVAC at the commercial level. I am an HVAC controls person by trade that has recently taken some basic courses on Machine learning and ...
0
votes
1answer
40 views
Train set and Test set For result and conclusion
I have performed a Logistic regression on a binary classification dataset.
The result are as follow :
The training-set accuracy score is 0.8523 while the test-set ...
0
votes
0answers
12 views
How to perform nonlinear regression on data with error?
Most of of physical measurements are associated with error, I am wondering how to perform nonlinear regression in this situation. In the linear case, there are few methods like Deming Regression, ...
1
vote
1answer
26 views
What are some application of Google's PageRank Algorithm in Data Science
I came across a topic on computational linear algebra that talks about iterative algorithms to compute eigenvalues. I've worked with power method which is an iterative algorithm that converges a ...
0
votes
2answers
16 views
where can we find the healthcare dataset [closed]
I'm researching Medical Data set on some diseases like tuberculosis,cirrhosis,chronic kidney disease with the columns of age, body mass index, cholesterol, glucose, blood pressure, and the like that.
...
0
votes
0answers
25 views
Retail Channel Performance Analysis
I have some real time sales and revenue data for a retailer for each day across customer type, state and channel. Sample data shared below:
Sales
Date
Region
State
Customer Type
Sales
Channel
1/1/...
0
votes
0answers
29 views
Categorical column with many missing values (33%)
I have a dataset of credit cards with these columns as feature (20000 rows):
...
0
votes
0answers
17 views
outlier detection: zscore vs isolation forest
Trying to understand when to use zscore and when to use isolation forest for determining outliers in the data.
I know that zscore is only applicable if data is normally distributed whereas ...
1
vote
1answer
42 views
The softmax function, why?
We know that Softmax usually applied to multi-class labels with the function of $e^{a}\over \sum e^{a}$.
My question is will a function like $a^{2} \over \sum a^{2}$ mostly work also? If not, why?
...
0
votes
0answers
19 views
What analytics model/classifier should be used to predict price?
I've go dataset with more than 10 features - football skills describing players. There is also price value in each row.
I would like to predict price by specifying ...
0
votes
1answer
15 views
Logistic Regression Model on Test Set - in Titanic Data Showing Error
I have built the model on Titanic Data set , with Logistic Regression Succeffullly and it is giving prediction on training set , but unfortunately I am unable to implement this on test data set.
...
0
votes
1answer
214 views
OneHotEncoder Showing error while encoding two columns
I am encoding two columns with index number 1 and 2 that is column number 2 and 3 , using the following code, however I am facing error of invalid syntax : If I am using only 1 in the index value it ...