Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [data-science-model]

Questions about the organization of elements of data, and the standardization of their relations.

Filter by
Sorted by
Tagged with
0 votes
1 answer
344 views

Trying to use different image size to test my trained model

I have built my model using images which are all 512x384, I then exported the model through .pkl and am hosting it on Render, the UI is built on React App where the user will input their chosen image ...
1 vote
0 answers
19 views

Linear Discriminant Analysis (LDA) determining the class for test data after transforming with eigenvectors

Suppose we are given two classes class-1 and class-2 and the mean of the two classes are $μ_1$ and $μ_2$ respectively before projection. Both of their variance-covariance matrix is also provided ...
1 vote
1 answer
776 views

How to extract embeddings of categorical variables

I am little bit confused about encoding categorical variables. There are other posts/blogposts on this issue but none is talking about the problem I am facing. I have a dataset with mixed variables (i....
0 votes
1 answer
27 views

I have some topics from python out of which I want to know the one which actually needs to be studied for data science roles specifically

The topics are as follows: Collections Itertools Regex and parsing Error and exceptions Date and time
0 votes
1 answer
75 views

Learn the evaluation matrix for hire a job candidate

Let us assume that we have a certain number of features that are weighted with some parameters . The features could be the different skills that belongs to a job candidate applying for a job ...
1 vote
0 answers
34 views

I need some advice about working as Mathematical Modeler/Data scientist

I have 10 years experience in studying mathematics in University, and I've just finished my Masters degree I have some experience with LaTeX and Mathematica, what do I need to study to be able to ...
0 votes
0 answers
11 views

ML for lot sizing task

I am solving the problem of automatic lot sizing, which consist of different products. I receive data about a certain product and I have to decide which products to combine into lots. And then ...
1 vote
1 answer
463 views

Object Detection: Setting threshold values as trainable parameters?

I am building my first object detection model (Mobilenet SSD, to detect animals in images) and happy with the current test results. When I tested it using images without bounding boxes, I noticed some ...
1 vote
1 answer
22 views

Feature Engineering a Recency feature

I have a customer scoring problem I'm working on specifically on predicting conversion and coming up with a probability score on conversion (using xgboost classifier atm). There's a feature I want to ...
0 votes
1 answer
641 views

Can absolute or relative contributions from X be calculated for a multiplicative model? $\log{ y}$ ~ $\log {x_1} + \log{x_2}$

(How) can absolute or relative contributions be calculated for a multiplicative (log-log) model? Relative contributions from a linear (additive) model E.g., there are 3 contributors to $y$ (given by ...
2 votes
1 answer
27 views

How to analyze time series data and create time series model in Python?

I am trying to understand time-series data and model. In youtube tutorial and others, mostly univariate examples are shown. And they are applicable or suitable for those conditions. What if our ...
3 votes
1 answer
541 views

Two steps optimization of a credit card limit

I have a problem similar to what is on the title but not the same. The problem on the title allows me to explain the dynamics of my need. I have to determine what the optimal value is for a variable ...
2 votes
1 answer
56 views

Artificial Intelligence trends and topics

I was wondering if there are websites with which to stay constantly updated on the latest trends or topics on disruptive applications in artificial intelligence. I usually read scientific publications ...
1 vote
1 answer
55 views

Machine Learning on Small Dataset with Huge Variation

In 2018 the NCAA allowed players to transfer school more freely, so now teams want an advantage by getting transfer players. I want to create a model that can predict which transfer players can be ...
0 votes
0 answers
12 views

What to include in fact and dimension table from election database

I am working with election dataset of India of year 2014 and data for 2019 I also have table for party names and descriptions and finally state name with code. I am not getting how do i create a ...
1 vote
1 answer
37 views

How to measure different models' feature importance using a generic and common standard?

I want to measure the feature importance of a series of models after training them. Most models have some built-in APIs that allow me to access their feature importance, but as far as I know, these ...
0 votes
0 answers
19 views

Input 0 of layer "sequential_2" is incompatible with the layer: expected shape=(None, 3, 3), found shape=(1, 3, 11)

I am trying to predict stock closing price using news sentiment analysis with the help LSTM neural network but after I do model.fit(). I am encountered with the error message: ValueError: Input 0 of ...
2 votes
1 answer
2k views

Advantages and disadvantages of using softmax/sigmoid and categorical_crossentropy/binary crossentropy for a binary classification with a CNN

I'm doing a deep learning model using tensorflow and keras. I have a question about the output architecture. I want to classify between two classes, images with defects and images without defects, I'...
1 vote
2 answers
2k views

model.fit vs model.evaluate gives different results?

The following is a small snippet of the code, but I'm trying to understand the results of model.fit with train and test dataset vs the model.evaluate results. I'm not sure if they do not match up or ...
0 votes
1 answer
112 views

What is the right Pytorch RNN implementation?

I read about RNN in pytorch: RNN — PyTorch 1.12 documentation. According to the document the RNN run the following function: I looked on another RNN example (from pytorch tutorial): NLP FROM SCRATCH: ...
-1 votes
0 answers
19 views

Why Python is considered the perfect choice for healthcare technology

"Versatile Language: Python's flexibility allows for a wide range of applications in healthcare technology, from data analysis to machine learning algorithms.Rapid Prototyping: The ease of ...
1 vote
1 answer
2k views

Determine model hyper-parameter values for grid search

I built machine learning model for Ridge,lasso, elastic net and linear regression, for that I used gridsearch for the parameter tuning, i want to know how give value range for **params Ridge ** below ...
4 votes
2 answers
594 views

How do you use KS-test in a data science report?

I'm writing a data science report, I want to find an exist distribution to fit the sample. I got a good looking result , but when I use KS-test to test the model, I got a low p-value,1.2e-4, ...
0 votes
1 answer
68 views

What actually is model size scaling and how do i globally apply to every model?

I read this article on the EfficientNet paper and have seen a lot of this kind of scaling. For example, there's Tiny-YOLO, YOLO (the base),.. Some model like SVTR, people did scale it to Tiny, Small, ...
-1 votes
1 answer
33 views

I need suggestion for a project

I want to make a forecasting system which will forecast how much quantity will be sold next year based on the previous 5 years' data from 2019 to 2023 and want to predict for future years. Now the ...
2 votes
1 answer
283 views

reducing false positives with annotated named entity recognition model

I am training a NER model to detect mentioned phrases and slang words in a bias study conducted on court cases. Essentially, I have packets of text that I scanned and these are the complete ...
0 votes
1 answer
948 views

Use both differencing and normalization in time series modeling to make it stationary?

I am working on a time series dataset. Should we use both differencing and normalizing or either of the ones to make it stationary?
2 votes
1 answer
285 views

what are the next step after ML prediction and how to proceed?

I have trained an ML model with a good accuracy but what next? I am facing difficulty in answering this question, how will you present your model. Which framework do you use How do you make sure ...
0 votes
1 answer
129 views

Relationship Between Independent and Dependent variables

I calculated the distance correlation among the independent variables and the dependent variables to verify the nonlinear relationship among the variables and the values I am getting for each ...
0 votes
1 answer
65 views

Models vs algorithms

What are basic difference between algorithms and models Is regression SVM random forest decision trees algorithms or model
1 vote
1 answer
113 views

Predicting invoice data of 12 month using only 1 month data

I have only 1 month of historical data of invoices can I predict next 12 month of data with good accuracy if it is possible then which model should I used for prediction? Thanks
1 vote
0 answers
18 views

Xgboost custom objective function. How to modify the weights?

I have a custom objective function to xgboost: ...
1 vote
1 answer
174 views

which Model to apply on panel data where unique id has 6-8 records and total records are 2,000,000?

I am new to such panel data where I have multiple observation for same ID in different Quarter and I am not sure what kind of machine learning algorithm I can apply. I have data from Q1-18 till Q4-...
1 vote
1 answer
288 views

Running H2O in databricks

I am trying to run H2O in databricks. However, when I do the following: hc = pysparkling.H2OContext.getOrCreate(spark) I get the following error: ...
0 votes
0 answers
20 views

Question regarding model inference consistency

I am doing some research on gaze estimation model L2CS provided in here. When you look at the inference predictions on provided image, when face/eye direction barely changes, inference predictions ...
1 vote
1 answer
26 views

How can a citation dataset (like Cora) have strongly connected components?

This website https://snap.stanford.edu/data/cit-HepPh.html shows that the High-energy physics citation network has strongly connected components and it's driving me crazy. A SCC would mean that you ...
0 votes
0 answers
13 views

Are there any Python (sklearn or other) ML libraries that can handle missing data?

I am running a model using a sparse matrix for the X. It can not be imputed. So are there any libraries who modify the main ML models to deal with this?
1 vote
2 answers
71 views

Regression prediction for HVAC unit Best way to utilize available data?

I am starting to investigate machine learning applications for HVAC at the commercial level. I am an HVAC controls person by trade that has recently taken some basic courses on Machine learning and ...
1 vote
1 answer
18 views

Need inputs on logging Machine Learning models and their versions in logs for my application

So i have a web application that recommends movies based on the subject and question that the user puts in , it also uses NLP and ML models like Named Entity Recognition(NER) model to extract keywords ...
0 votes
0 answers
17 views

Variable Selection and model prediction

In a supervised problem, I used randomForest for variable selection to identify the most important features. Question: am I required to use a random forest model for subsequent predictions, or can I ...
1 vote
2 answers
723 views

checking model stability - Performance for different class

I tried to do multi-class classification problem. The goal is to predict whether the match will be won by HomeTeam, AwayTeam or Draw. I did feature engineering from the attributes and finally came up ...
0 votes
1 answer
119 views

General question on EDA, correlations, classification, ML

I am looking for a general best practices regarding classification and correlations. I created a new predictor feature call it B, based on a certain threshold in a feature A. Now I started to do EDA ...
1 vote
1 answer
379 views

How to find correlation between features and labels when features are unordered words?

I have a data set with ~ 85 labels and a target (house price) I wish to explore the correlation between the labels and the effect it has on the target. I have some features that number and others that ...
0 votes
1 answer
19 views

Missing data in train set and test set

I have a dataset of N columns. Now I'm able to preprocess data and find a subset of features that I can use to train a model and make predictions. In the case where the train data has missing feature ...
0 votes
0 answers
10 views

Missing Value in a dataset

i'm curently cleaning a dataset and theres a column called " Institution", it is needed for encoding and training the classification model later so it needs to be cleaned. In that column, ...
0 votes
3 answers
418 views

How to find the driver features towards a particular result in Classification problems

In a classifier model, we can predict the outcome class, but here I need to find out the features that drive towards a particular result in a classification problem, that are a strong indicator of a ...
1 vote
1 answer
87 views

I Have Issues Installing Basemap

I tried to install Basemap and it gives me this: preparing transaction: done verifying transaction: done executing transaction: failed ERROR conda.core.link:_execute(507): An error occurred while ...
1 vote
1 answer
205 views

Generating a set of different scenarios based on some initial observations

I have a in my hands 3 different time series which model 3 different scenarios (base, downside, upside). Every of this time-series depends on a set of 11 different attributes, which take values for ...
1 vote
2 answers
4k views

inconsistency between y and x numbers in the Split into train and test sets

I am new to the field to the data science, and need help in the following: I am working on a data set that consists of both categorical and numerical values, first I have concatenate the two files (...
0 votes
1 answer
61 views

Text classification and predictive model

I have collected a lot of data that I would like to analyse and classified. Unfortunately, they are not already labelled, so I am going to do manually. The dataset consists of texts in Italian and I ...

1
2 3 4 5
14