Questions tagged [machine-learning]
Machine Learning is a subfield of computer science that draws on elements from algorithmic analysis, computational statistics, mathematics, optimization, etc. It is mainly concerned with the use of data to construct models that have high predictive/forecasting ability. Topics include modeling building, applications, theory, etc.
11,316
questions
0
votes
0
answers
16
views
Algorithms from R-statistics package Caret R Package- LVQ algorithm, is there similar in Python
In the R-statistics package : Caret R Package, they have the LVQ algorithm that is used
for the purpose of "Feature Selection".
I have used this to do some data science in R-stats over 6 ...
- 103
0
votes
0
answers
4
views
Demand Forecasting methods for hundreds of time series
I have TFL cycling dataset for the time period from JAN 2023 to JUNE 2023. I would like to forecast the demand or expected no. of trips for each station at every hour of the day.
Post some data ...
- 197
0
votes
1
answer
17
views
Does learning rate depend on input and output range?
I watched hours of videos on gradient descent and still feel pretty confused. Let's say I have a "model":
y = x * w
I use 2 as my target ...
- 103
1
vote
1
answer
28
views
Minimizing error in cosine similarity
Presume I have a vector space, and I am attempting to compress it into a latent vector space, while minimizing error in cosine similarity between entries. Suppose that I know the actual cosine ...
- 13
1
vote
1
answer
44
views
Which type of Machine Learning is used in robots?
Which type of Machine Learning is used in robots? Is it supervised learning or unsupervised learning or Reinforcement learning?Especially the robots that were sent in space?
- 11
1
vote
1
answer
32
views
Aggregating decision criteria of different scales
Let's say I have a framework that performs a detection task on some dataset. In order to do so I use three different metrics (A, B, and C) as decision makers. A and B are probabilities, i.e., $ 0 \le ...
- 113
1
vote
0
answers
17
views
Two-part ML classification model on panel data - is it viable?
I have a dataset of medical encounters, and I aim to predict whether a patient will return to the hospital within 30 days after being discharged. Each row in my dataset corresponds to a specific ...
0
votes
2
answers
38
views
Counting Number of Holes in an Image of Cheese
I've been assigned a project that involves writing a script to detect the number of holes in an image of cheese. My background in AI is quite limited, so I was wondering if anyone could give me a good ...
- 3
1
vote
1
answer
27
views
Ordering of Train/Val/Test set use in hyperparameter tuning
The way I read almost lots of ML advice on these datasets sounds like "You train a model that's randomly chosen hyperparameters first on the training set, then you ignore this bit of the work, ...
- 101
0
votes
1
answer
17
views
Logistic Regression Import error
Hi Im using SKlearn for a school project. I cannot importy Logistics regression without getting a numpy float error.
Have not been able to find any solutions online.
0
votes
0
answers
8
views
ML approach for quantifying building quality perception
I'm working on a project to model public perceptions of buildings in a tourism context, focusing on attributes like beauty and mystery. The data I have is a labeled dataset of building photos, each ...
- 101
0
votes
0
answers
16
views
Can I modify my training datasets (X_train and Y_train) while fitting the model?
I am new to ML and I am trying to train a forecasting model. The target variable (Y_train) has multiple columns, all of Boolean type. The features table (X_train), according to my approach, in the ...
-2
votes
0
answers
21
views
Creating a data visualisation using matplotlib and unsupervised learning
I have to write a python code on a kmeans algorithm and heres the requirements.
You should submit a single file (not zipped) named myVisualiser.py containing a function with signature:
def ...
0
votes
0
answers
16
views
Looking for datasets on automobile parts information for machine learning
I'm embarking on a machine learning project that requires a comprehensive dataset of automobile parts information. The goal is to train a model that can identify and categorize various auto parts, ...
- 1
0
votes
1
answer
13
views
Hassle-free platform for a small data science team?
our team of 4 data scientists has been exploring options to automate our ETL, data storage and model updates and are looking for a hassle-free platform that can help with this.
We've had several ...
0
votes
0
answers
15
views
Seeking datasets for training a Language Model on U.S. mortgage loan processes
I'm in the process of training a Language Model (LLM) and require datasets that encompass various aspects of the U.S. mortgage loan process. The model's aim is to understand and simulate decision-...
- 1
1
vote
1
answer
37
views
How does oversampling or undersampling approch is going to help during the testing on real time data?
We have a dataset with class A as 10% only and Class B as 90% . Let say we did undersampling or oversampling on training data and we made 50% of class A and 50% of class B. But in reality the data ...
- 13
0
votes
1
answer
27
views
Test set won't have all the features present in the training set
I have to analyze a cardboard packaging system. To simplify, it consists of three parts, each of which needs to be set up (this depends on the pre-order): the printer, the slotter, and the cutter. The ...
- 1
0
votes
0
answers
8
views
How to selectively train a deep model based on the unavailability of a subset of the feature set
I am creating a deep learning binary classification model. Each sample in the dataset contains two mutually exclusive feature sets X and Y.
Feature set X is present in all samples; however, there are ...
1
vote
1
answer
21
views
Out-of-Range Target Variable in Sequence-based Machine Learning Model
I'm encountering a scaling issue in a machine learning project. I'm predicting a target variable from an input sequence (and doing this for many). However, I've encountered a challenge where the ...
- 11
2
votes
1
answer
1k
views
Why images, audio/video clips, text are regarded as unstructured data?
Tabular data is regarded as structured data, while other data types such as images, audio, video, text are regarded as unstructured data.
I am confused that, taking images as an example, they are just ...
- 23
0
votes
0
answers
6
views
SVM kernel for detecting if a substring appears in some given string
I'm trying to do the exercise in 16.1 in the book Understanding Machine Learning, Ben-David, et al. formulated as follows:
Consider the task of learning to find a sequence of characters
("...
- 155
0
votes
0
answers
17
views
How to estimate the weights for a weighted average if not every weight is used in every example?
Say that you have a data set that contains $N$ examples. For each example, there are three main sections of important information. The first most important piece of information is the name of the ...
0
votes
0
answers
30
views
Some questions from a noob - Chat bot
I'm a T-SQL and .NET developer but I need to understand some basis about a data science / ml project.
I would like to know the guidelines and be directed to the right topics about the steps that need ...
0
votes
0
answers
22
views
Using LLMs for structured data?
I've been trying to work with structured data in language models, and it's proving to be quite challenging. I'm confident that with Langchain, I should be able to solve the problem, but I'm not ...
- 21
0
votes
0
answers
33
views
Mislabeled problem with hospital data
I am writing this post to ask or see if someone can help me with this problem in case you may have faced a similar situation.
My problem has to do with a ML tool that I am trying to develop in a ...
- 1
0
votes
0
answers
58
views
Design a CNN that can detect the face in the given input image
a. What strategy will you use? How many layers? How many filters?
b. Describe the filters for each layer in detail.
c. Show how the convolutions will work and demonstrate that your CNN will be able to ...
- 1
0
votes
1
answer
46
views
Proper way to build time series dataset
I have daily time series but need to predict weekly total.
Here is example:
date
col0
col1
col2
col3
col4
target
0
2023-01-01 00:00:00
-1.021
0.708
-0.564
-0.502
0.244
-106.538
1
2023-01-02 00:00:...
- 1
0
votes
1
answer
40
views
Semantic Search on numeric data
I have a dataset in csv format. Most columns have numbers in them. The data is mostly number based, with little text.
A sample of my dataset:
I want to build a semantic search engine that can answer ...
- 275
1
vote
2
answers
51
views
How to create a bot for a real-time PvP game using machine learning?
Unfortunately, I am not well-versed in machine learning. However, I'm trying to understand if it's possible to create a bot for a real-time PvP game like, for example, Clash Royale or Random Dice: ...
- 111
0
votes
1
answer
69
views
Employee Attrition - Binary Classification - Predicting leavers
I'm trying to wrap my head around what the standard or best approach is for identifying which employees in a business would be most at risk of leaving, given their features and an indicator column ...
0
votes
0
answers
6
views
Clustering high-dimensional data
Every sample in my dataset consists of two components: its $x$ component is a $n\times m$ matrix, and its $y$ component is a $p\times q$ matrix (Feature selection and PCA have been done before). Apart ...
- 1
0
votes
2
answers
46
views
What methods do top Kagglers employ for score gain?
I’m currently taking a course on ML and part of my final grade is my position on a Kaggle competition (private one) regarding a classification task. The majority of groups tend to have a similar ...
0
votes
0
answers
29
views
Feature selection: ANOVA between features vs within a feature
I am currently performing feature selection on a dataset containing continuous and categorical features. The target is a continuous variable.
If I understand properly, ANOVA can be used between ...
- 1
0
votes
0
answers
25
views
Loss values seem to fluctuate, yet the weights are correct
I'm taking my first steps with tensorflow (and in ML in general), and using this piece of code to train a very simple model that tries to find the underlying linear relation: f(x,y) = 4x +7y -2 (+ ...
- 1
0
votes
0
answers
14
views
Data Transformation Pipeline Issue on Flight Fare Prediction End-to-End Machine Learning Project
I am following the process shown on Wine Quality Prediction End-to-End ML Project on Krish Naik's YouTube channel to do a Flight Fare Prediction Project.
I am facing an issue with Data Transformation ...
1
vote
1
answer
45
views
How do I use ML models to estimate current stress level based on past data?
I am new to machine learning and I cannot understand the difference between estimating current stress level and predicting future stress levels based on historical data. I have been told these are two ...
1
vote
1
answer
40
views
Should I apply the same data transformations in production for my classification model's inference steps
I am now moving my best classification model to production and doing tests currently.
Should I use the same scaler() I used in training during my inference in ...
0
votes
0
answers
17
views
How to make a dataset for Audio Speech Recognition of Arabic Language
I am trying to map Quranic Verses for the identification of errors. Different audios for the same verse have different durations as it depends on the reciter. I used Audacity to normalize but the ...
- 1
0
votes
0
answers
19
views
Best accurate face recognition library
I need to use an accurate library for face recognition in my attendance python project But I used the face_recognition but I could no get the desired result.is there any way to get the 99% accuracy?
I ...
- 1
1
vote
1
answer
47
views
Beginner basic clustering model and one-hot encoding?
I have a dataframe of natural disaster incidents in Afghanistan from 2016 - 2023.
Column names:
REGION (Northern, Eastern etc)
PROV_CODE (province)
PROV_NAME
DIST_CODE (district)
DIST_NAME
INC_DATE (...
- 13
0
votes
0
answers
25
views
Target variable is discrete ranging from 1 to 14, with each value having same proportion in the dataset, ML models fail miserably
I have a dataset of shape (55314,23). The target variable is league_rank. There are exactly 3951 leagues in this dataset, with each club having a ranking from 1 to 14. The variable is discrete, and ...
- 1
0
votes
0
answers
15
views
Open Source Model or dataset for attention map visualization
Helloo (:
I'm trying to develop a python application where users can upload an image e.g. of their website and receive a heatmap or attention map in return. This map should indicate where users are ...
- 1
0
votes
1
answer
30
views
Beginner clustering project, what are the input features and how do I analyze the data?
I am a beginner to data science. I have this dataset on natural disaster events in Afghanistan from 2016 - 2017. Columns:
REGION (ex. North, North West, etc)
PROVINCE_NAME (kind of like US 50 states)
...
- 13
0
votes
0
answers
14
views
What do I need to take into account if I want to test one model on different test datasets?
I'm just new to machine learning, I want to test a generative model on two different test datasets to compare its performance on different datasets. What do I need to take into account about the ...
- 1
0
votes
0
answers
7
views
Oblique Decision Tree HHCART algorithm explaination
I am now studying a paper about implementing oblique decision tree algorithm
https://arxiv.org/abs/1504.03415
I was wondering if any code implementation and alternative explaination, as a support ...
- 149
1
vote
1
answer
17
views
Is it possible to run ML models on SBC boards?
Can I run models like Tortoise TTS or OpenAI Whisper on SBCs like Orange Pi 5 or Odroid N2+?
- 111
0
votes
0
answers
5
views
Data Tracking For Process Improvement
I work in a manufacturing plant with 6 production lines. As part of the maintenance crew, it is my job to record all maintenance work performed on the equipment inside of our shared OneNote. This ...
- 1
0
votes
0
answers
8
views
LGBM handle categorical variable with categories which have quantities less than that of min_data_in_leaf
I am building a LGBM model where categorical features have been encoded using ordinal encoding. The categories get values from number from 1 to a max number that are all consecutive. How does LGBM ...
1
vote
1
answer
33
views
activation=tf.keras.activations.relu vs activation='relu'
Both models are for binary classification problems
Model 1
...
