Questions tagged [machine-learning]

Machine Learning is a subfield of computer science that draws on elements from algorithmic analysis, computational statistics, mathematics, optimization, etc. It is mainly concerned with the use of data to construct models that have high predictive/forecasting ability. Topics include modeling building, applications, theory, etc.

Filter by
Sorted by
Tagged with
0 votes
0 answers
16 views

Algorithms from R-statistics package Caret R Package- LVQ algorithm, is there similar in Python

In the R-statistics package : Caret R Package, they have the LVQ algorithm that is used for the purpose of "Feature Selection". I have used this to do some data science in R-stats over 6 ...
Palu's user avatar
  • 103
0 votes
0 answers
4 views

Demand Forecasting methods for hundreds of time series

I have TFL cycling dataset for the time period from JAN 2023 to JUNE 2023. I would like to forecast the demand or expected no. of trips for each station at every hour of the day. Post some data ...
a_jelly_fish's user avatar
0 votes
1 answer
17 views

Does learning rate depend on input and output range?

I watched hours of videos on gradient descent and still feel pretty confused. Let's say I have a "model": y = x * w I use 2 as my target ...
Eugene's user avatar
  • 103
1 vote
1 answer
28 views

Minimizing error in cosine similarity

Presume I have a vector space, and I am attempting to compress it into a latent vector space, while minimizing error in cosine similarity between entries. Suppose that I know the actual cosine ...
Krystal Fox's user avatar
1 vote
1 answer
44 views

Which type of Machine Learning is used in robots?

Which type of Machine Learning is used in robots? Is it supervised learning or unsupervised learning or Reinforcement learning?Especially the robots that were sent in space?
ATJ's user avatar
  • 11
1 vote
1 answer
32 views

Aggregating decision criteria of different scales

Let's say I have a framework that performs a detection task on some dataset. In order to do so I use three different metrics (A, B, and C) as decision makers. A and B are probabilities, i.e., $ 0 \le ...
Minuano's user avatar
  • 113
1 vote
0 answers
17 views

Two-part ML classification model on panel data - is it viable?

I have a dataset of medical encounters, and I aim to predict whether a patient will return to the hospital within 30 days after being discharged. Each row in my dataset corresponds to a specific ...
Frederico Portela's user avatar
0 votes
2 answers
38 views

Counting Number of Holes in an Image of Cheese

I've been assigned a project that involves writing a script to detect the number of holes in an image of cheese. My background in AI is quite limited, so I was wondering if anyone could give me a good ...
A. Boy's user avatar
  • 3
1 vote
1 answer
27 views

Ordering of Train/Val/Test set use in hyperparameter tuning

The way I read almost lots of ML advice on these datasets sounds like "You train a model that's randomly chosen hyperparameters first on the training set, then you ignore this bit of the work, ...
Socorro's user avatar
  • 101
0 votes
1 answer
17 views

Logistic Regression Import error

Hi Im using SKlearn for a school project. I cannot importy Logistics regression without getting a numpy float error. Have not been able to find any solutions online.
James sullivan 26's user avatar
0 votes
0 answers
8 views

ML approach for quantifying building quality perception

I'm working on a project to model public perceptions of buildings in a tourism context, focusing on attributes like beauty and mystery. The data I have is a labeled dataset of building photos, each ...
Blerg's user avatar
  • 101
0 votes
0 answers
16 views

Can I modify my training datasets (X_train and Y_train) while fitting the model?

I am new to ML and I am trying to train a forecasting model. The target variable (Y_train) has multiple columns, all of Boolean type. The features table (X_train), according to my approach, in the ...
Mookesh Dash's user avatar
-2 votes
0 answers
21 views

Creating a data visualisation using matplotlib and unsupervised learning

I have to write a python code on a kmeans algorithm and heres the requirements. You should submit a single file (not zipped) named myVisualiser.py containing a function with signature: def ...
Mohamed Evan's user avatar
0 votes
0 answers
16 views

Looking for datasets on automobile parts information for machine learning

I'm embarking on a machine learning project that requires a comprehensive dataset of automobile parts information. The goal is to train a model that can identify and categorize various auto parts, ...
Anand 's user avatar
0 votes
1 answer
13 views

Hassle-free platform for a small data science team?

our team of 4 data scientists has been exploring options to automate our ETL, data storage and model updates and are looking for a hassle-free platform that can help with this. We've had several ...
Rotten_Cabbagges's user avatar
0 votes
0 answers
15 views

Seeking datasets for training a Language Model on U.S. mortgage loan processes

I'm in the process of training a Language Model (LLM) and require datasets that encompass various aspects of the U.S. mortgage loan process. The model's aim is to understand and simulate decision-...
Anand 's user avatar
1 vote
1 answer
37 views

How does oversampling or undersampling approch is going to help during the testing on real time data?

We have a dataset with class A as 10% only and Class B as 90% . Let say we did undersampling or oversampling on training data and we made 50% of class A and 50% of class B. But in reality the data ...
Professor's user avatar
0 votes
1 answer
27 views

Test set won't have all the features present in the training set

I have to analyze a cardboard packaging system. To simplify, it consists of three parts, each of which needs to be set up (this depends on the pre-order): the printer, the slotter, and the cutter. The ...
Isaac's user avatar
  • 1
0 votes
0 answers
8 views

How to selectively train a deep model based on the unavailability of a subset of the feature set

I am creating a deep learning binary classification model. Each sample in the dataset contains two mutually exclusive feature sets X and Y. Feature set X is present in all samples; however, there are ...
flamingo_stark's user avatar
1 vote
1 answer
21 views

Out-of-Range Target Variable in Sequence-based Machine Learning Model

I'm encountering a scaling issue in a machine learning project. I'm predicting a target variable from an input sequence (and doing this for many). However, I've encountered a challenge where the ...
Bloggy's user avatar
  • 11
2 votes
1 answer
1k views

Why images, audio/video clips, text are regarded as unstructured data?

Tabular data is regarded as structured data, while other data types such as images, audio, video, text are regarded as unstructured data. I am confused that, taking images as an example, they are just ...
XMB-7's user avatar
  • 23
0 votes
0 answers
6 views

SVM kernel for detecting if a substring appears in some given string

I'm trying to do the exercise in 16.1 in the book Understanding Machine Learning, Ben-David, et al. formulated as follows: Consider the task of learning to find a sequence of characters ("...
Tran Khanh's user avatar
0 votes
0 answers
17 views

How to estimate the weights for a weighted average if not every weight is used in every example?

Say that you have a data set that contains $N$ examples. For each example, there are three main sections of important information. The first most important piece of information is the name of the ...
Ignatius the Learner's user avatar
0 votes
0 answers
30 views

Some questions from a noob - Chat bot

I'm a T-SQL and .NET developer but I need to understand some basis about a data science / ml project. I would like to know the guidelines and be directed to the right topics about the steps that need ...
Pietro Ariano's user avatar
0 votes
0 answers
22 views

Using LLMs for structured data?

I've been trying to work with structured data in language models, and it's proving to be quite challenging. I'm confident that with Langchain, I should be able to solve the problem, but I'm not ...
Cosapocha's user avatar
0 votes
0 answers
33 views

Mislabeled problem with hospital data

I am writing this post to ask or see if someone can help me with this problem in case you may have faced a similar situation. My problem has to do with a ML tool that I am trying to develop in a ...
Daniel's user avatar
  • 1
0 votes
0 answers
58 views

Design a CNN that can detect the face in the given input image

a. What strategy will you use? How many layers? How many filters? b. Describe the filters for each layer in detail. c. Show how the convolutions will work and demonstrate that your CNN will be able to ...
Sweta 's user avatar
0 votes
1 answer
46 views

Proper way to build time series dataset

I have daily time series but need to predict weekly total. Here is example: date col0 col1 col2 col3 col4 target 0 2023-01-01 00:00:00 -1.021 0.708 -0.564 -0.502 0.244 -106.538 1 2023-01-02 00:00:...
aplusk's user avatar
  • 1
0 votes
1 answer
40 views

Semantic Search on numeric data

I have a dataset in csv format. Most columns have numbers in them. The data is mostly number based, with little text. A sample of my dataset: I want to build a semantic search engine that can answer ...
Apoorva's user avatar
  • 275
1 vote
2 answers
51 views

How to create a bot for a real-time PvP game using machine learning?

Unfortunately, I am not well-versed in machine learning. However, I'm trying to understand if it's possible to create a bot for a real-time PvP game like, for example, Clash Royale or Random Dice: ...
Nolequen's user avatar
  • 111
0 votes
1 answer
69 views

Employee Attrition - Binary Classification - Predicting leavers

I'm trying to wrap my head around what the standard or best approach is for identifying which employees in a business would be most at risk of leaving, given their features and an indicator column ...
TheCheeseWizard's user avatar
0 votes
0 answers
6 views

Clustering high-dimensional data

Every sample in my dataset consists of two components: its $x$ component is a $n\times m$ matrix, and its $y$ component is a $p\times q$ matrix (Feature selection and PCA have been done before). Apart ...
yuxuan-z's user avatar
0 votes
2 answers
46 views

What methods do top Kagglers employ for score gain?

I’m currently taking a course on ML and part of my final grade is my position on a Kaggle competition (private one) regarding a classification task. The majority of groups tend to have a similar ...
Frederico Portela's user avatar
0 votes
0 answers
29 views

Feature selection: ANOVA between features vs within a feature

I am currently performing feature selection on a dataset containing continuous and categorical features. The target is a continuous variable. If I understand properly, ANOVA can be used between ...
Fred vh's user avatar
0 votes
0 answers
25 views

Loss values seem to fluctuate, yet the weights are correct

I'm taking my first steps with tensorflow (and in ML in general), and using this piece of code to train a very simple model that tries to find the underlying linear relation: f(x,y) = 4x +7y -2 (+ ...
Stars's user avatar
  • 1
0 votes
0 answers
14 views

Data Transformation Pipeline Issue on Flight Fare Prediction End-to-End Machine Learning Project

I am following the process shown on Wine Quality Prediction End-to-End ML Project on Krish Naik's YouTube channel to do a Flight Fare Prediction Project. I am facing an issue with Data Transformation ...
Md. Ehsanul Haque Kanan's user avatar
1 vote
1 answer
45 views

How do I use ML models to estimate current stress level based on past data?

I am new to machine learning and I cannot understand the difference between estimating current stress level and predicting future stress levels based on historical data. I have been told these are two ...
user123456789's user avatar
1 vote
1 answer
40 views

Should I apply the same data transformations in production for my classification model's inference steps

I am now moving my best classification model to production and doing tests currently. Should I use the same scaler() I used in training during my inference in ...
Marc Atanante's user avatar
0 votes
0 answers
17 views

How to make a dataset for Audio Speech Recognition of Arabic Language

I am trying to map Quranic Verses for the identification of errors. Different audios for the same verse have different durations as it depends on the reciter. I used Audacity to normalize but the ...
Sijran's user avatar
  • 1
0 votes
0 answers
19 views

Best accurate face recognition library

I need to use an accurate library for face recognition in my attendance python project But I used the face_recognition but I could no get the desired result.is there any way to get the 99% accuracy? I ...
Mohammad's user avatar
1 vote
1 answer
47 views

Beginner basic clustering model and one-hot encoding?

I have a dataframe of natural disaster incidents in Afghanistan from 2016 - 2023. Column names: REGION (Northern, Eastern etc) PROV_CODE (province) PROV_NAME DIST_CODE (district) DIST_NAME INC_DATE (...
Mas's user avatar
  • 13
0 votes
0 answers
25 views

Target variable is discrete ranging from 1 to 14, with each value having same proportion in the dataset, ML models fail miserably

I have a dataset of shape (55314,23). The target variable is league_rank. There are exactly 3951 leagues in this dataset, with each club having a ranking from 1 to 14. The variable is discrete, and ...
Little L's user avatar
0 votes
0 answers
15 views

Open Source Model or dataset for attention map visualization

Helloo (: I'm trying to develop a python application where users can upload an image e.g. of their website and receive a heatmap or attention map in return. This map should indicate where users are ...
Vic Wild's user avatar
0 votes
1 answer
30 views

Beginner clustering project, what are the input features and how do I analyze the data?

I am a beginner to data science. I have this dataset on natural disaster events in Afghanistan from 2016 - 2017. Columns: REGION (ex. North, North West, etc) PROVINCE_NAME (kind of like US 50 states) ...
Mas's user avatar
  • 13
0 votes
0 answers
14 views

What do I need to take into account if I want to test one model on different test datasets?

I'm just new to machine learning, I want to test a generative model on two different test datasets to compare its performance on different datasets. What do I need to take into account about the ...
Lynnnn's user avatar
  • 1
0 votes
0 answers
7 views

Oblique Decision Tree HHCART algorithm explaination

I am now studying a paper about implementing oblique decision tree algorithm https://arxiv.org/abs/1504.03415 I was wondering if any code implementation and alternative explaination, as a support ...
PwNzDust's user avatar
  • 149
1 vote
1 answer
17 views

Is it possible to run ML models on SBC boards?

Can I run models like Tortoise TTS or OpenAI Whisper on SBCs like Orange Pi 5 or Odroid N2+?
best_of_man's user avatar
0 votes
0 answers
5 views

Data Tracking For Process Improvement

I work in a manufacturing plant with 6 production lines. As part of the maintenance crew, it is my job to record all maintenance work performed on the equipment inside of our shared OneNote. This ...
Austin's user avatar
  • 1
0 votes
0 answers
8 views

LGBM handle categorical variable with categories which have quantities less than that of min_data_in_leaf

I am building a LGBM model where categorical features have been encoded using ordinal encoding. The categories get values from number from 1 to a max number that are all consecutive. How does LGBM ...
bunti papu's user avatar
1 vote
1 answer
33 views

activation=tf.keras.activations.relu vs activation='relu'

Both models are for binary classification problems Model 1 ...
Justin Jonany's user avatar

1
2 3 4 5
227