# All Questions

28,667 questions
Filter by
Sorted by
Tagged with
2 views

### How to configure null hypothesis or what's the null hypothesis when using sklearn?

I'm predicting how BMI, GDP, ... factors affect life expectancy. Firstly, I tried to select topK features. ...
2 views

### Small object detection preprocessing

I am currently working on an object detection project in which I amtrying to detect very small objects 50x50 object in a 2k image. EfficientDet produced a very low result if I just put the raw ...
3 views

### Accuracy on Validation and Test set, Overfit?

Just a quick question, I am building a ML model right now however I am receiving very similar (72.2 and 72.4 for example)% for both Accuracy and F1-Score on my Validation Dataset and my unseen Test ...
6 views

### What is the learning path for the role of NLP engineer a beginner should follow?

I am data science enthusiast and have interest in NLP. How should I develop my understanding for the domain and prepare for the role of an NLP engineer? What are the must have skills to master NLP? ...
10 views

### What is Inductive bias

Bias in a neural network is an additional neuron to be fired i.e let y=a+bx where a is bias term Do we have any difference between bias and inductive bias. How Inductive bias is helpful in ...
6 views

### Markov Chain vs Bayes Net

I am learning about Markov Chain and Bayesian Nets. However at this point I am a bit confused about what types of problems are modelled with the two different models presented to us. From what I ...
8 views

### In Time Series forecast, should Scaling be done on both train and test features combined ( test is 1 new data point)?

Let say I have a Time series, I'm using sliding/expanding window method to split to train and test data: train would be all the data I have until day x and test is day x+1. To avoid Data leakage I'm ...
7 views

### feature Extraction with mobileNet visualization

I am trying to create a logical visualization regarding how feature extraction with mobile net works in ml5.js. There's a good explanation here: https://youtu.be/kRpZ5OqUY6Y With ml5, you use a part ...
11 views

### Is this a task of meta-learning or transfer learning?

I have a task that I am not able to identify if it is of transfer or meta learning. I want to know this, in order to ask help in solving it, because there are some parts that I have not understood. ...
9 views

### Effective way to find similarity between utterance(short text) and question(long text)

The challenge I have is a bunch of questions(long text) that are closely matching with an user utterance (short text). I have tried cosine similarity & Tf-iDF, BM25,Jaccard similarity, etc., but ...
17 views

### Machine Learning - Euclidian Distance Classifier exercise

I'm taking part in an elective subject at university which mainly focuses on the foundations of Machine Learning. Now we got our first exercise - this task should be done practically in any language (...
6 views

I've been working on Neural Collaborative Filtering (NCF) recently to build a recommender system using Tensorflow Recommenders. Doing some hyperparameter tuning with different optimizers available in ...
5 views

### Choosing the size of the network for Neural Collaborative Filtering (NCF)?

I've been working on Neural Collaborative Filtering (NCF) recently to build a recommender system. After doing some hyperparameter tuning with various sizes for embedding and dense layers sizes, from ...
10 views

### Data Analytics how to read ECDF graph

Hi there, My question is about how to read ECDF graphs. I am still quite unsure what the jumps / zig-zags in the graph mean and what is happening when there is a horizontal line and so on. I would be ...
19 views

### Which dataset I should use when I am retraining my model?

I trained my deep learning model using x dataset and now I got new dataset and I give it name as y. I want to retrain my model on this new dataset which is y. Do I need to use x+y dataset or just y? ...
25 views

### Is scraping job posts and gathering skills tags illegal? [closed]

I want to scrape a freelancer site (freelancer.com) and gather their public projects skill tags. Is this illegal to do? And is publishing it illegal?
10 views

### how can we feed both data time series and non time series data together in machine learning classification model

I have a dataset composed of time-series and integer data; the objective of my task is to use the dataset for classification. Whilst current libraries in sktime accept multivariate time-series data as ...
9 views

### How much does it cost to train models to compete in Kaggle competitions? [closed]

I know some competitions cost almost nothing to compete in whereas other ones cost more to do all the training on cloud computing. But in general, what kind of price range could I expect to have to ...
10 views

### How an input data flows through an lstm layer cells?

I make this sec2sec NN model for the purposes of learning: ...
6 views

### How to optimize AUPRC for imbalanced data given a precision or recall bias?

My general understanding is that when optimizing a model in an imbalanced class case with a small preferred target class one should optimize first for a model with the best AUPRC (assuming one doesn't ...
5 views

### Automated tools to generate synthetic training images out of synthetic 3D models and 2D backgrounds

I have 3D meshes and textures for a dozen of objects, which have to be detected in synthetic images. I have 2D textures of backgrounds these objects will be visible in front of. Object detection will ...
14 views

### Evaluate Topic Modelling on synthetic data

I try to find the optimal number of topics on a synthetic corpus (so a list of lists of tokens I generate using various parameters). I, therefore, know the true number of topics and the true topics ...
10 views

### Improving a CNNs accuracy - help & advice

So I have created a CNN for image classification, and I train and test it with two datasets. One contains 9,339 images and the other 9,100 images. The first model which I designed gave an accuracy of ...
15 views

### How to force a NN to ouput the same output given a reverse input?

I want to choose an architecture that can deal with an input symmetry. As input, I have a sequence of zeros and ones, like [1, 1, 1, 0, 1, 0] and at the output layer I have N neurons that outputs a ...
16 views

### Machine Learning Model for Time Series Forecasting

I am using Random Forest, SVM, and XGBoost models to nowcast/forecast an economic time series variable. However, I would like to extend these models to optimize/customize them for time series ...
17 views

### How to create multi-hot encoding from a list column in dataframe?

I have dataframe like this Label IDs 0 [10, 1] 1 [15] 0 [14] I want to create a multihot encoding of the feature ...
16 views

### BERT Self-Attention layer

I am trying to use the first individual BertSelfAttention layer for the BERT-base model, but the model I am loading from torch.hub seems to be different then the ...
21 views

### Train/ Test split on small dataset along with SMOTE

I have a binary classification imbalanced dataset with 1000 samples ( 15% of class 1, 85% of the rest). My main goal is to build a robust classifier using the following approach. Wanted to know if ...
15 views

### Syntax error in function but everything seems correct

I am custom defining a function and following is my function but I get error as below ...
28 views

### Alternatives with better GPU than Google Colab Pro

I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM Is there any alternatives with better GPU and more RAM than ...
15 views

### Exploration in Q learning: Epsilon greedy vs Exploration function

I am trying to understand how to make sure that our agent explores the state space enough before exploiting what it knows. I am aware that we use epsilon-greedy approach with a decaying epsilon to ...
19 views

### MLP local minima question

I came across an excercise on deep learning from here. It goes as follows: Consider a simple MLP with a single hidden layer of $d$ dimensions in the hidden layer and a single output. Show that for any ...
17 views

### Tree complexity in xgboost

According to xgboost paper, regularization is given by: $$\Omega(f) = \gamma T + \lambda || w||^2$$ where $\gamma$ is the complexity of a tree (i.e., number of leaves in the tree). The parameter ...
21 views

### Generalization between 2 datasets of same domain

Suppose that I'm have 2 different datasets of same domain and trained a model with d1 dataset. Can we generalize the model to predict d2 dataset ? Is it possible or not. For example consider Dataset ...
9 views

### Unused bottleneck neurons in autoencoder

I'm using an autoencoder to compress categorical data, by a factor of about 20x. For this part of my data set, I have roughly 3500 variables, so my final bottleneck size is 180. I'm getting pretty ...
22 views

### I'm planning to record video now and then analyze it in the future once AI programs are more accurate, what resolution and FPS should I record at? [closed]

I'm going to record videos and want to future proof them for AI analysis as much as possible. I have a decent amount of storage to work with, 2.7TB. I'm hoping to make it last for at least two years. ...
16 views

### Imbalance classes in Named Entity Recognition

I am currently working on a NER problem which attempts to extract 2 entities - place-of-interest(POI) and street from an address string in the Indonesian language. I used IndoBert (available here) and ...
23 views

I've been searching for a long time to answer my question, but I haven't found anything. So I hope you can help. I'm searching for an opportunity to add a regressor to my prophet model in python. I ...
9 views

### Sequence multi-class classification only learns a few outputs

I have a multi-event delineation problem, where given a signal, I have an output with the same signal length. Something like 0011002200, where each unique number ...
15 views

### Sklearn compute_class_weight function leads to inaccurate result

I am trying to fit CNN to imbalanced data with 3 classes and therefore I am using compute_class_weight function from SKLearn. The code is presented below. ...
22 views

### GPA prediction of college student

I have a dataset consist of 8 columns and 15600 rows with the following columns:- 1.Entry_academic_year which have 5 discrete value (2558,2559,2560,2561,2562) 2.Faculty (It is the faculty that ...
20 views

### Usage of KL divergence to improve BOW model

For a university project I chose to do sentiment analysis on a google playstore reviews dataset. I have obtained decent results classifying the data using BOW model and an ADALINE classifier. I want ...
23 views

### Applying activation on part of the layer in Keras

Context I am trying to implement the YOLO algorithm in Keras. What I have so far is the following network: ...
13 views

### Profiles classification

I've been working on a project where it consists of a dataset of profiles (50k rows) along with their position, age group and hobbies (200 columns). These features (except for the position) are graded ...
13 views

### dataframe merge on string not working

having two dataframes each having common column which is country_code. while merging it by 'inner' join, it's returns empty dataframe. but i can see there is many values are common like IND, USA.... <...
11 views

### target encoding and weighting

I am working on a project in which I use data of movies and I represent each movie as a vector of length of 15. So there are 15 features ranging from genre to director. Most of the features are ...
18 views

### Proof that Gini Impurity in a Decision Tree is Monotone Decreasing?

I asked this in a reply to an answer to another of my questions; but I think this merits its own question since I couldn't find an answer, and it's a pretty interesting question on its own. Suppose we ...
34 views

### Is it possible to do Normalization before Xgboost?

Currently I am working on a project which uses Xgboost Regression. Before putting data into model, I implemented Normalization, the accuracy significantly increased compared with without Normalization....