All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
2 views

How to configure null hypothesis or what's the null hypothesis when using sklearn?

I'm predicting how BMI, GDP, ... factors affect life expectancy. Firstly, I tried to select topK features. ...
0
votes
0answers
2 views

Small object detection preprocessing

I am currently working on an object detection project in which I amtrying to detect very small objects 50x50 object in a 2k image. EfficientDet produced a very low result if I just put the raw ...
0
votes
0answers
3 views

Accuracy on Validation and Test set, Overfit?

Just a quick question, I am building a ML model right now however I am receiving very similar (72.2 and 72.4 for example)% for both Accuracy and F1-Score on my Validation Dataset and my unseen Test ...
0
votes
0answers
6 views

What is the learning path for the role of NLP engineer a beginner should follow?

I am data science enthusiast and have interest in NLP. How should I develop my understanding for the domain and prepare for the role of an NLP engineer? What are the must have skills to master NLP? ...
1
vote
1answer
10 views

What is Inductive bias

Bias in a neural network is an additional neuron to be fired i.e let y=a+bx where a is bias term Do we have any difference between bias and inductive bias. How Inductive bias is helpful in ...
1
vote
0answers
6 views

Markov Chain vs Bayes Net

I am learning about Markov Chain and Bayesian Nets. However at this point I am a bit confused about what types of problems are modelled with the two different models presented to us. From what I ...
0
votes
0answers
8 views

In Time Series forecast, should Scaling be done on both train and test features combined ( test is 1 new data point)?

Let say I have a Time series, I'm using sliding/expanding window method to split to train and test data: train would be all the data I have until day x and test is day x+1. To avoid Data leakage I'm ...
0
votes
0answers
7 views

feature Extraction with mobileNet visualization

I am trying to create a logical visualization regarding how feature extraction with mobile net works in ml5.js. There's a good explanation here: https://youtu.be/kRpZ5OqUY6Y With ml5, you use a part ...
0
votes
0answers
11 views

Is this a task of meta-learning or transfer learning?

I have a task that I am not able to identify if it is of transfer or meta learning. I want to know this, in order to ask help in solving it, because there are some parts that I have not understood. ...
0
votes
0answers
9 views

Effective way to find similarity between utterance(short text) and question(long text)

The challenge I have is a bunch of questions(long text) that are closely matching with an user utterance (short text). I have tried cosine similarity & Tf-iDF, BM25,Jaccard similarity, etc., but ...
0
votes
1answer
17 views

Machine Learning - Euclidian Distance Classifier exercise

I'm taking part in an elective subject at university which mainly focuses on the foundations of Machine Learning. Now we got our first exercise - this task should be done practically in any language (...
0
votes
0answers
6 views

Why does Adam optimizer work slower than Adagrad, Adadelta, and SGD for Neural Collaborative Filtering (NCF)?

I've been working on Neural Collaborative Filtering (NCF) recently to build a recommender system using Tensorflow Recommenders. Doing some hyperparameter tuning with different optimizers available in ...
0
votes
0answers
5 views

Choosing the size of the network for Neural Collaborative Filtering (NCF)?

I've been working on Neural Collaborative Filtering (NCF) recently to build a recommender system. After doing some hyperparameter tuning with various sizes for embedding and dense layers sizes, from ...
0
votes
0answers
10 views

Data Analytics how to read ECDF graph

Hi there, My question is about how to read ECDF graphs. I am still quite unsure what the jumps / zig-zags in the graph mean and what is happening when there is a horizontal line and so on. I would be ...
0
votes
1answer
19 views

Which dataset I should use when I am retraining my model?

I trained my deep learning model using x dataset and now I got new dataset and I give it name as y. I want to retrain my model on this new dataset which is y. Do I need to use x+y dataset or just y? ...
1
vote
0answers
25 views

Is scraping job posts and gathering skills tags illegal? [closed]

I want to scrape a freelancer site (freelancer.com) and gather their public projects skill tags. Is this illegal to do? And is publishing it illegal?
0
votes
0answers
10 views

how can we feed both data time series and non time series data together in machine learning classification model

I have a dataset composed of time-series and integer data; the objective of my task is to use the dataset for classification. Whilst current libraries in sktime accept multivariate time-series data as ...
0
votes
0answers
9 views

How much does it cost to train models to compete in Kaggle competitions? [closed]

I know some competitions cost almost nothing to compete in whereas other ones cost more to do all the training on cloud computing. But in general, what kind of price range could I expect to have to ...
0
votes
0answers
10 views

How an input data flows through an lstm layer cells?

I make this sec2sec NN model for the purposes of learning: ...
0
votes
0answers
6 views

How to optimize AUPRC for imbalanced data given a precision or recall bias?

My general understanding is that when optimizing a model in an imbalanced class case with a small preferred target class one should optimize first for a model with the best AUPRC (assuming one doesn't ...
0
votes
0answers
5 views

Automated tools to generate synthetic training images out of synthetic 3D models and 2D backgrounds

I have 3D meshes and textures for a dozen of objects, which have to be detected in synthetic images. I have 2D textures of backgrounds these objects will be visible in front of. Object detection will ...
2
votes
0answers
14 views

Evaluate Topic Modelling on synthetic data

I try to find the optimal number of topics on a synthetic corpus (so a list of lists of tokens I generate using various parameters). I, therefore, know the true number of topics and the true topics ...
0
votes
0answers
10 views

Improving a CNNs accuracy - help & advice

So I have created a CNN for image classification, and I train and test it with two datasets. One contains 9,339 images and the other 9,100 images. The first model which I designed gave an accuracy of ...
1
vote
1answer
15 views

How to force a NN to ouput the same output given a reverse input?

I want to choose an architecture that can deal with an input symmetry. As input, I have a sequence of zeros and ones, like [1, 1, 1, 0, 1, 0] and at the output layer I have N neurons that outputs a ...
1
vote
0answers
16 views

Machine Learning Model for Time Series Forecasting

I am using Random Forest, SVM, and XGBoost models to nowcast/forecast an economic time series variable. However, I would like to extend these models to optimize/customize them for time series ...
0
votes
1answer
17 views

How to create multi-hot encoding from a list column in dataframe?

I have dataframe like this Label IDs 0 [10, 1] 1 [15] 0 [14] I want to create a multihot encoding of the feature ...
0
votes
2answers
16 views

BERT Self-Attention layer

I am trying to use the first individual BertSelfAttention layer for the BERT-base model, but the model I am loading from torch.hub seems to be different then the ...
0
votes
0answers
21 views

Train/ Test split on small dataset along with SMOTE

I have a binary classification imbalanced dataset with 1000 samples ( 15% of class 1, 85% of the rest). My main goal is to build a robust classifier using the following approach. Wanted to know if ...
1
vote
1answer
15 views

Syntax error in function but everything seems correct

I am custom defining a function and following is my function but I get error as below ...
0
votes
2answers
28 views

Alternatives with better GPU than Google Colab Pro

I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM Is there any alternatives with better GPU and more RAM than ...
2
votes
1answer
15 views

Exploration in Q learning: Epsilon greedy vs Exploration function

I am trying to understand how to make sure that our agent explores the state space enough before exploiting what it knows. I am aware that we use epsilon-greedy approach with a decaying epsilon to ...
0
votes
1answer
19 views

MLP local minima question

I came across an excercise on deep learning from here. It goes as follows: Consider a simple MLP with a single hidden layer of $d$ dimensions in the hidden layer and a single output. Show that for any ...
1
vote
1answer
17 views

Tree complexity in xgboost

According to xgboost paper, regularization is given by: $$\Omega(f) = \gamma T + \lambda || w||^2$$ where $\gamma$ is the complexity of a tree (i.e., number of leaves in the tree). The parameter ...
0
votes
0answers
21 views

Generalization between 2 datasets of same domain

Suppose that I'm have 2 different datasets of same domain and trained a model with d1 dataset. Can we generalize the model to predict d2 dataset ? Is it possible or not. For example consider Dataset ...
0
votes
0answers
9 views

Unused bottleneck neurons in autoencoder

I'm using an autoencoder to compress categorical data, by a factor of about 20x. For this part of my data set, I have roughly 3500 variables, so my final bottleneck size is 180. I'm getting pretty ...
1
vote
1answer
22 views

I'm planning to record video now and then analyze it in the future once AI programs are more accurate, what resolution and FPS should I record at? [closed]

I'm going to record videos and want to future proof them for AI analysis as much as possible. I have a decent amount of storage to work with, 2.7TB. I'm hoping to make it last for at least two years. ...
2
votes
0answers
16 views

Imbalance classes in Named Entity Recognition

I am currently working on a NER problem which attempts to extract 2 entities - place-of-interest(POI) and street from an address string in the Indonesian language. I used IndoBert (available here) and ...
0
votes
1answer
23 views

Facebook Prophet add Regressor

I've been searching for a long time to answer my question, but I haven't found anything. So I hope you can help. I'm searching for an opportunity to add a regressor to my prophet model in python. I ...
0
votes
0answers
9 views

Sequence multi-class classification only learns a few outputs

I have a multi-event delineation problem, where given a signal, I have an output with the same signal length. Something like 0011002200, where each unique number ...
0
votes
0answers
15 views

Sklearn compute_class_weight function leads to inaccurate result

I am trying to fit CNN to imbalanced data with 3 classes and therefore I am using compute_class_weight function from SKLearn. The code is presented below. ...
1
vote
1answer
22 views

GPA prediction of college student

I have a dataset consist of 8 columns and 15600 rows with the following columns:- 1.Entry_academic_year which have 5 discrete value (2558,2559,2560,2561,2562) 2.Faculty (It is the faculty that ...
1
vote
0answers
20 views

Usage of KL divergence to improve BOW model

For a university project I chose to do sentiment analysis on a google playstore reviews dataset. I have obtained decent results classifying the data using BOW model and an ADALINE classifier. I want ...
0
votes
1answer
23 views

Applying activation on part of the layer in Keras

Context I am trying to implement the YOLO algorithm in Keras. What I have so far is the following network: ...
0
votes
0answers
13 views

Profiles classification

I've been working on a project where it consists of a dataset of profiles (50k rows) along with their position, age group and hobbies (200 columns). These features (except for the position) are graded ...
0
votes
0answers
13 views

dataframe merge on string not working

having two dataframes each having common column which is country_code. while merging it by 'inner' join, it's returns empty dataframe. but i can see there is many values are common like IND, USA.... <...
0
votes
0answers
11 views

target encoding and weighting

I am working on a project in which I use data of movies and I represent each movie as a vector of length of 15. So there are 15 features ranging from genre to director. Most of the features are ...
0
votes
0answers
18 views

Proof that Gini Impurity in a Decision Tree is Monotone Decreasing?

I asked this in a reply to an answer to another of my questions; but I think this merits its own question since I couldn't find an answer, and it's a pretty interesting question on its own. Suppose we ...
0
votes
1answer
34 views

Is it possible to do Normalization before Xgboost?

Currently I am working on a project which uses Xgboost Regression. Before putting data into model, I implemented Normalization, the accuracy significantly increased compared with without Normalization....
0
votes
0answers
10 views

Question on rnn

For recurrent neural network, it can handle time series data I get some question on its pratice. Consider below 10,46,44,2,4,5 (t1, t2,....) 10,46,44 =>2 46,44,2=>4 ... Input ( x_t1, x_t2, x_t3) In ...
0
votes
0answers
4 views

In Google AutoML Tables, how do I export model then deploy it to docker container in Cloud Run

AutoML Table endpoint is really expensive and I was wondering if someone could point me in the right direction in how to export then deploy to a docker container in Cloud Run similar to this tutorial ...

15 30 50 per page
1
2 3 4 5
574