Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

1
vote
0answers
40 views

Using machine learning algorithm to approximate a matrix? [closed]

I don't know if this is a good question. I would like to use machine learning to approximate a matrix. For example, a very simple one as \begin{align} A=\begin{pmatrix} 1 &0 \\ 0& 2 \end{...
3
votes
0answers
56 views

What is the best way to read SQL dataset in to Tensorflow?

What is the best way to read SQL database in to Tensorflow? Currently, I am using Postgres on server and developed DL algorithm on Tensorflow using Jupyter Lab. How can I import data into Jupyter Lab ...
0
votes
0answers
11 views

Prevent predict_generator from shuffling data in deep learning

I created a cnn model, and I want to check the performance of the model by using predict_generator. I am using the following code which compares the images' labels ...
0
votes
1answer
16 views

How to increase accuracy of model from tensorflow model zoo?

Situation: My dataset is 70k images of people wearing clothes. Images are labeled: bbox position and class. There are 10 classes. I did 80:20 split. Categories are balanced with exception of one ...
3
votes
1answer
57 views

Convolutional neural networks for non-image applications?

If I remember correctly, Convolutional neural networks (CNN) have first been developed for image classification purposes (see work from LeCun et al.). The convolution process that "slides" over the ...
3
votes
2answers
56 views

What is the purpose of a 1x1 convolutional layer?

SqueezeNet uses 1x1 convolutions. I try to understand it in this simple example: if the input is one MNIST digit, i.e. of shape 1x28x28x1 (I use Batch x Height x ...
0
votes
0answers
6 views

Are 3D visualisations of data useful at higher dimensions?

In a machine learning course, a lot of things are explained using 3-dimensional data i.e. using examples with 3 features to allow for it to be visualised. (An example would be multivariate gaussian ...
0
votes
1answer
51 views

Single machine learning algorithm for multiple classes of data : One hot encoder

I have data of the following kind: x1 x2 y 0 0 1 1 1 0 2 2 2 0 3 3 3 0 4 4 4 1 1 4 5 1 2 8 6 1 3 12 7 1 4 16 Is it possible ...
1
vote
0answers
12 views

How to get the survival duration prediction for each individual in the data by using the Kaplan-Meier method?

I am trying to learn how to use the Kaplan-Meier survival estimator model in the lifelines package. The documentation says that the KaplanMeierFitter.fit function ...
1
vote
1answer
17 views

How can I create a pixel labelled image for Semantic Segmentation?

I am following the Semantic Segmentation Examples tutorial by MathWorks. I understand that I can load pixel labeled images ...
0
votes
1answer
29 views

CNN backpropagation between layers

I have this CNN architecture: I know how to calculate error for weights based on the output and update weights between output<-->hidden and hidden<-->input layers. The problem is that I have ...
0
votes
1answer
17 views

Sparse Representation vs Dense Representation

The one of the benefits of ReLUs is sparsity. Sparsity arises when a≤0 (a = wX+b). The more such units that exist in a layer the more sparse the resulting representation. Sigmoids on the other hand ...
0
votes
2answers
13 views

Autonomous evalution

Do you think it is possible to learn the app, how to autonomous evaluate good or bad parking of the bikes? The thing is you need to take a picture with your phone and app need to decide according to ...
0
votes
1answer
21 views

Prepare JSON data from sentiment analysis to perform Logistic Regression

I'm new to this field, so very sorry for this basic question. I'm working on a text analysis project using Google's NLP API along with some other APIS. After performing the sentiment analysis I have ...
0
votes
0answers
8 views

Update Machine Learning models in Mllib dataframe based PySpark (2.2.0)

I have built a Machine Learning model based on clustering, & now just want to update it with new data periodically (on daily basis). I am using PySpark Mlib, & not able to find any method in ...
0
votes
0answers
25 views

How to let predict_generator make ordered prediction when using functional API model in deep learning?

I am designing a deep learning model to classify images and I am using the following code to check the predication performance. It compares the images' labels with the predicted classes and then ...
0
votes
1answer
27 views

Difference between sklearn’s “log_loss” and “LogisticRegression”?

I am a newbie currently learning data science from scratch and I have a rather stupid question to ask. I’m currently learning about binary classification, and I understand that the logistic function ...
0
votes
0answers
22 views

machine learning for Data set of data sets

I know that we apply machine learning in a data set that has features and results this example to show if students cheated in Exam 3 we compare results for Exam 1 and 2 to find if Exam 3 results were ...
1
vote
1answer
23 views

How to transform features order to make their distribution normal?

After sns.pairplot(df) command, I got this picture: The question is what transformation to use in order to make the distributions normal? Thank you
0
votes
1answer
32 views

Training and Test set

I was asked by my supervisor to replicate a result from a former graduate student. My supervisor believes the result of that paper is not accurate and he asked me to find out why! The paper was about ...
0
votes
0answers
14 views

Loss function become worse after the data is shuffling

Is it possible that loss function become worse after the data is shuffling for every epoch (entire data)? In my case, I have around 85000 data with 7500 data attributes then I am using neural network ...
0
votes
0answers
23 views

How to extract LIFT from association rules using PySpark FPgrowth (pyspark.ml.fpm import FPGrowth)

I have been working on fetching association rules so far using minimum support and confidence. Now I aim to get rid of garbage rules using LIFT. I looked up on apache sparks website, they recently ...
1
vote
0answers
18 views

Is there a way to automatically generate a string given an input of another string? [closed]

I am fairly new to data science in general, and I'm wondering if it is possible to use machine learning/natural language processing to generate definitions for various terms. My team has recently ...
1
vote
1answer
22 views

How to save prediction values for the whole data in Keras

I am using pre-trained VGG16 model to classify images located in the folder. Currently, I am able to classify only one single image. How can I modify the code to classify all the images in the ...
0
votes
0answers
14 views
0
votes
0answers
13 views

How can I build a recommender system that accepts data of varying granularity?

I'm tasked with building a recommender system that can make recommendations based on input data of varying levels of granularity. To explain what I mean, let's use a running example of a Movie Title ...
1
vote
1answer
30 views

Confused about false positive and false negative in confusion matrix?

I am working on binary classification for classifying cancer=1 and no-cancer=0, I use confusion matrix from sklearn, this is my confusion matrix on test set: ...
0
votes
1answer
20 views

Tagging documents for doc2vec

I am working on resume parsing script. I am trying to tag documents sentences with TaggedDocument function, provided by gensim. What I have managed for now is to divide every text into sentence, put ...
0
votes
0answers
12 views

Gene expression prediction without sliding window in LSTM

i want to implement the LSTM on whole genome of Histone modification on a single RNA strand with ten thousand base pairs (10,000 bp) in each RNA. All the previous approaches used have used sliding ...
0
votes
0answers
7 views

Optimization Error for Logistic Regression using Scipy.opt [migrated]

I've been trying to write Andrew NG's Logistic Regression Problem Using python and Scipy.opt for optimizing the function. However, I get a VALUE ERROR that says I have mismatching dimensions. I've ...
2
votes
1answer
26 views

Can I use a GAN to increase my Dataset used for Image detection?

I am currently working on a machine learning project where I use the YOLO Algorithm to detect an object inside of a picture or video. The problem I face is that the specific image set (side-scan sonar)...
0
votes
0answers
31 views

Reinforcement learning using Restricted Boltzmann Machine(RBM)

I am very new to the field of machine learning, AI and related things. I am right now, in particular looking for some references where RBMs can be used to achieve Reinforcement learning, something ...
0
votes
1answer
35 views

Why xgboost can not deal with this simple sentence case?

There is only 1 feature dim. But the result is unreasonable. The code and data is below. The purpose of the code is to judge whether the two sentences are the same. In fact, the final input to the ...
1
vote
1answer
13 views

The mix of leaky Relu at the first layers of CNN along with conventional Relu for object detection

First of all, I know the usage of leaky RELUs and some other relevant leaky activation functions as well. However I have seen in a lot of papers on object detection tasks (e.g YOLO) to use this type ...
6
votes
1answer
136 views

On a multi lingual sentiment corpus

I am looking to compile a sentiment corpus for news articles in multiple languages (~100k per lang. for a machine learning experiment) where each article is labeled positive, neutral, or negative. I ...
0
votes
0answers
11 views

Practical examples/tutorials of using One-Class Support Vector Machines

I am a newbie in machine learning, and hope to solve an anomaly detection task using One-Class Support Vector Machines (OCSVM). ...
1
vote
0answers
17 views

Rain radar image noise reduction and cleanup

An application that I am building is plotting rain radar images on map. The images are transparent PNGs that are sourced straight from the local meteorological service. As can be seen in the example, ...
2
votes
0answers
10 views

word based learning similar to what is done in mnist [closed]

I am fairly new to this field and I have a use case where I would like to classify the type of a cloth by its attribute information(like descriptions of its length, width, height, cloth type etc etc). ...
2
votes
0answers
21 views

Non-linear Support Vector Regression issue - Sklearn Python 3.6

I am fairly new to Sklearn and machine learning and have encountered an issue when using SVR with an RBF kernel. Below is my predicted data compared directly with my real data: I do not know what I ...
1
vote
1answer
15 views

Boostrap parameter in random forest regressor?

There's one parameter in RandomForestRegressor which is bootstrap. By default bootstrap=True bootstrap : boolean, optional (...
1
vote
0answers
5 views

Test Loss plateau fast in Convolutional Neural Net

I have a 10k dataset of 1 channel 100X100pixels images with 31 classes. I set up a CNN with 3 convolution layers each followed by a batchnorm and a 2d pooling. I tried out several combinations of ...
0
votes
0answers
18 views

Snake AI seems to be very biased

I've been working on a snake AI in Java, and so far it seems pretty good except for one hitch. The AI always seems to develop a bias and only turn in one direction (it is given inputs for data ...
3
votes
1answer
29 views

Hyperparameter tuning for stacked models

I'm reading the following kaggle post for learning how to incorporate model stacking http://blog.kaggle.com/2016/12/27/a-kagglers-guide-to-model-stacking-in-practice/ in ML models. The structure ...
3
votes
2answers
28 views

Multiple formulas for r squared eval metric for regression

I was came across different formulas for R squared on different articles. R Squared = 1 - RSS/TSS R Squared = ESS/TSS RSS -Residual sum of squares. TSS - Total sum of squares. ESS - Explained ...
0
votes
0answers
14 views

Clusterise 2 variables in 3 groups

I have thousands points for 2 different variables i would like to clusterise in 3 groups : -1, 0, 1. If i drop the group 0 in my dataframe and scatter plot for -1 and 1 i have the following : It's ...
1
vote
0answers
32 views

Combine multiple features for text classification

Recently I started reading more about NLP and following tutorials in Python in order to learn more about the subject. I'm trying to make my own classification algorithm (the text sends a positive/...
0
votes
0answers
4 views

Writing slice by slice to a new .nii file in Python

I am using python 2.7. I am writing code that reads from an initial nii file, modifies each slice of it, and then creates a new nii file and writes to it slice by slice. My main issues are I do not ...
0
votes
0answers
9 views

Why GP (Gaussian Process) works?

Actually I read through some papers about GP(google the stanford university and oxford university lecture pdf and read) I knew the procedure to do it with detail to choose the kernel and test and the ...
0
votes
0answers
6 views

Theoretical underpinning behind Hardmax operator

In the tensor flow Github repository, in the file attentionwrapper.py, hardmax operator has been defined. On the docs, it has been mentioned tf.contrib.seq2seq.hardmax I want to know what's the ...
1
vote
1answer
18 views

How to find similarity of two series over time containing periodic trends?

Considering the data is received from a streaming source each second.How to distinguish if both the line graphs 'look' same/different in real time, statically, like the picture given below Edit: 1....