Questions tagged [tensorflow]

TensorFlow is an open source library for machine learning and machine intelligence. TensorFlow uses data flow graphs with tensors flowing along edges. For details, see https://www.tensorflow.org. TensorFlow is released under an Apache 2.0 License.

Filter by
Sorted by
Tagged with
121
votes
5answers
138k views

The cross-entropy error function in neural networks

In the MNIST For ML Beginners they define cross-entropy as $$H_{y'} (y) := - \sum_{i} y_{i}' \log (y_i)$$ $y_i$ is the predicted probability value for class $i$ and $y_i'$ is the true probability ...
6
votes
4answers
640 views

What are the possible ways to detect skin while classifying diseases?

I am working on a skin disease classification problem where I have successfully created a classifier ( TensorFlow + Keras ) which can classify images of two skin diseases. The sample image needs to ...
5
votes
3answers
2k views

What is the relationship between the accuracy and the loss in deep learning?

I have created three different models using deep learning for multi-class classification and each model gave me a different accuracy and loss value. The results of the testing model as the following: ...
6
votes
1answer
5k views

Keras: How to normalize dataframe with continuous and categorical data?

I have a dataframe with about 50 columns. The columns are either categorical or continuous data. The continuous data can be between 0.000001-1.00000 or they can be between 500,000-5,000,000. The ...
5
votes
1answer
3k views

Keras CNN with low/constant accuracies

I am dealing with the Street View House Number recognition problem. I am trying to train a CNN with Keras. Here is how I prepared the input: ...
51
votes
5answers
47k views

Neural networks: which cost function to use?

I am using TensorFlow for experiments mainly with neural networks. Although I have done quite some experiments (XOR-Problem, MNIST, some Regression stuff, ...) now, I struggle with choosing the "...
36
votes
3answers
38k views

Multi GPU in keras

How we can program in the keras library (or tensorflow) to partition training on multiple GPUs? Let's say that you are in an Amazon ec2 instance that has 8 GPU's and you would like to use all of them ...
20
votes
3answers
19k views

Keyword/phrase extraction from Text using Deep Learning libraries

Perhaps this is too broad, but I am looking for references on how to use deep learning in a text summarization task. I have already implemented text summarization using standard word-frequency ...
21
votes
3answers
31k views

Neural Network for Multiple Output Regression

I have a dataset containing 34 input columns and 8 output columns. One way to solve the problem is to take the 34 inputs and build individual regression model for each output column. I am wondering ...
26
votes
1answer
9k views

PyTorch vs. Tensorflow Fold

Both PyTorch and Tensorflow Fold are deep learning frameworks meant to deal with situations where the input data has non-uniform length or dimensions (that is, situations where dynamic graphs are ...
16
votes
3answers
38k views

What is weight and bias in deep learning?

I'm starting to learn Machine learning from Tensorflow website. I have developed a very very rudimentary understanding of the flow a deep learning program follows (this method makes me learn fast ...
14
votes
1answer
2k views

How to add non-image features along side images as the input of CNNs

I'm training a convolutional neural network to classify images on fog conditions (3 classes). However, for each of about 150.000 images I also have four meteorological variables available that might ...
11
votes
1answer
20k views

How to define a custom performance metric in Keras?

I tried to define a custom metric fuction (F1-Score) in Keras (Tensorflow backend) according to the following: ...
7
votes
3answers
49k views

Switching Keras backend Tensorflow to GPU

I use Keras-Tensorflow combo installed with CPU option (it was said to be more robust), but now I'd like to try it with GPU-version. Is there a convenient way to switch? Or shall I re-install fully ...
7
votes
2answers
22k views

Custom loss function with additional parameter in Keras

I'm looking for a way to create a loss function that looks like this: The function should then maximize for the reward. Is this possible to achieve in Keras? Any suggestions how this can be achieved ...
6
votes
2answers
8k views
7
votes
1answer
6k views

Neural network with flexible number of inputs?

Is it possible to create a neural network which provides a consistent output given that the input can be in different length vectors? I am currently in a situation where I have sampled a lot of audio ...
1
vote
3answers
5k views

Predict sinus with keras feed forward neural network

I have a very simple feed forward neural network with keras that should learn a sinus. Why is the predictive power so bad and what is generally the best way to pinpoint issues with a network? In the ...
8
votes
1answer
4k views

What is a tower?

In many tensorflow tutorials (example) "towers" are mentioned without a definition. What is meant by that?
7
votes
3answers
4k views

Difference between indicator column and categorical identity column in tensorflow

I am learning Tensorflow and came across different feature columns used in Tensorflow . Out of these types, two are categorical_identity_column and ...
6
votes
4answers
1k views

Why choose TensorFlow?

I have noticed that most of the deep learning developers use TensorFlow. So why choose TensorFlow? What is the advantage of TensorFlow over Theano and CNTK?
5
votes
1answer
3k views

Keras negative sampling with custom layer

I am trying to implement negative sampling in Keras. I wrote the following code that just compute the loss and I plan to add an additional output for the logits once I get it up and running. Here is ...
4
votes
2answers
4k views

Is it possible using tensorflow to create a neural network that maps a certain input to a certain output?

I am currently playing with tensorflow, but can't seem to get a hold whether it usefull for my problem? I need to create a neural network, that is capable of mapping input to output. The way things ...
4
votes
2answers
5k views

What is the shape of conv3d and conv3d_transpose?

I want to do a GAN with coloured pictures. This means I need a three dimensional input and therefore I like to use conv3d and conv3d_transpose. Unfortunately in the TensorFlow documentation, I can't ...
3
votes
1answer
3k views

The model of LSTM with more than one unit

In stacked LSTM, for example: 2 LSTM layers, LSTM_1 in order to pass the output of every time step to LSTM_2, so it needs to return hidden state value in every time step, like the architecture I drew ...
2
votes
1answer
2k views

How to create a multi-dimensional softmax output in Tensorflow?

I came across this research paper released by YouTube, on how they use deep learning neural networks for recommendations. It's located here: https://static.googleusercontent.com/media/research.google....
6
votes
2answers
5k views

Binary Classifier making only one prediction

tl;dr I'm building a binary classifier that always eventually predicts all "0" or all "1" after some number of epochs and I'm looking for possible reasons why/how to proceed. Below is all just more ...
6
votes
1answer
1k views

What is the difference between a Categorical Column and a Dense Column?

In Tensorflow, there are 9 different feature columns, arranged into three groups: categorical, dense and hybrid. From reading the guide, I understand categorical columns are used to represent ...
3
votes
0answers
856 views

Multivariate, multistep forecasting with LSTM

I want to use an RNN with LSTM to forecast multiple steps into the future, based on multiple inputs. I have some ideas for different ways to approach this, but I'm afraid I'm missing the "right way" ...
2
votes
3answers
139 views

Tensorflow classification - maximize the accuracy of certain classes

I'm doing some experimentation and trying to train a forex trading model to classify based on three classes: Buy Sell No action Input rows are labeled as buy when ...
1
vote
1answer
2k views

Build knowledge bot using deep learning

I'm going through this chatbot example, which uses the Cornell movie dialog corpus. Expanding this example, is it possible to build a "knowledge bot" (ie) a bot that can chat and be knowledgeable in a ...
1
vote
2answers
1k views

Adding hand-crafted features to a convolutional neural network (CNN) in TensorFlow

Let's say I want to add a few hand-crafted features to a convolutional neural network CNN in TensorFlow. The CNN can be a simple one as described here. Naturally I'd like to add these features right ...
0
votes
1answer
2k views

Multiclass Classification on live sensor data

I want to use an accelerometer to detect which way a train is heading. You could do this by just setting thresholds manually to detect the direction of acceleration on the x-axis (which would be ...
0
votes
1answer
5k views

autoencoder for features selection [closed]

I m using a data set with 41 features numerics and nominals the 42 one is the class (normal or not) first I changed all the nominals features to numeric since the autoencoder requires that the imput ...
4
votes
1answer
5k views

TensorFlow: number of channels of conv1d filter

I want to apply a ConvNet on my one dimensional data retrieved from 13 sensors. So, each of my samples consists of 13 channels (of 51 values) I am using 'conv1d' ...
4
votes
1answer
520 views

Tensorflow: how to look up and average a different amount of embedding vectors per training instance, with multiple training instances per minibatch?

In a recommender system setting: let's say I want to learn to predict future item purchases based on user past purchases using an approach inspired by Youtube's recommender system: Concretely, let's ...
3
votes
2answers
2k views

When to use different Word2Vec training approaches?

So I am learning Word2Vec for the first time and my question is quite basic: How to know what approach to use? I.e, Word2Vec in Tensorflow or Word2Vec trained with Gensim ? In what cases would ...
2
votes
1answer
295 views

How to design batches in a stateful RNN

I am using TF Eager to train a stateful RNN (GRU). I have several variable length time sequences about 1 minute long which I split into windows of length 1s. In TF Eager, like in Keras, if ...
2
votes
2answers
786 views

Data augmentation based on the class type in the CNN model

I would like to use CNN model to classify images but some classes in my dataset have low amount of data. Can I apply data augmentation based on the number of the images in the class? For example, ...
2
votes
1answer
245 views

CNN training data size for determing the winner of tic-tac-toe

I'm trying to learn machine learning with tensorflow and wrote a program that uses CNNs to determine game results for a given tic-tac-toe board. Its inputs and outputs are - Input - An array of 9 ...
1
vote
1answer
7k views

How to convert my tensorflow model to pytorch model? [closed]

I performed transfer learning using ssd + mobilenet as my base model in tensorflow and freezed a new model. Now I want to convert that model into pytorch. Is there any way how I can achieve it? Any ...
1
vote
1answer
358 views

We are using PostgreSQL to store big data and are concerned it may crash the on-board Neural Net. Any thoughts?

We have figured out how to write Big Data to our PostgreSQL database. We would like to run this (normalized) data into the on-board Neural Network in Orange. Our lead programmer said he thought Orange ...
1
vote
1answer
1k views

How to Implement a Custom Loss Function with Keras for a Sparse Dataset

My dataset is composed of an idle system that, at some time instants, receives requests. I'm trying to predict these instants through a clock. Since the requests are sparsely distributed (I've forced ...
1
vote
0answers
733 views

Model Parallelism not working? Inception v3 with keras and tensorflow

I have been stuck with a problem like this for a while now. I have an AWS setup with 500 GB of ram and about 7 GPUs. Now the issue is that each time I try to run my keras with tensorflow as back-end ...
1
vote
1answer
622 views

How to arrange the image dataset in CNN?

How do I arrange the image dataset in CNN? Should I put each image category in a separate folder? Or all of them in the same folder? Should the image name be the category name? I would like to see an ...
1
vote
1answer
294 views

Prediction on timeseries data using tensorflow

I have an input and output of below format: (X) = [[ 0 1 2] [ 1 2 3]] y = [ 3 4 ] It's timeseries data. The task is to predict the next number....
0
votes
1answer
92 views

Tutorial for restricted Boltzmann machine using PyTorch or Tensorflow?

I am trying to find a tutorial on training Restricted Boltzmann machines on some dataset (e.g. MNIST), using either PyTorch or Tensorflow. The few I found are outdated. Can you recommend any?
0
votes
0answers
27 views

Variability in CNN test results

I'm trying to do some time series analysis on 1-minute forex data using a CNN. I'm new to deep learning and just getting started in building a model. So this is probably a very basic question, but I'...
0
votes
2answers
607 views

converting a Tensorflow model for Tensorflow.js

(Warning, I'm a Tensorflow/ML noob) I'm trying to convert and load a TensorFlow model into tensorflow.js The model is saved: ...
0
votes
0answers
681 views

How to map RGB image segmentation ground truth to classes/one-hot vectors in TensorFlow?

Is there a TensorFlow function which takes multicategorical ground truth for semantic image segmentations in the form of RGB images and outputs a tensor with a one-hot vector encoding of the ...