Questions tagged [tensorflow]

TensorFlow is an open source library for machine learning and machine intelligence. TensorFlow uses data flow graphs with tensors flowing along edges. For details, see https://www.tensorflow.org. TensorFlow is released under an Apache 2.0 License.

Filter by
Sorted by
Tagged with
107
votes
5answers
126k views

The cross-entropy error function in neural networks

In the MNIST For ML Beginners they define cross-entropy as $$H_{y'} (y) := - \sum_{i} y_{i}' \log (y_i)$$ $y_i$ is the predicted probability value for class $i$ and $y_i'$ is the true probability ...
6
votes
4answers
617 views

What are the possible ways to detect skin while classifying diseases?

I am working on a skin disease classification problem where I have successfully created a classifier ( TensorFlow + Keras ) which can classify images of two skin diseases. The sample image needs to ...
6
votes
1answer
5k views

Keras: How to normalize dataframe with continuous and categorical data?

I have a dataframe with about 50 columns. The columns are either categorical or continuous data. The continuous data can be between 0.000001-1.00000 or they can be between 500,000-5,000,000. The ...
5
votes
1answer
3k views

Keras CNN with low/constant accuracies

I am dealing with the Street View House Number recognition problem. I am trying to train a CNN with Keras. Here is how I prepared the input: ...
48
votes
4answers
45k views

Neural networks: which cost function to use?

I am using TensorFlow for experiments mainly with neural networks. Although I have done quite some experiments (XOR-Problem, MNIST, some Regression stuff, ...) now, I struggle with choosing the "...
31
votes
3answers
29k views

Multi GPU in keras

How do you can program in the keras library (or tensorflow) to partition training on multiple GPUs? Let's say that you are in an Amazon ec2 instance that has 8 GPU's and you would like to use all of ...
19
votes
3answers
17k views

Keyword/phrase extraction from Text using Deep Learning libraries

Perhaps this is too broad, but I am looking for references on how to use deep learning in a text summarization task. I have already implemented text summarization using standard word-frequency ...
26
votes
1answer
9k views

PyTorch vs. Tensorflow Fold

Both PyTorch and Tensorflow Fold are deep learning frameworks meant to deal with situations where the input data has non-uniform length or dimensions (that is, situations where dynamic graphs are ...
20
votes
3answers
25k views

Neural Network for Multiple Output Regression

I have a dataset containing 34 input columns and 8 output columns. One way to solve the problem is to take the 34 inputs and build individual regression model for each output column. I am wondering ...
15
votes
3answers
32k views

What is weight and bias in deep learning?

I'm starting to learn Machine learning from Tensorflow website. I have developed a very very rudimentary understanding of the flow a deep learning program follows (this method makes me learn fast ...
13
votes
1answer
2k views

How to add non-image features along side images as the input of CNNs

I'm training a convolutional neural network to classify images on fog conditions (3 classes). However, for each of about 150.000 images I also have four meteorological variables available that might ...
11
votes
1answer
16k views

How to define a custom performance metric in Keras?

I tried to define a custom metric fuction (F1-Score) in Keras (Tensorflow backend) according to the following: ...
6
votes
3answers
42k views

Switching Keras backend Tensorflow to GPU

I use Keras-Tensorflow combo installed with CPU option (it was said to be more robust), but now I'd like to try it with GPU-version. Is there a convenient way to switch? Or shall I re-install fully ...
6
votes
1answer
6k views

Neural network with flexible number of inputs?

Is it possible to create a neural network which provides a consistent output given that the input can be in different length vectors? I am currently in a situation where I have sampled a lot of audio ...
1
vote
3answers
4k views

Predict sinus with keras feed forward neural network

I have a very simple feed forward neural network with keras that should learn a sinus. Why is the predictive power so bad and what is generally the best way to pinpoint issues with a network? In the ...
7
votes
1answer
4k views

What is a tower?

In many tensorflow tutorials (example) "towers" are mentioned without a definition. What is meant by that?
6
votes
3answers
3k views

Difference between indicator column and categorical identity column in tensorflow

I am learning Tensorflow and came across different feature columns used in Tensorflow . Out of these types, two are categorical_identity_column and ...
6
votes
4answers
1k views

Why choose TensorFlow?

I have noticed that most of the deep learning developers use TensorFlow. So why choose TensorFlow? What is the advantage of TensorFlow over Theano and CNTK?
4
votes
1answer
3k views

Keras negative sampling with custom layer

I am trying to implement negative sampling in Keras. I wrote the following code that just compute the loss and I plan to add an additional output for the logits once I get it up and running. Here is ...
4
votes
3answers
871 views

What is the relationship between the accuracy and the loss in deep learning?

I have created three different models using deep learning for multi-class classification and each model gave me a different accuracy and loss value. The results of the testing model as the following: ...
4
votes
2answers
4k views

Is it possible using tensorflow to create a neural network that maps a certain input to a certain output?

I am currently playing with tensorflow, but can't seem to get a hold whether it usefull for my problem? I need to create a neural network, that is capable of mapping input to output. The way things ...
2
votes
1answer
2k views

How to create a multi-dimensional softmax output in Tensorflow?

I came across this research paper released by YouTube, on how they use deep learning neural networks for recommendations. It's located here: https://static.googleusercontent.com/media/research.google....
5
votes
1answer
840 views

What is the difference between a Categorical Column and a Dense Column?

In Tensorflow, there are 9 different feature columns, arranged into three groups: categorical, dense and hybrid. From reading the guide, I understand categorical columns are used to represent ...
4
votes
2answers
5k views

What is the shape of conv3d and conv3d_transpose?

I want to do a GAN with coloured pictures. This means I need a three dimensional input and therefore I like to use conv3d and conv3d_transpose. Unfortunately in the TensorFlow documentation, I can't ...
2
votes
1answer
3k views

The model of LSTM with more than one unit

In stacked LSTM, for example: 2 LSTM layers, LSTM_1 in order to pass the output of every time step to LSTM_2, so it needs to return hidden state value in every time step, like the architecture I drew ...
1
vote
1answer
2k views

Build knowledge bot using deep learning

I'm going through this chatbot example, which uses the Cornell movie dialog corpus. Expanding this example, is it possible to build a "knowledge bot" (ie) a bot that can chat and be knowledgeable in a ...
0
votes
1answer
2k views

Multiclass Classification on live sensor data

I want to use an accelerometer to detect which way a train is heading. You could do this by just setting thresholds manually to detect the direction of acceleration on the x-axis (which would be ...
4
votes
1answer
5k views

TensorFlow: number of channels of conv1d filter

I want to apply a ConvNet on my one dimensional data retrieved from 13 sensors. So, each of my samples consists of 13 channels (of 51 values) I am using 'conv1d' ...
2
votes
1answer
227 views

CNN training data size for determing the winner of tic-tac-toe

I'm trying to learn machine learning with tensorflow and wrote a program that uses CNNs to determine game results for a given tic-tac-toe board. Its inputs and outputs are - Input - An array of 9 ...
2
votes
1answer
542 views

multi-output regression problem with tensorflow

number of features: 12 , -15 < each feature < 15 number of targets: 6 , 0 < each target < 360 number of examples: 262144 my normalization: I normalized the features so that they are ...
2
votes
1answer
116 views

How to design batches in a stateful RNN

I am using TF Eager to train a stateful RNN (GRU). I have several variable length time sequences about 1 minute long which I split into windows of length 1s. In TF Eager, like in Keras, if ...
2
votes
1answer
318 views

Tensorflow: how to look up and average a different amount of embedding vectors per training instance, with multiple training instances per minibatch?

In a recommender system setting: let's say I want to learn to predict future item purchases based on user past purchases using an approach inspired by Youtube's recommender system: Concretely, let's ...
2
votes
2answers
2k views

When to use different Word2Vec training approaches?

So I am learning Word2Vec for the first time and my question is quite basic: How to know what approach to use? I.e, Word2Vec in Tensorflow or Word2Vec trained with Gensim ? In what cases would ...
2
votes
0answers
705 views

Multivariate, multistep forecasting with LSTM

I want to use an RNN with LSTM to forecast multiple steps into the future, based on multiple inputs. I have some ideas for different ways to approach this, but I'm afraid I'm missing the "right way" ...
1
vote
1answer
946 views

How to Implement a Custom Loss Function with Keras for a Sparse Dataset

My dataset is composed of an idle system that, at some time instants, receives requests. I'm trying to predict these instants through a clock. Since the requests are sparsely distributed (I've forced ...
1
vote
0answers
611 views

Model Parallelism not working? Inception v3 with keras and tensorflow

I have been stuck with a problem like this for a while now. I have an AWS setup with 500 GB of ram and about 7 GPUs. Now the issue is that each time I try to run my keras with tensorflow as back-end ...
1
vote
1answer
446 views

How to arrange the image dataset in CNN?

How do I arrange the image dataset in CNN? Should I put each image category in a separate folder? Or all of them in the same folder? Should the image name be the category name? I would like to see an ...
1
vote
1answer
265 views

We are using PostgreSQL to store big data and are concerned it may crash the on-board Neural Net. Any thoughts?

We have figured out how to write Big Data to our PostgreSQL database. We would like to run this (normalized) data into the on-board Neural Network in Orange. Our lead programmer said he thought Orange ...
1
vote
1answer
266 views

Prediction on timeseries data using tensorflow

I have an input and output of below format: (X) = [[ 0 1 2] [ 1 2 3]] y = [ 3 4 ] It's timeseries data. The task is to predict the next number....
1
vote
2answers
642 views

Data augmentation based on the class type in the CNN model

I would like to use CNN model to classify images but some classes in my dataset have low amount of data. Can I apply data augmentation based on the number of the images in the class? For example, ...
0
votes
2answers
501 views

converting a Tensorflow model for Tensorflow.js

(Warning, I'm a Tensorflow/ML noob) I'm trying to convert and load a TensorFlow model into tensorflow.js The model is saved: ...
0
votes
0answers
357 views

How to map RGB image segmentation ground truth to classes/one-hot vectors in TensorFlow?

Is there a TensorFlow function which takes multicategorical ground truth for semantic image segmentations in the form of RGB images and outputs a tensor with a one-hot vector encoding of the ...
0
votes
0answers
30 views

Join Multiple Tensor from a CNN features extractor

I have a mixed neural network. The first part is a CNN that extrapolate features from an image; I used: ...
0
votes
1answer
51 views

Massive variation in results with tensorflow and keras

I'm new to Tensorflow and Keras and I some background knowledge of how CNN's work. I'm using a basic sequential model based on the code by https://pythonprogramming.net/convolutional-neural-network-...