Questions tagged [theano]

Theano is a numerical computation library for Python. Computations are expressed using a Numpy-like syntax and compiled to run efficiently on either CPU or GPU architectures. Theano uses a mathematical computational graph and optimized the graph to speed up the computations using optimized C code. As of release 1.0, Theano will no longer be actively developed.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

Visualizing activation maps using Theano and Lasagne

I am trying to visualize the intermediary activation maps of my NN. I load in my parameters: ...
0
votes
0answers
13 views

Theano gradient descent and cost function issue

Sorry but can anyone point out whats wrong with this code? ...
0
votes
0answers
15 views

Convert theano model to Caffe

Is there a way to convert a Theano model into a Caffe model? I've found several scripts that converts Caffe -> Theano but not the other way around.
3
votes
1answer
121 views

Communication between Keras and Backend like Tensorflow, Theano

Keras is a high level neural network API providing python library which uses tensor flow or theano or cntk as backend. What are the primary roles of backend libraries? Is it implementation? or Is it ...
1
vote
0answers
8 views

Functions with state

I'm quite new to Theano and was reading the deep learning documentation here : deep learning Theano The function called accumulator with "inc" and state was explained really unclear, that I couldn'...
1
vote
0answers
45 views

Linear regression NN in Theano using List

I am quite new to Theano, while having used Neural Networks in MATLAB before. I have succeeded with reading all my data from my excel files, and create the input and output lists. To separate each ...
1
vote
1answer
821 views

Keras/Theano custom loss calculation - working with tensors

I'm struggling to write some tensor manipulation code for a custom loss function I'm using in Keras. Basically, I'm trying to modify a binary_crossentropy loss by adding a weight that is calculated ...
1
vote
0answers
539 views

Neural network for peak identification problem not training successfully

I'm trying to build a program that can identify peaks in a signal. It's my first attempt at machine learning so I'm starting with a toy problem where I'm generating a gaussian curve of random width ...
10
votes
1answer
14k views

Make Keras run on multi-machine multi-core cpu system

I'm working on Seq2Seq model using LSTM from Keras (using Theano background) and I would like to parallelize the processes, because even few MBs of data need several hours for training. It is clear ...
3
votes
2answers
1k views

Convolutional layer dropout layer in keras

According to classical paper http://www.cs.toronto.edu/~rsalakhu/papers/srivastava14a.pdf dropout operation affects not only training step but also test step - we need to multiply all neuron output ...
20
votes
4answers
26k views

Using TensorFlow with Intel GPU

I am a newbie in deep learning. Is there any way now to use TensorFlow with Intel GPUs? If yes, please point me in the right direction. If not, please let me know which framework, if any, (Keras, ...
2
votes
1answer
1k views

CNN for classification giving extreme result probabilities

I'm having issues with my CNN, using Keras with Theano backend. Basically, I need to classify 340x340 grayscale images into 6 categories. The problem is my CNN gives too "hard" probabilities, for ...
1
vote
0answers
325 views

LSTM Weight Matrix Interpretation

Consider the following code in Keras for building a LSTM model. ...
1
vote
1answer
317 views

printing theano.tensor without having any idea about the shape and type of the tensor

I am debugging a code which I haven't written. I want to print out state_below_ variable which is calculated as following: ...
6
votes
1answer
5k views

Keras: How to normalize dataframe with continuous and categorical data?

I have a dataframe with about 50 columns. The columns are either categorical or continuous data. The continuous data can be between 0.000001-1.00000 or they can be between 500,000-5,000,000. The ...
1
vote
0answers
306 views

L2 regularization in caffe

I have a lasgane code. I want to create the same network using caffe. I could conver the network.But i need help with the hyperparameters in lasagne. The hyperparameters look like: ...
3
votes
1answer
2k views

Recurrent Neural Network on Panel Data

There are 2 parts to this question. Suppose we are looking at sales $S$ of a product across $> 1000$ stores where a it sells. For each of these $1000$ stores we have 24 months recorded data. We ...
1
vote
0answers
634 views

Does the time to train a model using keras increase linear with epoches?

Training a model in keras can go very fast. I trained the following model. To train the model with 1 epoch finishes in a few second. However, using 20 epochs it lasts half an hour or so? An epoch ...
1
vote
1answer
2k views

shape of theano tensor variable out of keras Conv2D

Being new to theano, pls bear with me. I thought the shape of the tensor variable is already well defined out of the Conv2D layer since the input is specified, as follow, ...
1
vote
0answers
731 views

Image as input and output in keras

I am trying to make a model of this image. Here is the relevant code: ...
6
votes
3answers
2k views

Convolutional Neural Network not learning EEG data

I have trained a simple CNN (using Python + Lasagne) for a 2-class EEG classification problem, however, the network doesn't seem to learn. loss does not drop over epochs and classification accuracy ...
-2
votes
1answer
385 views

Keras Import Error

While importing keras (from keras.models import Sequential), I am getting the following error: ...
5
votes
1answer
8k views

What does Theano dimension ordering mean?

In this code , line 13 is commented as Theano dimension ordering mode. What does this mean?
8
votes
1answer
7k views

Why doesn't training RNNs use 100% of the GPU?

I wonder why training RNNs typically doesn't use 100% of the GPU. For example, if I run this RNN benchmark on a Maxwell Titan X on Ubuntu 14.04.4 LTS x64, the GPU utilization is below 90%: The ...
2
votes
0answers
75 views

GPU Utilisation Issues

I observed that my GPU's memory is being consumed but the Utilisation stays 0. Because of this, my model is taking forever to load. I have tweaked this code to handle multilabel data. The only changes ...
1
vote
0answers
48 views

Find boundaries for a smallest mean error

I am new at deep learning, but willing to learn. I have this problem. Have 5 inputs: A,B,C,D,E(columns in CSV) that gives me 1 or 0. A,B,C,D or E can be between 0 and 100. For example, a ...
3
votes
2answers
3k views

How Int8 (byte) operations can be useful for deep learning?

Nvidia is planing to add hardware support for int8 operations to their titan card and target deep learning. I am trying to understood how its useful and what types of network will benefit from this. ...
1
vote
0answers
177 views

About installing Theano

I hope this question is relevant to this community as Theano is increasingly a standard software to do machine learning. So I have been trying to follow the instructions here, http://deeplearning....
1
vote
1answer
1k views

Theano vs Tensorflow for building Neural Networks for NLP tasks

I am trying to learn Theano and TensorFlow for building neural networks for NLP based tasks. Any suggestions as to when one should choose one over the other or what works better and when or is it just ...
1
vote
0answers
78 views

Mean vs Sum of cost in theano

I have recently observed in many cases that taking mean of the cost function vs sum of cost function results in very different results (specifically in thenano)? Many times sum of cost gives nan ...
1
vote
0answers
509 views

Why is this trained model misclassifying new cases?

Below is text / code from a recent SO post of mine that I hope you could comment on: Using Keras/Theano, I successfully trained a model using the Keras sample code for CIFAR10. It ran for about 2 ...
4
votes
3answers
1k views

Training Restricted Boltzmann Machines (RBMs) using gradient descent

Hey I am a little new to the whole RBM entropy/energy training thing, having some trouble understanding and trying to figure whether it is worth the effort needed to understand. Can't RBMs quite ...
4
votes
1answer
208 views

Benchmarking Theano

I sometimes want to benchmark Theano, either to compare different versions of Theano, or to compare two different computing environment with the same version of Theano. Is there any Theano code I ...
1
vote
1answer
345 views

Character recognition neural net topology/design

I'm building a neural net for classifying characters in pictures. The input can be any character a-z, lowercase and uppercase. I only care about classifying the characters, and not the case, so the ...
6
votes
3answers
4k views

Stuck on deconvolution in Theano and TensorFlow

I'm captivated by autoencoders and really like the idea of convolution. It seems though that both Theano and TensorFlow only support conv2d to go from an array of 2D-RGB (n 3D arrays) to an array of ...
2
votes
0answers
182 views

Contrastive divergence in RBM

I have the following code, where x in the input data, w is the weight matrix, bv and bh are the biases for the visible and hidden units. ...
0
votes
2answers
78 views

Logistic regression program does not give statistically correct result [closed]

I wrote a very simple and compact logistic regression program using theano. I am initialising my data randomly, and I have restricted the number of training steps to 1, so since the weights are also ...
3
votes
2answers
195 views

Can PyLearn do everything that Theano can?

Since PyLearn2 is build upon Theano, is it possible to do anything I can do in Theano in Pylearn2? For example, if I have some snippets of Theano code, can I run them as-is in Pylearn2, or would this ...
2
votes
1answer
658 views

Early-Stopping for logistic regression. Theano

I am trying to understand the code for the logistic regression on the official documentation, but I am struggling to understand the logic behind this code: ...
2
votes
1answer
466 views

How can I preprocess multi-page image inputs in a theano/lasagne network?

I am trying to classify multi-page documents using a convolutional neural network (CNN). The content of each page in the corpus contains only text (i.e., no photographs or icons), and different ...
2
votes
1answer
157 views

Theano logistic regression understanding code

I am used to C/Java like programming, and sometimes I am getting a headache on understanding the Python notation. On the logistic regression code available online, I am trying to understand this line ...
0
votes
1answer
433 views

Multi-class logistic regression

I am trying to understand logistic regression for a multi-class example and I have the following code: ...
3
votes
1answer
679 views

Theano logistic regression example

I am trying to understand some simple neural net case using theano. The deeplearning.net site gives the following simple code for implementing a logistic regression application to a simple case: <...
20
votes
2answers
9k views

Choosing between TensorFlow or Theano as backend for Keras

Keras supports both TensorFlow and Theano as backend: what are the pros/cons of choosing one versus the other, besides the fact that currently not all operations are implemented with the TensorFlow ...
4
votes
4answers
13k views

Library to count number of objects in image?

I'm reading a paper on counting cells, humans, etc. Is there an off-the-shelf library for Python/Theano or TensorFlow I could use?
5
votes
2answers
73 views

Error on multitask neural nets where all outputs not observed for every example

Let's say I have 2 datasets, each from a set of experiments. Dataset A measures a set of properties X for set S, while dataset B measures properties Y for set T. X and Y are highly correlated, and S ...