Questions tagged [tensorflow]

TensorFlow is an open source library for machine learning and machine intelligence. TensorFlow uses data flow graphs with tensors flowing along edges. For details, see https://www.tensorflow.org. TensorFlow is released under an Apache 2.0 License.

Filter by
Sorted by
Tagged with
0
votes
0answers
2 views

Multi-GPU: Lower performance with more workers, smaller batch size, smaller queue

I'm getting unexpected results when I'm tweaking the training parameters of my run. CNN model (~1M parameters, consecutive 2D CNN into two FC layers) Data set: 20k images from CelebA with 218x178x3 ...
0
votes
0answers
8 views

VGG style transfer fails with pre-computed `vgg19.preprocessing()` for the content, transfer, style inputs

I'm working through the style transfer tutorial on tensorflow, see: style transfer I made a few adjustments to my notebook, but it works fine for the base case: [ content_image | transfer_image | ...
0
votes
0answers
29 views

Error loading a model (.h5 file) after training yolo-keras classification model

I am working on realtime object detection using my laptop's camera with Yolo and Keras. I have trained a model and the resulting output is a .h5 file containing (from my understanding) the model and ...
0
votes
0answers
19 views

Training with many CPU cores doesn't improve performance

I ran my job on a computing cluster: first with 1 node / 4 cores, then with 2 nodes / 32 cores. But the training time is pretty much exactly the same for both of them! 67 seconds per step. I am ...
0
votes
0answers
17 views

Sudden decline in cumulative reward of an reinforcement learning training agent

Hi I am training an RL agent using PPO algorithm of stable baselines library. I have integrated my training with tensorboard to monitor the training process. Over a period of time my training rewards ...
2
votes
1answer
39 views

How can we reduce the GPU memory usage when the model is already small enough?

I trained a model and froze it into a PB(protocol buffer) file and a directory of some variables, and the total size is about 31M. We deployed it using a GPU card and followed this answer and set the <...
0
votes
0answers
25 views

UserWarning: `Sequential.model` is deprecated

C:\Users\AppData\Local\Continuum\anaconda3\lib\site-packages\keras\engine\sequential.py:110: UserWarning: Sequential.model is deprecated. ...
0
votes
0answers
7 views

Understanding the output of embeddings and an error message when I change a parameter in the embedding layer in Keras/tensorflow 2.0 [closed]

I am trying to understand and familiarize myself with embeddings. I created an artficial dataset of 5000 observations comprised from the union of 5 datasets: Sample of 1000 values drawn from a ...
0
votes
0answers
27 views

Fully-Configured Deep Learning Virtual Machines in Python (VirtualBox or VMware)

Often when we start working on any new technology, the most common challenge that we face is "How can I not waste time setting up my environment but directly working on the technology?" If you aren’t ...
0
votes
0answers
15 views

TF/Keras: different results based on how I combine models

I'm trying to follow the Transfer learning with a pretrained ConvNet tutorial, using my own images and data. If I first run my images through the base model (MobileNetV2), and then take the results ...
0
votes
0answers
9 views

Gym Cartpole not solving with Cross Entropy Method?

Cross Entropy Method is considered as one of the simplest optimization algorithm which can be used for training an agent. I tried to train an agent to solve gym's cartpole environment and I have used ...
0
votes
0answers
10 views

Transfer learning training accuracy starts from a fixed value

I am training a transfer learning model using tensorflow.keras library for image classification. I am dealing with 7 classes. I have used several pre-trained models ...
0
votes
1answer
40 views

How to get sentence embedding using BERT?

How to get sentence embedding using BERT? ...
0
votes
0answers
6 views

why evaluate_generator accuracy too much by using flow_from_directory with shuffle true?

i am using tensorflow and keras on colab i train with shuffled data but i met this strange accuracy with evaluate_generator with my training set that has 95% acc if i did not shuffle my data with ...
0
votes
0answers
27 views

sess.run in losses.py

now I want to use sess.run in losses.py so that complex codes can be written by python style for customizing error function as below; ...
1
vote
1answer
30 views

Encoding logic rules in machine learning [closed]

For some problems you have certain rules that you know for a fact are true. A very simplistic example would be - "A grade below 40% is a failing grade" There is no ambiguity in the statement and ...
1
vote
1answer
24 views

How reproducible should CNN models be? [closed]

I want to train several CNN architectures with Google Colab (GPU), Keras and Tensorflow. Since the trained models are not reproducible due to GPU support, I would like to train the models several ...
1
vote
0answers
7 views

Handling a large dataset consisting of npy files

I have a high number of npy files (448 files) each consisting of around 12k frames (150x150 RGB images) which together make the input to my neural network (X). However, since it is impossible to load ...
0
votes
0answers
15 views

Viewing TensorFlow datasets vs. pandas DataFrames: Differences?

A simple preview of a pandas.DataFrame is typically done by calling head(k) and will simply return the first ...
0
votes
0answers
46 views

For loop and assignment procedure in losses.py for customizing loss function of ML model

I want to customize a loss function for neural networks. A computation of the loss function requires the inclusion of a for loop like below. However, it is super difficult to implement because ...
0
votes
0answers
4 views

Training Algorithm for pointcloud data (3d point data)

I have a "PointNet" neural network which theoretically can work with any number of points as input. I have trained the model using an equal number of points from each object. That is fairly simple and ...
0
votes
0answers
11 views

Convolution with different dilation rates for each dimension

How can I get a dilated convolution with different dilation ratio on each axis? Tensorflow/Keras would be best. For example, the filter in the gif below would have the following properties: ...
0
votes
1answer
9 views

What methods are used to determine acceptable loss levels for autoencoders?

I've been looking at autoencoders for disparate uses such as dimension reduction, blurring or sharpening images and data denoising. What methods are used to determine acceptable loss levels for ...
0
votes
0answers
3 views

Seperating reusable layers gradients in tensorflow

Lets say we have $l = f(g(x, \theta), \theta)$, where $\theta$ is a reusable parameter. If we now do tf.gradients on $l$ and $\theta$ we will get $\frac{\partial{f}}{\partial{g}}\frac{dg}{d\theta} +...
2
votes
3answers
60 views

How to fix my high validation loss and inaccuracy

New to machine learning and tried to train my bird recognization model and found very high validation loss and inaccuracy. I'm using this dataset: http://www.vision.caltech.edu/visipedia/CUB-200-2011....
1
vote
0answers
19 views

How to access an embedding table that is too large to fully load into memory?

I'm currently trying to find a way of loading/deserializing a .json file containing Flair word embeddings that is too large to fit in my RAM at once (>60GB .json with 32GB of RAM). My current code for ...
0
votes
0answers
7 views

Tensorboard not being recognized on Amazon Deep Learning instance after upgrading to TF 2.0

I am running an EC2 instance based on the Ubuntu (18.04) deep learning AMI. To make a long story short I wanted to upgrade from TF 1.14 to TF 2.0. That seems to be working: ...
0
votes
0answers
9 views

RL library for implementing PPO algorithm

I have recently studied about PPO algorithm. I want to train an RL agent using PPO. However I am finding it difficult to implement. So I am planning to use a library which will help me in the ...
0
votes
0answers
13 views

Combining two structurally similar datasets from different sources

I am working with a text summarization problem, and I am trying to use this architecture [Pointer Generator]. My data set is VERY small (225 samples) compared to the CNN/ Daily Mail dataset this paper ...
0
votes
1answer
24 views

LSTM - Incorporate word embedding in layer with multiple records in same date

I have a time series data having more than one record in a single date. Number of records in a single date is not consistent. I have 3 input features namely phrase, cost and weight. My goal is to ...
0
votes
1answer
22 views

How can I explain the cause of different performances for two different LSTM models and improve the performance?

I've built two different models for Load Forecasting. Dataset has six features. The performance evaluation metric is the Mean Absolute Percentage Error(MAPE). Both models are based on LSTM. Here is ...
0
votes
0answers
11 views

Data input and shape for LSTM

I want to classify data with a LSTM. I need a binary classification, thus 2 classes (0,1). I probably need a stateful LSTM as one CSV file (sequence) is a continous recording in time. The data is ...
0
votes
0answers
10 views

Conditional loss for bounding boxes in Tensorflow

I want to build a classifier plus localizer in Tensorflow. I wonder how I can implement a loss function with a condition that checks the accuracy of the bounding box only of the object is detected. ...
0
votes
1answer
26 views

Training a sound localization neural network

I am trying to train a neural network, to estimate the location (in degrees from 0 to 180) a sound is coming from. I am using tensorflow keras in python to train the model. The input data are two ...
0
votes
1answer
16 views

Validation generator in Autoencoder returning NaN

I am trying to build a fairly simple autoencoder using Keras on the OpenImages dataset. Here is the architecture of the ae: ...
1
vote
1answer
24 views

Error on custom RNN/LSTM with multiple inputs

I want to implement a custom RNN/LSTM model similar to this. The model should take two separate vectors as input and process them. I was following keras tutorial to implement a custom keras layer and ...
0
votes
1answer
22 views

Can I save only some VGG19's layers into a .H5 file?

I am training a deep-learning style transfer model with the pretrained-VGG19 CNN. My aim is to use it in my Android app for personal purposes with Google Firebase Machine Learning Kit (which would ...
0
votes
0answers
11 views

evaluate pretrained model on a new class and previously learned classes

I am trying to write a model to demonstrate catastrophic forgetting. I am using cifar10 image dataset that has got images from 10 different classes. Firstly, I trained the model on 8 classes (except <...
1
vote
1answer
34 views

Does resizing images during training affect the bounding box annotations?

I am using tensorflow object detection API to train my own custom dataset and I am preparing annotations for the same. I see from the config file of my pre trained ssd inception net, the size of the ...
0
votes
0answers
32 views

Tensorflow Probability Example : Gradient Computation Error

I am trying to run example code from tensorflow Probability for Dirichlet Process Mixture Model (https://github.com/tensorflow/probability/blob/master/tensorflow_probability/examples/jupyter_notebooks/...
0
votes
1answer
183 views

Tensorflow error: Input signature not matching inputs

I have been stuck on this one for awhile and I hate this website so I wouldn't post here unless I've tried everything else but I've been following Sentdex's tutorials on Youtube about Deep Learning ...
0
votes
0answers
9 views

Can't visualize Word Embeddings properly

I have used Keras v2.3.1 with TensorFlow 2.0.0 to train a model and save trained word-embeddings for visualization in tensorboard. I am using the following piece of code. ...
1
vote
1answer
29 views

Normalize the output of a dense layer with linear activation

I have the following architecture of my network: ...
1
vote
1answer
32 views

How does keras (TF) know how to differentiate my custom loss?

Suppose I have this custom loss: ...
2
votes
1answer
47 views

Tensorflow uses more memory, the more epochs it completes

I created a genetic algorithm "optimizer" for Tensorflow but it is written in python. I know TensorFlow was not designed like this and I need to rather create the optimizer in C++ using their API's ...
0
votes
0answers
13 views

SGD Optimizer NAN Loss

I am working on a regression type problem. When if run to train the model i am facing the following outputs. Is there any problem in my code? I also used adam, it gives numeric loss and ...
0
votes
0answers
13 views

How to see what's inside a tf.feature_column.crossed_column

I am starting with tensorflow and I am currently working through the titanic/linear estimator tutorial (https://www.tensorflow.org/tutorials/estimator/linear). I just arrived at the point where they ...
-1
votes
2answers
48 views

LSTM to predict Sin(x) from x

Hi I want to pass a series of values x1, x2... as input to the model to predict y1 = sin(x1), y2 = sin(x2)... -I created dataset: x=[0.1,0.2,...] and y=[sin(0.1),sin(0.2),...] -I normalize x in [0,1]...
0
votes
0answers
10 views

Number of parameters in a 3D U-Net

I am interested in the 3D U-Net as proposed in Çiçek et al. 2016 (https://arxiv.org/abs/1606.06650). A Caffe implementation is publicly available (in particular, the prototxt), but I am using ...
2
votes
1answer
104 views

Running out of memory when training Keras LSTM model for binary classification on image sequences

I'm trying to come up with a Keras model based on LSTM layers that would do binary classification on image sequences. The input data has the following shape: ...