Questions tagged [data-augmentation]
The data-augmentation tag has no usage guidance.
54
questions
0
votes
1answer
20 views
Why do we use different image processing at train and test time for an image classification tasl
I would like to ask why we use different image processing at train and test for an image classification task. For example, this pytorch tutorial uses RandomResizedCrop at train time and then Resize + ...
0
votes
1answer
16 views
Using MultiLabelBinarizer for SMOTE
This is my first NLP project. I'm trying to use SMOTE for a classifier with 14 classes. I need to convert the classes into an array before using SMOTE. I tried using MultiLinearBinarizer but it does ...
0
votes
1answer
22 views
ImageDataGenerator - trained with model.fit instead of model.fit_generator [closed]
I am a beginner in using the ImageDataGenerator from Keras and I accidentally used model.fit instead of model.fit_generator.
...
0
votes
0answers
31 views
How to build wake-word detection dataset from keyword pronunciations
I have quite a few audio files which are just pronunciation of one particular word, of course there are different tones, accents etc.
I want to build model for wake-word detection, so I need to ...
0
votes
1answer
30 views
Same validation accuracy, different train accuracy for two neural networks models
I'm performing emotion classification over FER2013 dataset. I'm trying to measure different models performance, and when I checked ImageDataGenerator with a model I had already used I came up with the ...
1
vote
1answer
21 views
Data augmentation in deep training
I'm trying to understand the role of data augmentation and how it can affect the performance/accuracy of a deep model. My target application is a fire classification (fire or not, on video frames), ...
1
vote
0answers
15 views
How many augmentated data points for each training image?
What are some useful rules of thumb for picking the number of augmenters per training image?
I realize this is a hyperparameter I can vary and test: I'm just trying to get a sense for reasonable ...
3
votes
1answer
298 views
Is GridSearchCV in combination with ImageDataGenerator possible and recommendable?
I want to optimize some hyperparameters for a CNN architecture by using GridSearchCV (Scikit-Learn) in combination with Data Augmentation (ImageDataGenerator from Keras).
However, GridSearchCV only ...
1
vote
1answer
28 views
How important is the channel order in deep-learning computer vision tasks?
I stumbled across this question while working with OpenCV, which stores color images in BGR order in memory, while most other libraries I know of use RGB order.
How important is this difference? ...
0
votes
0answers
27 views
Computer vision and Augmented reality
I'm new to the Computer Vision I want to make AR application, I don't know where to start.
Please give me some advice?
1
vote
1answer
174 views
Fastest batch perspective transform for image augmentation
I need to do some augmentation for my training images for a neural networks.
The problem is that even when loading batches in parallel, the augmentation is taking longer to perform than the network ...
0
votes
0answers
12 views
Random crop in multi-label image classification context
In some research papers, people use random cropping with variable sizes and then they resize them to original size as a data augmentation technique saying that it helps boost results. Can someone help ...
2
votes
0answers
130 views
Data Augmentation techniques for classification of imbalanced time series datasets
Now I have a task to classify the imbalanced time series datasets using ML classifiers, such as Logistic Regression, Decision Tree, SVM, and KNN. I am not allowed to use the Deep Learning tools, such ...
0
votes
0answers
27 views
How do I augment data after spliting traininng datset into train and validation set for CIFAR10 using PyTorch?
When classifying the CIFAR10 in PyTorch, there are normally 50,000 training samples and 10,000 testing samples. However, if I need to create a validation set, I can do it by splitting the training set ...
1
vote
1answer
19 views
What is the reason behind having low results using the data augmentation technique in NLP?
I used Data augmentation technique on my dataset, to have more data to train. My data is text so the data augmentation technique is based on random insertion of words, random swaps and synonyms ...
0
votes
0answers
134 views
Data Augmentation Multi Outputs
This question is asked several times here on SE, but I havent been able to find the right answer.
I'm trying to build a network with 1 input and 2 outputs. I don't have a lot of data so I would like ...
1
vote
1answer
21 views
Using data agumentation for a frozen pre-trained model
I was following the following article with regards to doing transfer learning:
https://blog.keras.io/building-powerful-image-classification-models-using-very-little-data.html
In the section, Using ...
0
votes
1answer
54 views
Non-Real Time Data Augmentation for CNN Classification. What are the drawbacks?
When people talk about and use data augmentation, are they mostly referring to real-time data augmentation? In the case of image classification, that would involve augmenting the data right before ...
1
vote
2answers
123 views
after augmentation validation accuracy going down?
My main question is about augmentation.
if I process the augmentation I believe it always better than less data
but in my case the validation accuracy going down
train : 7000 images , validation: ...
0
votes
0answers
41 views
Can the test set of non-image data be augmented?
I have learned the test set of image data can be augmented by a method called Test Time Augmentation
and I am wondering after I researched on it if the test set of ...
1
vote
0answers
21 views
Back-Translation model for German and English
Do you know of any pre-trained models for back translation between German and English? I am aware that there are ways to include a monolingual corpus into the training of a machine translation model (...
2
votes
1answer
144 views
Why can't I use data augmentation with a pretrained convnet?
Reading Deep Learning with Python by François Chollet. In section 5.3.1, we've instantiated a pretrained convnet, VGG16, and are given two options to proceed:
A) Running the convolutional base over ...
0
votes
0answers
37 views
How to return batches of augmented images in an image preprocessor?
I've written the following class that generates augmented images one by one. However, I'd like to be able to generate batches of 8 images each (or any number really). The way I'm hoping to do it is:
...
2
votes
1answer
184 views
Is image sharpening a good idea for data augmentation?
I'm training segmentation networks and while the dataset is somehow decent (~5k images) I wanted to augment it, so far I'm trying:
RandomFlip
RandomRotate
RandomBrightness changes
RandomShadows
Due ...
1
vote
1answer
239 views
Implementing back translation as a data augmentation for text classification
Since back translation English->other language -> English seems like quite a useful data augmentation technique , I wanted to experiment with it. E.g. it occurred to me that languages from very ...
2
votes
2answers
1k views
Is there any augmentation tool for images and bounding boxes?
I don't have a lot of training data and I'm looking for some tools in python or executable program like labelimg that do some heavy augmentation on images, even better if they also change bounding ...
5
votes
1answer
2k views
CNN - imbalanced classes, class weights vs data augmentation
I have a set of data with a few strongly imbalanced classes, eg the smallest class is about 54 times smaller than the largest. Therefore, data augmentation in order to equalize the size of classes ...
0
votes
1answer
534 views
How to properly rotate image and labels for semantic segmentation data augmentation in Tensorflow?
What's a proper procedure for doing the image and label rotation for semantic segmentation in dataset augmentation using Tensorflow?
Images
I have seen the function tf.contib.image.rotate(), but ...
1
vote
2answers
137 views
Is there a disadvantage to letting a model train for a large number of epochs?
I created a model to solve a time series forecasting problem. I had a limited amount of time series with which I could train the model therefore I decided to augment the data. The data augmentation ...
0
votes
1answer
22 views
Generated training set on convnet
I have a dataset with roughly 800 images that are classified in 18 classes.
The classes are spread unevenly, with some classes having 30 images and others having 5.
In order to increase my dataset,...
2
votes
1answer
320 views
How to benefit Data augmentation when it yields to different classes
I'm trying to classify rooftop sky images orientations, whether it is horizontal or vertical. Knowing that the most obvious feature here is known: orientation. I can simply augment each class by ...
1
vote
1answer
48 views
What brings the performance difference in Deep Learning with different data augmentation strategies?
I am studying the performance of deep learning models toward abnormality detection in chest X-rays.
Due to sparsity of data, I augment the data using different augmentation strategies including:
...
0
votes
1answer
62 views
Methods for augmenting binary datasets
I have a small (~100 samples) dataset with roughly 20 features which are mostly binary, and a few are numeric (~5). I wanted to use methods for augmenting the training set and see if I can get better ...
1
vote
2answers
892 views
When using Data augmentation is it ok to validate only with the original images?
I'm working on a multi-classification deep learning algorithm and I was getting big over-fitting:
My model is supposed to classify sunglasses on 17 different brands, but I only had around 400 images ...
3
votes
3answers
1k views
How can I augment my image data?
What are the correct and common ways to normalize image for CNN?
I used to work with text and it was pretty straightforward. Removing stop words, clean text from noise, tokenization, stemming etc. ...
0
votes
1answer
133 views
Data Augmentation for Regression ANN with low Sample Size
There is a Dataset of 65 tuples.
I want to Augment new Data from this set and validate my ANN on the original Data.
Is there a possibility, that my ANN already overfits on the augmentet Data. For ...
2
votes
0answers
186 views
Data augmentation / feature extraction on pre-trained convnets
I'm reading 'Deep Learning with Python' by François Chollet, which is an excellent book. He talks about using pre-trained convnets (in his example, VGG16) and then running smaller datasets to tweak ...
1
vote
2answers
3k views
Data Augmentation recommended pipeline
I want to perform image classification using Keras and a dataset made of 50 classes. At the moment, I have only 7 images per class and I need to perform data augmentation in order to train the model ...
3
votes
1answer
1k views
How to create speech commands data set
I am planning to create a speech recognition network that recognize few words (voice commands) and came across Speech Commands dataset from google. Apart from available dataset I am planning to add ...
0
votes
1answer
133 views
GAN's for data augmentation [closed]
I am working to augment my data using Generative Adversarial Networks, I have used Deep Convolutional GAN's for this purpose but they are not learning the right data distribution, so please suggest me ...
1
vote
0answers
214 views
Expected behaviour of loss and accuracy when using data augmentation
I have implemented a convolutional neural network in Keras, and I use off-line data augmentation in the training set. The way I do this is that I create batches of training data in separate files (...
2
votes
0answers
225 views
Spatial Transformer Networks and Data Augmentation
We are all familiar with the famous Deep Mind paper STN.
Upon implementation, such as https://pytorch.org/tutorials/intermediate/spatial_transformer_tutorial.html , did anyone still use input data ...
5
votes
1answer
3k views
Memory error on using data generator in keras
I am using the following augmentations on dataset of size 9 GB:
...
1
vote
0answers
155 views
Data augmentation from directory and oriented features with Keras
Let this, be a dataset labeling the head pose for each photo:
...
2
votes
1answer
1k views
How to implement PCA color augmentation as discussed in AlexNet
I read through "ImageNet Classification with Deep Convolutional Neural Networks" again specifically for details on how to implement PCA color augmentation.
I am unsure if I have it right. Here is how ...
1
vote
1answer
2k views
Data augmentation: rotating images and zero values
A lot of people rotate images to create a larger training set for neural networks. For most nets, all of the inputs have to be the same size so the image rotation function has to crop the newly ...
-1
votes
1answer
801 views
Is image data augmentation breaking the distribution?
NOTE: if you can please edit my question title...
I am thinking a simple question just came in my mind.
There are many people use data augmentation on their image data to train deep CNN.
When I ...
1
vote
0answers
24 views
Are annotated audio datasets augmented with mutated versions the way image datasets are?
Data augmentation is very standard for annotated image datasets for tasks like image labelling. Images are flipped, rotated, pixelated and so on, to add more training data and make the system robust ...
6
votes
2answers
2k views
Data Augmentation for Regression
I want to use deep learning for regression. However, the number of training samples is not large. In image processing, some new samples are generated on the basis of initial data through tasks like ...
3
votes
0answers
2k views
Data Augmentation in Tensorflow
I am trying to replicate a network for facial key point detection like in the following link Daniel Nouri's Blog on KFKD. The blog uses Lasagne but i am trying to do using Tensorflow. I am unable to ...
