Questions tagged [colab]
Google Colab is an online browser based python notebook/execution environment similar to Jupyter Notebooks.
71
questions
23
votes
6
answers
122k
views
Uploading images folder from my system into Google Colab
I want to train a deep learning model on a dataset containing around 3000 images. Since the dataset is huge, I want to use Google colab since it's GPU supported. How do I upload this full image folder ...
- 341
11
votes
3
answers
15k
views
How to automatically mount my Google Drive to Google Colab
I have recently discovered Google Colab and I am wondering if there is an option to permanently authorize Google Colab to access and mount my Google Drive.
...
- 213
8
votes
1
answer
39k
views
How to download dynamic files created during work on Google Colab?
I have two different files and on the first, I tried to save data to file as:
np.save(open(Q1_TRAINING_DATA_FILE, 'wb'), q1_data)
On second file, i'm trying to ...
- 185
6
votes
3
answers
7k
views
Kaggle notebook Vs Google Colab
What are the major differences between Kaggle notebook and Google Colab notebook?
To work on a dataset my first step is to start a Kaggle notebook but then I cant help thinking what could be the ...
- 61
4
votes
3
answers
3k
views
Very Fast Training After First Epoch
I trained an InceptionV3 model using plant images. I used Keras library. When training was started, first epoch took 29s per step and then other steps took approximately 530ms per step. So that made ...
- 422
4
votes
1
answer
39k
views
How to save google colab notebook outputs and variables [closed]
I want to save variables and outputs in text file with colab!
Any bright idea?
- 41
4
votes
1
answer
761
views
How to cache GridSearchCV optimizer result in Google Colab?
I have to execute GridSearchCV() cell every time I reload the page and it takes a lot of time. Is there a caching mechanism which stores the GridSearchCV result so ...
3
votes
3
answers
4k
views
Alternatives with better GPU than Google Colab Pro
I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM
Is there any alternatives with better GPU and more RAM than ...
- 173
3
votes
1
answer
1k
views
NLP: what are the advantages of using a subword tokenizer as opposed to the standard word tokenizer?
I'm looking at this Tensorflow colab tutorial about language translation with Transformers, https://www.tensorflow.org/tutorials/text/transformer, and they tokenize the words with a subword text ...
- 339
2
votes
3
answers
14k
views
How do I download a Google Colab notebook?
I have to download code written in a Google Colab notebook, because I need to send it via email. How do I do this?
- 801
2
votes
1
answer
2k
views
How to import large datasets into Google Colab?
Does anyone know a (free) method for importing large datasets into Google Colab, of multiple GB? Github is severely limited, uploading a folder to google drive takes a long time.
- 451
2
votes
1
answer
86
views
Notebook for data science
I'm searching for an online Jupiter notebook environment that allows collaborating in real-time. I've found that I've choice from two services Deepnote.com and DataLore by JetBrains. I have little ...
- 157
2
votes
1
answer
1k
views
Google Colab conda packages permanently installation
I want to install some conda packages on Google Colab. Installation done successfully, but it wont detect it when we restart the new Colab session.
I followed the link "#https://stackoverflow.com/...
- 1,232
2
votes
1
answer
287
views
Colab can not connect to GPU from a python file [closed]
I am trying to run a github deep learning repository in Colab but I can not connect the python files to colab GPU.
I can connect to GPU when writing a script in the colab notebook e.g. when I run ...
- 23
2
votes
1
answer
465
views
How to use Kaggle Api in Google Colab for directly using dataset?
I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are :
...
- 121
2
votes
0
answers
866
views
get a can't set attribute while using GPU in google colab but not not while using CPU
Hi i was learning to create a classifier using pytorch in google colab that i learned in Udacity. here is the link
so i was loading data in the dataloader and when i used cpu it loaded and displayed ...
- 351
1
vote
1
answer
16k
views
Not able to connect to GPU on Google Colab
I'm trying to use tensorflow with a GPU on Google Colab.
I followed the steps listed at https://www.tensorflow.org/install/gpu
I confirmed that gpu is visible and CUDA is installed with the ...
- 143
1
vote
2
answers
57
views
Which desktop hardware is best for DL?
I will be building my home Deep Learning workstation. Right now, I'm digging for some time about the best HW to use for home conditions.
The workstation will be used for my work as a developer, but I ...
- 111
1
vote
1
answer
212
views
ValueError: Error when checking input: expected conv2d_25_input to have shape (144, 256, 3) but got array with shape (256, 144, 3)
I have built a CNN with images of size 720 (height) and 1280 (width). I attempt to re scale images to 144x256. However, I receive this error:
...
- 451
1
vote
1
answer
149
views
Where do I find the .csv file for the submission after creating it?
I am making a submission of a classificaition problem with CNN on Google Colab. So I have arrived at doing this:
subm.to_csv('submission.csv', index=False)
so in ...
- 801
1
vote
1
answer
683
views
How to upload a saved file from google colab to a site such as kaggle or github? [closed]
We are able to load a file from a site such as kaggle and git hub to google collab, we apply the below code to download from other sites into google colab:
...
- 65
1
vote
1
answer
634
views
M1 MacBooks versus Google Colab
I am just starting getting into deep learning with tf.keras. I am at the point where I have to decide where I want to develop. The thesis project will be timeseries ...
- 111
1
vote
0
answers
103
views
Orange Data Mining Tool on Google Colab
Is it possible to use Orange Data Mining Tool on Google Colab?
- 11
1
vote
1
answer
87
views
Best way to get data into Colab Notebook
I am working concurrently with multiple very large datasets (10s-100s of GBs)). I signed up for Colab Pro+ thinking it is the best option. However, I face a significant bottleneck in getting data into ...
- 293
1
vote
1
answer
1k
views
Python: SARIMAX Model Fits too slow
I have a time series data with the date and temperature records of a city. Following are my observations from the time series ...
- 11
1
vote
0
answers
79
views
Downloading a large dataset in google colaboratory
I have a link of a dataset, it is 22 gig but in the collab, there is just 32 gig free disk space. The data is in the zip file and after unzipping collab show crash massage. How can I solve this ...
- 11
1
vote
0
answers
1k
views
setting class weights for imbalanced dataset in tensorflow [closed]
I have 24 classes in my dataset and I am trying to set class weights in the following way:
...
- 111
1
vote
0
answers
403
views
Using Images uploaded in google drive in Colab
Does anyone know how to use already uploaded images in Google Drive to colaboratory for creating a trainloader?
I'm creating the trainloader and model in Pytorch
- 11
1
vote
2
answers
657
views
What interactive graph package do you use for timeseries data?
I have millions of sensor readings taken over time. I'd like to create an interactive plot in Google colab where I can easily zoom in on sections. I've done something similar with the Plotly package....
- 119
1
vote
0
answers
4k
views
how to resolve this error in Tesseract : (2, 'Usage: pytesseract [-l lang] input_file') [closed]
pytesseract.pytesseract.tesseract_cmd = r'/usr/local/bin/pytesseract'
img = Image.open("/content/drive/My Drive/abc.jpg")
print(pytesseract.image_to_string(img))
...
- 1,361
1
vote
1
answer
81
views
Problem importing dataset in zip format
I am trying to import a image dataset in Google Colab in order to do image classification. The dataset is in my Google drive, so I do the following:
...
- 801
1
vote
1
answer
93
views
How reproducible should CNN models be? [closed]
I want to train several CNN architectures with Google Colab (GPU), Keras and Tensorflow.
Since the trained models are not reproducible due to GPU support, I would like to train the models several ...
- 45
1
vote
1
answer
4k
views
keras UserWarning: The input 1303 could not be retrieved. It could be because a worker has died
I am trying to train an autoencoder CNN on Google Colab using keras. I have mounted my Google Drive which contains all training data. The training uses six workers and the data is loaded by the ...
- 113
1
vote
0
answers
30
views
Google Colaboratory - Won't Start Error
Has anyone else encountered this error? I am teaching a business analytics class with python this semester and Colab has been absolutely fantastic, yet one student is getting the following error.
...
- 131
1
vote
0
answers
1k
views
Google team drive and google colaboratory uploading/downloading files [closed]
So I have google Team drive set-up with all the permissions.
1. How I can access google team drive in google colaboratory? I think i'm missing something... it's always showing me output of my drive
2. ...
- 11
0
votes
1
answer
523
views
How many images can be trained in Google Colab? [closed]
I am using the ResNet50 pretrained model to train my images using TensorFlow. I have 70k images and upgraded to Google Colab Pro, but still I am facing a memory error. So how many images I can train ...
- 351
0
votes
1
answer
13k
views
How to save dynamic files from colab to Google Drive?
I have processed some png images on Colab and saved them in the Colab Directory. Now I want to save these images from Colab to Google Drive. How can I do this?
0
votes
2
answers
315
views
mBART training "CUDA out of memory"
I want to train a network with mBART model in google colab , but I got the message of
...
- 41
0
votes
2
answers
2k
views
Loading pretrained model with Pytorch
I saved my model with this code:
from google.colab import files
torch.save(net, 'model.pth')
# download checkpoint file
files.download('model.pth')
Then uploaded ...
- 149
0
votes
1
answer
13k
views
How to use inverse_transform in MinMaxScaler for pred answer in a matrix
I am working on a data, for preding output, I used SVR by bellow code:
...
- 13
0
votes
1
answer
3k
views
Upload 'tsv' file to Google Colab / Jupyter Notebook
TSV(Tab separated Value) extension file can't be uploaded to google colab using pandas
Used this to upload my file
...
- 101
0
votes
1
answer
20
views
Linear regression not converging
I'm trying to implement the simplest possible machine learning algorithm which is linear regression. But I'm having trouble because the loss function is not converging. Please can you look at my ...
- 157
0
votes
1
answer
283
views
Colab Pro+ CNN GPU memory saturation
I have a problem when executing jupyter notebook for CNN in colab pro+, to train a model with a size of 560664x48x48x1.
normally the data is composed of images with a size of 48x48.
I used 10 fold ...
- 101
0
votes
1
answer
145
views
Any alternative to Google Colab?
I have to train vgg16 from scratch on a digit dataset as my college project. I require more computational power. Can anyone suggest to me how can I do that other than Google Colab? Currently, it is ...
- 139
0
votes
1
answer
803
views
How to save the history epochs and plots in files from keras models
I have a question, that maybe is very simple, but I can't do it: I have 3 neural networks which are trained with 100 epochs, and I need to save all the history's train displayed at the end in a .txt ...
- 13
0
votes
1
answer
41
views
Machine Learning A-Z: Help connecting with datasets
I'm in Machine Learning A-Z lecture 19 where we access our first dataset. I've connected to the Google Colab folder in my gmail account, but when I try to access the the file I get the below error ...
0
votes
2
answers
59
views
I am getting different mean_absolute_error when i retrain my model everything same
I have set my numpy random seed to 0.
I am training on colab and using keras.
I didn't change anything.
I just re-ran my cell and the val_absolute_error changed.
Code:
...
0
votes
2
answers
121
views
How to use function from other Colab file?
I’m coming from a math background and learning some data science. I am very new to some details of this stuff.
Working with colab, I’m trying to organize my sample simulating functions in such a way ...
- 1
0
votes
0
answers
6
views
tensorflow dataset 'plant_leaves' cannot be imported to google Colab : DownloadRetryLimitReachedError
I'm trying to upload a tensorflow dataset called plant_leaves but it won't work and it shows a runtime error :
0
votes
0
answers
57
views
Getting error "Failed to find data adapter that can handle input" even after converting list to array
I am getting this error : ValueError: Failed to find data adapter that can handle input' I even changed the list to arrays but still the error keeps pooping up.
This is the code:
...
