14
votes
Uploading images folder from my system into Google Colab
Method 1 :
zip the file
Upload the zipped file, there is an Upload button under the Files Section.
Unzip it using the command on colab :
!unzip level_1_test.zip
Method 2 :
upload the zip file ...
- 141
9
votes
Uploading images folder from my system into Google Colab
The best bet would be to upload the images as a zip file to your Google drive and then access it through Google Colab (GC)
Zip the image folder
Upload the zip file to your Google drive
Turn to GC to ...
6
votes
Accepted
Very Fast Training After First Epoch
Keras supports lazy execution. The create_model and model.compile code are not executed until it is absolutely required which is ...
- 20.4k
6
votes
How to automatically mount my Google Drive to Google Colab
For some reason, Colab allows me to automatically mount if I'm the creator of the notebook. If that's not the case, such was when I create a copy, the ...
- 161
6
votes
Kaggle notebook Vs Google Colab
There are several rundowns between the two services like this one.
Key for me:
Only Kaggle supports R, only Colab supports SWIFT
Colab is a Google product and is therefore optimized for Tensorflow ...
- 1,723
5
votes
Very Fast Training After First Epoch
Although there are valid points in the accepted answer, I believe it is incorrect in this case.
The timing differences mentioned were between the first epoch of training and the remaining epochs. The ...
- 14.7k
4
votes
How to save google colab notebook outputs and variables
Save your content in the current directory and execute !dir to see the content. Then follow the following code snippet:
...
- 13.9k
4
votes
Accepted
How to download dynamic files created during work on Google Colab?
Based on what I've seen and experienced, the best way is to store and retrieve your data from your drive account. Actually your question is a bit unclear but first I say, try to use the following ...
- 13.9k
4
votes
Accepted
Not able to connect to GPU on Google Colab
In Google Colab you just need to specify the use of GPUs in the menu above. Click:
Edit > Notebook settings >
and then select ...
- 6,065
4
votes
Accepted
How many images can be trained in Google Colab?
The real problem is that you should not try to fit all your images in memory. Instead, you should small groups of images, normally called "minibatches", which can fit in the GPU/CPU memory.
...
- 23.7k
4
votes
Accepted
NLP: what are the advantages of using a subword tokenizer as opposed to the standard word tokenizer?
Subword tokenization is the norm nowadays in NLP models because:
It mostly avoids the out-of-vocabulary (OOV) word problem. Word vocabularies cannot handle words that are not in the training data. ...
- 23.7k
3
votes
Kaggle notebook Vs Google Colab
I have been frequently using both the platforms and could straightaway point a few differences:
Kaggle gives NVIDIA Tesla P100 PCI based 16GB GPUS for approximately 9 straight hrs in a single commit, ...
- 2,395
3
votes
How to save dynamic files from colab to Google Drive?
Just mount your drive into Colab and create the checkpoint in the mount point location. Let me try to explain this with an example:
Mount the drive as follows:
...
- 2,395
3
votes
Accepted
How to cache GridSearchCV optimizer result in Google Colab?
We can save the trained model or any other file via Google Colaboratory.
How I'm using it?
I have mapped my Google Drive with Google Colaboratory notebook and
saved trained model as a pickle ...
- 1,252
3
votes
Uploading images folder from my system into Google Colab
You don't need to upload them if you have a download link ...( it would be faster if you can upload them all as either ways you have to do so.. So its better to upload them first and then download ...
- 2,460
3
votes
Alternatives with better GPU than Google Colab Pro
Here are a few options:
Commercial cloud provider: AWS is the go-to cloud provider for virtually any need, they have options for everything. Check out their options for Deep Learning.
You could also ...
- 25k
2
votes
Accepted
How to upload a saved file from google colab to a site such as kaggle or github?
In your directory /miryam/myproject:
...
- 1,365
2
votes
Accepted
How do I download a Google Colab notebook?
You do not need to download Google Colab to send a file through email.
To send directly:
On Upper right-hand side there is a share button, Click on it.
A pop-up appears, Enter email addresses or ...
2
votes
Accepted
Where do I find the .csv file for the submission after creating it?
When you are done with Colab instince files saves will not persist. You have to configure saving them to google drive. Try something like this;
...
- 5,629
2
votes
Accepted
How to automatically mount my Google Drive to Google Colab
Choose the folder icon in the left sidebar.
Wait for the runtime to initialize (you will see icons appear under the word "Files" in the sidebar).
Choose the Google Drive icon (the hover text ...
- 146
2
votes
How to automatically mount my Google Drive to Google Colab
I was working on a google colab project, after a while I decided to copy the work and rename it as a new version (manual type of git control). After doing this I noticed that my google drive doesn't ...
- 121
2
votes
Upload 'tsv' file to Google Colab / Jupyter Notebook
You first need to upload your file. The io.BytesIO only reads from the uploaded. So first run:
from google.colab import files
uploaded = files.upload()
and ...
2
votes
Accepted
ValueError: Error when checking input: expected conv2d_25_input to have shape (144, 256, 3) but got array with shape (256, 144, 3)
Clearly, there is this inconsistency between the shape of input images:
target_size = (image_width, image_height)
and the input shape of the model:
...
- 854
2
votes
Kaggle notebook Vs Google Colab
I am new to both Kaggle and Colab. But in these days I have found some advantages of Kaggle over Colab.
Kaggle is a great source of datasets and you can use these Datasets in Kaggle notebooks very ...
- 123
2
votes
Accepted
How to use inverse_transform in MinMaxScaler for pred answer in a matrix
From my understanding you are working on a regression task in which you have applied MainMaxScaler to your target variable y prior modeling.
If so you have two ...
- 2,879
2
votes
How to import large datasets into Google Colab?
One option is that you can download the dataset into your system and save it in an easily accessible directory. Then, run the following codes:
...
2
votes
Accepted
Loading pretrained model with Pytorch
Got the very same error recently.
Your network is usually defined as a class (here class EfficientNet(nn.Module). It seems when we load a model, it needs the class ...
- 626
2
votes
Alternatives with better GPU than Google Colab Pro
Try Kaggle, they offer 30 hours of TPU per week which might help if you are working with tensorflow or torch (TPUs have 128GB of memory). What you should try when running into memory issues is to use ...
- 979
2
votes
mBART training "CUDA out of memory"
mBART available in huggingface transformers is not in its base architecture. This means you will not be able to fit this transformer into single GPU offered by Colab.
To deal with GPU OOM problem, you ...
- 2,395
2
votes
Which desktop hardware is best for DL?
This question is complex because GPUs' power and memory are not linear.
I had some projects where some additional power or memory would have a much better result from one GPU to another, without any ...
- 4,589
Only top scored, non community-wiki answers of a minimum length are eligible