Questions tagged [colab]
Google Colab is an online browser based python notebook/execution environment similar to Jupyter Notebooks.
65
questions
0
votes
0
answers
50
views
How to automatically save images from colab to gdrive in seperate folders whose name are as same as the labels of the respective images?
I have a total of 30k images. They are distributed among 32 classes. I want to save these images from google colab to my drive with folder names as their label name. Can it be possible by python code? ...
- 121
0
votes
0
answers
8
views
Why does the McCulloch-Pitts Neural net for XOR gate use a hidden layer?
So I am rookie, trying to understand why do we use a hidden layer while making a neural net for the XOR gate?
I have tried doing it in code without using the hidden layers like this:
...
1
vote
0
answers
55
views
Orange Data Mining Tool on Google Colab
Is it possible to use Orange Data Mining Tool on Google Colab?
- 11
0
votes
0
answers
76
views
Google Colab outputs disappears right after is shown
I haven't been able to solve this problem. From a few days ago my colab notebooks outputs are malfunctioning: the outputs appear after the execution of the cell but dissapear inmediately. If I click ...
0
votes
0
answers
45
views
Colab TPU restarting due to protobuf incompatibility
I am trying to train a TemporalFusionTransformer model from pytorch-forecasting on the free ...
- 11
0
votes
1
answer
125
views
Colab Pro+ CNN GPU memory saturation
I have a problem when executing jupyter notebook for CNN in colab pro+, to train a model with a size of 560664x48x48x1.
normally the data is composed of images with a size of 48x48.
I used 10 fold ...
- 101
0
votes
0
answers
18
views
How to Calculate degrees in un-directed network and plot it? | Using python COLAB [duplicate]
I have loaded txt file (com-dblp.ungraph.txt) which includes DBLP collaboration network to a COLAB notebook. I found 317080 nodes & 1049866 edges in the network by reading the txt manually.
Trying ...
0
votes
0
answers
202
views
Colab Pro+ notebook stopped being busy when reopened without producing any output
I am training a fairly large dataset on Colab Pro+ with background execution. While the cell is running, the status reads 'busy' and I can check from the Resources tab that the notebook is indeed ...
- 1
0
votes
0
answers
33
views
Is there any point in using a colab TPU for inference?
I have a colab pro+ subscription and like many, I'm finding that the GPU allowance is rather small compared to the price. While I wait for GPU access I was wondering if the TPU VM would be a ...
0
votes
0
answers
503
views
How to read a table from MySQL work bench in colab
I have referred to various articles on Stack Overflow and external sources but somehow am unable to get answer for this. I would like to read a table from MySQL workbench database into a dataframe in ...
- 26
0
votes
0
answers
13
views
Label images on-the-fly
I have a code in which it downloads images from Google image according to a query. All those queries are cars (different branch, model and year). Since it is difficult to label each image with a given ...
- 1
0
votes
0
answers
41
views
Neural network model in Google Colab significantly slower with increased data points
I've made a neural network in google colab. The original data contained 12 000 rows (csv 350KB). 4 features and 2 labels. Each epoch would run within a few ms. I tried to increase the amount of data ...
- 103
0
votes
1
answer
116
views
Any alternative to Google Colab?
I have to train vgg16 from scratch on a digit dataset as my college project. I require more computational power. Can anyone suggest to me how can I do that other than Google Colab? Currently, it is ...
- 139
0
votes
1
answer
82
views
Colab variable inspector stops working after importing from fastbook
As best as I could find, this question was not asked before.
I'm using colab, and I use its variable inspector.
I'm trying to do the FastAI exercices, and I noticed that when doing them, the variable ...
- 1
1
vote
1
answer
57
views
Best way to get data into Colab Notebook
I am working concurrently with multiple very large datasets (10s-100s of GBs)). I signed up for Colab Pro+ thinking it is the best option. However, I face a significant bottleneck in getting data into ...
- 273
0
votes
0
answers
52
views
Use Google Colab Resources on local IDE
I have a big doubt. I see a lot of blog posts where they say that you can use the Colab front-end to edit a local Jupiter Notebook
However, I don't see the point. the actual advantage would be to use ...
0
votes
1
answer
30
views
How to drop the previous rows of a database based on a matching value in a column?
So I am currently trying to sort through a data frame containing attribute classes and values of teams. However, my data has multiple rows of different classes and values of the same Team ID/Attribute ...
0
votes
2
answers
252
views
mBART training "CUDA out of memory"
I want to train a network with mBART model in google colab , but I got the message of
...
- 41
0
votes
1
answer
587
views
How to save the history epochs and plots in files from keras models
I have a question, that maybe is very simple, but I can't do it: I have 3 neural networks which are trained with 100 epochs, and I need to save all the history's train displayed at the end in a .txt ...
- 13
0
votes
0
answers
697
views
Package directory does not exist
I'm trying to install python packages in COLAB using the following setup.py file.
...
- 21
0
votes
1
answer
37
views
Machine Learning A-Z: Help connecting with datasets
I'm in Machine Learning A-Z lecture 19 where we access our first dataset. I've connected to the Google Colab folder in my gmail account, but when I try to access the the file I get the below error ...
-1
votes
1
answer
1k
views
How to read .pb file using Google Colab? [closed]
I would like to know how we can see/load/read a .pb file in Google Colab?
Thank you.
- 11
0
votes
0
answers
45
views
Automate downloading datasets via Colab
My desktop computer recently broke, and I'm currently working on a small laptop with barely 500mb of space left. I need to download about 100gb of files from the DFAUST dataset. I was wondering if ...
0
votes
1
answer
274
views
Keras: Very high loss for Autoencoder
I am trying to implement an autoencoder for prediction of multiple labels using Keras. This is a snippet:
...
- 101
2
votes
3
answers
3k
views
Alternatives with better GPU than Google Colab Pro
I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM
Is there any alternatives with better GPU and more RAM than ...
- 163
0
votes
2
answers
1k
views
Loading pretrained model with Pytorch
I saved my model with this code:
from google.colab import files
torch.save(net, 'model.pth')
# download checkpoint file
files.download('model.pth')
Then uploaded ...
- 149
1
vote
1
answer
587
views
M1 MacBooks versus Google Colab
I am just starting getting into deep learning with tf.keras. I am at the point where I have to decide where I want to develop. The thesis project will be timeseries ...
- 111
2
votes
1
answer
80
views
Notebook for data science
I'm searching for an online Jupiter notebook environment that allows collaborating in real-time. I've found that I've choice from two services Deepnote.com and DataLore by JetBrains. I have little ...
- 157
0
votes
1
answer
675
views
1
vote
1
answer
1k
views
Python: SARIMAX Model Fits too slow
I have a time series data with the date and temperature records of a city. Following are my observations from the time series ...
- 11
0
votes
1
answer
10k
views
How to use inverse_transform in MinMaxScaler for pred answer in a matrix
I am working on a data, for preding output, I used SVR by bellow code:
...
- 13
0
votes
1
answer
433
views
How many images can be trained in Google Colab? [closed]
I am using the ResNet50 pretrained model to train my images using TensorFlow. I have 70k images and upgraded to Google Colab Pro, but still I am facing a memory error. So how many images I can train ...
- 341
2
votes
1
answer
1k
views
How to import large datasets into Google Colab?
Does anyone know a (free) method for importing large datasets into Google Colab, of multiple GB? Github is severely limited, uploading a folder to google drive takes a long time.
- 451
3
votes
1
answer
1k
views
NLP: what are the advantages of using a subword tokenizer as opposed to the standard word tokenizer?
I'm looking at this Tensorflow colab tutorial about language translation with Transformers, https://www.tensorflow.org/tutorials/text/transformer, and they tokenize the words with a subword text ...
- 329
6
votes
3
answers
6k
views
Kaggle notebook Vs Google Colab
What are the major differences between Kaggle notebook and Google Colab notebook?
To work on a dataset my first step is to start a Kaggle notebook but then I cant help thinking what could be the ...
- 61
2
votes
1
answer
1k
views
Google Colab conda packages permanently installation
I want to install some conda packages on Google Colab. Installation done successfully, but it wont detect it when we restart the new Colab session.
I followed the link "#https://stackoverflow.com/...
- 1,224
0
votes
1
answer
869
views
What is the efficient way to use apply method in column of pandas Dataframe for large dataset?
I have a dataset of approximate 1 hundred thousand records. I want to use apply method in each of the records for further data processing but it takes very long time to process (As apply method works ...
- 13
1
vote
0
answers
63
views
Downloading a large dataset in google colaboratory
I have a link of a dataset, it is 22 gig but in the collab, there is just 32 gig free disk space. The data is in the zip file and after unzipping collab show crash massage. How can I solve this ...
- 11
1
vote
0
answers
1k
views
setting class weights for imbalanced dataset in tensorflow [closed]
I have 24 classes in my dataset and I am trying to set class weights in the following way:
...
- 111
2
votes
1
answer
245
views
Colab can not connect to GPU from a python file [closed]
I am trying to run a github deep learning repository in Colab but I can not connect the python files to colab GPU.
I can connect to GPU when writing a script in the colab notebook e.g. when I run ...
- 23
1
vote
1
answer
143
views
ValueError: Error when checking input: expected conv2d_25_input to have shape (144, 256, 3) but got array with shape (256, 144, 3)
I have built a CNN with images of size 720 (height) and 1280 (width). I attempt to re scale images to 144x256. However, I receive this error:
...
- 451
1
vote
0
answers
374
views
Using Images uploaded in google drive in Colab
Does anyone know how to use already uploaded images in Google Drive to colaboratory for creating a trainloader?
I'm creating the trainloader and model in Pytorch
- 11
1
vote
2
answers
610
views
What interactive graph package do you use for timeseries data?
I have millions of sensor readings taken over time. I'd like to create an interactive plot in Google colab where I can easily zoom in on sections. I've done something similar with the Plotly package....
- 119
1
vote
0
answers
4k
views
how to resolve this error in Tesseract : (2, 'Usage: pytesseract [-l lang] input_file') [closed]
pytesseract.pytesseract.tesseract_cmd = r'/usr/local/bin/pytesseract'
img = Image.open("/content/drive/My Drive/abc.jpg")
print(pytesseract.image_to_string(img))
...
- 1,301
2
votes
3
answers
12k
views
How do I download a Google Colab notebook?
I have to download code written in a Google Colab notebook, because I need to send it via email. How do I do this?
- 771
1
vote
1
answer
123
views
Where do I find the .csv file for the submission after creating it?
I am making a submission of a classificaition problem with CNN on Google Colab. So I have arrived at doing this:
subm.to_csv('submission.csv', index=False)
so in ...
- 771
10
votes
3
answers
12k
views
How to automatically mount my Google Drive to Google Colab
I have recently discovered Google Colab and I am wondering if there is an option to permanently authorize Google Colab to access and mount my Google Drive.
...
- 203
0
votes
1
answer
13k
views
How to save dynamic files from colab to Google Drive?
I have processed some png images on Colab and saved them in the Colab Directory. Now I want to save these images from Colab to Google Drive. How can I do this?
1
vote
1
answer
66
views
Problem importing dataset in zip format
I am trying to import a image dataset in Google Colab in order to do image classification. The dataset is in my Google drive, so I do the following:
...
- 771
1
vote
1
answer
16k
views
Not able to connect to GPU on Google Colab
I'm trying to use tensorflow with a GPU on Google Colab.
I followed the steps listed at https://www.tensorflow.org/install/gpu
I confirmed that gpu is visible and CUDA is installed with the ...
- 143