Questions tagged [colab]
Google Colab is an online browser based python notebook/execution environment similar to Jupyter Notebooks.
71
questions
2
votes
2
answers
70
views
Which desktop hardware is best for DL?
I will be building my home Deep Learning workstation. Right now, I'm digging for some time about the best HW to use for home conditions.
The workstation will be used for my work as a developer, but I ...
- 121
0
votes
2
answers
143
views
How to use function from other Colab file?
I’m coming from a math background and learning some data science. I am very new to some details of this stuff.
Working with colab, I’m trying to organize my sample simulating functions in such a way ...
- 1
0
votes
0
answers
6
views
tensorflow dataset 'plant_leaves' cannot be imported to google Colab : DownloadRetryLimitReachedError
I'm trying to upload a tensorflow dataset called plant_leaves but it won't work and it shows a runtime error :
0
votes
0
answers
58
views
Getting error "Failed to find data adapter that can handle input" even after converting list to array
I am getting this error : ValueError: Failed to find data adapter that can handle input' I even changed the list to arrays but still the error keeps pooping up.
This is the code:
...
0
votes
0
answers
137
views
ValueError: Shapes (None,) and (None, 3, 3) are incompatible
I am trying to train a neural network to recognize the number of pixels that are turned on in a 3x3 matrix. The "image" is very simple. Each pixel is either on or off. So it doesn't have ...
0
votes
0
answers
62
views
CUDA not available in Colab if checked using a python file
I'm trying to run a model which uses CUDA and the colab notebook I'm using is running on GPU runtime.
Now if I call print(torch.cuda.is_available()) from the colab ...
0
votes
1
answer
20
views
Linear regression not converging
I'm trying to implement the simplest possible machine learning algorithm which is linear regression. But I'm having trouble because the loss function is not converging. Please can you look at my ...
- 157
0
votes
0
answers
1k
views
How to automatically save images from colab to gdrive in seperate folders whose name are as same as the labels of the respective images?
I have a total of 30k images. They are distributed among 32 classes. I want to save these images from google colab to my drive with folder names as their label name. Can it be possible by python code? ...
- 121
0
votes
0
answers
16
views
Why does the McCulloch-Pitts Neural net for XOR gate use a hidden layer?
So I am rookie, trying to understand why do we use a hidden layer while making a neural net for the XOR gate?
I have tried doing it in code without using the hidden layers like this:
...
1
vote
0
answers
104
views
Orange Data Mining Tool on Google Colab
Is it possible to use Orange Data Mining Tool on Google Colab?
- 11
0
votes
0
answers
330
views
Google Colab outputs disappears right after is shown
I haven't been able to solve this problem. From a few days ago my colab notebooks outputs are malfunctioning: the outputs appear after the execution of the cell but dissapear inmediately. If I click ...
0
votes
0
answers
116
views
Colab TPU restarting due to protobuf incompatibility
I am trying to train a TemporalFusionTransformer model from pytorch-forecasting on the free ...
- 11
0
votes
1
answer
289
views
Colab Pro+ CNN GPU memory saturation
I have a problem when executing jupyter notebook for CNN in colab pro+, to train a model with a size of 560664x48x48x1.
normally the data is composed of images with a size of 48x48.
I used 10 fold ...
- 101
0
votes
0
answers
21
views
How to Calculate degrees in un-directed network and plot it? | Using python COLAB [duplicate]
I have loaded txt file (com-dblp.ungraph.txt) which includes DBLP collaboration network to a COLAB notebook. I found 317080 nodes & 1049866 edges in the network by reading the txt manually.
Trying ...
0
votes
0
answers
342
views
Colab Pro+ notebook stopped being busy when reopened without producing any output
I am training a fairly large dataset on Colab Pro+ with background execution. While the cell is running, the status reads 'busy' and I can check from the Resources tab that the notebook is indeed ...
- 1
0
votes
0
answers
57
views
Is there any point in using a colab TPU for inference?
I have a colab pro+ subscription and like many, I'm finding that the GPU allowance is rather small compared to the price. While I wait for GPU access I was wondering if the TPU VM would be a ...
0
votes
0
answers
772
views
How to read a table from MySQL work bench in colab
I have referred to various articles on Stack Overflow and external sources but somehow am unable to get answer for this. I would like to read a table from MySQL workbench database into a dataframe in ...
- 26
0
votes
0
answers
13
views
Label images on-the-fly
I have a code in which it downloads images from Google image according to a query. All those queries are cars (different branch, model and year). Since it is difficult to label each image with a given ...
- 1
0
votes
0
answers
75
views
Neural network model in Google Colab significantly slower with increased data points
I've made a neural network in google colab. The original data contained 12 000 rows (csv 350KB). 4 features and 2 labels. Each epoch would run within a few ms. I tried to increase the amount of data ...
- 103
0
votes
1
answer
146
views
Any alternative to Google Colab?
I have to train vgg16 from scratch on a digit dataset as my college project. I require more computational power. Can anyone suggest to me how can I do that other than Google Colab? Currently, it is ...
- 139
0
votes
1
answer
101
views
Colab variable inspector stops working after importing from fastbook
As best as I could find, this question was not asked before.
I'm using colab, and I use its variable inspector.
I'm trying to do the FastAI exercices, and I noticed that when doing them, the variable ...
- 1
1
vote
1
answer
87
views
Best way to get data into Colab Notebook
I am working concurrently with multiple very large datasets (10s-100s of GBs)). I signed up for Colab Pro+ thinking it is the best option. However, I face a significant bottleneck in getting data into ...
- 293
0
votes
1
answer
57
views
How to drop the previous rows of a database based on a matching value in a column?
So I am currently trying to sort through a data frame containing attribute classes and values of teams. However, my data has multiple rows of different classes and values of the same Team ID/Attribute ...
0
votes
2
answers
317
views
mBART training "CUDA out of memory"
I want to train a network with mBART model in google colab , but I got the message of
...
- 41
0
votes
1
answer
811
views
How to save the history epochs and plots in files from keras models
I have a question, that maybe is very simple, but I can't do it: I have 3 neural networks which are trained with 100 epochs, and I need to save all the history's train displayed at the end in a .txt ...
- 13
0
votes
0
answers
787
views
Package directory does not exist
I'm trying to install python packages in COLAB using the following setup.py file.
...
- 21
0
votes
1
answer
41
views
Machine Learning A-Z: Help connecting with datasets
I'm in Machine Learning A-Z lecture 19 where we access our first dataset. I've connected to the Google Colab folder in my gmail account, but when I try to access the the file I get the below error ...
-1
votes
1
answer
2k
views
How to read .pb file using Google Colab? [closed]
I would like to know how we can see/load/read a .pb file in Google Colab?
Thank you.
- 11
0
votes
0
answers
49
views
Automate downloading datasets via Colab
My desktop computer recently broke, and I'm currently working on a small laptop with barely 500mb of space left. I need to download about 100gb of files from the DFAUST dataset. I was wondering if ...
0
votes
1
answer
372
views
Keras: Very high loss for Autoencoder
I am trying to implement an autoencoder for prediction of multiple labels using Keras. This is a snippet:
...
- 101
3
votes
3
answers
4k
views
Alternatives with better GPU than Google Colab Pro
I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM
Is there any alternatives with better GPU and more RAM than ...
- 173
0
votes
2
answers
2k
views
Loading pretrained model with Pytorch
I saved my model with this code:
from google.colab import files
torch.save(net, 'model.pth')
# download checkpoint file
files.download('model.pth')
Then uploaded ...
- 149
1
vote
1
answer
635
views
M1 MacBooks versus Google Colab
I am just starting getting into deep learning with tf.keras. I am at the point where I have to decide where I want to develop. The thesis project will be timeseries ...
- 111
2
votes
1
answer
86
views
Notebook for data science
I'm searching for an online Jupiter notebook environment that allows collaborating in real-time. I've found that I've choice from two services Deepnote.com and DataLore by JetBrains. I have little ...
- 157
0
votes
1
answer
869
views
1
vote
1
answer
1k
views
Python: SARIMAX Model Fits too slow
I have a time series data with the date and temperature records of a city. Following are my observations from the time series ...
- 11
0
votes
1
answer
13k
views
How to use inverse_transform in MinMaxScaler for pred answer in a matrix
I am working on a data, for preding output, I used SVR by bellow code:
...
- 13
0
votes
1
answer
523
views
How many images can be trained in Google Colab? [closed]
I am using the ResNet50 pretrained model to train my images using TensorFlow. I have 70k images and upgraded to Google Colab Pro, but still I am facing a memory error. So how many images I can train ...
- 351
2
votes
1
answer
2k
views
How to import large datasets into Google Colab?
Does anyone know a (free) method for importing large datasets into Google Colab, of multiple GB? Github is severely limited, uploading a folder to google drive takes a long time.
- 451
3
votes
1
answer
1k
views
NLP: what are the advantages of using a subword tokenizer as opposed to the standard word tokenizer?
I'm looking at this Tensorflow colab tutorial about language translation with Transformers, https://www.tensorflow.org/tutorials/text/transformer, and they tokenize the words with a subword text ...
- 339
6
votes
3
answers
7k
views
Kaggle notebook Vs Google Colab
What are the major differences between Kaggle notebook and Google Colab notebook?
To work on a dataset my first step is to start a Kaggle notebook but then I cant help thinking what could be the ...
- 61
2
votes
1
answer
1k
views
Google Colab conda packages permanently installation
I want to install some conda packages on Google Colab. Installation done successfully, but it wont detect it when we restart the new Colab session.
I followed the link "#https://stackoverflow.com/...
- 1,232
0
votes
1
answer
941
views
What is the efficient way to use apply method in column of pandas Dataframe for large dataset?
I have a dataset of approximate 1 hundred thousand records. I want to use apply method in each of the records for further data processing but it takes very long time to process (As apply method works ...
- 13
1
vote
0
answers
79
views
Downloading a large dataset in google colaboratory
I have a link of a dataset, it is 22 gig but in the collab, there is just 32 gig free disk space. The data is in the zip file and after unzipping collab show crash massage. How can I solve this ...
- 11
1
vote
0
answers
1k
views
setting class weights for imbalanced dataset in tensorflow [closed]
I have 24 classes in my dataset and I am trying to set class weights in the following way:
...
- 111
2
votes
1
answer
287
views
Colab can not connect to GPU from a python file [closed]
I am trying to run a github deep learning repository in Colab but I can not connect the python files to colab GPU.
I can connect to GPU when writing a script in the colab notebook e.g. when I run ...
- 23
1
vote
1
answer
213
views
ValueError: Error when checking input: expected conv2d_25_input to have shape (144, 256, 3) but got array with shape (256, 144, 3)
I have built a CNN with images of size 720 (height) and 1280 (width). I attempt to re scale images to 144x256. However, I receive this error:
...
- 451
1
vote
0
answers
403
views
Using Images uploaded in google drive in Colab
Does anyone know how to use already uploaded images in Google Drive to colaboratory for creating a trainloader?
I'm creating the trainloader and model in Pytorch
- 11
1
vote
2
answers
657
views
What interactive graph package do you use for timeseries data?
I have millions of sensor readings taken over time. I'd like to create an interactive plot in Google colab where I can easily zoom in on sections. I've done something similar with the Plotly package....
- 119
1
vote
0
answers
4k
views
how to resolve this error in Tesseract : (2, 'Usage: pytesseract [-l lang] input_file') [closed]
pytesseract.pytesseract.tesseract_cmd = r'/usr/local/bin/pytesseract'
img = Image.open("/content/drive/My Drive/abc.jpg")
print(pytesseract.image_to_string(img))
...
- 1,361