Questions tagged [colab]
Google Colab is an online browser based python notebook/execution environment similar to Jupyter Notebooks.
61
questions
0
votes
0
answers
10
views
How to Calculate degrees in un-directed network and plot it? | Using python COLAB [duplicate]
I have loaded txt file (com-dblp.ungraph.txt) which includes DBLP collaboration network to a COLAB notebook. I found 317080 nodes & 1049866 edges in the network by reading the txt manually.
Trying ...
0
votes
0
answers
17
views
Colab Pro+ notebook stopped being busy when reopened without producing any output
I am training a fairly large dataset on Colab Pro+ with background execution. While the cell is running, the status reads 'busy' and I can check from the Resources tab that the notebook is indeed ...
- 1
0
votes
0
answers
11
views
Is there any point in using a colab TPU for inference?
I have a colab pro+ subscription and like many, I'm finding that the GPU allowance is rather small compared to the price. While I wait for GPU access I was wondering if the TPU VM would be a ...
0
votes
0
answers
40
views
How to read a table from MySQL work bench in colab
I have referred to various articles on Stack Overflow and external sources but somehow am unable to get answer for this. I would like to read a table from MySQL workbench database into a dataframe in ...
- 26
0
votes
0
answers
11
views
Label images on-the-fly
I have a code in which it downloads images from Google image according to a query. All those queries are cars (different branch, model and year). Since it is difficult to label each image with a given ...
- 1
0
votes
0
answers
19
views
Neural network model in Google Colab significantly slower with increased data points
I've made a neural network in google colab. The original data contained 12 000 rows (csv 350KB). 4 features and 2 labels. Each epoch would run within a few ms. I tried to increase the amount of data ...
- 103
0
votes
1
answer
27
views
Any alternative to Google Colab?
I have to train vgg16 from scratch on a digit dataset as my college project. I require more computational power. Can anyone suggest to me how can I do that other than Google Colab? Currently, it is ...
- 139
0
votes
1
answer
48
views
Colab variable inspector stops working after importing from fastbook
As best as I could find, this question was not asked before.
I'm using colab, and I use its variable inspector.
I'm trying to do the FastAI exercices, and I noticed that when doing them, the variable ...
- 1
1
vote
1
answer
30
views
Best way to get data into Colab Notebook
I am working concurrently with multiple very large datasets (10s-100s of GBs)). I signed up for Colab Pro+ thinking it is the best option. However, I face a significant bottleneck in getting data into ...
- 263
0
votes
0
answers
42
views
Use Google Colab Resources on local IDE
I have a big doubt. I see a lot of blog posts where they say that you can use the Colab front-end to edit a local Jupiter Notebook
However, I don't see the point. the actual advantage would be to use ...
0
votes
1
answer
19
views
How to drop the previous rows of a database based on a matching value in a column?
So I am currently trying to sort through a data frame containing attribute classes and values of teams. However, my data has multiple rows of different classes and values of the same Team ID/Attribute ...
0
votes
1
answer
148
views
mBART training "CUDA out of memory"
I want to train a network with mBART model in google colab , but I got the message of
...
- 41
0
votes
1
answer
138
views
How to save the history epochs and plots in files from keras models
I have a question, that maybe is very simple, but I can't do it: I have 3 neural networks which are trained with 100 epochs, and I need to save all the history's train displayed at the end in a .txt ...
- 13
0
votes
0
answers
441
views
ValueError: Data cardinality is ambiguous in colab
Initially, only x_train was reshape, and an error occurred, so x_test was also reshape. Then, I have another error. It seems to be an error caused by inconsistency with y data, but modifying the code ...
- 1
0
votes
0
answers
528
views
Package directory does not exist
I'm trying to install python packages in COLAB using the following setup.py file.
...
- 21
0
votes
0
answers
44
views
Unable to connect to files folder in Google Colab after insalling Rapids?
I am following steps mentioned in below link for installing Rapids in Google Colab. However as soon as I run cell no 4, the folders I see in file section disappear and I see "Connecting to a ...
- 109
0
votes
1
answer
28
views
Machine Learning A-Z: Help connecting with datasets
I'm in Machine Learning A-Z lecture 19 where we access our first dataset. I've connected to the Google Colab folder in my gmail account, but when I try to access the the file I get the below error ...
-1
votes
1
answer
629
views
How to read .pb file using Google Colab? [closed]
I would like to know how we can see/load/read a .pb file in Google Colab?
Thank you.
- 11
0
votes
0
answers
40
views
Automate downloading datasets via Colab
My desktop computer recently broke, and I'm currently working on a small laptop with barely 500mb of space left. I need to download about 100gb of files from the DFAUST dataset. I was wondering if ...
0
votes
1
answer
174
views
Keras: Very high loss for Autoencoder
I am trying to implement an autoencoder for prediction of multiple labels using Keras. This is a snippet:
...
- 101
1
vote
2
answers
2k
views
Alternatives with better GPU than Google Colab Pro
I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM
Is there any alternatives with better GPU and more RAM than ...
- 153
0
votes
2
answers
892
views
Loading pretrained model with Pytorch
I saved my model with this code:
from google.colab import files
torch.save(net, 'model.pth')
# download checkpoint file
files.download('model.pth')
Then uploaded ...
- 149
1
vote
1
answer
537
views
M1 MacBooks versus Google Colab
I am just starting getting into deep learning with tf.keras. I am at the point where I have to decide where I want to develop. The thesis project will be timeseries ...
- 111
2
votes
1
answer
70
views
Notebook for data science
I'm searching for an online Jupiter notebook environment that allows collaborating in real-time. I've found that I've choice from two services Deepnote.com and DataLore by JetBrains. I have little ...
- 157
0
votes
1
answer
432
views
1
vote
1
answer
885
views
Python: SARIMAX Model Fits too slow
I have a time series data with the date and temperature records of a city. Following are my observations from the time series ...
- 11
0
votes
1
answer
7k
views
How to use inverse_transform in MinMaxScaler for pred answer in a matrix
I am working on a data, for preding output, I used SVR by bellow code:
...
- 13
0
votes
1
answer
344
views
How many images can be trained in Google Colab? [closed]
I am using the ResNet50 pretrained model to train my images using TensorFlow. I have 70k images and upgraded to Google Colab Pro, but still I am facing a memory error. So how many images I can train ...
- 341
2
votes
1
answer
1k
views
How to import large datasets into Google Colab?
Does anyone know a (free) method for importing large datasets into Google Colab, of multiple GB? Github is severely limited, uploading a folder to google drive takes a long time.
- 451
3
votes
1
answer
985
views
NLP: what are the advantages of using a subword tokenizer as opposed to the standard word tokenizer?
I'm looking at this Tensorflow colab tutorial about language translation with Transformers, https://www.tensorflow.org/tutorials/text/transformer, and they tokenize the words with a subword text ...
- 309
6
votes
3
answers
5k
views
Kaggle notebook Vs Google Colab
What are the major differences between Kaggle notebook and Google Colab notebook?
To work on a dataset my first step is to start a Kaggle notebook but then I cant help thinking what could be the ...
- 61
2
votes
1
answer
924
views
Google Colab conda packages permanently installation
I want to install some conda packages on Google Colab. Installation done successfully, but it wont detect it when we restart the new Colab session.
I followed the link "#https://stackoverflow.com/...
- 1,204
0
votes
1
answer
761
views
What is the efficient way to use apply method in column of pandas Dataframe for large dataset?
I have a dataset of approximate 1 hundred thousand records. I want to use apply method in each of the records for further data processing but it takes very long time to process (As apply method works ...
- 13
1
vote
0
answers
42
views
Downloading a large dataset in google colaboratory
I have a link of a dataset, it is 22 gig but in the collab, there is just 32 gig free disk space. The data is in the zip file and after unzipping collab show crash massage. How can I solve this ...
- 11
1
vote
0
answers
1k
views
setting class weights for imbalanced dataset in tensorflow [closed]
I have 24 classes in my dataset and I am trying to set class weights in the following way:
...
- 111
2
votes
1
answer
199
views
Colab can not connect to GPU from a python file [closed]
I am trying to run a github deep learning repository in Colab but I can not connect the python files to colab GPU.
I can connect to GPU when writing a script in the colab notebook e.g. when I run ...
- 23
1
vote
1
answer
76
views
ValueError: Error when checking input: expected conv2d_25_input to have shape (144, 256, 3) but got array with shape (256, 144, 3)
I have built a CNN with images of size 720 (height) and 1280 (width). I attempt to re scale images to 144x256. However, I receive this error:
...
- 451
1
vote
0
answers
344
views
Using Images uploaded in google drive in Colab
Does anyone know how to use already uploaded images in Google Drive to colaboratory for creating a trainloader?
I'm creating the trainloader and model in Pytorch
- 11
1
vote
2
answers
503
views
What interactive graph package do you use for timeseries data?
I have millions of sensor readings taken over time. I'd like to create an interactive plot in Google colab where I can easily zoom in on sections. I've done something similar with the Plotly package....
- 119
1
vote
0
answers
3k
views
how to resolve this error in Tesseract : (2, 'Usage: pytesseract [-l lang] input_file') [closed]
pytesseract.pytesseract.tesseract_cmd = r'/usr/local/bin/pytesseract'
img = Image.open("/content/drive/My Drive/abc.jpg")
print(pytesseract.image_to_string(img))
...
- 1,181
2
votes
3
answers
10k
views
How do I download a Google Colab notebook?
I have to download code written in a Google Colab notebook, because I need to send it via email. How do I do this?
- 741
1
vote
1
answer
88
views
Where do I find the .csv file for the submission after creating it?
I am making a submission of a classificaition problem with CNN on Google Colab. So I have arrived at doing this:
subm.to_csv('submission.csv', index=False)
so in ...
- 741
9
votes
3
answers
10k
views
How to automatically mount my Google Drive to Google Colab
I have recently discovered Google Colab and I am wondering if there is an option to permanently authorize Google Colab to access and mount my Google Drive.
...
- 193
0
votes
1
answer
12k
views
How to save dynamic files from colab to Google Drive?
I have processed some png images on Colab and saved them in the Colab Directory. Now I want to save these images from Colab to Google Drive. How can I do this?
1
vote
1
answer
55
views
Problem importing dataset in zip format
I am trying to import a image dataset in Google Colab in order to do image classification. The dataset is in my Google drive, so I do the following:
...
- 741
1
vote
1
answer
15k
views
Not able to connect to GPU on Google Colab
I'm trying to use tensorflow with a GPU on Google Colab.
I followed the steps listed at https://www.tensorflow.org/install/gpu
I confirmed that gpu is visible and CUDA is installed with the ...
- 143
0
votes
0
answers
642
views
why evaluate_generator accuracy too much by using flow_from_directory with shuffle true?
i am using tensorflow and keras on colab i train with shuffled data but i met this strange accuracy with evaluate_generator with my training set that has 95% acc
if i did not shuffle my data with ...
1
vote
1
answer
75
views
How reproducible should CNN models be? [closed]
I want to train several CNN architectures with Google Colab (GPU), Keras and Tensorflow.
Since the trained models are not reproducible due to GPU support, I would like to train the models several ...
- 45
1
vote
1
answer
4k
views
keras UserWarning: The input 1303 could not be retrieved. It could be because a worker has died
I am trying to train an autoencoder CNN on Google Colab using keras. I have mounted my Google Drive which contains all training data. The training uses six workers and the data is loaded by the ...
- 113
0
votes
1
answer
2k
views
Upload 'tsv' file to Google Colab / Jupyter Notebook
TSV(Tab separated Value) extension file can't be uploaded to google colab using pandas
Used this to upload my file
...
- 101