Questions tagged [colab]
Google Colab is an online browser based python notebook/execution environment similar to Jupyter Notebooks.
70
questions
0
votes
2
answers
2k
views
How to use function from other Colab file?
I’m coming from a math background and learning some data science. I am very new to some details of this stuff.
Working with colab, I’m trying to organize my sample simulating functions in such a way ...
CommunityBot
- 1
0
votes
1
answer
490
views
Keras: Very high loss for Autoencoder
I am trying to implement an autoencoder for prediction of multiple labels using Keras. This is a snippet:
...
CommunityBot
- 1
0
votes
1
answer
142
views
How to drop the previous rows of a database based on a matching value in a column?
So I am currently trying to sort through a data frame containing attribute classes and values of teams. However, my data has multiple rows of different classes and values of the same Team ID/Attribute ...
CommunityBot
- 1
0
votes
1
answer
31
views
Utilizing Colab's GPU/TPU to Speed Up General Python Code not just data science code
I am new to using Colab and trying to speed up my code by utilizing the GPU/TPU runtimes. I have a block of plain Python code without any data science libraries like TensorFlow or PyTorch. I was able ...
- 368
0
votes
1
answer
17
views
Locating base.py when working on Colab
I have faced an error while working with langchain on colab. There is a post on github which recommends changing some configurations in
...
1
vote
1
answer
141
views
Best way to get data into Colab Notebook
I am working concurrently with multiple very large datasets (10s-100s of GBs)). I signed up for Colab Pro+ thinking it is the best option. However, I face a significant bottleneck in getting data into ...
CommunityBot
- 1
0
votes
1
answer
142
views
Colab variable inspector stops working after importing from fastbook
As best as I could find, this question was not asked before.
I'm using colab, and I use its variable inspector.
I'm trying to do the FastAI exercices, and I noticed that when doing them, the variable ...
CommunityBot
- 1
0
votes
1
answer
3k
views
How to automatically save images from colab to gdrive in seperate folders whose name are as same as the labels of the respective images?
I have a total of 30k images. They are distributed among 32 classes. I want to save these images from google colab to my drive with folder names as their label name. Can it be possible by python code? ...
CommunityBot
- 1
1
vote
2
answers
761
views
What interactive graph package do you use for timeseries data?
I have millions of sensor readings taken over time. I'd like to create an interactive plot in Google colab where I can easily zoom in on sections. I've done something similar with the Plotly package....
CommunityBot
- 1
1
vote
0
answers
828
views
Google Colab outputs disappears right after is shown
I haven't been able to solve this problem. From a few days ago my colab notebooks outputs are malfunctioning: the outputs appear after the execution of the cell but dissapear inmediately. If I click ...
0
votes
0
answers
18
views
Why doesn't loss decrease with each epoch (for IMDB data vs Rotten Tomatoes data)
I am following the Google tutorial on ML for text classification
I made this Google Colab notebook which you should be able to run from start to finish to see the issue.
When the code trains a ...
- 393
0
votes
0
answers
36
views
How to change this humorous output style in pycaret+colab?
My eyes are on fire. I checked the documents, there is just an option to disable all outputs, and I just need to clean this dirty yellow cells.
Thanks for any help.
- 3
0
votes
0
answers
29
views
Conda refuses install install some packages in env.yml
I have been trying to apply answer 2 from this tutorial to install conda on Colab. However, in my example here, when I run source activate then ...
- 101
0
votes
0
answers
14
views
optimization of multi-regression CNN architecture
I use T4 GPU on Google Colab to train a model for multi regression. I use to training 30k RGB images 256x256, 5k to validate, 7k to evaluate. The model has 11 outputs [0-1] range (the sum of outputs <...
- 1
0
votes
3
answers
296
views
Any alternative to Google Colab?
I have to train vgg16 from scratch on a digit dataset as my college project. I require more computational power. Can anyone suggest to me how can I do that other than Google Colab? Currently, it is ...
- 11
0
votes
0
answers
44
views
Multiprocessing data loading in colab
I want to convert mozilla common voice dataset from mp3 to wav. But this dataset is large and convertion takes many time. How can I make this convertion in colab with multiprocessing to decrease time ...
2
votes
2
answers
414
views
Which desktop hardware is best for DL?
I will be building my home Deep Learning workstation. Right now, I'm digging for some time about the best HW to use for home conditions.
The workstation will be used for my work as a developer, but I ...
- 4,589
0
votes
0
answers
17
views
tensorflow dataset 'plant_leaves' cannot be imported to google Colab : DownloadRetryLimitReachedError
I'm trying to upload a tensorflow dataset called plant_leaves but it won't work and it shows a runtime error :
- 1
0
votes
0
answers
150
views
Getting error "Failed to find data adapter that can handle input" even after converting list to array
I am getting this error : ValueError: Failed to find data adapter that can handle input' I even changed the list to arrays but still the error keeps pooping up.
This is the code:
...
0
votes
0
answers
250
views
ValueError: Shapes (None,) and (None, 3, 3) are incompatible
I am trying to train a neural network to recognize the number of pixels that are turned on in a 3x3 matrix. The "image" is very simple. Each pixel is either on or off. So it doesn't have ...
- 7,157
13
votes
3
answers
19k
views
How to automatically mount my Google Drive to Google Colab
I have recently discovered Google Colab and I am wondering if there is an option to permanently authorize Google Colab to access and mount my Google Drive.
...
0
votes
0
answers
184
views
CUDA not available in Colab if checked using a python file
I'm trying to run a model which uses CUDA and the colab notebook I'm using is running on GPU runtime.
Now if I call print(torch.cuda.is_available()) from the colab ...
1
vote
1
answer
2k
views
Python: SARIMAX Model Fits too slow
I have a time series data with the date and temperature records of a city. Following are my observations from the time series ...
CommunityBot
- 1
0
votes
1
answer
26
views
Linear regression not converging
I'm trying to implement the simplest possible machine learning algorithm which is linear regression. But I'm having trouble because the loss function is not converging. Please can you look at my ...
- 157
1
vote
0
answers
216
views
Orange Data Mining Tool on Google Colab
Is it possible to use Orange Data Mining Tool on Google Colab?
- 11
0
votes
2
answers
434
views
mBART training "CUDA out of memory"
I want to train a network with mBART model in google colab , but I got the message of
...
- 828
0
votes
1
answer
451
views
Colab Pro+ CNN GPU memory saturation
I have a problem when executing jupyter notebook for CNN in colab pro+, to train a model with a size of 560664x48x48x1.
normally the data is composed of images with a size of 48x48.
I used 10 fold ...
- 23.8k
4
votes
3
answers
7k
views
Alternatives with better GPU than Google Colab Pro
I am currently running/training MAchine learning models that are very GPU expensive, Google Colab Pro is not giving me enough GPU/RAM
Is there any alternatives with better GPU and more RAM than ...
- 11
7
votes
3
answers
11k
views
Kaggle notebook Vs Google Colab
What are the major differences between Kaggle notebook and Google Colab notebook?
To work on a dataset my first step is to start a Kaggle notebook but then I cant help thinking what could be the ...
- 123
0
votes
0
answers
1k
views
How to read a table from MySQL work bench in colab
I have referred to various articles on Stack Overflow and external sources but somehow am unable to get answer for this. I would like to read a table from MySQL workbench database into a dataframe in ...
- 1,635
2
votes
1
answer
514
views
How to use Kaggle Api in Google Colab for directly using dataset?
I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are :
...
CommunityBot
- 1
0
votes
1
answer
1k
views
How to save the history epochs and plots in files from keras models
I have a question, that maybe is very simple, but I can't do it: I have 3 neural networks which are trained with 100 epochs, and I need to save all the history's train displayed at the end in a .txt ...
- 7,157
0
votes
1
answer
52
views
Machine Learning A-Z: Help connecting with datasets
I'm in Machine Learning A-Z lecture 19 where we access our first dataset. I've connected to the Google Colab folder in my gmail account, but when I try to access the the file I get the below error ...
- 1,896
-1
votes
1
answer
3k
views
How to read .pb file using Google Colab? [closed]
I would like to know how we can see/load/read a .pb file in Google Colab?
Thank you.
- 1,635
0
votes
0
answers
58
views
Automate downloading datasets via Colab
My desktop computer recently broke, and I'm currently working on a small laptop with barely 500mb of space left. I need to download about 100gb of files from the DFAUST dataset. I was wondering if ...
2
votes
1
answer
2k
views
Google Colab conda packages permanently installation
I want to install some conda packages on Google Colab. Installation done successfully, but it wont detect it when we restart the new Colab session.
I followed the link "#https://stackoverflow.com/...
- 20.5k
0
votes
2
answers
2k
views
Loading pretrained model with Pytorch
I saved my model with this code:
from google.colab import files
torch.save(net, 'model.pth')
# download checkpoint file
files.download('model.pth')
Then uploaded ...
- 626
1
vote
1
answer
783
views
M1 MacBooks versus Google Colab
I am just starting getting into deep learning with tf.keras. I am at the point where I have to decide where I want to develop. The thesis project will be timeseries ...
- 979
2
votes
1
answer
99
views
Notebook for data science
I'm searching for an online Jupiter notebook environment that allows collaborating in real-time. I've found that I've choice from two services Deepnote.com and DataLore by JetBrains. I have little ...
- 136
0
votes
1
answer
1k
views
2
votes
3
answers
18k
views
How do I download a Google Colab notebook?
I have to download code written in a Google Colab notebook, because I need to send it via email. How do I do this?
- 1,232
0
votes
1
answer
17k
views
How to use inverse_transform in MinMaxScaler for pred answer in a matrix
I am working on a data, for preding output, I used SVR by bellow code:
...
- 2,909
1
vote
1
answer
17k
views
Not able to connect to GPU on Google Colab
I'm trying to use tensorflow with a GPU on Google Colab.
I followed the steps listed at https://www.tensorflow.org/install/gpu
I confirmed that gpu is visible and CUDA is installed with the ...
0
votes
1
answer
753
views
How many images can be trained in Google Colab? [closed]
I am using the ResNet50 pretrained model to train my images using TensorFlow. I have 70k images and upgraded to Google Colab Pro, but still I am facing a memory error. So how many images I can train ...
- 381
4
votes
3
answers
3k
views
Very Fast Training After First Epoch
I trained an InceptionV3 model using plant images. I used Keras library. When training was started, first epoch took 29s per step and then other steps took approximately 530ms per step. So that made ...
2
votes
1
answer
2k
views
How to import large datasets into Google Colab?
Does anyone know a (free) method for importing large datasets into Google Colab, of multiple GB? Github is severely limited, uploading a folder to google drive takes a long time.
- 1,958
23
votes
6
answers
130k
views
Uploading images folder from my system into Google Colab
I want to train a deep learning model on a dataset containing around 3000 images. Since the dataset is huge, I want to use Google colab since it's GPU supported. How do I upload this full image folder ...
3
votes
1
answer
2k
views
NLP: what are the advantages of using a subword tokenizer as opposed to the standard word tokenizer?
I'm looking at this Tensorflow colab tutorial about language translation with Transformers, https://www.tensorflow.org/tutorials/text/transformer, and they tokenize the words with a subword text ...
- 23.8k
1
vote
0
answers
1k
views
setting class weights for imbalanced dataset in tensorflow [closed]
I have 24 classes in my dataset and I am trying to set class weights in the following way:
...
- 1,783
0
votes
1
answer
1k
views
What is the efficient way to use apply method in column of pandas Dataframe for large dataset?
I have a dataset of approximate 1 hundred thousand records. I want to use apply method in each of the records for further data processing but it takes very long time to process (As apply method works ...
CommunityBot
- 1