Last call to make your voice heard! Our 2022 Developer Survey closes in less than a week. Take survey.

Questions tagged [cloud-computing]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
32 views

What is CI/CD Pipeline in DevOps? [closed]

I just graduated with a non-tech background. As a person from a non-IT Background is DevOps a good career choice? Is it a good time to enroll in devops training?
user avatar
1 vote
1 answer
22 views

Best way to get data into Colab Notebook

I am working concurrently with multiple very large datasets (10s-100s of GBs)). I signed up for Colab Pro+ thinking it is the best option. However, I face a significant bottleneck in getting data into ...
user avatar
0 votes
0 answers
34 views

Use Google Colab Resources on local IDE

I have a big doubt. I see a lot of blog posts where they say that you can use the Colab front-end to edit a local Jupiter Notebook However, I don't see the point. the actual advantage would be to use ...
user avatar
0 votes
1 answer
24 views

Cost Efficient Machine Learning Development Using Cloud GPUs

Let's say I have a Juypter Notebook I am working on where I am analyzing, visualizing, testing, etc. various Machine Learning Models with different hyperparameters on some arbitrary data set or I am ...
user avatar
  • 11
0 votes
0 answers
105 views

Why does my first Amazon sagemaker autogluon training job fail and keep failing?

I followed the instructions from this article about creating a code-free machine learning pipeline. I already had a working pipeline offline using the same data in TPOT (autoML). I uploaded my data to ...
user avatar
0 votes
1 answer
111 views

How to run unmodified Python program on GPU servers with scheduled GPUs?

Say I have one server with 10 GPUs. I have a python program which detects available GPU and use all of them. I have a couple of users who will run python (Machine learning or data mining) programs and ...
user avatar
  • 103
1 vote
1 answer
59 views

Alternatives to GCP / AWS / Azure

Can anyone recommend an alternative to the big 3 cloud computing alternatives? I know they're the best but I found them overly complicated because they cater to massive enterprises. The amount of set ...
user avatar
  • 181
1 vote
1 answer
23 views

Deep learning on cloud

I am trying to implement some deep learning models with large amount of data around 10gigabyte. Although, my Laptop and Collab-free crashes when it tries to load them. Do you think it worths to buy ...
user avatar
1 vote
1 answer
433 views

Keras multi GPU in vast.ai

I am trying to run a keras model on vast.ai using multiple GPUs. For that I am using keras.utils.multi_gpu_model , however I keep having this error: ...
user avatar
1 vote
0 answers
33 views

What VM should I use? [closed]

So I am starting a project that has some code in it that has to do with machine learning (for example recommender system). At the moment I am thinking that if I want to deploy this application, should ...
user avatar
1 vote
0 answers
19 views

Moving paper documents to cloud (AWS) - [closed]

I'm trying to solve a simple problem and seeking advise/suggestions - I have lot of paper documents in my drawers which I want to store on cloud (S3) as PDFs. My idea blueprint is - 1) scanning all ...
user avatar
  • 431
1 vote
0 answers
26 views

What is the easiest way to duplicate my model and run in 10 cloud machines? [closed]

I have built a model in a cloud machine(google cloud). It runs for a few hours to a day. I need to scan some parameters like learning rate and batch size. How do I duplicate my compute engine, run ...
user avatar
1 vote
0 answers
19 views

How to Read Photos for Deep Learning on Google Cloud Platform Compute Engine VM Instance, Through Jupyter Lab

I've set up a project on GCP with a Compute Engine VM and Storage Bucket. Access Scopes set to Allow full access to all Cloud APIs Have set a default Region and Zone I believe I have completed SSH ...
user avatar
  • 71
1 vote
1 answer
2k views

how to run my python code on google cloud without fear of getting disconnected - an absolute beginner?

I have been trying to use python 3 for text mining on a 650 MB csv file, which my computer was not powerful enough to do. My second solution was to reach out to google cloud. I have set up my VMs and ...
user avatar
  • 113
0 votes
1 answer
48 views

How can I use my laptop to implement analysis in Python but use a different fast server for computation of analysis?

I am working in a company but I am new in the field. We have a central server which is faster than my laptop (of course). So my goal is that I still use my laptop to do python analysis for machine ...
user avatar
0 votes
1 answer
29 views

Amazon Cloud Image istance most suited for R data mining

I'm new to the field of machine learning, I always used my laptop for regular statistical analysis with no performance problems. Though lately I started programming with caret and I find myself stuck ...
user avatar
  • 125
2 votes
1 answer
821 views

Train a deep reinforcement learning model using two computers

I would like to know if there is a way to train a deep rl model using two different computers. The first one would execute the game and send requisitions to the second computer which would store and ...
user avatar
1 vote
0 answers
148 views

Is there a way to use Orange3 on a remote server or in the cloud? [closed]

My question there is a way to run the Orange, not on a local computer, but on a remote server, even in the cloud? My notebook has only 8GB memory and limited number of CPU core, which is insufficient ...
user avatar
  • 11
3 votes
2 answers
2k views

Different number of images in classes

I am working on a deep learning CNN project. The dataset contains more than 500 classes and the classes have different numbers of items (images). For example, some of the classes have 5 images and ...
user avatar
  • 1,675
1 vote
1 answer
57 views

Which cloud platform to maximize my impact as a data scientist? [closed]

I am looking to pick up the knowledge/software skills to move towards becoming an end to end deep learning engineer. By this I mean handling the following on my own: preprocess big data at low ...
user avatar
  • 113
1 vote
0 answers
30 views

Cloud computing with country-specific region for Switzerland

Are there any cloud computing services that allow for processing and storing data exclusively in Switzerland? Are there any that have machine-learning-specific functionality? Most do not seem to have ...
user avatar
  • 114
8 votes
1 answer
38k views

How to download dynamic files created during work on Google Colab?

I have two different files and on the first, I tried to save data to file as: np.save(open(Q1_TRAINING_DATA_FILE, 'wb'), q1_data) On second file, i'm trying to ...
user avatar
  • 185
39 votes
6 answers
49k views

Are there free cloud services to train machine learning models?

I want to train a deep model with a large amount of training data, but my desktop does not have that power to train such a deep model with these abundant data. I'd like to know whether there are any ...
user avatar
  • 13.3k
33 votes
5 answers
13k views

What are the use cases for Apache Spark vs Hadoop

With Hadoop 2.0 and YARN Hadoop is supposedly no longer tied only map-reduce solutions. With that advancement, what are the use cases for Apache Spark vs Hadoop considering both sit atop of HDFS? I've ...
user avatar
  • 511