Questions tagged [sagemaker]

Amazon SageMaker is a fully-managed AWS service that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale.

Filter by
Sorted by
Tagged with
0
votes
0answers
18 views

Pandas On AWS Sagemaker

Hello Guys i have a question We want to start working with AWS Sagemaker. I understand that i can open Jupiter notebook and work like it was in my computer. but i know pandas working on single ...
0
votes
1answer
16 views

How Can I Process SageMaker Ground Truth NER JSON Output into DataFrame?

So, I've recently created a job using AWS SageMaker Ground Truth for NER purposes, and have received an output in the form a manifest file. I'm now trying to process the manifest file into a dataframe,...
1
vote
0answers
13 views

Docker File AWS [closed]

I am trying to implement a docker file for Amazon Sagemaker Container,in initial step i am following this link https://towardsdatascience.com/brewing-up-custom-ml-models-on-aws-sagemaker-e09b64627722 ...
0
votes
0answers
26 views

Training a DeepAR time series model with monthly data. Can only train on Daily

I am training a DeepAR model (arXiv) in Jupyter Notebook. I am following this tutorial. I create a collection of time series (concat_df), as needed by the DeepAR ...
0
votes
0answers
22 views

COVID-19 Rapid Test Result Image Detection

I fine-tuned an Inception V3 model provided in AWS SageMaker to detect COVID-19 Rapid Test Results (see the image below for an example). I provided about 20 pictures of negative and about 20 pictures ...
0
votes
1answer
45 views

When to tune hyperparameters in deep learning

I am currently playing around with different CNN and LSTM model architectures for my multivariate time series classification problem. I can achieve validation accuracy of better than 50 %. I would ...
0
votes
1answer
87 views

OOM memory after kernel restart, was working before

Ran my CNN on a SageMaker notebook and it started training, but I had to restart the kernel due to AWS disconnecting. However when I tried to rerun my code, I received an OOM error, and it never ...
1
vote
1answer
349 views

How to fix Sagemaker's "No finished training job found associated with this estimator" error?

I ran a complete AWS SageMaker Autopilot experiment. I now want to generate batch forecasts using this model but I get the error: "No finished training job found associated with this estimator. ...
0
votes
1answer
29 views

SageMaker - mini_batch_size what is it and why can't I get it higher than 5?

I'm following this tutorial but I keep getting the error: "The number of input images must be bigger or equal to the mini_batch_size." I've tried a series ...
0
votes
0answers
13 views

Keras training output

I am currently training images for classification. Initially I was using a local machine with a decent GPU. The number of training images is around 3561. I used a batch size of 64. The output during ...
0
votes
0answers
88 views

Why does my first Amazon sagemaker autogluon training job fail and keep failing?

I followed the instructions from this article about creating a code-free machine learning pipeline. I already had a working pipeline offline using the same data in TPOT (autoML). I uploaded my data to ...
0
votes
1answer
43 views

What is the benefit of training an ML model with an AWS SageMaker Estimator?

It looks like there are different routes to deploying an ML model on SageMaker. You can: pre-train a model, create a deployment archive, then deploy create an estimator, train the model on SageMaker ...
1
vote
0answers
28 views

How can I prepare my discrete batches of data for training?

I'm trying to calculate effect of parameters of an operation on the thickness of a wall. Each operation is thinning the wall thickness and at some point the wall is replaced and operation starts again....
0
votes
0answers
15 views

How to handle features containing strings in XGBoost in AWS Sagemaker

How can i handle the string containing spaces and colons as a feature for my xgboost classifier model? AWS Sagemaker requires the input in csv format, I don't know how to convert the string to the ...
0
votes
0answers
22 views

Development on Sagemaker takes a long time

I have created a notebook in sagemaker and a python script called my_script.py. I then train a model using the following command: ...
2
votes
1answer
868 views

How to include lifecycle configuration in Sagemaker studio's user notebook

I want to use lifecycle configuration in Sagemaker studio so that on start of user's notebook it runs the given lifecycle configuration. My lifecycle configuration will have shell script which will ...
1
vote
0answers
21 views

not getting point predictions from sagemaker clarify [closed]

I wanted to create shap values for my predictions in sagemaker. I found out that I can use "clarify" functionality in sagemaker to get shap values. However, I want to get point predictions ...
1
vote
1answer
2k views

Deploying multiple pre-trained model (tar.gz files) on Sagemaker in a single endpoint

We have followed the following steps: Trained 5 TensorFlow models in local machine using 5 different training sets. Saved those in .h5 format. Converted those into tar.gz (Model1.tar.gz,...Model5.tar....
1
vote
2answers
155 views

IDE for Machine Learning workflow - AWS SageMaker

Looks like we don't really use an IDE in any of Machine Learning workflow stages if we use AWS SageMaker. Entire work is done in jupyter notebook. Is this correct?
1
vote
1answer
338 views

AWS SageMaker Model as endpoint size limit

Is there a size limit imposed on models deployed on AWS SageMaker as endpoints? I first tried to deploy a simple TensorFlow/Keras Iris classification model by converting to protobuf, tarring the model,...
1
vote
0answers
74 views

Sagemaker - XGBOOST rank:ndcg

Does anyone know if the rank:ndcg is available on AWS Sagemaker? I am currently trying to run a model, but it seems like it's not implemented. Am I using an older xgboost version? Kinda new to AWS ...
2
votes
2answers
2k views

upload model to S3

I'm using AWS Sage Maker to build my model. I want to store the model in S3 for later use. How do you save your model in S3 with Amazon Sage Maker? I know this seems trivial but I didn't understand ...
1
vote
0answers
33 views

Integrate SageMaker notebook instances into development flow

I often get stuck by the calculation time when I work on a model locally. Even sampling quite heavily sometimes still let the running times very long. Ideally, these times must be of the order of the ...
2
votes
1answer
2k views

Does AWS Sagemaker continue running when I go offline?

I'm pulling data from web services in an AWS Sagemaker Notebook. I'd like to be able to close my computer for an hour, reconnect my computer and see that the data collection has continued to run. ...
1
vote
1answer
1k views

Difference between AWS amazonei_tensorflow and tensorflow conda environments

In AWS SageMaker there are several Conda environments available based on different ML frameworks: conda info -e I would like to know the difference between a <...