Questions tagged [sagemaker]
Amazon SageMaker is a fully-managed AWS service that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale.
24
questions
0
votes
0
answers
5
views
How to handle multiple training jobs in AWS Sagemaker Pipelines?
I am trying to create a pipeline for training an image dataset via Sagemaker Pipelines. Based on the examples I understood that for all distinct stages like data preparation, model training, ...
2
votes
2
answers
1k
views
Is it possible to work with AWS Sagemaker Studio Notebooks using a local IDE?
Is it possible to work with AWS Sagemaker Studio Notebooks using an IDE such as VSCode or PyCharm/IntelliJ running on my local machine?
And if yes, how?
Ideally I'd like to want to connect to the ...
- 121
0
votes
1
answer
154
views
DisableProfiler error on XGBoost fit
Suddenly, code that was working (before the Christmas break) now does not. I would like to know why. The documentation seems incomplete and the error message is cryptic in context.
On trying to fit a ...
- 196
0
votes
0
answers
180
views
AWS Stepfunctions using SageMaker ScriptProcessor
Hello Data Science/Engineer folks,
I need a help in orchestrating a ML model using AWS Step Functions. There are some tutorials on using StepFunction with Python SDKs, but all of them are focused ...
- 101
0
votes
0
answers
414
views
Loading a model saved in s3 to SageMaker instance
I trained a ML model in SageMaker using Docker Container. After the training is finished, the model is saved as .pkl file which gets written to S3 bucket as .tar file.
I need to use that model to run ...
- 101
0
votes
1
answer
508
views
Pandas On AWS Sagemaker
Hello Guys i have a question
We want to start working with AWS Sagemaker.
I understand that i can open Jupiter notebook and work
like it was in my computer.
but i know pandas working on single ...
- 35
0
votes
1
answer
306
views
How Can I Process SageMaker Ground Truth NER JSON Output into DataFrame?
So, I've recently created a job using AWS SageMaker Ground Truth for NER purposes, and have received an output in the form a manifest file. I'm now trying to process the manifest file into a dataframe,...
1
vote
0
answers
105
views
Docker File AWS [closed]
I am trying to implement a docker file for Amazon Sagemaker Container,in initial step i am following this link
https://towardsdatascience.com/brewing-up-custom-ml-models-on-aws-sagemaker-e09b64627722
...
- 31
1
vote
2
answers
97
views
When to tune hyperparameters in deep learning
I am currently playing around with different CNN and LSTM model architectures for my multivariate time series classification problem.
I can achieve validation accuracy of better than 50%. I would like ...
- 19
0
votes
2
answers
212
views
OOM memory after kernel restart, was working before
Ran my CNN on a SageMaker notebook and it started training, but I had to restart the kernel due to AWS disconnecting. However when I tried to rerun my code, I received an OOM error, and it never ...
- 451
2
votes
1
answer
1k
views
How to fix Sagemaker's "No finished training job found associated with this estimator" error?
I ran a complete AWS SageMaker Autopilot experiment. I now want to generate batch forecasts using this model but I get the error: "No finished training job found associated with this estimator. ...
- 21
0
votes
1
answer
133
views
SageMaker - mini_batch_size what is it and why can't I get it higher than 5?
I'm following this tutorial but I keep getting the error:
"The number of input images must be bigger or equal to the mini_batch_size."
I've tried a series ...
- 101
1
vote
1
answer
147
views
What is the benefit of training an ML model with an AWS SageMaker Estimator?
It looks like there are different routes to deploying an ML model on SageMaker. You can:
pre-train a model, create a deployment archive, then deploy
create an estimator, train the model on SageMaker ...
- 213
1
vote
0
answers
33
views
How can I prepare my discrete batches of data for training?
I'm trying to calculate effect of parameters of an operation on the thickness of a wall.
Each operation is thinning the wall thickness and at some point the wall is replaced and operation starts again....
- 111
2
votes
1
answer
2k
views
How to include lifecycle configuration in Sagemaker studio's user notebook
I want to use lifecycle configuration in Sagemaker studio so that on start of user's notebook it runs the given lifecycle configuration.
My lifecycle configuration will have shell script which will ...
1
vote
0
answers
44
views
not getting point predictions from sagemaker clarify [closed]
I wanted to create shap values for my predictions in sagemaker. I found out that I can use "clarify" functionality in sagemaker to get shap values. However, I want to get point predictions ...
- 71
1
vote
2
answers
4k
views
Deploying multiple pre-trained model (tar.gz files) on Sagemaker in a single endpoint
We have followed the following steps:
Trained 5 TensorFlow models in local machine using 5 different training sets.
Saved those in .h5 format.
Converted those into tar.gz (Model1.tar.gz,...Model5.tar....
- 13
2
votes
2
answers
340
views
IDE for Machine Learning workflow - AWS SageMaker
Looks like we don't really use an IDE in any of Machine Learning workflow stages if we use AWS SageMaker.
Entire work is done in jupyter notebook. Is this correct?
- 145
1
vote
1
answer
659
views
AWS SageMaker Model as endpoint size limit
Is there a size limit imposed on models deployed on AWS SageMaker as endpoints? I first tried to deploy a simple TensorFlow/Keras Iris classification model by converting to protobuf, tarring the model,...
- 13
1
vote
0
answers
141
views
Sagemaker - XGBOOST rank:ndcg
Does anyone know if the rank:ndcg is available on AWS Sagemaker? I am currently trying to run a model, but it seems like it's not implemented. Am I using an older xgboost version? Kinda new to AWS ...
- 23
3
votes
2
answers
7k
views
upload model to S3
I'm using AWS Sage Maker to build my model. I want to store the model in S3 for later use. How do you save your model in S3 with Amazon Sage Maker? I know this seems trivial but I didn't understand ...
- 53
1
vote
0
answers
34
views
Integrate SageMaker notebook instances into development flow
I often get stuck by the calculation time when I work on a model locally. Even sampling quite heavily sometimes still let the running times very long. Ideally, these times must be of the order of the ...
- 11
7
votes
1
answer
5k
views
Does AWS Sagemaker continue running when I go offline?
I'm pulling data from web services in an AWS Sagemaker Notebook.
I'd like to be able to close my computer for an hour, reconnect my computer and see that the data collection has continued to run.
...
- 271
1
vote
1
answer
2k
views
Difference between AWS amazonei_tensorflow and tensorflow conda environments
In AWS SageMaker there are several Conda environments available based on different ML frameworks:
conda info -e
I would like to know the difference between a <...
- 177