Questions tagged [azure-ml]
Azure Machine Learning offers a streamlined experience for all data scientist skill levels, from setting up with only a web browser, to using drag and drop gestures and simple data flow graphs to set up experiments. Can create amusing visualizations on the data.
55 questions
0
votes
0
answers
14
views
List running and queued jobs in AzureML workspace
The documentation to list jobs using the AzureML REST API is here: https://learn.microsoft.com/en-us/rest/api/azureml/jobs/list?view=rest-azureml-2024-04-01&tabs=HTTP
However this query can return ...
- 101
-1
votes
1
answer
261
views
Azure OpenAI API with LangChain issue
We(my company) have Azure OpenAI API for all our LLM projects. We are working on getting to know how to use this Azure OpenAI API using LangChain as we have been suggested this is the best framework ...
0
votes
1
answer
118
views
Azure Databricks Feature Store + Azure ML training
👋
Anyone know whether it is possible to use Azure Databricks Feature Store and combine it with training in Azure ML?
Databricks: “Integration with MLflow ensures that the features are stored ...
- 140
0
votes
0
answers
39
views
How to read the "predicted_true" Metric of an Azure ML experiment?
I followed along to Explore Automated Machine Learning in Azure Machine Learning
which had me create a regression experiment using data from https://aka.ms/bike-rentals (731 samples; 12 features; 1 ...
- 143
0
votes
0
answers
18
views
Purpose of Azure Cognitive Search
Azure provides a service called Cognitive Search which is an intelligent AI-based search service based on advanced NLP.
I tried this feature. And to make the search as efficient as possible, it ...
- 327
0
votes
1
answer
22
views
Hassle-free platform for a small data science team?
our team of 4 data scientists has been exploring options to automate our ETL, data storage and model updates and are looking for a hassle-free platform that can help with this.
We've had several ...
0
votes
1
answer
113
views
Where can I find gpt-35-turbo in the Microsoft Pricing calculator?
Where can I find gpt-35-turbo in the Microsoft Pricing calculator? I don't see gpt-35-turbo in the model list:
https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/ ...
- 5,820
0
votes
1
answer
41
views
Is classification enough for this?
I have a DB with 2 tables connected with a one to many relationship. Let's say one of A is linked to many of B. The tables have both two fields for a date and some text. And both tables get new ...
- 1
0
votes
1
answer
267
views
Is there any differences between using text-davinci-003 with the Azure API vs. with the OpenAI API? [closed]
I wonder whether there are any differences between using text-davinci-003 with the Azure API vs. with the OpenAI API.
- 5,820
0
votes
1
answer
49
views
MS Azure Computer Vision Service Performing Worse on More Data
We are trying to classify damaged cars versus undamaged cars using MS Azure Computer Vision service. The problem is that the model was performing better when it was trained on lesser data compared to ...
- 11
1
vote
0
answers
90
views
Azure AutoML: decimal numbers in confusion matrix
I have been running Azure AutoML on a binary classification task. When I visualize the performance and the confusion matrix in particular, I observe the following:
How can I have decimal numbers in ...
- 111
2
votes
2
answers
695
views
Estimating the uncertainty of regression models
Given a regression model, with n features, how can I measure the uncertainty or confidence of the model for each prediction?
Suppose for a specific prediction the accuracy is amazing, but for another ...
- 21
1
vote
2
answers
2k
views
Multiple Merges make the data frame in pandas to explode and causing Memory Issue in jupyter notebook
I have made a multiple merges using pandas data frame (refer the example script below).
It made the data frame to explode and consume more memory as it records reach to 18 Billion in ...
- 11
0
votes
1
answer
159
views
Deployment in AzureML for NLP with fastText
I am new to Azure ML. I am working on sentimental analysis on a small tweet dataset with the help of fastText embedding (fastText file 'wiki-news-300d-1M.vec' is around 2.3 GB which I downloaded in my ...
- 1
0
votes
3
answers
165
views
Azure ML / AutoML: problem with univariate time series forecasting
I'm having troubles generating univariate time series forecasts with Azure Automated Machine Learning (I know...).
What I'm doing
So I have about 5 years worth of monthly observations in a dataframe ...
- 101
1
vote
0
answers
29
views
different scored probability distributions for a classification model using python vs Azure ML Studio
I have a classification model which I initially built in Azure ML studio and then created a similar model in python (its similar because the algorithms in python VS Azure are a bit different so they ...
- 71
1
vote
1
answer
609
views
Azure automl time series forecasting error
I'm using Microsoft Azure automl to try and generate models for time series forecasting but I keep getting an error:
...
- 37
0
votes
0
answers
66
views
Different results with same input in request/response if input by one row or several rows in Azure Machine Learning Studio
I created a classifier by trained SVM and PCA as well as normalization transformation. And use Request/Response Excel to test.
And if I only input for one row, all the PCA would be "0"
but ...
0
votes
0
answers
360
views
Custom Object Detection on Azure Machine Learning or Databricks
I'm looking to train a custom object detection model using Tensorflow's API. Is it possible to do it in Azure ML Studio or in Databricks?
Object Detection link - https://tensorflow-object-detection-...
- 285
0
votes
1
answer
31
views
build biased image dataset for emotion analysis
This is a pre-project question.
I would like to find or build a biased dataset to demonstrate what happens if training data are biased (biased distributed ethnicity for exemple).
I try this for the ...
- 101
1
vote
3
answers
11k
views
PicklingError in pyspark (PicklingError: Can't pickle <class '__main__.Person'>: attribute lookup Person on __main__ failed)
I am unable to pickle the below class. I am using data bricks 6.5 ML (includes Apache Spark 2.4.5, Scala 2.11)
...
0
votes
1
answer
109
views
Azure Cloud SQL - Querying large number of rows with Python
I have a Python Flask application that connects to an Azure Cloud SQL Database, and uses the Pandas read_sql method with SQLAlchemy to perform a select operation on a table and load it into a ...
- 113
1
vote
2
answers
315
views
Which ML algorithm should I use for following use case for classification and Why?
I have data in table format having total 3 columns. One column for label, other two columns are features. So, such 30 rows(1 row contains 2 feature and 1 label) make one set of data with all 30 rows ...
- 159
1
vote
0
answers
24
views
Is there a way to attach a VM instance from Azure as compute power to train your model locally?
I have a python folder locally which does the training of the model.
I am wondering, is there a way, for example to bring some GPUs locally and just "attach them" to your script or do you need to do ...
- 25
1
vote
0
answers
212
views
lags and rolling window in Azure AutoML Time series forecasting
I'm following this tutorial to try Machine Learning AutoML Forecasting.
In the several parameters we can submit to the AutoML experiment, we have these ones:
target_logs;
target_rolling_window_size;...
- 193
2
votes
1
answer
130
views
where does the database created in spark go?
I am following this tutorial:https://docs.microsoft.com/en-us/learn/modules/intro-to-azure-databricks/4-using-notebooks
In this tutorial we create a database like this:
...
- 31
1
vote
0
answers
591
views
How to know which binning mode to apply to target column
I am trying to prepare for DP-100 certification and I got some sample questions online. Here is one of the questions:
...
- 31
1
vote
1
answer
209
views
xgboost in R have different results compared to boosted decision tree in Azure ML
I have a small data set (4000 records with 10 features) and I used XGBOOST in R as well as Boosted Decision Tree model in Azure ML studio. Unfortunately the results are different. I like to optimize ...
- 71
0
votes
1
answer
47
views
Experiment click to lead prediction with Azure ML
I am experimenting now with the Azure ML Studio and I am trying to predict leads based on the clicks I have.
I am exporting a data set of 60.000 Clicks and 8.000 Leads from these clicks.
My data ...
- 191
1
vote
1
answer
152
views
Score Columns in Azure ML Studio
So I have a data set I have successfully used to train a model, and have decent results. I am using a Two Class Boosted Decision tree for a Boolean output. So far so good.
I now want to analyze each ...
- 121
1
vote
1
answer
41
views
Service Request classification, questionnaire filling and call logging
I am very new to machine learning. I just went through some of the tutorials in Azure and completed one practice workflow(car price prediction). I hope I can ask basic questions here.
Scenario : We ...
- 11
0
votes
1
answer
231
views
Mean Absolute Error increasing with more correlated factors
I am using Microsoft Azure Machine Learning Studio to predict stock market prices. We have the variables- Index price(target-to be predicted),Low price,High price,dates and days. We use split of 0.7 ...
2
votes
1
answer
88
views
What Machine Learning Algorithm could I use to determine some measure in a date?
I am getting stuck with this problem. Let's say that we have the next information.
CustomerID: 1, Date: 3/2/2018, Quantity: 3, Total: 390.78, Min: 130.26, Max: 130.26
We want to determine given a ...
- 23
2
votes
1
answer
688
views
Is it possible to use TensorFlow inside a python script in Azure Machine Learning Studio?
I'm trying to get TensorFlow running inside a python script in Azure Machine Learning Studio. As TensorFlow is not part of Azure Machine Learning Studio, I needed to import it using a zip file. I ...
- 121
1
vote
2
answers
206
views
Problem importing CNTK in Azure jupyter notebook
Vineeth Sai indicated in this that with the following code:
pip install cntk
the problem is solved. However, I am getting the error shown in attached image:
- 181
2
votes
1
answer
211
views
Converting ML Azure random forest to Python - what is "Number of random splits per node"?
I want to convert a random forest model from ML Azure to Python (using SKlearn.ensemble.RandomForestRegressor. However there is a hyperparameter called "Number of ...
- 121
6
votes
3
answers
19k
views
Using python and machine learning to extract information from an invoice? Inital dataset? [closed]
DISCLAIMER: I have absolutely no background with machine learning/data science, and am unfamiliar with the general lingo of data science, so please bear with me.
I'm trying to make a machine learning ...
- 61
2
votes
1
answer
1k
views
Create Custom Python Model in Azure ML Studio?
I came across this article on how to create a Custom R Model and use it in Azure ML studio
https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/create-r-model
Can we ...
- 93
1
vote
0
answers
65
views
Data analysis of unstructured data that have non linear Key value position [closed]
I have unstructured data consist of three excel sheet
Text contents of 3 tables some how related to each other But there is no linear direct relationship between them e.g First row of table 1 is not ...
- 11
0
votes
1
answer
1k
views
How to bypass ID column without being used in the training model but have it as output - Azure ML
The input data in the model includes column ControlNo.
But I don't want this column being part of learning process so I'm using Select Columns in Dataset to ...
- 115
1
vote
1
answer
319
views
Why training model give great result but real data gives very bad result: Azure ML Studio
I am using Two-Class Boosted Decision Tree to train model.
Evaluation result I'd say really good.
But when I am using real dataset - the result is very bad.
What can possibly go wrong that makes ...
- 115
1
vote
1
answer
206
views
How to apply SelectKBest in azure machine learning
I am very new to machine learning, I started to understand fundamental and using it in azure studio, I see that there is an algorithm in ...
- 133
0
votes
1
answer
222
views
How to predict a group of events using machine learning? [closed]
Whether any machine learning model can dynamically predict different types of stages it would go through for completing a process.
0
votes
1
answer
340
views
No result for scored labels in Azure ML Web Service
I am trying to predict scored labels using regression. But when I am about to get the result from Azure ML Web Service in Excel 2016, there is no result appeared in the scored label column. How should ...
- 101
1
vote
1
answer
69
views
Deployed Web service
When I deploy my web service in AZURE Machine learning, is it possible to have NULL or empty in my test data set? Or I have to fill all the information to get the results of my prediction?
- 481
1
vote
1
answer
397
views
Which Regression Machine Learning algorithm to use in Azure for statistical prediction/forecasting
I've a golf website that pulls a load of statistical data and makes forecasts for upcoming events.
I'm trying to improve the algorithm and have been looking into Azure's ML Studio. I've lots of data ...
- 111
-2
votes
1
answer
4k
views
What is PCA and MICE
I am doing an experiment on Azure ML. While pre processing my data, there is an option to clean missing data using either PCA or MICE.
Please provide me an example of how I can decide on which option ...
- 481
0
votes
1
answer
117
views
Best way for data preparation to have accurate prediction
I'm trying to experiment if an opportunity will win or lose in Azure Machine Learning studio. However, am still in Data preparation method.
In my Data base I have opportunity table and products table....
- 481
1
vote
1
answer
206
views
Anomoly detection method selection
I need to decide between SVM (One-Class Support Vector Machine) and PCA (PCA-Based Anomaly Detection) as anomaly detection methods. Azure ML is used and provides SVM and PCA as methods - hence the ...
- 242
2
votes
2
answers
2k
views
Using Pandas to_numeric() in Azure Machine Learning Studio
I am facing an issue that Azure Machine Learning Studio fails to find the to_numeric method in pandas.
After reading a .csv in AMLS I try to process it in a python ...
- 123