Questions tagged [machine-learning]
Machine Learning is a subfield of computer science that draws on elements from algorithmic analysis, computational statistics, mathematics, optimization, etc. It is mainly concerned with the use of data to construct models that have high predictive/forecasting ability. Topics include modeling building, applications, theory, etc.
11,307
questions
-1
votes
1
answer
594
views
Probability of what product will be purchased in repeat orders
I have a problem I need to solve and am looking for assistance in what algorithm to use. I have a online store that I have say 10 products and I have all the order history for every order. What I am ...
- 101
-1
votes
1
answer
55
views
How do I create my features
I am working on the prediction of the behaviour of a new well in a map.
The data that I have is a map in a form of a grid and its properties (9 of them), and a set of wells with the position of each ...
- 1
-1
votes
1
answer
63
views
Texts classifications approaches
I have a set of predefined categories(like: cars, girls, etc.) and a set short texts and I need to assign one or several categories to each text. What is the best way to do this? I don't have ...
- 101
-1
votes
1
answer
633
views
Do we Need to Populate the Neutral DataSets for Sentiment analysis?
I'm working with datumbox ml framework for sentiment analysis.Here the git link. I found a sentiment Ml code in code examples of frame work here is the code example link. I want to use same code for ...
- 389
-1
votes
1
answer
698
views
Using Topic Models in R
I am learning about Probabilistic Topic Models by reading this article by D. Blei, watching this video, and doing this exercise A Gentle Introduction to Topic Modeling in R.
After the topics in my ...
- 111
-1
votes
1
answer
934
views
Reading from log file and train a model for prediction
I have a file (access.log) from apache server which is my dataset. and I want to train a model on what is "Normal" and "Abnormal" in the file, so I manually added to some line a field that takes one ...
-1
votes
1
answer
146
views
Beggining in machine learning [closed]
I just want to know which books, courses,videos, links,etc do you recommend me to start in machine learning, neural networks, languajes most commonly used. I want to start from zero, just in the ...
-1
votes
1
answer
79
views
Can grid-based clustering method be use for customer segmentation? [closed]
I am trying some clustering methods for customer segmentation and I stumbled upon grid based methods like: STING, MAFIA, WAVE CLUSTER, and CLIQUE. However, from what i've read, most of them are for ...
- 23
-2
votes
1
answer
67
views
What can possibly go wrong? [closed]
Some machine learning projects produce great results for the client. Some don't, for a variety of reasons. What makes the difference?
How can you manage scope, schedule, and costs for a machine ...
- 135
-2
votes
2
answers
58
views
Building CNN, Need More Images [closed]
I'm building a custom Convolutional Neural Network for image recognition. I'm running into the issue of only having around 100 images or so to train and test on. From my research and model results, ...
- 183
-2
votes
1
answer
875
views
Any Master Thesis Topics related to NoSQL and Machine Learning or Business Intelligence? [closed]
Im currently in the last year, and I want to do a masters thesis on a topic that has NOSQL and Machine Learning or Business Intelligence. In my topic i want for defintely NOSQL, so I want to add a ...
- 113
-2
votes
1
answer
39
views
how to split the original data in training, validation and testing? [closed]
I have the original data but i didn't know how to split the data and how to implement that data into some algorithms. can you guys help me out in this problem.
thank you
-2
votes
1
answer
186
views
Help Interpreting a Active Learning Learning Curve
I am applying a active learning with a SGDClassifier (log loss function) as the base learner on some data and I have the following graphs representing the learning curve of queries vs error rate. The ...
- 145
-2
votes
1
answer
360
views
Best ML practice for temporal dependency between features
I am trying to figure out what would be the best way to learn patterns with a data-set that has temporal dependency between its features.
Let's say I want to predict whether a patient will suffer ...
- 11
-2
votes
1
answer
71
views
what tree generation algorithm is used to create DT, ID3? C4.5, CART? [closed]
By default what tree generation algorithm is used to create decision tree? D3? C4.5, CART?
- 239
-2
votes
1
answer
76
views
combine two features into one [closed]
In an epidemic disease dataset of 3 months, I have a feature (var dt_died) with the death dates of patients (800 people died out of all 12k unique subjects in this dataset, so obviously only dead ...
- 103
-2
votes
1
answer
30
views
How to achieve better accuracy of 90+ on a 3 class highly skewed dataset?
I have a 3 class dataset with very high imbalance classes:
class 1: 75000
class 2: 27000
class 3: 3000
With simple learning algorithms, accuracy is ...
- 119
-2
votes
1
answer
32
views
ML - Labelling - number of possibilities [closed]
I've started learning ML and stuck with the number of possibilities in labelling. I have a sample which comprises 4 attributes (binary) (from the book Apprentissage artificiel, Antoine Cornéujols) ...
- 9
-2
votes
1
answer
33
views
I want to start studying the field of machine translation [closed]
I've studied Japanese language and literature and passed some linguistic courses and now as for my masters, I want to study natural language processing and especially machine translation. so I tried ...
-2
votes
1
answer
265
views
What are pickle, cPickle, and pickling in keras model?
I want to save full keras model. But in their documentation, they recommended not to use pickle or cPickle to to save a keras model.
I am not clear about the two terms.
What are they and why use or ...
- 55
-2
votes
1
answer
468
views
Training a model to predict duplicate records in machine learning
I have the adjustment data in telecom domain: There are problems that sometimes the automation script generates the bill twice which causes duplicate records.
I want to know how to prepare the data ...
- 283
-2
votes
1
answer
4k
views
What is PCA and MICE
I am doing an experiment on Azure ML. While pre processing my data, there is an option to clean missing data using either PCA or MICE.
Please provide me an example of how I can decide on which option ...
- 481
-2
votes
1
answer
35
views
Model Architecture Design
I have two different model architectures, I am just curious if one would be better then the other. I have tested both and they vary in performance each time I train them, but the second model ...
-2
votes
1
answer
32
views
Which ml framework/library makes you do the most of the work but still eases the process for you? [closed]
This may sound like a stupid question, but trust me it's not, I am searching for a ml framework/library that makes you do most of the work yourself so I can learn rather than depending on a framework/...
- 103
-2
votes
1
answer
127
views
What library to choose for machine learning on swift? [closed]
I have to do a ML project for university and I’ve chosen to do something similar as this https://m.youtube.com/watch?v=Aut32pR5PQA, since I have most experience with swift language, I would like to ...
- 101
-2
votes
1
answer
417
views
Is shuffling data really necessary for training? [duplicate]
I don't mean if we had a dataset where if sequentially sampled, the labels would be [1111122223333]. In this case, the network learns to predict everything as 1, then 2, and so on and it's impossible ...
-2
votes
1
answer
92
views
How to get the data from gender dataset
May I know how to modify my Python programming thus it will be get the same result as refer to the image file?
...
- 5
-2
votes
1
answer
1k
views
Best way to extract information from text description and match it with set of words
I have 10k records of data, each record represents a unique product(10k class labels) and its description. For example, "Coffee Maker, this product takes coffee beans and brew it, to make tasty cofe". ...
- 11
-2
votes
1
answer
360
views
How to find data that is the maximum distance from cluster center or stayed border of the cluster
After applying k-means clustering we can easily find the closest index of the cluster. Now if I want to find the distance index from cluster center / index that is staying border of the cluster, how ...
- 295
-2
votes
1
answer
705
views
Can I use a regression machine learning model for predicting a vector with multiple values?
Introduction
I have a large CSV file with about 400 rows.
Each row contains 1000 x values and ...
-2
votes
1
answer
58
views
Can you use machine learning to extract the entropy from a hand print reliably?
Let's say that I want to generate a cryptographic key based on my hand (I'm using hands just as an example). What I could do is I scan my hand (so that the friction ridges are apparent) and then use a ...
- 97
-2
votes
1
answer
95
views
Finding relationships from group of variables
Given time-series data of a set of input metrics $M_1$, $M_2$, $M_3$ ... $M_n$ and a set of observed metrics $O_1$, $O_2$, $O_3$ ... $O_m$.
For each $M_i$, what is the best way to find equations that ...
- 11
-2
votes
1
answer
126
views
What is the difference between statistical learning and predictive analytics?
I am new to data science. I am confused about the differences between statistical learning and predictive analytics. To me, it looks like both are the same as we try to work on function of x(...
-2
votes
2
answers
446
views
Finding similarity between a word and a sentence (like "restart" and "turn off and on")
I am using Word2Vec for text vectorization. It is doing a good job but some cases it is failing. For example "turn the computer off and on" and the sentence "restart the computer" does not have a very ...
- 207
-2
votes
1
answer
799
views
Q: xgboost regressor training on a large number of indicator variables results in same prediction for all rows in test
I'm training a XGBoost regressor in Python on a data set with a large number of indicator variables (one-hot-encoded from categorical variables) and a few numerical variables.The dataset size is over ...
- 117
-2
votes
1
answer
364
views
An formula derivation question about SMO algorithm of SVM
I have a question about how to derive the bottom formula under "Fixing the other ai's .."?
Here's the completed PDF file Sequential Minimal Optimization for SVM
The screenshot is page 9 of this file....
- 1
-2
votes
1
answer
227
views
clean the data with sample selection?
I am using Python to do weather forecasting.
Here is the original data.
Thanks!
The input has 180 features and the meanings are:
Suppose we are doing forecast for hour k. We will use the historic ...
-2
votes
1
answer
1k
views
word2vec for propernouns
I have trained my word2vec model on a movie dataset with star cast, director name and other similar features/columns in the training data set. The text is not free flowing (it is comma separated). As ...
-2
votes
2
answers
83
views
How to create a model that can have multiple labels associated to it?
I have a set of news paper report.
I need to classify them as Sports, Politics related at first.
Once the given document is in Sports category, then I need to furthur classify them as Football, ...
- 1,900
-2
votes
2
answers
2k
views
Predictive Model with sort-of-non-binary labels
I'm working with government infrastructure public tenders data and want to build a predictive model. I'm want to train a model to predict if a company will or will not participate in a public tender. ...
- 1
-2
votes
1
answer
210
views
Clustering large number of strings based on tags
I have string representations of text written by users in the form of parts of speech tags like so:
$NNDN,OVDANPN,PNVRV,^^V,^^!$^OV
and
...
- 101
-3
votes
2
answers
1k
views
Which one will be the dominating programming language for next 5 years for analytics , machine learning . R or python or SAS [closed]
Which one will be the dominating programming language for next 5 years for analytics , machine learning . R verses python verses SAS. Advantage and disadvantage.
- 185
-3
votes
1
answer
726
views
Which Normal distribution a point belongs to?
I have estimated normal distributions for two classes (0 and 1). The distributions for the two classes are,
\begin{align}
X_0 &\sim \mathcal{N}(\mu=549.96,~~ \sigma=549.96) \\
X_1 &\sim \...
-3
votes
1
answer
72
views
Solve an equation using machine learning [closed]
Imagine we have the following equation: y=xz. We have y but not other ones. Note that y is like a matrix and we could as many sample we want. It is the values obtained from sensors. This means it ...
- 443
-3
votes
1
answer
152
views
To build a machine learning model of large data sets of 20,000 rows using python [closed]
What are the essential steps to build a Machine Learning model to predict the following 4 classes: whether the user was a male, a female, a brand (non-individual) or unknown.
The dataset contains 20,...
-3
votes
1
answer
47
views
Which is the correct method for outlier analysis on a dataset for modelling?
I'm trying to build a regression model but my data-set have many outliers points which I need to analyze and then remove them.
There are two ways to do it,
1) First do all the analysis on every ...
- 347
-3
votes
1
answer
638
views
A binary classifier predicts only one type of class
This is an assignment question. Can someone someone give me some clue on how to get through:
A generative approach is used for a binary classification problem and it turns out that the resulting ...
-3
votes
1
answer
188
views
-3
votes
1
answer
175
views
LogisticRegression NotImplementedError on fit function
im a newbie in data science or machine learning. i try to implement code from here, but i got error when try to call fit function
here is the code:
...
- 141
-3
votes
2
answers
82
views
Looking for Data science training with Python [closed]
Looking for Data science training with Python in Bangalore location with real time scenarios & Project preparations.
- 1