# All Questions

26,320 questions
Filter by
Sorted by
Tagged with
2answers
9 views

### Problem with a feature (normal distribution + peak around 0)

I have a small problem with a feature and I don'T know how to go around it to make it usable, so I would be really happy if someone can give a tip to solve this. The problem: I have a feature that ...
1answer
6 views

### Why BERT tokenizers function differently?

While experimenting with transformers' TFBertForSequenceClassification and BertTokenizer, I noticed that BertTokenizer: ...
0answers
4 views

### Can I set the perposal anchor boxes to a specific size in object detection?

I'm trainig a SSD MobileNet V2 FPNLite 640x640 object detection model on custom dataset, I undorstood that to make the model train faster is to change the parameters of anchor_generator for example, ...
0answers
11 views

### Blocking data on my iPhone [closed]

BLOCKING_ENABLED=true PIHOLE_INTERFACE=eth0 IPV4_ADDRESS=10.8.0.1/24 IPV6_ADDRESS= QUERY_LOGGING=true INSTALL_WEB_SERVER=true INSTALL_WEB_INTERFACE=true LIGHTTPD_ENABLED=true DNSMASQ_LISTENING=local ...
1answer
13 views

### how do I predict the next's alarms ? (time series categorical variables)

I'm trying to solve a time series forecasting problem, where the main goal is to read data with various alarm logs and make a prediction about what may happen in the future. Specifically, my data is a ...
0answers
10 views

### Tuning recall and precision for neural network

I have a multi-class classification neural network. After applying softmax to the last layer, I pick the class with the max value. My question is Like it is possible to tune the recall and precision ...
1answer
17 views

### Dealing with highly variable feature set size

I'm trying to use machine learning for security event classification. My goal is to predict the outcome (true positive or false positive) of a specific event. An event has a set of variables in it, ...
0answers
15 views

### From Labels to Graph: what machine learning approaches to use?

I want to drive from Seattle to San Francisco, and I've some time for sightseeing: what route should I choose to eat nice food and on my way, see some beautiful sides? I would model the world as a ...
0answers
11 views

### What parameters does the model learn in object classification?

In the case of object classification, what parameters do we learn from training examples? Do we learn mean and standard deviation? Let's say if I had 50 images with ground truth bounding boxes and ...
0answers
12 views

### NLP :Web Scrapping “News Articles” from financial website that included “MSFT” and “IBM” [closed]

I am planning to use BeautifulSoup to extract articles where the keyword "Microsoft" or "IBM" is mentioned. Preferred websites are: Google News Bloomberg New York Times Yahoo News ...
0answers
12 views

### Data system that manages aggregates over time intervals

I am looking to know if there is a data system that handles the following use case. To keep it simple, the data is a set of homogeneous enties E. E contains named numeric properties that the app code ...
0answers
10 views

### How is an ASR's output compared to ground truth for validation?

I am curious how it is done as I am interested in doing something similar. I have some manually transcribed data that contains tags for multiple speakers. I want to compare how well the out of the box ...
1answer
9 views

### Effect of weights on the Louvain communities detected

The Louvain method for community detection aims to optimize modularity and hence detect communities in the given graph. In case of a weighted graph would it be valid to assume that an edge with a ...
0answers
10 views

### Make my Two Different R Functions to be Just One Function [closed]

I want to use MonteCarlo function in MonteCarlo package in R which has one requirement among ...
0answers
8 views

### Read in file from Sharepoint folder on a given time (using Python) [closed]

I have a folder that lives within a sharepoint drive url. I wish to automatically extract a certain file, df, within this folder and import this file using Python. Desired Result: To schedule a 'job' ...
1answer
14 views

### How is calculated the error with multiple output neurons in neural network?

Machine Learning books generally explains that the error calculated for a given sample $i$ is: $e_i = y_i - \hat{y_i}$ Where $\hat{y}$ is the target output and $y$ is the actual output given by the ...
0answers
9 views

### How to find the slope of the parallel best fit lines for multiple groups of data? [closed]

Suppose we have k groups of points located closely to k lines. These k lines are parallel to each other. How can we estimate the slope of these parallel fit lines? Here talks about the case when k = 1,...
1answer
30 views

### Custom loss function with both min(y, p) and max(y,p)

I'm creating a neural network in tensorflow and need to minimize the following loss function: $\frac{max(y,p)}{min(y,p)}$ Where $y$ represents the true value and $p$ the predicted value. Since the ...
2answers
44 views

### How can data science teams inside businesses measure costs and efficiency of their technical work?

How can data science teams measure and improve costs of their technical work, when they often don't know the monetary value of the datasets and insights they are producing? Are they using industry ...
1answer
18 views

### Item-to-Item recommendation using DNN

I am new to DNN still learning, have a need to build item-to-item content based recommendation using DNN. For example, say I have a column of strings where each row represents a document I need to ...
0answers
9 views

### How to get all values for a specific entry collected along with time?

I have a table that has information about specific events. Say I have a list of people, Andrew, John, Mary, who may do different actions during the day at specific times. My table then looks like: <...
1answer
15 views

### Scaling of variables considering the values of a single column or the whole dataset

I read many time that for machine learning and data mining algorithms the multi-dimensional input data should be scaled (e.g. normalized or standardized). Now my question is whether the average, min ...
0answers
10 views

### Risk analysis on the uptime of web applications (classification? survival analysis?)

I've conducted a couple studies examining how "risky" several web applications are based on whether the respective support teams raise a major incident ticket. The data we have includes the ...
0answers
8 views

### Face matching using VGGFace library keras

I am working on face matching model (matching between id-card faces and selfies), where I am using the resnet50 pre-trained model from ...
0answers
9 views

### Epochs and other hyperparameters in Deep Q-Networks

I was wondering about hyperparameters used in Deep Q-Networks. Considering the use of replay memory and target network, together with the epsilon-greedy policy, are the number of epochs different of 1 ...
0answers
7 views

### Does the Context Vector consist of hidden state and Cell State or just the hidden state?

LSTM's carry a hidden state and a cell state with them. Now, in a standard encoder-decoder model, we pass the Context Vector from the encoder to the decoder. Does, this Context Vector consist of just ...
1answer
23 views

### I want to run PCA on a data set that will be aggregated by country. Should I aggregate the data before or after I standardize the data, and why?

Basically the title asks my question. I have the results of a survey that was filled out by people from different countries. I have been asked to analyze the data using PCA and see what findings I can ...
1answer
17 views

### Where can I find China's sales of electric cars in the last 10 years? [closed]

I have to do an Econometrics project about the sales of electric cars in China in the last 10 years by finding a possible relation between the level of pollution and the oil price.
0answers
20 views

### How to apply pruning on a BERT model?

I have trained a BERT model using ktrain (tensorflow wrapper) to recognize emotion on text, it works but it suffers from really slow inference. That makes my model not suitable for a production ...
0answers
10 views

### Drowsiness Detection issue understanding LSTM input shape

I’ve difficulty in understanding LSTM input shape. For example. I’ve 2 videos out of these 1 is categorized as Awake (0) and 1 as Drowsy (1). I preprocessed them to extract Eye Aspect Ratio and Mouth ...
3answers
35 views

### Time series classification, without the time dimension

Edit Thanks to the answer of @pcko1, I understand that I should use data augmentation to make my model resilient to order of data points. Clarification after the answer of @Icrmorin : My problem is ...
0answers
12 views

### How to desplay changes over time in aerial images as heatmap? [closed]

I have number of aerial/satellite images of a forest taken over 10 years. I wanted to create a heatmap of changes over time of the area. I was able to find tools to create diff between 2 images, but ...
1answer
23 views

### How to choose between Tensorflow and Pytorch?

Recently I've been working on a pretty vanilla ANN model in Python with sklearn (and its preprocessing pipeline), mostly in jupyterhub notebooks if that matters. I am considering changing the ...
1answer
8 views

### Encoding of high cardinality multi-label categorical feature?

This is the problem of binary classification: "1" - the subscriber is a driver (belongs to the segment of drivers), "0" - the subscriber is not a driver (does not belong to the ...
0answers
11 views

### KL divergence for exponential family distribution

In reinforcement learning, normal distribution is commonly used for continuous actions. I'm checking Pytorch's implementation for KL divergence between two normal distributions. I know it's impossible ...
2answers
23 views

### Why is large decision tree likely to overfit

My lecture slide told me that if we don't prune the regression tree, then the tree likely to over-fit. So, I wonder why would that happen? Is that because if the tree grows too large, we would end up ...
0answers
3 views

### How to specify scale_pos_weight value at runtime in Hyperopt?

I want to use LighgbmClassifier for a binary Classification. for Hyper Parameter tuning I want to use Hyperopt. The Dataset is imbalanced. Using Sklearns class_weight.compute_class_weight as shown ...
0answers
16 views

### Anomaly detection model on 1D data but not Gaussian distribution

I have a scenario that I have one-dimensional data and the distribution of the data is not Gaussian. (more like a bimodal distribution). I want to find an anomaly detection model that could predict ...
1answer
18 views

### Why does reducing the n_estimators in RandomForestClassifier improve accuracy? [closed]

I am taking a course that introduced me to sklearn.ensemble.RandomForestClassifier. At first it uses n_estimators with the default value of 10 and the resulting ...
0answers
22 views

### good combination of courses [closed]

I have started a project to find out good combination of courses. I have a dataset containing studentid, courses taken, grade for the course and final gpa. I am thinking, to get the students who have ...
0answers
13 views

### Object detection model's performance jumping up and down

I am training a model to detect buildings from satellite images in rural Africa. For labels, I use OpenStreetMap geometries. I use the Tensorflow Object Detection API and SSD Inception V2 as a model. ...
0answers
24 views

### Combining Satellite Data of Different Resolutions [closed]

I have precipitation satellite data of different resolutions: one is a 4.5 square kilometers and the other is 10 square kilometers. What would be a sufficient way to combine the two for further ...
2answers
53 views

### Loading collections of datasets - Python code examples

Sometimes you might want to check your ideas on multiple datasets. There are several places with datasets collections. Question: Please share some Python scripts how to download multiple datasets from ...
1answer
48 views

### What does n means in neural network neuron output?

I've found this equation that explains the output of a neuron in a MLP network: $y(n) = f(\mathbf{w}^T \mathbf{x}(n) + b)$ I can understand the general context, but since i have no background with ...
1answer
27 views

### what does the standard deviation plot around my learning curve indicate?

I plotted a learning curve below. There is a thick red band around the top portion of my training score. Why is it so high at the beginning? Below is a snippet of the code used: ...
1answer
15 views

### Does the output of the Sequence-to-Sequence encoder model exist in the same semantic space as the inputs (Word2vec)? [closed]

Does the output generated from the LSTM encoder module exist in the same semantic space as the original word vectors? If so, say for example we have a sentence and we pass it through the encoder to ...
1answer
22 views

### how print f1-score with scikit´s accuracy_score or accuracy of confusion_matrix?

I would like to print the f1-score. I got confused about the wording f1-accuracy score and accuracy score. What is the difference of these 2 scikit-learn metrics and how can I print the f1-score out ...
0answers
25 views

### Paragraph detection Techniques [closed]

I am applying OCR on pdf documents and later processing the content of them. I am having problems when trying to split into paragraphs: normally, one "\n" means an end of line while "\n\...
1answer
39 views

### Softmax regression cost function code [closed]

I really do not understand what does this code do M = sparse.coo_matrix(([1]*n, (Y, range(n))), shape=(k,n)).toarray() The code is related to calculating the ...
0answers
10 views

### AttributeError: 'numpy.ndarray' object has no attribute 'predict and having some warnings [closed]

from sklearn.metrics import confusion_matrix for i in range(len(model)): print('Model',i) cm=confusion_matrix(Y_test,model[i].predict(X_test)) TP=cm[0][0] TN=cm[1][1] FN=cm[1][0] FP=cm[0][...

15 30 50 per page