All Questions

Filter by
Sorted by
Tagged with
0
votes
2answers
9 views

Problem with a feature (normal distribution + peak around 0)

I have a small problem with a feature and I don'T know how to go around it to make it usable, so I would be really happy if someone can give a tip to solve this. The problem: I have a feature that ...
0
votes
1answer
5 views

Why BERT tokenizers function differently?

While experimenting with transformers' TFBertForSequenceClassification and BertTokenizer, I noticed that BertTokenizer: ...
0
votes
0answers
4 views

Can I set the perposal anchor boxes to a specific size in object detection?

I'm trainig a SSD MobileNet V2 FPNLite 640x640 object detection model on custom dataset, I undorstood that to make the model train faster is to change the parameters of anchor_generator for example, ...
-3
votes
0answers
11 views

Blocking data on my iPhone [closed]

BLOCKING_ENABLED=true PIHOLE_INTERFACE=eth0 IPV4_ADDRESS=10.8.0.1/24 IPV6_ADDRESS= QUERY_LOGGING=true INSTALL_WEB_SERVER=true INSTALL_WEB_INTERFACE=true LIGHTTPD_ENABLED=true DNSMASQ_LISTENING=local ...
-1
votes
1answer
13 views

how do I predict the next's alarms ? (time series categorical variables)

I'm trying to solve a time series forecasting problem, where the main goal is to read data with various alarm logs and make a prediction about what may happen in the future. Specifically, my data is a ...
-1
votes
0answers
10 views

Tuning recall and precision for neural network

I have a multi-class classification neural network. After applying softmax to the last layer, I pick the class with the max value. My question is Like it is possible to tune the recall and precision ...
1
vote
1answer
16 views

Dealing with highly variable feature set size

I'm trying to use machine learning for security event classification. My goal is to predict the outcome (true positive or false positive) of a specific event. An event has a set of variables in it, ...
0
votes
0answers
15 views

From Labels to Graph: what machine learning approaches to use?

I want to drive from Seattle to San Francisco, and I've some time for sightseeing: what route should I choose to eat nice food and on my way, see some beautiful sides? I would model the world as a ...
0
votes
0answers
11 views

What parameters does the model learn in object classification?

In the case of object classification, what parameters do we learn from training examples? Do we learn mean and standard deviation? Let's say if I had 50 images with ground truth bounding boxes and ...
0
votes
0answers
12 views

NLP :Web Scrapping “News Articles” from financial website that included “MSFT” and “IBM” [closed]

I am planning to use BeautifulSoup to extract articles where the keyword "Microsoft" or "IBM" is mentioned. Preferred websites are: Google News Bloomberg New York Times Yahoo News ...
0
votes
0answers
12 views

Data system that manages aggregates over time intervals

I am looking to know if there is a data system that handles the following use case. To keep it simple, the data is a set of homogeneous enties E. E contains named numeric properties that the app code ...
0
votes
0answers
10 views

How is an ASR's output compared to ground truth for validation?

I am curious how it is done as I am interested in doing something similar. I have some manually transcribed data that contains tags for multiple speakers. I want to compare how well the out of the box ...
1
vote
1answer
9 views

Effect of weights on the Louvain communities detected

The Louvain method for community detection aims to optimize modularity and hence detect communities in the given graph. In case of a weighted graph would it be valid to assume that an edge with a ...
-1
votes
0answers
10 views

Make my Two Different R Functions to be Just One Function [closed]

I want to use MonteCarlo function in MonteCarlo package in R which has one requirement among ...
-1
votes
0answers
8 views

Read in file from Sharepoint folder on a given time (using Python) [closed]

I have a folder that lives within a sharepoint drive url. I wish to automatically extract a certain file, df, within this folder and import this file using Python. Desired Result: To schedule a 'job' ...
0
votes
1answer
14 views

How is calculated the error with multiple output neurons in neural network?

Machine Learning books generally explains that the error calculated for a given sample $i$ is: $e_i = y_i - \hat{y_i}$ Where $\hat{y}$ is the target output and $y$ is the actual output given by the ...
0
votes
0answers
9 views

How to find the slope of the parallel best fit lines for multiple groups of data? [closed]

Suppose we have k groups of points located closely to k lines. These k lines are parallel to each other. How can we estimate the slope of these parallel fit lines? Here talks about the case when k = 1,...
0
votes
1answer
29 views

Custom loss function with both min(y, p) and max(y,p)

I'm creating a neural network in tensorflow and need to minimize the following loss function: $\frac{max(y,p)}{min(y,p)}$ Where $y$ represents the true value and $p$ the predicted value. Since the ...
4
votes
2answers
43 views

How can data science teams inside businesses measure costs and efficiency of their technical work?

How can data science teams measure and improve costs of their technical work, when they often don't know the monetary value of the datasets and insights they are producing? Are they using industry ...
0
votes
1answer
18 views

Item-to-Item recommendation using DNN

I am new to DNN still learning, have a need to build item-to-item content based recommendation using DNN. For example, say I have a column of strings where each row represents a document I need to ...
-1
votes
0answers
9 views

How to get all values for a specific entry collected along with time?

I have a table that has information about specific events. Say I have a list of people, Andrew, John, Mary, who may do different actions during the day at specific times. My table then looks like: <...
0
votes
1answer
15 views

Scaling of variables considering the values of a single column or the whole dataset

I read many time that for machine learning and data mining algorithms the multi-dimensional input data should be scaled (e.g. normalized or standardized). Now my question is whether the average, min ...
0
votes
0answers
10 views

Risk analysis on the uptime of web applications (classification? survival analysis?)

I've conducted a couple studies examining how "risky" several web applications are based on whether the respective support teams raise a major incident ticket. The data we have includes the ...
0
votes
0answers
8 views

Face matching using VGGFace library keras

I am working on face matching model (matching between id-card faces and selfies), where I am using the resnet50 pre-trained model from ...
0
votes
0answers
9 views

Epochs and other hyperparameters in Deep Q-Networks

I was wondering about hyperparameters used in Deep Q-Networks. Considering the use of replay memory and target network, together with the epsilon-greedy policy, are the number of epochs different of 1 ...
0
votes
0answers
7 views

Does the Context Vector consist of hidden state and Cell State or just the hidden state?

LSTM's carry a hidden state and a cell state with them. Now, in a standard encoder-decoder model, we pass the Context Vector from the encoder to the decoder. Does, this Context Vector consist of just ...
0
votes
1answer
23 views

I want to run PCA on a data set that will be aggregated by country. Should I aggregate the data before or after I standardize the data, and why?

Basically the title asks my question. I have the results of a survey that was filled out by people from different countries. I have been asked to analyze the data using PCA and see what findings I can ...
-1
votes
1answer
17 views

Where can I find China's sales of electric cars in the last 10 years? [closed]

I have to do an Econometrics project about the sales of electric cars in China in the last 10 years by finding a possible relation between the level of pollution and the oil price.
1
vote
0answers
20 views

How to apply pruning on a BERT model?

I have trained a BERT model using ktrain (tensorflow wrapper) to recognize emotion on text, it works but it suffers from really slow inference. That makes my model not suitable for a production ...
0
votes
0answers
10 views

Drowsiness Detection issue understanding LSTM input shape

I’ve difficulty in understanding LSTM input shape. For example. I’ve 2 videos out of these 1 is categorized as Awake (0) and 1 as Drowsy (1). I preprocessed them to extract Eye Aspect Ratio and Mouth ...
1
vote
3answers
35 views

Time series classification, without the time dimension

Edit Thanks to the answer of @pcko1, I understand that I should use data augmentation to make my model resilient to order of data points. Clarification after the answer of @Icrmorin : My problem is ...
-1
votes
0answers
12 views

How to desplay changes over time in aerial images as heatmap? [closed]

I have number of aerial/satellite images of a forest taken over 10 years. I wanted to create a heatmap of changes over time of the area. I was able to find tools to create diff between 2 images, but ...
0
votes
1answer
23 views

How to choose between Tensorflow and Pytorch?

Recently I've been working on a pretty vanilla ANN model in Python with sklearn (and its preprocessing pipeline), mostly in jupyterhub notebooks if that matters. I am considering changing the ...
0
votes
1answer
8 views

Encoding of high cardinality multi-label categorical feature?

This is the problem of binary classification: "1" - the subscriber is a driver (belongs to the segment of drivers), "0" - the subscriber is not a driver (does not belong to the ...
0
votes
0answers
11 views

KL divergence for exponential family distribution

In reinforcement learning, normal distribution is commonly used for continuous actions. I'm checking Pytorch's implementation for KL divergence between two normal distributions. I know it's impossible ...
2
votes
2answers
23 views

Why is large decision tree likely to overfit

My lecture slide told me that if we don't prune the regression tree, then the tree likely to over-fit. So, I wonder why would that happen? Is that because if the tree grows too large, we would end up ...
0
votes
0answers
3 views

How to specify scale_pos_weight value at runtime in Hyperopt?

I want to use LighgbmClassifier for a binary Classification. for Hyper Parameter tuning I want to use Hyperopt. The Dataset is imbalanced. Using Sklearns class_weight.compute_class_weight as shown ...
0
votes
0answers
16 views

Anomaly detection model on 1D data but not Gaussian distribution

I have a scenario that I have one-dimensional data and the distribution of the data is not Gaussian. (more like a bimodal distribution). I want to find an anomaly detection model that could predict ...
1
vote
1answer
18 views

Why does reducing the n_estimators in RandomForestClassifier improve accuracy? [closed]

I am taking a course that introduced me to sklearn.ensemble.RandomForestClassifier. At first it uses n_estimators with the default value of 10 and the resulting ...
-1
votes
0answers
22 views

good combination of courses [closed]

I have started a project to find out good combination of courses. I have a dataset containing studentid, courses taken, grade for the course and final gpa. I am thinking, to get the students who have ...
2
votes
0answers
13 views

Object detection model's performance jumping up and down

I am training a model to detect buildings from satellite images in rural Africa. For labels, I use OpenStreetMap geometries. I use the Tensorflow Object Detection API and SSD Inception V2 as a model. ...
-1
votes
0answers
24 views

Combining Satellite Data of Different Resolutions [closed]

I have precipitation satellite data of different resolutions: one is a 4.5 square kilometers and the other is 10 square kilometers. What would be a sufficient way to combine the two for further ...
2
votes
2answers
51 views

Loading collections of datasets - Python code examples

Sometimes you might want to check your ideas on multiple datasets. There are several places with datasets collections. Question: Please share some Python scripts how to download multiple datasets from ...
3
votes
1answer
48 views

What does n means in neural network neuron output?

I've found this equation that explains the output of a neuron in a MLP network: $y(n) = f(\mathbf{w}^T \mathbf{x}(n) + b)$ I can understand the general context, but since i have no background with ...
2
votes
1answer
27 views

what does the standard deviation plot around my learning curve indicate?

I plotted a learning curve below. There is a thick red band around the top portion of my training score. Why is it so high at the beginning? Below is a snippet of the code used: ...
2
votes
1answer
15 views

Does the output of the Sequence-to-Sequence encoder model exist in the same semantic space as the inputs (Word2vec)? [closed]

Does the output generated from the LSTM encoder module exist in the same semantic space as the original word vectors? If so, say for example we have a sentence and we pass it through the encoder to ...
1
vote
1answer
22 views

how print f1-score with scikit´s accuracy_score or accuracy of confusion_matrix?

I would like to print the f1-score. I got confused about the wording f1-accuracy score and accuracy score. What is the difference of these 2 scikit-learn metrics and how can I print the f1-score out ...
-1
votes
0answers
25 views

Paragraph detection Techniques [closed]

I am applying OCR on pdf documents and later processing the content of them. I am having problems when trying to split into paragraphs: normally, one "\n" means an end of line while "\n\...
0
votes
1answer
39 views

Softmax regression cost function code [closed]

I really do not understand what does this code do M = sparse.coo_matrix(([1]*n, (Y, range(n))), shape=(k,n)).toarray() The code is related to calculating the ...
-2
votes
0answers
10 views

AttributeError: 'numpy.ndarray' object has no attribute 'predict and having some warnings [closed]

from sklearn.metrics import confusion_matrix for i in range(len(model)): print('Model',i) cm=confusion_matrix(Y_test,model[i].predict(X_test)) TP=cm[0][0] TN=cm[1][1] FN=cm[1][0] FP=cm[0][...

15 30 50 per page
1
2 3 4 5
527