# All Questions

26,338 questions
Filter by
Sorted by
Tagged with
21 views

I've just extracted data from the twitter widget in Orange (with my private API etc) and I'm trying to visualize it with the Network Explorer - precisely like in the Youtube tutorial Text Mining: ...
18 views

### Pandas read_html with multiple charts from a website is there a way to see a preview in a pairplot-like form? [closed]

Looking for assistance to basically allow me to view multiple website charts in one line of code (preferably). Similar to what is produced with sns.pairplot in Seaborn. For example, if I pulled chart ...
17 views

### How to balance time/effort with transformations, feature selection, and models efficacy in nlp? [closed]

Being to new text analytics, I haven't gotten the hang of navigating a typical workflow given the longer times associated with the larger feature sets. My question then is how does one navigate ...
8 views

### Ideal framing of data from LSTM + adding static features

I'm dealing with a problem that I'll try to simplify here : You have a land where you can plant seeds and water them. On each day, you have the total area being watered and you have area that has just ...
15 views

### Relu activation in neural networks just a linear regression [closed]

If we use just relu activation function to define a neural network, and expand it to write it in the form of an equation like Z=f1(x1)+f2(x2)....fn(xn), we simply get a linear equation even if we ...
6 views

### How do I open a database in Hive & find the structure of all the tables in it? [closed]

"show databases;" list database A & B. How do I list all the tables in database A and B, and do an equivalent of HEAD of all the tables in database A and B?
10 views

### copying columns from one excel file to a created wb using pandas [closed]

I'm trying to copy columns from one excel file and paste them to a created workbook in python using pandas. I created a function that creates the wb (wb doesn't have a name yet) and names the sheet. ...
19 views

### Deep learning on cloud

I am trying to implement some deep learning models with large amount of data around 10gigabyte. Although, my Laptop and Collab-free crashes when it tries to load them. Do you think it worths to buy ...
18 views

### How can I fix this problem? [closed]

convert_counts <- function(x) { x <- ifelse(x > 0, 1, 0) ...
19 views

### how to measure if cosine similarity is relatively high [closed]

I'm trying to explain part of my recommendations based on item similarity. I have a trained model based on Item-Item cosine similarity that performs well. I'm trying to measure how much Item ItemA is ...
9 views

### Machine learning model for sales guidance [closed]

I want to build an ML-based sales guidance. I have all the incoming leads and phone/email actions when someone has called the lead is there an incoming call when someone has sent an email to the lead ...
15 views

### Recalculation the cluster centroids

I tried to cluster data points by k-medoids where k-centroids/medoids are randomly picked from (X), how those centroids are recalculated when there are some clusters changing by the updating x1? ...
32 views

### model.predict() accuracy extremely low on training dataset

This question is similar to this. I'm new to ML, and I am trying to classify breast cancer histology images using EfficientNets with Transfer Learning. The dataset is small (400 images in total - ...
16 views

### *(CATEGORIES[int(prediction[0][0])])* giving me different result for single image prediction from saved model

From a saved model, I am trying to predict a single image. I followed this code - https://www.youtube.com/watch?v=A4K6D_gx2Iw I am getting different result for two different command- ...
16 views

### CNN image classifier has poor accuracy - is this insufficient data, bad data or a bad model? [closed]

I'm new to keras and python and am trying to train a CNN to classify images of cells as cancerous or not. I started with an online tutorial for classifying the CIFAR-10 dataset, then tweaked the code ...
11 views

### Firebase AB testing. What does it means -85% to +247%? [closed]

I am running a Firebase AB testing experiment on my Android app to test a new subscription screen. I don't have much experience with Firebase. The image below is the summary I am getting from them. I ...
4 views

### What magnitude to use for sample_weight in keras.fit() for skewed datasets?

I've got a skewed dataset, but I want to keep it that way: don't want to log-scale/normalize, instead I want the network to generalize to the tail, but predict the outliers accurately. I'm using ...
11 views

### Matching financial reconciliation data / matching multiple rows based on column values

I'm working with financial reconciliation data and the ask is to train the algorithm to match transactions (that are otherwise manually matched if the existing application didn't because not all the ...
82 views

### What does this formula in Glorot & Bengio mean?

In this paper, on page 5, we find the formula $$Var(z^i)=Var(x)\prod_{i'=0}^{i-1}n_{i'}Var(W^{i'})$$ I am really struggling to understand what is meant by this formula. I think at least some of the ...
17 views

### Resource-unintensive (low complexity) methods for large-scale unsupervised clustering?

I'm working on an issue where I need to cluster user types on a scale in an unsupervised manner. I've been looking at the basics like KNN and K-means etc., but I found it hard to scale, as these ...
22 views

### How do I deal with additional input information other than images in a convolutional neural network?

I try to convert a game state of a board game into the input for a convolutional neural network. A convolutional neural network is useful because the players have to place items on the board, and the ...
10 views

### Manifold vs Kernel [closed]

I'm currently reading Pattern Recognition and Machine Learning. I'm trying to get a good grasp on the differencs between a kernel and a manifold. I've read three papers outside of this book and it ...
19 views

### How to decide number of trees for Adaboost [closed]

It is generally said that the number of parameters of your models should be far less than the training set else there will be "curve-fitting". Should i limit the number of trees/iterations ...
16 views

### Normalizing validation set in DL Model [closed]

I created a DL model for image segmentation. I normalized my training and test set by dividing them by 255.0. I then run predictions in new images (validation Set). However, I forgot to normalize them ...
36 views

### Does data science literacy still important when there are many cloud solutions already? [closed]

This problem has troubled me for quite a while and I would like to listen to experienced data scientist/machine learning engineers for their opinions. While there have been many useful APIs already ...
33 views

### Correctness of a ROC Curve

I've built a Decision Tree Classifier to practice with the sklearn library. My first task was to shuffle the iris dataset and split it keeping only the last 10 elements for the test. Then, after the ...
14 views

### Best chatbot dataset to achieve siri-like performance [closed]

What is one of the best chatbot data available, to achieve siri-like performance, or close to siri-like performance? And even if there is no such data available, then what is the best chatbot data for ...
10 views

### Using KNeighborRegression to predict weights in a 2D coordinate space (X,Y)? [closed]

I am using KNeighborRegressors in Scikit Learn for Python to figure out weights value for a specific coordinate. The data set I am using consists of X and Y coordinate and a weightage value at each of ...
19 views

### How to use the SGD chatbot data? [closed]

This is the SGD dataset: here Here, when I open a .json file, I can't understand how to use it as a chatbot What would be the inputs and the expected outputs to my model?
9 views

### Keras is adding dimension to shape

When I create an InputLayer, a None dimension gets added. I don't know why this is. ...
21 views

### How do I use the data I have to make predictions? [closed]

I've a set of CPUs (~100). I've the results of each CPU being benchmarked against a suite of benchmarks (~8). There is a specific task that interests me, and I need to find the optimal CPU for that ...
23 views

### How to achieve better accuracy of 90+ on a 3 class highly skewed dataset?

I have a 3 class dataset with very high imbalance classes: class 1: 75000 class 2: 27000 class 3: 3000 With simple learning algorithms, accuracy is ...
24 views

### Applying association rules for recommendation [closed]

How do we choose which association rules to apply for recommending items to future buyers? For instance, let's say that we have ${x_1, x_2, .... x_n}$ items and we have generated 20 rules for these ...
9 views

### Dropping Missing Observations under MAR Assumption

Some of the outcome data in my data set are missing. I believe that the missing data mechanism is missing at random (MAR) as the observed characteristics significantly differ between the missing and ...
16 views

### What does it mean to say convolution implementation is based on GEMM (matrix multiply) or it is based on 1x1 kernels?

I have been trying to understand (but miserably failing) how convolutions on images (with height, width, channels) are implemented in software. I've heard people say their convolution implementation ...
18 views

### How to explain MAE/MSE at each node of decision tree for regression in sklearn python? [closed]

If the mean value at any node is 60 and MSE = 169 so RMSE is 13. Can I conclude that the error at my node is 60 +-13 i.e my values in this particular sample split ranges from 60-13 to 60+13. If not , ...
8 views

### unhashable type 'numpy.ndarray' [closed]

I'm testing my code, which works perfectly with a smaller set of data (two columns: 1st is Date, 2nd values). I use the same formatting with the new data and the only differences I can discern at the ...
14 views

### loss function of autoencoders

I am trying to understand the loss function of autoencoders. I think the loss function of the decoder is to compare the input image with the decoded image, tell me if I am correct. but I don't ...
24 views

### Training Object Detection model on just 10 images

I am trying to train an object detection model using Mask-RCNN with Resnet50 as backbone. I am using the pre-trained models from PyTorch's Torchvision library. I have only 10 images that I can use to ...
14 views

### Modeling count data with time-dependent rate

For processes of discrete events occurring in continuous time with time-independent rate, we can use count models like Poisson or Negative Binomial. For discrete events that can occur once per sample ...
24 views

### How to control for Co-variate shift in test data set compared to train data for regression task?

I am working on a regression project. But I am facing the problem of covariate shift in features due to time delay.Test data was collected a year later due to which there has been some change in ...
17 views

### Compare ranking across trials with pandas

I am carrying out several runs of an experiment with different configurations on many different inputs. The experiment has a random element and I'm trying to investigate whether this randomness ...
41 views

### How to deal with nan values after merging / joining two dataframes? [closed]

A lot of time after merging two pandas dataframes, I end up with NaNs in the new dataframe, that's just how the way it is, because one csv does not have all the ID's that the other has (Two dataframes ...
14 views

### NLP Bert model to to calculate text similarity, same sentence but not close similarity

Dear expert here: I have a simple program to calculate text similarity. The program is copied from internet. Initially, I have a list of sentences or stored in db and fetched from db, then I make the ...
17 views

### Balance in Training set for Text classification [closed]

I am trying right now to find out how much posts on stack overflow are security related with NLP. For this I have a set of 5000 labeled secure related Posts. I have a set of 50k non security related ...
6 views

### Recurrent events analysis software (python) [closed]

I am looking for python packages suitable for analysis of recurrent events, preferably in the framework of non-linear Cox regression (which likely implies deep learning). Alternatively, tips for ...
18 views

### how can i show entire rows by searching column value in panda dataframe [closed]

df_test = pd.read_csv("register_10") type(df_test) <panda.series.data.frame> df_test i want show entire row by ...
17 views

### Multiclass ROC Curve using DecisionTreeClassifier

I built a DecisionTreeClassifier with custom parameters to try to understand what happens modifying them and how the final model classifies the instances of the iris dataset. Now My task is to create ...