All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
21 views

Network Explorer - twitter data. Missing links

I've just extracted data from the twitter widget in Orange (with my private API etc) and I'm trying to visualize it with the Network Explorer - precisely like in the Youtube tutorial Text Mining: ...
0
votes
0answers
18 views

Pandas read_html with multiple charts from a website is there a way to see a preview in a pairplot-like form? [closed]

Looking for assistance to basically allow me to view multiple website charts in one line of code (preferably). Similar to what is produced with sns.pairplot in Seaborn. For example, if I pulled chart ...
1
vote
0answers
17 views

How to balance time/effort with transformations, feature selection, and models efficacy in nlp? [closed]

Being to new text analytics, I haven't gotten the hang of navigating a typical workflow given the longer times associated with the larger feature sets. My question then is how does one navigate ...
0
votes
0answers
8 views

Ideal framing of data from LSTM + adding static features

I'm dealing with a problem that I'll try to simplify here : You have a land where you can plant seeds and water them. On each day, you have the total area being watered and you have area that has just ...
-1
votes
0answers
15 views

Relu activation in neural networks just a linear regression [closed]

If we use just relu activation function to define a neural network, and expand it to write it in the form of an equation like Z=f1(x1)+f2(x2)....fn(xn), we simply get a linear equation even if we ...
-1
votes
0answers
6 views

How do I open a database in Hive & find the structure of all the tables in it? [closed]

"show databases;" list database A & B. How do I list all the tables in database A and B, and do an equivalent of HEAD of all the tables in database A and B?
0
votes
0answers
10 views

copying columns from one excel file to a created wb using pandas [closed]

I'm trying to copy columns from one excel file and paste them to a created workbook in python using pandas. I created a function that creates the wb (wb doesn't have a name yet) and names the sheet. ...
1
vote
1answer
19 views

Deep learning on cloud

I am trying to implement some deep learning models with large amount of data around 10gigabyte. Although, my Laptop and Collab-free crashes when it tries to load them. Do you think it worths to buy ...
-1
votes
1answer
18 views

How can I fix this problem? [closed]

convert_counts <- function(x) { x <- ifelse(x > 0, 1, 0) ...
-1
votes
0answers
19 views

how to measure if cosine similarity is relatively high [closed]

I'm trying to explain part of my recommendations based on item similarity. I have a trained model based on Item-Item cosine similarity that performs well. I'm trying to measure how much Item ItemA is ...
-1
votes
0answers
9 views

Machine learning model for sales guidance [closed]

I want to build an ML-based sales guidance. I have all the incoming leads and phone/email actions when someone has called the lead is there an incoming call when someone has sent an email to the lead ...
0
votes
0answers
15 views

Recalculation the cluster centroids

I tried to cluster data points by k-medoids where k-centroids/medoids are randomly picked from (X), how those centroids are recalculated when there are some clusters changing by the updating x1? ...
0
votes
1answer
32 views

model.predict() accuracy extremely low on training dataset

This question is similar to this. I'm new to ML, and I am trying to classify breast cancer histology images using EfficientNets with Transfer Learning. The dataset is small (400 images in total - ...
0
votes
0answers
16 views

*(CATEGORIES[int(prediction[0][0])])* giving me different result for single image prediction from saved model

From a saved model, I am trying to predict a single image. I followed this code - https://www.youtube.com/watch?v=A4K6D_gx2Iw I am getting different result for two different command- ...
0
votes
0answers
16 views

CNN image classifier has poor accuracy - is this insufficient data, bad data or a bad model? [closed]

I'm new to keras and python and am trying to train a CNN to classify images of cells as cancerous or not. I started with an online tutorial for classifying the CIFAR-10 dataset, then tweaked the code ...
0
votes
0answers
11 views

Firebase AB testing. What does it means -85% to +247%? [closed]

I am running a Firebase AB testing experiment on my Android app to test a new subscription screen. I don't have much experience with Firebase. The image below is the summary I am getting from them. I ...
0
votes
0answers
4 views

What magnitude to use for sample_weight in keras.fit() for skewed datasets?

I've got a skewed dataset, but I want to keep it that way: don't want to log-scale/normalize, instead I want the network to generalize to the tail, but predict the outliers accurately. I'm using ...
0
votes
0answers
11 views

Matching financial reconciliation data / matching multiple rows based on column values

I'm working with financial reconciliation data and the ask is to train the algorithm to match transactions (that are otherwise manually matched if the existing application didn't because not all the ...
2
votes
1answer
82 views

What does this formula in Glorot & Bengio mean?

In this paper, on page 5, we find the formula $$Var(z^i)=Var(x)\prod_{i'=0}^{i-1}n_{i'}Var(W^{i'})$$ I am really struggling to understand what is meant by this formula. I think at least some of the ...
2
votes
0answers
17 views

Resource-unintensive (low complexity) methods for large-scale unsupervised clustering?

I'm working on an issue where I need to cluster user types on a scale in an unsupervised manner. I've been looking at the basics like KNN and K-means etc., but I found it hard to scale, as these ...
1
vote
1answer
22 views

How do I deal with additional input information other than images in a convolutional neural network?

I try to convert a game state of a board game into the input for a convolutional neural network. A convolutional neural network is useful because the players have to place items on the board, and the ...
-1
votes
0answers
10 views

Manifold vs Kernel [closed]

I'm currently reading Pattern Recognition and Machine Learning. I'm trying to get a good grasp on the differencs between a kernel and a manifold. I've read three papers outside of this book and it ...
-3
votes
0answers
19 views

How to decide number of trees for Adaboost [closed]

It is generally said that the number of parameters of your models should be far less than the training set else there will be "curve-fitting". Should i limit the number of trees/iterations ...
0
votes
0answers
16 views

Normalizing validation set in DL Model [closed]

I created a DL model for image segmentation. I normalized my training and test set by dividing them by 255.0. I then run predictions in new images (validation Set). However, I forgot to normalize them ...
-2
votes
2answers
36 views

Does data science literacy still important when there are many cloud solutions already? [closed]

This problem has troubled me for quite a while and I would like to listen to experienced data scientist/machine learning engineers for their opinions. While there have been many useful APIs already ...
0
votes
1answer
33 views

Correctness of a ROC Curve

I've built a Decision Tree Classifier to practice with the sklearn library. My first task was to shuffle the iris dataset and split it keeping only the last 10 elements for the test. Then, after the ...
-2
votes
0answers
14 views

Best chatbot dataset to achieve siri-like performance [closed]

What is one of the best chatbot data available, to achieve siri-like performance, or close to siri-like performance? And even if there is no such data available, then what is the best chatbot data for ...
0
votes
1answer
10 views

Using KNeighborRegression to predict weights in a 2D coordinate space (X,Y)? [closed]

I am using KNeighborRegressors in Scikit Learn for Python to figure out weights value for a specific coordinate. The data set I am using consists of X and Y coordinate and a weightage value at each of ...
-2
votes
0answers
19 views

How to use the SGD chatbot data? [closed]

This is the SGD dataset: here Here, when I open a .json file, I can't understand how to use it as a chatbot What would be the inputs and the expected outputs to my model?
0
votes
0answers
9 views

Keras is adding dimension to shape

When I create an InputLayer, a None dimension gets added. I don't know why this is. ...
1
vote
1answer
21 views

How do I use the data I have to make predictions? [closed]

I've a set of CPUs (~100). I've the results of each CPU being benchmarked against a suite of benchmarks (~8). There is a specific task that interests me, and I need to find the optimal CPU for that ...
-2
votes
1answer
23 views

How to achieve better accuracy of 90+ on a 3 class highly skewed dataset?

I have a 3 class dataset with very high imbalance classes: class 1: 75000 class 2: 27000 class 3: 3000 With simple learning algorithms, accuracy is ...
-1
votes
0answers
24 views

Applying association rules for recommendation [closed]

How do we choose which association rules to apply for recommending items to future buyers? For instance, let's say that we have ${x_1, x_2, .... x_n}$ items and we have generated 20 rules for these ...
0
votes
0answers
9 views

Dropping Missing Observations under MAR Assumption

Some of the outcome data in my data set are missing. I believe that the missing data mechanism is missing at random (MAR) as the observed characteristics significantly differ between the missing and ...
1
vote
0answers
16 views

What does it mean to say convolution implementation is based on GEMM (matrix multiply) or it is based on 1x1 kernels?

I have been trying to understand (but miserably failing) how convolutions on images (with height, width, channels) are implemented in software. I've heard people say their convolution implementation ...
0
votes
1answer
18 views

How to explain MAE/MSE at each node of decision tree for regression in sklearn python? [closed]

If the mean value at any node is 60 and MSE = 169 so RMSE is 13. Can I conclude that the error at my node is 60 +-13 i.e my values in this particular sample split ranges from 60-13 to 60+13. If not , ...
-1
votes
0answers
8 views

unhashable type 'numpy.ndarray' [closed]

I'm testing my code, which works perfectly with a smaller set of data (two columns: 1st is Date, 2nd values). I use the same formatting with the new data and the only differences I can discern at the ...
0
votes
1answer
14 views

loss function of autoencoders

I am trying to understand the loss function of autoencoders. I think the loss function of the decoder is to compare the input image with the decoded image, tell me if I am correct. but I don't ...
0
votes
1answer
24 views

Training Object Detection model on just 10 images

I am trying to train an object detection model using Mask-RCNN with Resnet50 as backbone. I am using the pre-trained models from PyTorch's Torchvision library. I have only 10 images that I can use to ...
1
vote
0answers
14 views

Modeling count data with time-dependent rate

For processes of discrete events occurring in continuous time with time-independent rate, we can use count models like Poisson or Negative Binomial. For discrete events that can occur once per sample ...
1
vote
0answers
24 views

How to control for Co-variate shift in test data set compared to train data for regression task?

I am working on a regression project. But I am facing the problem of covariate shift in features due to time delay.Test data was collected a year later due to which there has been some change in ...
1
vote
0answers
17 views

Compare ranking across trials with pandas

I am carrying out several runs of an experiment with different configurations on many different inputs. The experiment has a random element and I'm trying to investigate whether this randomness ...
-1
votes
2answers
41 views

How to deal with nan values after merging / joining two dataframes? [closed]

A lot of time after merging two pandas dataframes, I end up with NaNs in the new dataframe, that's just how the way it is, because one csv does not have all the ID's that the other has (Two dataframes ...
1
vote
0answers
14 views

NLP Bert model to to calculate text similarity, same sentence but not close similarity

Dear expert here: I have a simple program to calculate text similarity. The program is copied from internet. Initially, I have a list of sentences or stored in db and fetched from db, then I make the ...
-1
votes
0answers
17 views

Balance in Training set for Text classification [closed]

I am trying right now to find out how much posts on stack overflow are security related with NLP. For this I have a set of 5000 labeled secure related Posts. I have a set of 50k non security related ...
0
votes
0answers
6 views

Recurrent events analysis software (python) [closed]

I am looking for python packages suitable for analysis of recurrent events, preferably in the framework of non-linear Cox regression (which likely implies deep learning). Alternatively, tips for ...
-2
votes
1answer
18 views

how can i show entire rows by searching column value in panda dataframe [closed]

df_test = pd.read_csv("register_10") type(df_test) <panda.series.data.frame> df_test i want show entire row by ...
0
votes
0answers
17 views

Multiclass ROC Curve using DecisionTreeClassifier

I built a DecisionTreeClassifier with custom parameters to try to understand what happens modifying them and how the final model classifies the instances of the iris dataset. Now My task is to create ...
-1
votes
0answers
7 views

Platform to detect mistakes [closed]

I am a mathematics teacher and I wish to build a platform to detect mistakes in handwritten solutions and mathematical diagrams. Is it possible? Please help me.
2
votes
2answers
30 views

What is the next step after k fold CV?

I came across this video lecture https://www.youtube.com/watch?v=wjILv3-UGM8 on k fold cross validation (CV). The algorithm given in the video lecture is presented below: for k = 1:5 train on all ...

15 30 50 per page