Questions tagged [visualization]
Constructing meaningful and useful graphical representations of data. (If your question is only about how to get particular software to produce a specific effect, then it is likely not on topic here.)
685
questions
0
votes
0
answers
6
views
What do the areas under the graphs in a `kdeplot` mean when several graphs are drawn simultaneously from the same dataframe?
Suppose I have a dataframe documenting the offering prices in USD of a certain product in a certain market at a certain time. The product is manufactured by one of two manufacturers: ...
- 101
0
votes
0
answers
10
views
Visualizing three parameters dataset, in which parameters are sub-group of one another
I am trying to represent air quality for zones within a city. Initially, based on various factors zones were classified into four exposure categories (1,2,3,4).Those four categories were further sub-...
- 101
0
votes
1
answer
25
views
What are the different ways of Visualizing Textual Data?
I've recently scraped some textual data from the web and after removing stop-words and punctuations/symbols etc. created a WordCloud to get the most frequent words. ...
- 15
0
votes
0
answers
9
views
Can a location be derived from a compilation of paintings?
I have added a link to the collected paintings that were put into a video below.
I apologize for the quality, I had to gif and reduce it to fit here. (The SE team may consider increasing the size ...
- 101
0
votes
0
answers
11
views
(Apparently) Inconsistent Results Between Visual Patterns and Chi-Square Test in Categorical Data Analysis
I'm stuck while working on a categorical data analysis project and would appreciate any insight.
Here are the first 4 rows of the dataset:
successful_upload
feat_1
feat_2
0
T>2
<\$10K
1
0.5&...
0
votes
2
answers
18
views
Unfamiliar aspect on box plot
I am learning python and I am practicing with a project using a dataset. I created a box plot using seaborn's catplot only using the arguments data,x,y,and kind. There is something on the box plot (...
0
votes
0
answers
14
views
How to best visualize feature-label combinations as a tree/chart/table?
Given different combinations of four feature, a, b, c, d, we can get different different sets of labels from a fixed label set ...
- 2,340
0
votes
1
answer
41
views
Proper visualization of a metric per all subsets of a set
I've been working with a set of few neural networks, and building bigger models by selecting a subset and combining them. I haven't been able to find a proper way to visualize the quality(value of ...
- 115
0
votes
1
answer
29
views
Better understand the scatter plots
I'm trying to understand how to read a scatter plot based on the results of my confusion matrix. This is the CM:
I saw an high correlation between column 5 and column 6, a low correlation with column ...
- 59
0
votes
1
answer
23
views
Visualizing correlation between hyper-parameters and metrics for Neural Network
I am working with a neural network and I want to investigate how different settings affect the loss and standard deviation of the network. I can change various parameters such as the loss function, ...
- 101
0
votes
0
answers
20
views
Statistical approach for comparing ranks
I'm looking for a statistical approach to compare ranks produced by 2 versions of an ranking algorithm (A & B) against the actual ranks in the system. This is about ranking hospitals and the ...
- 101
0
votes
1
answer
27
views
How to visualize a changing distribution overtime, given non-uniformly sampled data with timestamps
Assume that there is a bernoulli distribution whose probability is unknown to us and may occasionally change.
What we have on hand are non-uniformly sample results (0/1) with timestamp information.
...
- 1
0
votes
1
answer
24
views
How do I interpret low dimentional embeddings of high dimentional embeddings?
I am trying to understand what I am supposed to learn about a problem when using dimensionality reduction methods. In particular, I am referring to methods like t-SNE and UMAP.
For the most part I am ...
- 111
0
votes
1
answer
33
views
Analysing 1GB of 200K of data rows having 50 columns
Total Newbie question here :
5 years ago, I wrote a web application in LAMP stack not using a framework, targeting end users, which now has over 200,000 rows where each row has 50+ columns and the ...
- 103
0
votes
1
answer
130
views
How do I prevent ConfusionMatrixDisplay.from_predictions from showing the plot?
ConfusionMatrixDisplay docs say:
It is recommend to use from_estimator or from_predictions ...
- 103
1
vote
1
answer
33
views
When visualizing graph nodes, should I use apply PCA to node2vec embedding?
I am trying to visualize graph nodes using node2vec embedding.
The node2vec embeddings has lengths of 50~100 dimensions.
I have two plans:
use umap to project node2vec embeddings to 2D space
use PCA ...
- 11
0
votes
2
answers
72
views
How to create a plot of specific row with every column using python and which package to choose matplotlib or seaborn?
I'm trying to create a plot for the ranking of each country from 2002 to 2023. I created this dataset by loading each csv file from the respective years, which contains the Countries and Ranking ...
4
votes
2
answers
348
views
How can I relatively compare these box plots?
I have the following box plots, which compares the time diffs. The data is collected from two different devices, which measure accelerometer data. I have done this analysis to compare the sampling ...
- 43
0
votes
0
answers
34
views
Media Mix Modeling: testing LightMMM or Robyn on specific dataset rather than ongoing basis
I'm currently scoping ideas for a student project in data analytics and wanted to build this around Media Mix Modeling through either LightMMM (in Python, unofficial Google library) or Robyn (in R, by ...
- 101
2
votes
1
answer
70
views
How to improve the preservation of the global data structure in UMAP?
I have a dataset, where the features are comprised of points arranged in a regular grid on a simplex. Each of these points are defined as follows: A point $\mathbf{x}$ on the simplex can be ...
- 121
0
votes
0
answers
21
views
Can TSNE and other visualisation methods separate multivariate normal blobs?
Consider we have two classes of points. Both of them come from a multivariate normal distribution with an unrestricted covariance matrix.
Let's assume, that the densities of those distributions do not ...
0
votes
0
answers
20
views
classification with rejection and how to interpret a 2D ambiguous data
Let's say we're going to train a classifier with the full data set. There's also a reject logic for ambiguous regions in the data. So, at the end, the final system outputs reject or 0 or 1. That is, ...
- 111
0
votes
1
answer
149
views
Dimension reduction of Word Embeddings: PCA vs. TSNE
I am pretty new to DS. I have a general question regarding the limitations of visualizing word embeddings using PCA.
I've learned so far that when using PCA (e.g. with ...
- 3
1
vote
0
answers
13
views
What is the name of a visualization to show inter-dependent events happening in paralel?
I'm trying to find an editor to help me draw this type of chart:
...but I'm finding it really difficult to do without knowing what to call it.
I want to show a sequence of events that happen over ...
- 111
0
votes
1
answer
24
views
How to evaluate-visualize clusters derived through PCA
the title might not be the best to adress my question. Here is my problem
I have a data set with 21 features. and I want to cluster the data to interpret if there are any insights that I can have by ...
- 31
0
votes
1
answer
253
views
How do I get pcolormesh to plot two distinct colormeshes on the same figure?
I am trying to plot 2 distinct colormeshes on the same figure. They are mutually exclusive, so there are no overlaps. This is my code:
...
- 109
0
votes
0
answers
14
views
Having trouble manipulating data to make better dashboard
I have a test dataset which has has 39 columns. Index is given below:
Sample data is as follows:
Some columns are omitted due to privacy concerns. The colored cells in the index belong to one type. ...
0
votes
0
answers
30
views
How to effectively plot a quantity for 10 variables?
This might be a bit of a simple or general question, but I have a case where I have a line plot with 10 lines, graphing a value over time for 10 states. This is too many, making the graph look ...
- 101
0
votes
3
answers
44
views
Is it meaningfull using boxplots for representing the distribution of just four data points?
I'm using boxplots for representing the distribution of some datasets. In one of these datasets I have just four data points. Is it meaningful using boxplots for representing the distribution of such ...
- 139
2
votes
1
answer
20
views
Im looking for good neurons silmilarity metric
Recently I managed to create simple neural network visualization, to help to understand how neural network works on the signal level. I also wanted to arrange neurons by similarity cause I was ...
- 23
1
vote
2
answers
36
views
Which language, tool. package,.. to create a standalone data visualization with interaction
My next task is to create an interface or rather a visualization of signals. Firstly, this is simply the plotting of a few signals, nothing special about that. But one shall be able to zoom in and ...
- 520
0
votes
1
answer
65
views
Ugly AUC curves. Sklearn. How to make AUC Curves less square
I dislike the square look of this AUC curve (SKLearn).
The purpose of this question is "visual". Please post code snippets.
This question is not requesting the theory behind the AUC.
My goal ...
- 136
0
votes
0
answers
166
views
Why Seaborn's histplot takes a longer time to plot when the data is far from the median than when it is closer?
I have recently noticed that, for the some number of data points and for the same precision (int64), when using Seaborn's histplot on data that has huge variance with respect to the median it takes a ...
- 1
1
vote
1
answer
32
views
Visualizing convolutional neural networks embedding
In this article, the author creates a graph (at the end of the post) from the embeddings of different words found by transformer model. I would like to do a similar thing for a convolutional neural ...
- 113
0
votes
1
answer
25
views
Understanding Box plots
I am new to box plots and I am trying to understand it. Consider the following figures :
According to my understanding, outliers will exist after the max. line and before the min. line. So according ...
- 145
0
votes
0
answers
14
views
Data Analytics Platforms
What are some of your go to tools for data analytics? I've been using Tesser Insights platform for cleaning and analyzing data.
It is pretty convenient and does not require code.
0
votes
0
answers
31
views
LIME visualization for resnet50
I am implementing LIME on my resnet50 mode. There are 4 classes in the dataset.
the code snippet of LIME:
...
- 172
0
votes
0
answers
62
views
Grad cam outputs for all the images are the same
I am using grad cam to see which regions of the test images are most important for the prediction of resnet50. The output I got has some errors.
Code Snippets:
<...
- 172
0
votes
0
answers
155
views
Can't understand grad cam output
I've implemented Grad Cam. The colors in a Grad-CAM heatmap usually use a red-to-blue color scale, where red signifies the highest importance and blue signifies the lowest importance. The intensity of ...
- 172
1
vote
1
answer
151
views
How to curve fit, Z variable dependent on X and Y?
I'm trying to find the function for this visualization:
I would like to get feedback if I'm taking the right approach. My approach:
These data points are created by a person. They are two ...
- 111
0
votes
0
answers
66
views
How to visualize a data drift?
I want to show that my data distribution changes between data windows. Is it enough to visualize the mean and variance for every window? Is there any other solution? thank you
- 21
1
vote
1
answer
215
views
BERTopic Visualization
I new to topic modeling and I'm trying to use BERTopic inside of PyCharm. I'm struggling to ...
- 141
0
votes
0
answers
7
views
Is there a dedicated name for a matrix of scatter plots representing all 2d projections of a n-d dataset?
When facing a n-dim dataset, all variables being numericals, I am used to produce a series of all 2d projection of this dataset. Do these exhaustive 2d projections over a dataset own a specific name ?
...
- 101
1
vote
1
answer
27
views
Empirical indications regarding demanded skills and tasks of data science jobs?
I am wondering if there are is any information about the current (and prospected) shares in skills required for advertised/existing data science jobs. This includes of course also the concrete tasks ...
- 111
0
votes
0
answers
4
views
Visualizing data distribution of categorized texts
I'm trying to develop an SVM model to classify some texts into positive and negative. For the training phase, I'm going to use a dataset containing 2400 comments from Twitter, classified into positive ...
- 1
1
vote
1
answer
21
views
Standardised plot of multiple points with varying thresholds and values
I would like to plot the points below to show which points are inside their thresholds and which are outside their thresholds.
I intend to do another set of analysis with other parameters which will ...
- 113
0
votes
0
answers
21
views
Plotting confidence intervals between points on a graph
I was actually doing some work regarding Bayesian Optimization and came across this graph.
I know this may appear to be a very naive question but.... what is the exact name of this graph (x-f(x) plot) ...
- 77
0
votes
1
answer
31
views
Why does PowerBI take longer to load data than PowerQuery takes to load preview?
I have a stored procedure in SQL Server and when I open PowerQuery, I can get a preview of the whole table in a minute or two. But once I click 'Apply and Close', it will take AGES to load and finally ...
1
vote
2
answers
29
views
Tool for visualizing the evolution of a dataset
I wonder if anyone knows of a tool that allows to visualize how a dataset has evolved over time.
There are tools for tracking experiments (neptune, mlflow, etc.) but they are based on keeping track of ...
- 241
0
votes
0
answers
26
views
Best ways to visualize the performance of a regression model?
How best to visualize 10,000 observations of continuous labels against predicted values in a way to summarises the overall performance of the model? I want to avoid using performance metrics such as ...
- 1