Questions tagged [visualization]
Constructing meaningful and useful graphical representations of data. (If your question is only about how to get particular software to produce a specific effect, then it is likely not on topic here.)
692
questions
178
votes
20
answers
239k
views
How do you visualize neural network architectures?
When writing a paper / making a presentation about a topic which is about neural networks, one usually visualizes the networks architecture.
What are good / simple ways to visualize common ...
- 18.8k
38
votes
3
answers
193k
views
Calculation and Visualization of Correlation Matrix with Pandas
I have a pandas data frame with several entries, and I want to calculate the correlation between the income of some type of stores. There are a number of stores with income data, classification of ...
- 535
30
votes
8
answers
3k
views
Purpose of visualizing high dimensional data?
There are many techniques for visualizing high dimension datasets, such as T-SNE, isomap, PCA, supervised PCA, etc. And we go through the motions of projecting the data down to a 2D or 3D space, so we ...
- 675
27
votes
8
answers
26k
views
Visualizing a graph with a million vertices
What is the best tool to use to visualize (draw the vertices and edges) a graph with 1000000 vertices? There are about 50000 edges in the graph. And I can compute the location of individual vertices ...
- 443
26
votes
10
answers
139k
views
GraphViz not working when imported inside PydotPlus (`GraphViz's executables not found`)
I've been trying to make these packages work for quite some time now but with no success. Basically the error is:
GraphViz's Executables not found
EDIT: I had ...
- 525
25
votes
6
answers
89k
views
make seaborn heatmap bigger
I create a corr() df out of an original df. The corr() df came out 70 X 70 and it is impossible to visualize the heatmap... <...
- 621
22
votes
3
answers
30k
views
How do I create a complex Radar Chart?
So, I want to create a Player Profile Radar Chart something like this:
Not only the scale of each variable different, but also I want a reversed scale for some statistics like the 'dispossessed' stat,...
- 323
21
votes
6
answers
13k
views
What do you use to generate a dashboard in R?
I need to generate periodic (daily, monthly) web analytics dashboard reports. They will be static and don't require interaction, so imagine a PDF file as the target output. The reports will mix tables ...
aiolias
20
votes
2
answers
151k
views
18
votes
2
answers
140k
views
How to plot two columns of single DataFrame on Y axis
I have two data frames (Action, Comedy). Action contains two columns (year, rating) ratings columns contains average rating with respect to year. The Comedy data frame contains the same two columns ...
- 291
17
votes
1
answer
2k
views
Visualization of multiple Markov models
I am working on a project where we compare over 10 different Markov models, each representing a different treatment plan.
Most often single models are visualized with a decision tree or transition ...
- 279
15
votes
2
answers
4k
views
Visualizing deep neural network training
I'm trying to find an equivalent of Hinton Diagrams for multilayer networks to plot the weights during training.
The trained network is somewhat similar to a Deep SRN, i.e. it has a high number of ...
- 293
15
votes
1
answer
5k
views
Can closer points be considered more similar in T-SNE visualization?
I understand from Hinton's paper that T-SNE does a good job in keeping local similarities and a decent job in preserving global structure (clusterization).
However I'm not clear if points appearing ...
- 1,490
14
votes
1
answer
39k
views
Heatmap on a map in Python
Mode Analytics has a nice heatmap feature, but it is not conducive to comparing maps (only one per report).
What they do allow is data to be pulled easily into a wrapped python notebook. And then ...
- 323
14
votes
3
answers
12k
views
How can I make big confusion matrices easier to read?
I have recently published a dataset (link) with 369 classes. I ran a couple of experiments on them to get a feeling for how difficult the classification task is. Usually, I like it if there are ...
- 18.8k
13
votes
4
answers
7k
views
How do I make an interactive PCA scatterplot in Python?
The matplotlib library is very capable but lacks interactiveness, especially inside Jupyter Notebook. I would like a good offline plotting tool like plot.ly.
- 330
13
votes
4
answers
19k
views
Interpreting Decision Tree in context of feature importances
I'm trying to understand how to fully understand the decision process of a decision tree classification model built with sklearn. The 2 main aspect I'm looking at are a graphviz representation of the ...
- 245
12
votes
3
answers
5k
views
How to animate growth of a social network?
I am seeking for a library/tool to visualize how social network changes when new nodes/edges are added to it.
One of the existing solutions is SoNIA: Social Network Image Animator. It let's you make ...
- 916
12
votes
3
answers
2k
views
Airline Fares - What analysis should be used to detect competitive price-setting behavior and price correlations?
I want to investigate price-setting behavior of airlines -- specifically how airlines react to competitors pricing.
As I would say my knowledge about more complex analysis is quite limited I've done ...
- 221
12
votes
1
answer
13k
views
What is the difference between regplot and lmplot in seaborn?
Seaborn library in python suggests to use either lmplot or regplot to visualise a regression between two variables. What is the difference between the two plots ? The result I was able to get are ...
- 649
11
votes
3
answers
1k
views
Data visualization for pattern analysis (language-independent, but R preferred)
I want to plot the bytes from a disk image in order to understand a pattern in them. This is mainly an academic task, since I'm almost sure this pattern was created by a disk testing program, but I'd ...
11
votes
2
answers
2k
views
ggvis vs. ggplot2+Shiny; which one to choose for interactive visualization?
There is a similar question here in CrossValidated, and I have read the answers. My question is a bit different. I don't want to merely visualize my data, and indeed what I want to visualize is not ...
- 271
10
votes
1
answer
13k
views
Python Seaborn: how are error bars computed in barplots?
I'm using seaborn library to generate bar plots in python. I'm wondering what statistics are used to compute the error bars, but can't find any reference to this in the seaborn's barplot documentation....
- 793
10
votes
5
answers
7k
views
Visualizing items frequently purchased together
I have a dataset in following structure inserted in a CSV file:
Banana Water Rice
Rice Water
Bread Banana Juice
Each row indicates a collection of items ...
- 179
10
votes
1
answer
2k
views
t-SNE: Why equal data values are visually not close?
I have 200 data points that have the same values on all features.
After t-SNE dimension reduction they doesn't look so equal anymore, just like this:
Why aren't they on the same point in the ...
10
votes
1
answer
3k
views
Why is Reconstruction in Autoencoders Using the Same Activation Function as Forward Activation, and not the Inverse?
Suppose you have an input layer with n neurons and the first hidden layer has $m$ neurons, with typically $m < n$. Then you compute the actication $a_j$ of the $j$-th neuron in the hidden layer by
...
- 101
10
votes
1
answer
291
views
How do I figure out if subsets can be plotted in a normal Euler diagram?
In some cases, it may be impossible to draw Euler diagrams with overlapping circles to represent all the overlapping subsets in the correct proportions. This type of data then requires using polygons ...
- 654
10
votes
1
answer
618
views
A clear visualization of a two-way ANOVA
To provide a full yet simple picture of a 3-level, one-way ANOVA, I use the following visualization where variation within each group (the filled circles) and variation between the groups (black ...
- 101
9
votes
2
answers
16k
views
Display Images (url) Inside Pandas Dataframe
I would like to display images (mostly jpg and png formats) directly from their url link inside a pandas dataframe. Imagine I already have the following dataframe:
...
- 4,207
9
votes
2
answers
2k
views
Why did Tufte call this a "superbly produced duck"?
I think I understand Tufte's concept of a "Duck" -- A graphic that is taken over by decorative forms.
But I couldn't understand why he called this a duck (a "superbly produced" one at that). It ...
9
votes
3
answers
1k
views
Interactive Graphing while logging data
I'm looking to graph and interactively explore live/continuously measured data. There are quite a few options out there, with plot.ly being the most user-friendly. Plot.ly has a fantastic and easy to ...
9
votes
4
answers
1k
views
Is t-SNE just for visualization?
I have used the t-SNE algorithm to visualize my high dimensional data. However, I was wondering if this is a practical method for inference?
- 203
8
votes
3
answers
991
views
What to consider before learning a new language for data analysis
I'm currently in the very early stages of preparing a new research-project (still at the funding-application stage), and expect that data-analysis and especially visualisation tools will play a role ...
- 191
8
votes
3
answers
6k
views
How to find out if two datasets are close to each other?
I have the following three datasets.
...
- 167
8
votes
1
answer
485
views
Anybody know what this type of visualisation is called?
I think this is a pretty cool way to visualise changes in values but I can’t find any name for this type of visualisation.
I
Source: https://www.economist.com/graphic-detail/2020/07/28/americans-are-...
- 183
8
votes
2
answers
3k
views
visualize a horizontal box plot in R
I have a dataset like this. The data has been collected through a questionnaire and I am going to do some exploratory data analysis.
...
- 940
7
votes
6
answers
2k
views
Why do we need data scientists if there are websites like this? [closed]
Very basic question about data science as I'm a beginner. I noticed that there are sites like illustrated below, that help visualize and analyze data so that the business owner can have a better ...
- 179
7
votes
1
answer
1k
views
Why it is recommended to use T SNE to reduce to 2-3 dims and not higher dim?
According to wiki it is recommenced to use T-SNE to map to 2-3 dimensional.
I can understand this , if we want to visualizing the data.
If we want to reduce the ...
- 297
7
votes
3
answers
3k
views
options available for visualizing a matrix type data frame in R
I have a data frame looking like the following:
p1-p5 are different products
A-C: price bands
1-3: size bands
e.g. A1: small store selling the expensive that product
D3: big store selling cheap ...
- 71
7
votes
2
answers
14k
views
Plotting different values in pandas histogram with different colors
I am working on a dataset. The dataset consists of 16 different features each feature having values belonging to the set (0, 1, 2). In order to check the distribution of values in each column, I used <...
- 3,021
7
votes
3
answers
11k
views
Visualize graph network with more than 30k edges
I have a dataset with users connection and I want to create a directed network graph.
Nodes: ~20.000
Edges: ~33.000
I used to work before on NodeXL and Gephi, but now I am on Mac and I don't have ...
- 3,890
7
votes
1
answer
3k
views
What does it mean by “t-SNE retains the structure of the data”?
I was learning about t-SNE when I was told that t-SNE retains the structure of the data in the embeddings.
What exactly does this mean ?
How does the algorithm achieve this ?
So far I have ...
- 231
7
votes
1
answer
4k
views
Visualizing many one-to-many relationships
I am trying to visualize the language tags on github repository data. I have names of 16k github repositories, and all the languages associated with each one of them. Below is a chord diagram I came ...
- 227
7
votes
2
answers
2k
views
How do you plot overlapping durations?
My data contains a set of start times and duration for an action. I would like to plot this so that for a given time slice I can see how many actions are active. I'm currently thinking of this as a ...
- 171
7
votes
1
answer
141
views
Projecting data from $S^n$ to $S^2$
I have few points in $S^n$, i.e., the $n$-dimensional unit sphere embedded in $\mathbb{R}^{n+1}$, and I would like to project them down to $S^2$, i.e., the 2-dimensional unit sphere (embedded in $\...
- 71
6
votes
2
answers
6k
views
How to create interactive plot of thousands of images as output of t-SNE?
I have many images that I want to plot as a result of running t-SNE and I want to be able to interactively explore them. matplotlib does not allow enough interactivity to explore, and plotly is too ...
- 231
6
votes
4
answers
225
views
Business exception reporting
I work in an analytical role at a a large financial services firm. We do a ton of daily reporting over metrics that rarely change in a meaningful way from day to day. From this daily reporting, our ...
- 61
6
votes
2
answers
681
views
Represent time-series data in much compact form
I have time series data of one month plotted day-wise as
Notice every day follows a different pattern. Now, I want to show this "diversity in pattern" of each day in much compact form in a ...
- 300
6
votes
1
answer
16k
views
Is there a way to Label/Annotate My Bubble Plot (Scatter plot with a z-axis) on matplotlib?
I would like to label my bubble plot, with the labels being INSIDE the bubbles. Something like this.
Is There any way to do that?
What I've tried:
...
- 173
6
votes
2
answers
4k
views
Seaborn Violin plot error No loop for unfunc add
I'm trying to plot a violin plot with a split based on Sex ( like in the fourth example in the doccumentation but with Sex)
I can produce a categorical scatter plot and split it by Sex. However, when ...
- 439