Questions tagged [visualization]

Constructing meaningful and useful graphical representations of data. (If your question is only about how to get particular software to produce a specific effect, then it is likely not on topic here.)

Filter by
Sorted by
Tagged with
85
votes
15answers
68k views

How do you visualize neural network architectures?

When writing a paper / making a presentation about a topic which is about neural networks, one usually visualizes the networks architecture. What are good / simple ways to visualize common ...
35
votes
3answers
161k views

Calculation and Visualization of Correlation Matrix with Pandas

I have a pandas data frame with several entries, and I want to calculate the correlation between the income of some type of stores. There are a number of stores with income data, classification of ...
23
votes
7answers
2k views

Purpose of visualizing high dimensional data?

There are many techniques for visualizing high dimension datasets, such as T-SNE, isomap, PCA, supervised PCA, etc. And we go through the motions of projecting the data down to a 2D or 3D space, so we ...
19
votes
3answers
18k views

How do I create a complex Radar Chart?

So, I want to create a Player Profile Radar Chart something like this: Not only the scale of each variable different, but also I want a reversed scale for some statistics like the 'dispossessed' stat,...
17
votes
7answers
17k views

Visualizing a graph with a million vertices

What is the best tool to use to visualize (draw the vertices and edges) a graph with 1000000 vertices? There are about 50000 edges in the graph. And I can compute the location of individual vertices ...
17
votes
6answers
12k views

What do you use to generate a dashboard in R?

I need to generate periodic (daily, monthly) web analytics dashboard reports. They will be static and don't require interaction, so imagine a PDF file as the target output. The reports will mix tables ...
16
votes
5answers
40k views

make seaborn heatmap bigger

I create a corr() df out of an original df. The corr() df came out 70 X 70 and it is impossible to visualize the heatmap... <...
14
votes
1answer
2k views

Can closer points be considered more similar in T-SNE visualization?

I understand from Hinton's paper that T-SNE does a good job in keeping local similarities and a decent job in preserving global structure (clusterization). However I'm not clear if points appearing ...
14
votes
0answers
843 views

Visualization of multiple Markov models

I am working on a project where we compare over 10 different Markov models, each representing a different treatment plan. Most often single models are visualized with a decision tree or transition ...
13
votes
2answers
3k views

Visualizing deep neural network training

I'm trying to find an equivalent of Hinton Diagrams for multilayer networks to plot the weights during training. The trained network is somewhat similar to a Deep SRN, i.e. it has a high number of ...
13
votes
1answer
27k views

Heatmap on a map in Python

Mode Analytics has a nice heatmap feature (https://community.modeanalytics.com/gallery/geographic-heat-map/). But it's not conducive to comparing maps (only one per report). What they do allow is ...
12
votes
2answers
1k views

Airline Fares - What analysis should be used to detect competitive price-setting behavior and price correlations?

I want to investigate price-setting behavior of airlines -- specifically how airlines react to competitors pricing. As I would say my knowledge about more complex analysis is quite limited I've done ...
11
votes
3answers
3k views

How to animate growth of a social network?

I am seeking for a library/tool to visualize how social network changes when new nodes/edges are added to it. One of the existing solutions is SoNIA: Social Network Image Animator. It let's you make ...
11
votes
3answers
4k views

How do I make an interactive PCA scatterplot in Python?

The matplotlib library is very capable but lacks interactiveness, especially inside Jupyter Notebook. I would like a good offline plotting tool like plot.ly.
10
votes
4answers
4k views

Visualizing items frequently purchased together

I have a dataset in following structure inserted in a CSV file: Banana Water Rice Rice Water Bread Banana Juice Each row indicates a collection of items ...
10
votes
3answers
883 views

Data visualization for pattern analysis (language-independent, but R preferred)

I want to plot the bytes from a disk image in order to understand a pattern in them. This is mainly an academic task, since I'm almost sure this pattern was created by a disk testing program, but I'd ...
10
votes
2answers
2k views

ggvis vs. ggplot2+Shiny; which one to choose for interactive visualization?

There is a similar question here in CrossValidated, and I have read the answers. My question is a bit different. I don't want to merely visualize my data, and indeed what I want to visualize is not ...
9
votes
4answers
12k views

Interpreting Decision Tree in context of feature importances

I'm trying to understand how to fully understand the decision process of a decision tree classification model built with sklearn. The 2 main aspect I'm looking at are a graphviz representation of the ...
9
votes
1answer
2k views

Why is Reconstruction in Autoencoders Using the Same Activation Function as Forward Activation, and not the Inverse?

Suppose you have an input layer with n neurons and the first hidden layer has $m$ neurons, with typically $m < n$. Then you compute the actication $a_j$ of the $j$-th neuron in the hidden layer by ...
9
votes
3answers
5k views

How can I make big confusion matrices easier to read?

I have recently published a dataset (link) with 369 classes. I ran a couple of experiments on them to get a feeling for how difficult the classification task is. Usually, I like it if there are ...
9
votes
1answer
941 views

t-SNE: Why equal data values are visually not close?

I have 200 data points that have the same values on all features. After t-SNE dimension reduction they doesn't look so equal anymore, just like this: Why aren't they on the same point in the ...
9
votes
1answer
223 views

How do I figure out if subsets can be plotted in a normal Euler diagram?

In some cases, it may be impossible to draw Euler diagrams with overlapping circles to represent all the overlapping subsets in the correct proportions. This type of data then requires using polygons ...
8
votes
1answer
7k views

Python Seaborn: how are error bars computed in barplots?

I'm using seaborn library to generate bar plots in python. I'm wondering what statistics are used to compute the error bars, but can't find any reference to this in the seaborn's barplot documentation....
8
votes
2answers
1k views

Why did Tufte call this a “superbly produced duck”?

I think I understand Tufte's concept of a "Duck" -- A graphic that is taken over by decorative forms. But I couldn't understand why he called this a duck (a "superbly produced" one at that). It ...
8
votes
3answers
940 views

Interactive Graphing while logging data

I'm looking to graph and interactively explore live/continuously measured data. There are quite a few options out there, with plot.ly being the most user-friendly. Plot.ly has a fantastic and easy to ...
8
votes
2answers
2k views

visualize a horizontal box plot in R

I have a dataset like this. The data has been collected through a questionnaire and I am going to do some exploratory data analysis. ...
7
votes
3answers
275 views

Find if the two datasets are close to each other

I have the following three datasets. ...
7
votes
1answer
129 views

Projecting data from $S^n$ to $S^2$

I have few points in $S^n$, i.e., the $n$-dimensional unit sphere embedded in $\mathbb{R}^{n+1}$, and I would like to project them down to $S^2$, i.e., the 2-dimensional unit sphere (embedded in $\...
6
votes
3answers
941 views

What to consider before learning a new language for data analysis

I'm currently in the very early stages of preparing a new research-project (still at the funding-application stage), and expect that data-analysis and especially visualisation tools will play a role ...
6
votes
2answers
567 views

Represent time-series data in much compact form

I have time series data of one month plotted day-wise as Notice every day follows a different pattern. Now, I want to show this "diversity in pattern" of each day in much compact form in a research ...
6
votes
3answers
2k views

options available for visualizing a matrix type data frame in R

I have a data frame looking like the following: p1-p5 are different products A-C: price bands 1-3: size bands e.g. A1: small store selling the expensive that product D3: big store selling cheap ...
6
votes
3answers
5k views

Visualize graph network with more than 30k edges

I have a dataset with users connection and I want to create a directed network graph. Nodes: ~20.000 Edges: ~33.000 I used to work before on NodeXL and Gephi, but now I am on Mac and I don't have ...
6
votes
1answer
150 views

Geometric Interpretation of Whether SVMs are performing well or not

I came across this research paper which contained this figure which talks about the center of mass (presumably, of the training dataset's datapoints?) and represents the solution of an SVM as ...
6
votes
3answers
1k views

Summarize and visualize a CSV in Java/Scala?

I would like to summarize (as in R) the contents of a CSV (possibly after loading it, or storing it somewhere, that's not a problem). The summary should contain the quartiles, mean, median, min and ...
6
votes
2answers
1k views

Pandas grouped data to Bokeh graph

I'm having trouble graphing Pandas grouped data in Bokeh. ...
5
votes
4answers
157 views

Business exception reporting

I work in an analytical role at a a large financial services firm. We do a ton of daily reporting over metrics that rarely change in a meaningful way from day to day. From this daily reporting, our ...
5
votes
2answers
337 views

Data Visualization with multiple dimension, and linear separability

I have a dataset of two classes with several features, how can I visualise such data using Matlab to decide if it is linear separable or not?
5
votes
2answers
188 views

Techniques for trend extraction from unbalanced panel data

My data set is formatted like this: User-id | Threat_score aaa 45 bbb 32 ccc 20 The list contains the top 100 users with the highest threat ...
5
votes
2answers
302 views

What visualization technique to best describe a recommendation dataset?

I've written a simple recommender which generates recommendations for users based on what they have clicked. The recommender generates a data file with the following format: ...
5
votes
1answer
590 views

What does it mean by “t-SNE retains the structure of the data”?

I was learning about t-SNE when I was told that t-SNE retains the structure of the data in the embeddings. What exactly does this mean ? How does the algorithm achieve this ? So far I have ...
5
votes
1answer
5k views

Plotting different values in pandas histogram with different colors

I am working on a dataset. The dataset consists of 16 different features each feature having values belonging to the set (0,1,2). In order to check the distribution of values in each column, I used <...
5
votes
1answer
133 views

Git for Deep Learning - what are the best tools for versioning/tracking machine learning experiments?

I'm looking for a tool to track the results of several experiments/iterations in machine learning. Training a model can take days/weeks, so it's essential to track its performance and be able to ...
5
votes
2answers
1k views

How to more simply see overlapping data for dozens of variables?

I'm trying to think of the best way to see how multiple variables (about 40) related to a very large userbase can be seen to interact with one another. As an analogy, imagine I had survey data of ...
5
votes
2answers
272 views

Is t-SNE just for visualization?

I have used the t-SNE algorithm to visualize my high dimensional data. However, I was wondering if this is a practical method for inference?
5
votes
2answers
692 views

How do you plot overlapping durations?

My data contains a set of start times and duration for an action. I would like to plot this so that for a given time slice I can see how many actions are active. I'm currently thinking of this as a ...
5
votes
1answer
472 views

Is this a bug in Seaborn?

I am using the seaborn violin plot feature however the size of the violins aren't what I would expect them to be. Does anyone know whether this is something I am doing wrong, or as I suspect whether ...
5
votes
2answers
2k views

What is the classical way to visualize 3D filters in convolutional neural networks?

Suppose that at a layer $N$ within a CNN, my "image" is a 200$\times$200$\times$10 array. Thus, if I convolve such an array with, for example, 15 filters of size 3$\times$3$\times$10, I will end up ...
5
votes
1answer
339 views

A clear visualization of a two-way ANOVA

To provide a full yet simple picture of a 3-level, one-way ANOVA, I use the following visualization where variation within each group (the filled circles) and variation between the groups (black ...
4
votes
2answers
3k views

How to create interactive plot of thousands of images as output of t-SNE?

I have many images that I want to plot as a result of running t-SNE and I want to be able to interactively explore them. matplotlib does not allow enough interactivity to explore, and plotly is too ...
4
votes
4answers
1k views

How to visualise multidimensional categorical data with additional time dimension

I am trying to visualize a dataset that registers the career of people in an organisation and their backgrounds before starting in that particular organisation. I 'd like to show how individuals are ...