Questions tagged [visualization]

Constructing meaningful and useful graphical representations of data. (If your question is only about how to get particular software to produce a specific effect, then it is likely not on topic here.)

Filter by
Sorted by
Tagged with
102
votes
16answers
96k views

How do you visualize neural network architectures?

When writing a paper / making a presentation about a topic which is about neural networks, one usually visualizes the networks architecture. What are good / simple ways to visualize common ...
36
votes
3answers
179k views

Calculation and Visualization of Correlation Matrix with Pandas

I have a pandas data frame with several entries, and I want to calculate the correlation between the income of some type of stores. There are a number of stores with income data, classification of ...
26
votes
8answers
2k views

Purpose of visualizing high dimensional data?

There are many techniques for visualizing high dimension datasets, such as T-SNE, isomap, PCA, supervised PCA, etc. And we go through the motions of projecting the data down to a 2D or 3D space, so we ...
21
votes
7answers
20k views

Visualizing a graph with a million vertices

What is the best tool to use to visualize (draw the vertices and edges) a graph with 1000000 vertices? There are about 50000 edges in the graph. And I can compute the location of individual vertices ...
20
votes
3answers
20k views

How do I create a complex Radar Chart?

So, I want to create a Player Profile Radar Chart something like this: Not only the scale of each variable different, but also I want a reversed scale for some statistics like the 'dispossessed' stat,...
19
votes
6answers
12k views

What do you use to generate a dashboard in R?

I need to generate periodic (daily, monthly) web analytics dashboard reports. They will be static and don't require interaction, so imagine a PDF file as the target output. The reports will mix tables ...
19
votes
5answers
54k views

make seaborn heatmap bigger

I create a corr() df out of an original df. The corr() df came out 70 X 70 and it is impossible to visualize the heatmap... <...
19
votes
9answers
79k views

GraphViz not working when imported inside PydotPlus (`GraphViz's executables not found`)

I've been trying to make these packages work for quite some time now but with no success. Basically the error is: GraphViz's Executables not found EDIT: I had ...
16
votes
1answer
1k views

Visualization of multiple Markov models

I am working on a project where we compare over 10 different Markov models, each representing a different treatment plan. Most often single models are visualized with a decision tree or transition ...
14
votes
1answer
31k views

Heatmap on a map in Python

Mode Analytics has a nice heatmap feature (https://community.modeanalytics.com/gallery/geographic-heat-map/). But it's not conducive to comparing maps (only one per report). What they do allow is ...
14
votes
1answer
2k views

Can closer points be considered more similar in T-SNE visualization?

I understand from Hinton's paper that T-SNE does a good job in keeping local similarities and a decent job in preserving global structure (clusterization). However I'm not clear if points appearing ...
13
votes
2answers
3k views

Visualizing deep neural network training

I'm trying to find an equivalent of Hinton Diagrams for multilayer networks to plot the weights during training. The trained network is somewhat similar to a Deep SRN, i.e. it has a high number of ...
12
votes
3answers
4k views

How to animate growth of a social network?

I am seeking for a library/tool to visualize how social network changes when new nodes/edges are added to it. One of the existing solutions is SoNIA: Social Network Image Animator. It let's you make ...
12
votes
2answers
1k views

Airline Fares - What analysis should be used to detect competitive price-setting behavior and price correlations?

I want to investigate price-setting behavior of airlines -- specifically how airlines react to competitors pricing. As I would say my knowledge about more complex analysis is quite limited I've done ...
11
votes
3answers
5k views

How do I make an interactive PCA scatterplot in Python?

The matplotlib library is very capable but lacks interactiveness, especially inside Jupyter Notebook. I would like a good offline plotting tool like plot.ly.
11
votes
3answers
975 views

Data visualization for pattern analysis (language-independent, but R preferred)

I want to plot the bytes from a disk image in order to understand a pattern in them. This is mainly an academic task, since I'm almost sure this pattern was created by a disk testing program, but I'd ...
10
votes
1answer
9k views

Python Seaborn: how are error bars computed in barplots?

I'm using seaborn library to generate bar plots in python. I'm wondering what statistics are used to compute the error bars, but can't find any reference to this in the seaborn's barplot documentation....
10
votes
4answers
5k views

Visualizing items frequently purchased together

I have a dataset in following structure inserted in a CSV file: Banana Water Rice Rice Water Bread Banana Juice Each row indicates a collection of items ...
10
votes
3answers
7k views

How can I make big confusion matrices easier to read?

I have recently published a dataset (link) with 369 classes. I ran a couple of experiments on them to get a feeling for how difficult the classification task is. Usually, I like it if there are ...
10
votes
2answers
2k views

ggvis vs. ggplot2+Shiny; which one to choose for interactive visualization?

There is a similar question here in CrossValidated, and I have read the answers. My question is a bit different. I don't want to merely visualize my data, and indeed what I want to visualize is not ...
10
votes
1answer
248 views

How do I figure out if subsets can be plotted in a normal Euler diagram?

In some cases, it may be impossible to draw Euler diagrams with overlapping circles to represent all the overlapping subsets in the correct proportions. This type of data then requires using polygons ...
9
votes
4answers
14k views

Interpreting Decision Tree in context of feature importances

I'm trying to understand how to fully understand the decision process of a decision tree classification model built with sklearn. The 2 main aspect I'm looking at are a graphviz representation of the ...
9
votes
1answer
2k views

Why is Reconstruction in Autoencoders Using the Same Activation Function as Forward Activation, and not the Inverse?

Suppose you have an input layer with n neurons and the first hidden layer has $m$ neurons, with typically $m < n$. Then you compute the actication $a_j$ of the $j$-th neuron in the hidden layer by ...
9
votes
1answer
1k views

t-SNE: Why equal data values are visually not close?

I have 200 data points that have the same values on all features. After t-SNE dimension reduction they doesn't look so equal anymore, just like this: Why aren't they on the same point in the ...
8
votes
3answers
969 views

What to consider before learning a new language for data analysis

I'm currently in the very early stages of preparing a new research-project (still at the funding-application stage), and expect that data-analysis and especially visualisation tools will play a role ...
8
votes
2answers
1k views

Why did Tufte call this a “superbly produced duck”?

I think I understand Tufte's concept of a "Duck" -- A graphic that is taken over by decorative forms. But I couldn't understand why he called this a duck (a "superbly produced" one at that). It ...
8
votes
3answers
967 views

Interactive Graphing while logging data

I'm looking to graph and interactively explore live/continuously measured data. There are quite a few options out there, with plot.ly being the most user-friendly. Plot.ly has a fantastic and easy to ...
8
votes
2answers
2k views

visualize a horizontal box plot in R

I have a dataset like this. The data has been collected through a questionnaire and I am going to do some exploratory data analysis. ...
7
votes
3answers
635 views

Find if the two datasets are close to each other

I have the following three datasets. ...
7
votes
3answers
6k views

Visualize graph network with more than 30k edges

I have a dataset with users connection and I want to create a directed network graph. Nodes: ~20.000 Edges: ~33.000 I used to work before on NodeXL and Gephi, but now I am on Mac and I don't have ...
7
votes
4answers
431 views

Is t-SNE just for visualization?

I have used the t-SNE algorithm to visualize my high dimensional data. However, I was wondering if this is a practical method for inference?
7
votes
1answer
134 views

Projecting data from $S^n$ to $S^2$

I have few points in $S^n$, i.e., the $n$-dimensional unit sphere embedded in $\mathbb{R}^{n+1}$, and I would like to project them down to $S^2$, i.e., the 2-dimensional unit sphere (embedded in $\...
6
votes
4answers
162 views

Business exception reporting

I work in an analytical role at a a large financial services firm. We do a ton of daily reporting over metrics that rarely change in a meaningful way from day to day. From this daily reporting, our ...
6
votes
2answers
583 views

Represent time-series data in much compact form

I have time series data of one month plotted day-wise as Notice every day follows a different pattern. Now, I want to show this "diversity in pattern" of each day in much compact form in a ...
6
votes
3answers
2k views

options available for visualizing a matrix type data frame in R

I have a data frame looking like the following: p1-p5 are different products A-C: price bands 1-3: size bands e.g. A1: small store selling the expensive that product D3: big store selling cheap ...
6
votes
1answer
5k views

What is the difference between regplot and lmplot in seaborn?

Seaborn library in python suggests to use either lmplot or regplot to visualise a regression between two variables. What is the difference between the two plots ? The result I was able to get are ...
6
votes
3answers
183 views

Git for Deep Learning - what are the best tools for versioning/tracking machine learning experiments?

I'm looking for a tool to track the results of several experiments/iterations in machine learning. Training a model can take days/weeks, so it's essential to track its performance and be able to ...
6
votes
3answers
2k views

Why is a correlation matrix symmetric?

I'm sorry for being so weak in math. (I'm a student) For eg. this is a correlation matrix. ...
6
votes
1answer
150 views

Geometric Interpretation of Whether SVMs are performing well or not

I came across this research paper which contained this figure which talks about the center of mass (presumably, of the training dataset's datapoints?) and represents the solution of an SVM as ...
6
votes
3answers
1k views

Summarize and visualize a CSV in Java/Scala?

I would like to summarize (as in R) the contents of a CSV (possibly after loading it, or storing it somewhere, that's not a problem). The summary should contain the quartiles, mean, median, min and ...
6
votes
2answers
904 views

How do you plot overlapping durations?

My data contains a set of start times and duration for an action. I would like to plot this so that for a given time slice I can see how many actions are active. I'm currently thinking of this as a ...
6
votes
2answers
2k views

Pandas grouped data to Bokeh graph

I'm having trouble graphing Pandas grouped data in Bokeh. ...
6
votes
1answer
683 views

Is this a bug in Seaborn?

I am using the seaborn violin plot feature however the size of the violins aren't what I would expect them to be. Does anyone know whether this is something I am doing wrong, or as I suspect whether ...
6
votes
2answers
3k views

What is the classical way to visualize 3D filters in convolutional neural networks?

Suppose that at a layer $N$ within a CNN, my "image" is a 200$\times$200$\times$10 array. Thus, if I convolve such an array with, for example, 15 filters of size 3$\times$3$\times$10, I will end up ...
6
votes
1answer
386 views

A clear visualization of a two-way ANOVA

To provide a full yet simple picture of a 3-level, one-way ANOVA, I use the following visualization where variation within each group (the filled circles) and variation between the groups (black ...
5
votes
2answers
521 views

Data Visualization with multiple dimension, and linear separability

I have a dataset of two classes with several features, how can I visualise such data using Matlab to decide if it is linear separable or not?
5
votes
2answers
192 views

Techniques for trend extraction from unbalanced panel data

My data set is formatted like this: User-id | Threat_score aaa 45 bbb 32 ccc 20 The list contains the top 100 users with the highest threat ...
5
votes
2answers
8k views

Display Images (url) Inside Pandas Dataframe

I would like to display images (mostly jpg and png formats) directly from their url link inside a pandas dataframe. Imagine I already have the following dataframe: ...
5
votes
2answers
313 views

What visualization technique to best describe a recommendation dataset?

I've written a simple recommender which generates recommendations for users based on what they have clicked. The recommender generates a data file with the following format: ...
5
votes
2answers
94 views

Data visualization with extreme far away points

I want to show points across two groups. However, for both groups, there are some points which are far away from most of the other points within each group, shown below. Any suggestions for this ...

1
2 3 4 5
10