Questions tagged [visualization]

Constructing meaningful and useful graphical representations of data. (If your question is only about how to get particular software to produce a specific effect, then it is likely not on topic here.)

Filter by
Sorted by
Tagged with
1
vote
0answers
183 views

About installing Theano

I hope this question is relevant to this community as Theano is increasingly a standard software to do machine learning. So I have been trying to follow the instructions here, http://deeplearning.net/...
0
votes
1answer
2k views

Python: ggplot geom_histogram() binwidth or bin parameter missing?

I am unable to change number of bins when using geom_histogram() function. There is nothing in the documention, except some examples where binwidth=X is used (which is how R:ggplot2 uses it). However, ...
102
votes
16answers
95k views

How do you visualize neural network architectures?

When writing a paper / making a presentation about a topic which is about neural networks, one usually visualizes the networks architecture. What are good / simple ways to visualize common ...
4
votes
2answers
75 views

Represent outlier days

I have hourly power consumption data for 30 days. On representing, each day data using a separate line, I get a plot as I want to highlight the days with abnormally high consumption (in other words, ...
1
vote
1answer
104 views

A faster multidimensional scaling?

I've been playing around with some data, and I've created a decently large similarity matrix (each column value for a row represents how similar the document corresponding to the column is to the ...
2
votes
2answers
125 views

How do you define the steps to explore the data? [closed]

I'm falling in love with data science and I'm spending a lot of time studying it. It seems that a common data science workflow is: Frame the problem Collect the data Clean the data Work on the data ...
4
votes
2answers
182 views

Choosing data clustering method to visualize data

I'm working with a database about internally displaced persons in Colombia. All data are absolutes values, so I calculate the rate per 1000 people. I started to visualize all data using QGis. I ...
1
vote
1answer
236 views

Are there any good general techniques for binning/histogramming arbitrary data?

Let's say we want to histogram a finite set of measurements of some quantity. It is straight forward to calculate the usual statistical quantities for our sample such as the mean and the variance. Let'...
1
vote
0answers
90 views

Interpreting statistical formulas using python (mu + sigma * data)

I am working with data using python. I tried to plot a histogram using mathplotlib. I found a few examples on how to analyze data to get more accurate graphs. So ...
2
votes
1answer
104 views

Why is this series of house prices being thrown into one bin with plt.hist?

I have a series of houseprices that looks like this: 0 410000 1 610000 2 579950 3 559950 4 404950 Name: price, dtype: int64 And using ...
1
vote
0answers
253 views

Visualization: Changing group memberships over time

I am looking for an interactive visualization. I have store classification based on their sales (sales buckets) for multiple quarters. I want to visualize The size of each bucket for every quarter ...
11
votes
3answers
5k views

How do I make an interactive PCA scatterplot in Python?

The matplotlib library is very capable but lacks interactiveness, especially inside Jupyter Notebook. I would like a good offline plotting tool like plot.ly.
3
votes
3answers
8k views

Open-source interactive dashboard in Python

I am trying to find a package to construct a dashboard with interactive graphs (including widgets such as sliders) in python (mainly IPython notebook). I know there is plotly but I would like a fully ...
3
votes
1answer
1k views

Decision Tree generating leaves for only one case

I had asked a question regarding predictive analysis for marketing earlier. Prediction model for marketing to prospective customers (using pandas) Still have some doubts about it, but I have a doubt ...
1
vote
1answer
441 views

Visualizing N-way frequency table as a Decision Tree in R

I have a N-way frequency table generated from a regression model fit. This is a reproducible example of such table: ...
1
vote
0answers
754 views

Multi Model data set Visualization Python

I have a data-set with two variable frequency values as given below ...
1
vote
0answers
15 views

Network analysis applied on terms

I'm dealing with textual data. Imagine a certain number of statements (they could be descriptions), each one referring to a certain process, where each process ends in one f three categories: A, B, C. ...
8
votes
2answers
1k views

Why did Tufte call this a “superbly produced duck”?

I think I understand Tufte's concept of a "Duck" -- A graphic that is taken over by decorative forms. But I couldn't understand why he called this a duck (a "superbly produced" one at that). It ...
4
votes
1answer
504 views

In Orange, is it possible to analyze or visualize real time, streaming data?

Using orange, I would like to be able to do real time analysis or visualizations on streaming data. I would appreciate any input on the matter!
0
votes
1answer
129 views

Graphical Dyslexia — building intuition for common data visualizations? [closed]

It took me years before I could understand what was going on in a histogram. I had trouble understanding the tails, skewness, and concepts such as "fat tails." With a lot of practice, histograms have ...
3
votes
3answers
3k views

Data visualization of frequencies of state transitions (possibly in R?)

I am working on some experimental data, which can be of types A, B and C. Now I observe this data for 5 time points, and I can see them move between A to B, B to C,... etc. I see such transitions for ...
1
vote
2answers
447 views

Weka alternative - visual data exploration with a very large dataset

I love Weka for its visual data exploration features (it's great at quickly giving you a mile-high aerial view of the distributions of all your variables). I have a 0.5gb dataset, and Weka is unable ...
1
vote
1answer
590 views

How to create visualisation on medical data?

I want to create a data visualization on medical data i.e. patient's medical history, allergies one is having, any chronic patient's name must be highlighted, etc. And, there can be a separate ...
2
votes
0answers
63 views

Core components of data literacy for working professionals

I am a social scientist invited to give a 90-minute seminar on data literacy for working professionals in the U.S. government. I've struggled to develop a concise definition of data literacy, but ...
4
votes
1answer
226 views

Can I apply Clustering algorithms to the result of Manifold Visualization Methods?

Some methods related to manifold-learning are commonly stated as good-for-visualization, such as T-SNE and self-organizing-maps (SOM). I understand that when referring specifically to "visualization" ...
1
vote
1answer
70 views

Need some tips regarding starting out with the field's specific programming languages, with a heavy focus on data visualization

I've got rather expansive development experience, but I'm new to data science. I have been trying to familiarize myself with the main concepts and deciding between R and Python to put my time into. ...
1
vote
3answers
75 views

Creating queries on the fly and general manipulation for dataset of half a million data records

What would one use for manipulating data of the kind below ? a) Data is bio-markers of different globs GlobA 3 4 5 .... GlobB 2 1 1 .... GlobC 3 2 1 .... b) Manipulations are queries like: - show ...
4
votes
1answer
2k views

Heat maps in R with more than 2 categorical variables

I have a dataset which looks like- ...
14
votes
1answer
2k views

Can closer points be considered more similar in T-SNE visualization?

I understand from Hinton's paper that T-SNE does a good job in keeping local similarities and a decent job in preserving global structure (clusterization). However I'm not clear if points appearing ...
2
votes
0answers
53 views

Free/open interactive softwares/plugins for end-users' high-dimensional data visualization

Aside from questions about How to visualize data of a multidimensional dataset (TIMIT), the Purpose of visualizing high dimensional data? and High-dimensional data: What are useful techniques to know?,...
7
votes
3answers
6k views

Visualize graph network with more than 30k edges

I have a dataset with users connection and I want to create a directed network graph. Nodes: ~20.000 Edges: ~33.000 I used to work before on NodeXL and Gephi, but now I am on Mac and I don't have ...
1
vote
1answer
3k views

heatmap color and d3.js

This follows a recent post where I got my answer concerning possible web-based techno for plotting big heatmaps ($600 \times 600$ dissimilarity matrix). Now, that I have achieved that, I'm struggling ...
4
votes
2answers
2k views

How to plot large web-based heatmaps?

I want to plot large heatmaps (say a matrix $500 \times 500$). I can do it in Python/matplotlib.pyplot with pcolor, but it is not interactive (and I need an interactive heatmap). I have tried with D3....
36
votes
3answers
178k views

Calculation and Visualization of Correlation Matrix with Pandas

I have a pandas data frame with several entries, and I want to calculate the correlation between the income of some type of stores. There are a number of stores with income data, classification of ...
6
votes
1answer
150 views

Geometric Interpretation of Whether SVMs are performing well or not

I came across this research paper which contained this figure which talks about the center of mass (presumably, of the training dataset's datapoints?) and represents the solution of an SVM as ...
-6
votes
1answer
976 views

merging two video camera into one screen? [closed]

Hello there community im looking for a way to merge 2 live video feeds onto one screen but still keeping 2 different perspectives from individual cameras in their own windows while in right side of ...
1
vote
1answer
4k views

Colouring points based on cluster on matplotlib

I have a set of points where I performed a KMeans classification. How make a plot where the color of the point is based on the cluster they belong? EDIT: for clarification, having the set of points, ...
6
votes
2answers
583 views

Represent time-series data in much compact form

I have time series data of one month plotted day-wise as Notice every day follows a different pattern. Now, I want to show this "diversity in pattern" of each day in much compact form in a ...
3
votes
1answer
533 views

Knime : Scatter Plot

I have a sample dataset containing around 77k of rows and I have clustered them by using k mean clustering and colored the clusters using color manager. Now i would like to view them, However I could ...
2
votes
1answer
114 views

What would be the best way to structure and mine this set of data?

http://pastebin.com/K0eq8cyZ I went through each season of "It's Always Sunny in Philadelphia" and determined the character groupings (D=Dennis, F=Frank, C=Charlie, M=Mac, B=Sweet Dee) for each ...
2
votes
0answers
133 views

Visualizing a big number of polynomials as atlas of graphs?

Suppose you have a big number of polynomials such as xyz+xy+z where xyz, xy and ...
10
votes
2answers
2k views

ggvis vs. ggplot2+Shiny; which one to choose for interactive visualization?

There is a similar question here in CrossValidated, and I have read the answers. My question is a bit different. I don't want to merely visualize my data, and indeed what I want to visualize is not ...
9
votes
1answer
2k views

Why is Reconstruction in Autoencoders Using the Same Activation Function as Forward Activation, and not the Inverse?

Suppose you have an input layer with n neurons and the first hidden layer has $m$ neurons, with typically $m < n$. Then you compute the actication $a_j$ of the $j$-th neuron in the hidden layer by ...
1
vote
1answer
676 views

How to visualize (make plot) of regression output against categorical input variable? [closed]

I am doing linear regression with multiple variables. In my data I have n = 143 features and m = 13000 training examples. Some of my features are continuous (ordinal) variables (area, year, number of ...
1
vote
2answers
71 views

Modelling population changes with years on a network graph

This may be a silly question, apologies if it is. And further apologies if I've said something wrong. Network graphs, or visualisations look somewhat like this, with each node representing a thing ...
26
votes
8answers
2k views

Purpose of visualizing high dimensional data?

There are many techniques for visualizing high dimension datasets, such as T-SNE, isomap, PCA, supervised PCA, etc. And we go through the motions of projecting the data down to a 2D or 3D space, so we ...
1
vote
4answers
169 views

What kind of research I can do with my data set?

I have a data containing 200K ads (sale and rent property in the United Arab Emirates, or UAE). Here is a sample: ...
4
votes
1answer
2k views

Plotting libraries for Scala on Zeppelin

My main question is it looks like Zeppelin limit the display of the results to on 1000, I know that I can change this number but when I change it Zeppelin become slow. And it looks like the default ...
4
votes
4answers
1k views

How to visualise multidimensional categorical data with additional time dimension

I am trying to visualize a dataset that registers the career of people in an organisation and their backgrounds before starting in that particular organisation. I 'd like to show how individuals are ...
10
votes
1answer
9k views

Python Seaborn: how are error bars computed in barplots?

I'm using seaborn library to generate bar plots in python. I'm wondering what statistics are used to compute the error bars, but can't find any reference to this in the seaborn's barplot documentation....

1
6 7 8
9
10