Catalog & Classify

An information graphics Monster Manual

This is a collective research project providing examples and discussion of the basic building blocks of visual data representation.

Physical Map

Physical maps order elements by physical location, such as latitude and longitude points.

Cartogram types of maps distort reality to convey information. They resize and exaggerate any variable on an attribute value.

Density-equalizing cartograms are your traditional cartograms. In density-equalizing cartograms, map features bulge out a specific variable. Even though it distorts each feature, it remains connected during its creation.

As you can see, it’s easy to get information at only a glance.

In this map, you can instantly see that a high proportion of population live in California and New York. While states like Montana and North Dakota are smaller proportions.

Disadvantages:
- Must be used with care because knowledge of the actual land area is essential for the reader to make sense of the distorted version shown in the cartogram.
Best Practice:
- Show the actual map before introducing the cartogram

The Dorling Cartogram uses shapes like circles and rectangles to depict area. These types of cartograms make it easy to recognize patterns.

dorling cartogram

States are substituted with appropriately sized circles to represent clusters of population in the United States. However, the downfall for Dorling Cartograms is that it doesn’t maintain the shape. This means that readers may have difficulty understanding features in the map.

Hexagonal Bins

Hexagonal binning creates a grid in the map with regular hexagons.

Use:
- There are a lot of data points but you do not want to compromise on accuracy
- This map is great for understanding spatial distribution patterns of data
- Spatially aggregating the points into polygon regions to look at groups of data instead of the individual points

The image below shows the ares in which people hail taxis in NYC. On the left, it is difficult to make sense of patterns because there is not enough space between the individual point marks so that you can clearly see where one cluster of data starts and another ends.  

Tree/Graph

A Tree is largely used to show ordered data by connecting lines between those points akin to the branches of a tree. In slight contrast to tree maps, Tree Graphs are a collection of nodes that eliminate the need to display hierarchy when it isn't relevant factor to the data's narrative. Some terminology that is commonly used with these visualizations include: Root, Child, Leaf, Generation, Parent, Siblings, Branch, etc. Technically trees are graphs (and families). So what's the difference?

Graphs

Graphs are trees that include a set of nodes and "edges" which act as links between the nodes. In graphs the nodes can connect back to itself which is a pretty handy tool when algorithms are needed to solve problems online, in business and of course, mathematics.

A graph with 3 nodes and 3 edges

Tree Graph Examples:

Source: https://www.slideshare.net/rabin95/tree-in-graph-theory-in-discrete-structure

"Generating several different topic trees after one another causes tree topics to superposition. For example, generating a tree with depth 3 and number of child nodes 5 after previous generation results a graph" (Source: http://www.wandora.org/wiki/Tree_graph_generator)

Trees

There are a number of values that this genre of visualization tends to illustrate best, including hierarchy, genealogy, classification, relationships, and organization. The "family" descriptors mentioned above are also used within the organizational structure and logic of computers, discreet mathematics, HTML, and other programming languages.

Tree Examples (for you Rock music enthusiasts):

Image Source: “100 years of Rock Music in 1 Minute”https://www.fastcompany.com/3021791/100-years-of-rock-music-in-less-than-a-minute
A so/so example. Image Source: http://www.fakeplasticrock.com/wp-content/uploads/genealogy-of-pop-and-rock-music.png

Image Source: https://www.worldreligionnews.com/religion-news/christianity/evolutionary-tree-religion-map-simon-e-davies

However, there are certainly instances where it is unclear where hierarchy exists. In the example below you can see the organizational chart from the non-profit where I work. I've been an employee for over five years and I still find this graphic to be unwieldy in it's application. In fact, there isn't enough space in this image to place the continued variety of data that exists about front-line employees; their names and titles have been eliminated for efficiency, at the expense of accuracy and the erasure of information.   (Photo deleted on 10/27 for privacy concerns)

Pre-Processing

When considering using this type of graphic, you have to figure out the key question that requires visualization and the kind of data you would like to display. It is clear that information that can display hierarchy and lineage works best with Trees, where as Graphs are more useful when limitations aren't your jam and you need to process a repeated action or send the direction of data in multiple directions, rather than through a top-down hierarchy. The use of bright colors tend to lend well to comprehending the structure and information contained within Trees.  In contrast, the use of monotone colors makes it incredibly difficult to find specific data points within the lineage. Additionally, the Trees that use similar shapes, and typefaces are far more difficult to manage visually and therefore conceptually; regardless of the top-down simplicity of the information flow.

Tree Map

This is a map of trees...

A literal tree map

...but this is a "tree map"

What is it?

A tree map displays hierarchical data as a set of nested boxes. Each set of nested boxes can be thought of as a branch of a tree. Like a real tree, some branches simply have a single set of leaves, but some branches have additional branches off of those branches.

In the simple example below, the Pet Shop is the tree, and Birds, Mammals, Fish, and Reptiles are the branches.

Basic single level tree map with pet shop 'inventory'

Real Life Usage and Function

A tree map is a great way to show impact through hierarchy within a system and its subgroups. For example, a tree map is a popular visualization for stock market data. In the example below, the market (tree) is broken into major sectors (main branches) and within those main sectors, smaller subsectors (branches of branches), with the atomic component being the boxes (leaves) for each company.

Map of the financial market that utilizes multiple subgroups and color indicators

Each box in a tree map can show two different measures: Size and Color

Use of Size

You can see the size of the box indicates the market cap for each company represented proportionally as a percentage of their whole sector. It's clear right away that Apple and Google occupy the largest spaces, which makes sense.

Use of Color

Another variable aside from the size of the groups and subgroups area, is the use of color. In the stock market visualization above, each company is one of seven colors (legend in the bottom right of the graphic) indicating the current change in performance of the stock. We can see apple is down -3.01%, which places it in the poorest performance bucket, using the color red.

Through the use of color in this example, it would be immediately clear when the market was having an up or down day. In the example above, it's clear that Apple's drop in price was not due to market-wide conditions. It stands out among a mostly positive day for the market.

Interactivity

By hovering or clicking on each company, users can see a popover with more details of the performance and size. Additionally, interactivity allows for multiple subgroups to be representing when drilling down into each branch while also reducing clutter.

Click on the link below to interact with this tree map example.

https://finviz.com/map.ashx

Best Practices

  • Don't use too many levels of hierarchy - especially in a static visualization. As a general rule, only go two or three levels (branches) deep – otherwise it will become cluttered and difficult to interpret.
  • Use clear labels that add value and not clutter
  • Always be conscious of adding space, since it is the main variable. For example don't add space outside the boxes for labels as it distorts the spatial relationship between the individual boxes.
  • Use legends for color usage
  • Use hover states with basic tooltips to provide additional information in interactive graphics - do not try to cram too much information in the box

The example below is bad. It's cluttered and difficult to read because the sections and subsections have too many items at the atomic level to be remotely useful in a static graphic.

This isn't helping anyone

The below example is good. Click on the link in the caption to see the interactive version of this treemap.

https://archive.nytimes.com/www.nytimes.com/interactive/2010/02/01/us/budget.html

Scatter Plot

What is it?

  • A scatter plot is a two dimensional chart that uses points or “dots” to represent specific values.
  • Scatter plots most commonly have two different values that are represented using the X and Y axis.
  • This specific type of chart is best used to show the relationship between the X values and the Y values.
  • Instead of simply representing X and Y as values, scatter plots effectively show the correlation between these two variables.

Usages:

  • Scatter plots are beneficial to see the correlation between two variables, such as how X is affected when Y is increased.
  • It is important to note that while scatter plots have been referred to as “disconnected line graphs”, they do not necessarily have to be linear.
  • The example below represents a scatter plot of the average daily high temperatures by month using a non-linear graphing method.
  • In some instances, the points on scatter plots may be completely random, showing little to no correlation at all.
figure 2
https://chartio.com/learn/dashboards-and-charts/what-is-a-scatter-plot/ 
  • In addition to X and Y, the color, shape and size of the points on a scatter plot can also be seen as variables.
  • The example below depicts a scatter plots of the height and weight of children by gender, with height and weight being the X and Y variables.
  • The example also uses color as a variable to distinguish between male and female children.  
https://chartio.com/learn/dashboards-and-charts/what-is-a-scatter-plot/

Advantages:

  • The many variables within scatter plots, such as color, shape and size, allow data to be categorized within the chart.
  • Scatter plots are effective at giving an overview of the correlation between the X and Y variables.
  • Within scatter plots, it is easy to find "outliers" as some points are made very obvious if they are not near the rest of the clusters.
  • The example below demonstrates how scatter plots can be helpful for quickly finding deviances in data
http://faculty.virginia.edu/ASTR3130/lablinks/GuidePlots.html

Disadvantages:

  • If scatter plots contain too many points, they encounter "over plotting" problems.
  • This occurs when points are placed over top of one another, making the chart difficult to interpret and read.
  • However, as evidenced by the example below, transparency can be used as a solution to over plotting
https://www.infragistics.com/community/blogs/b/tim_brock/posts/jitter-another-solution-to-overplotting

Chernoff Faces

created in 1973 by Herman Chernoff - an applied mathematician

The Chernoff 'faces'  (called GLYPHs - a symbol or pictograph) are probably the easiest and possibly the most humanistic way of visualizing data.  Its called a 'MULTIVARIATE' (or more than 2 variables ) ANALYSIS.  These faces are universal, quick and easy.   All children of any country, ethnicity or bias would draw and we as humans, understand this immediately.  The kind of value this visualization represents is immediate and read as a mode of human emotion and cultural intelligence:

ANGRY/UNFRIENDLY/OPEN/COMTEMPLATIVE/AMENIABLE(happy).

Chernoff 'faces' to show lawyers ratings of twelve judges

Some of the DOWNFALLS of this visualization are:
* The data is Totally Interpretive
* What if you're blind or emotionally handicapped (ie: autistic)
*  Cultural Understanding (Asian cultures want a 'Serious' Judge; OR  some assumption that a 'Serious' Judge is more impartial?)
*  It is binary – only shows one set of data that assumes its universality.
* Certain graphical bits on this chart (ie Eyebrows) catch your attention more readily, and can influence you.
*  'Fight or Flight'.

The BEAUTY of this visualization is:
*  The Immediacy/Speed
*  Not using excess space/ink/clutter
* It runs on an X Y axis – you could see the 'progression' of the representation.
* Not alot of discussion needs to be initiated.
*  'Fight or Flight'.

HERES ANOTHER -

A more thorough chart of 'Chernoff' faces.

Mapping Faces

A 'Map' of the values – shape, line, position

This comes from an article called: Mapping Quality of Life with Chernoff Faces.  The face is distilled down to shape and line.  Distortion of the shapes and the angles of lines determine the 'Mapping'.  

https://web.archive.org/web/20041217153643/http://gis.esri.com/library/userconf/educ04/papers/pap5000.pdf

This was interestingly found to be:  "In this map, four variables--affluence, unemployment rate, urban stresses, and percentage of white population — are presented by facial elements face shape, mouth curvature, eyebrow slope, and face color, respectively (Figure 3) and identified the head shape/mouth curve/eye shape and eyebrow slopes/color are a reference to how to read the visualization. The award-winning map successfully captured the living conditions in the Los Angeles area. The success of the map was largely due to the use of Chernoff faces as its symbolism. Turner described this map as “probably one of the most interesting maps I’ve created because the expressions evoke an emotional association with the data.”

However, the example ASSUMES cultural norms, and the map doesn't identify distinct areas of Los Angeles.

Wong-Baker Healthcare Pain Guide

This tool was originally created with children and for children to help them communicate about their pain in a doctors office or hospital. This scale is used around the world with people-ages 3 and older, facilitating communication and improving assessment so pain management can be addressed.

Very specific analysis.

A good representation of 'mapping' that shows its universality.

Problems with Color

Color can add confusing interpretations of this data.

Color seems to add a value to the visualization that isn't as easily interpreted as the shape and line valuations.  Color (and black and white) can distort the shape/lines.

Other

The research also finds something called:  Pareidolia  (see below)

Seeing faces on a closeup of Mars
https://en.wikipedia.org/wiki/Pareidolia

When you mix up the visual cues, the visualization can become very obscure

This data visualization is the precursor to Emojis.

QUESTIONS  


*Are there visual ways to show subtlety of the data quickly?
*Is there a way to introduce a secondary or tertiary sets of data in the same visual presentation format without the visualization getting messy?  (don't think so)
*Can you add the use of color ( or glow) without being biased?

(Check out the different eyebrows)

bar graph

  • bar graph is a graphical way to display data using bars vertically or horizontally in x and y axis.
  • usually one axis shows the categories and the other axis shows percentages.
  • bar graphs are used for comparison and representing relationship between groups with different data.

bar graph components:

  • x and y axis
  • name of groups or categories (axis 1)
  • numbers (axis 2)
  • scale (the range of numbers shown on the graph)

bar graph design elements:

  • colors (hues and gradients) to show the differences between the groups
  • thickness and size of the bar

example of a bad executed bar graphs:

https://venngage-wordpress.s3.amazonaws.com/uploads/2017/08/misleading-graphs-1.png

this bar graph is misleading because at first glance you think there's a massive difference between the republicans and democrats who agreed with court, when in fact it's only 14%, but the y axis is showing the range from 50-64, the following example shows how the scale should have been used.

Now this version is better because we actually see the slight difference between the three groups, because the y axis and the bars are now showing the percentages.

https://www.datapine.com/blog/wp-content/uploads/2014/06/Same-Data-Different-Y-Axis-Data-Visualization-Designed-to-Mislead.png

The chart on the left makes you think that the interest rates have increased dramatically in 4 years when in fact it only increased 0.014% as shown on the right graph.

This is a good example of a bar graph because:

  • It shows the labels (Gross Earnings, Years)
  • Graph key or legend
  • Contemporary colors
  • Y axis is used correctly

Table Lens Graph

What's Its Purpose?

A survey plot, also known as a side by side bar chart or Table Lens' main purpose is to visualize patterns and outliers in multivariate datasets. In its simplified form, a Table Lens graph is a way to cluster relationships using bars. They are normally sorted independently and interesting patterns may evolve post clustering. From the superficial research done, it seems that academic articles refer to this chart as the Table Lens chart but modern use cases may refer to it as otherwise.

How Do I Read it?

The bars making up the Table Lens graph can be represented by multiple values because the variables are sorted independently. They can be made up of averages, numbers, percentages, ranks, distributions etc.

Stephen Few suggests using a table lens graph when your audience is not familiar with scatter plots. Perhaps he suggests this as a way to better view the correlations between variables.

Pre-Processing

Sorting of the variable column is required in order to find relationships among variables in the Table Lens graph. Table lens graphs are laid out similar to a table with the independent variables going horizontally.

According to an academic article, the process to achieving the Table Lens graph is: 1) Scanning through each variable left-to-right 2) Sorting the columns 3) Scan columns to the right, judging if they are correlated.

Mapping

When researching the Table Lens graph, I did not find any interesting aesthetics choices. Due to the fact that this chart requires a multitude of tiny bars in order to find any relationships within the variables, colours tend to be muted so that the reader can establish a pattern. Table Lens graphs tend to be quite busy as they require multiple independent variables.

Good Use vs Bad Use Cases

Good Use

The graph represented below is a good example of a Table Lens used in the modern day. The colours are quite muted but each colour represents a different independent variable. I also quite like that the labels have been added to each bar in order to process one variable over the other. Again, it's quite hard to grasp the relationship between the bars , so the labels add context.

Table Lens Chart on Tableau Public by Rody Zakovich Analyzing Dangerous Sports

Bad Use

The graph represented below is a bad example of the Table Lens graph. The data is really busy. As well, there are no labels so it's difficult to distinguish between the variables, not to mention the hot pink colour doesn't help on an already very busy visualization.

Table Lens Chart on Research Gate representing baseball player stats

Sources used: https://www.perceptualedge.com/images/Effective_Chart_Design.pdf

http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.22.1565&rep=rep1&type=pdf  

https://public.tableau.com/profile/rody.zakovich#!/vizhome/THEWORLDSTOUGHESTSPORTS/THEWORLDSTOUGHESTSPORTS

https://www.researchgate.net/figure/Table-Lens-showing-a-table-of-baseball-players-performance-classification-statistics-for_fig8_30012634

Line Charts

Idiom Line Charts
What: Data One quantitative value, one ordered attribute
How: Encode Points with connection marks between them
Why Show trend
Scale Hundreds of levels of the ordered attribute

Line charts displays one value attribute and one key attribute in a  2-D space, while showing categorical attribute using colors or shapes. It uses one axis for a quantitative attribute and the other for an ordered (sequential/divergent) attribute.

An important feature of line charts is that they also use connection marks to emphasize the ordering of the items along the key axis by explicitly showing the relationship between one item and the next. Thus, they have a stronger implication of trend relationships, as well as continuity.

Line charts should be used for ordered values but not categorical values. A line chart used for categorical data violates the expressiveness principle, since it visually implies a trend where one cannot exist. This implication is so strong that it can override common knowledge.

The underline message of the charts ought to address the difference in heights versus genders. However, the line chart for the above categorical data provides the misleading information such as “The more male a person is, the taller he/she is”.

When designing a line chart, an important question to consider is its aspect ratio: the ratio of width to height of the entire plot. While many standard charting packages simply use a square or some other fixed size, in many cases this default choice hides dataset structure. The relevant perceptual principle is that our ability to judge angles is more accurate at exact diagonals than at arbitrary directions.

The classic sunspot example dataset! The blue line graphs the data itself, while the red line is the derived locally weighted regression line showing the trend. The aspect ratio close to 4 in (a) shows the classic low-frequency oscillations in the maximum values of each sunspot cycle. The aspect ratio close to 22 in (b) shows that many cycles have a steep onset followed by a more gradual decay. 
* Sources: Visualization Analysis and Design, Tamara Munzner, 2014

Rubber Sheet and Isosurfaces

Descriptions

Rubber Sheet
https://en.wikipedia.org/wiki/Rubbersheeting
Like a heat map but used to map four or more dimensions through the use of a colored, three dimensional surface.

Isosurfaces
https://en.wikipedia.org/wiki/Isosurface
Map of data that resemble topographic maps. An isosurface is a three-dimensional analog of an isoline. It is a surface that represents points of a constant value (e.g. pressure, temperature, velocity, density) within a volume of space; in other words, it is a level set of a continuous function whose domain is 3D-space.

Uses

Good for...
plotting concentration, area, depth, altitude encourages: comparison of height, general landscape. Perhaps most often seen as weather maps. Measuring space is more efficient than measuring color.

Not so good for...
Imprecise. data resolution might influence understanding of numbers. Ambiguity about what colors represent and thresholds. How does resolution of data influence meaning?

Ideas: model economies, temperature, belief/political systems

Function

Why extrude from isoline to isosurface? For greater clarity about value meaning. Adding height and depth might communicate more about value differences than color and numeric valued.

Extruding from isoline to isosurface

Example of an isoline, from which an isosurface might be extruded.

Commonly used to represent weather systems

How does the resolution of data affect our interpretation?

The designer is making decisions about the coarseness of data representation and has enormous power to influence the message. Ex. a map of ethnicities represented in the United States that only has 3 inputs will communicate a very different message than the same map with 10 inputs.

What is the appropriate resolution of data? How could this skew or influence meaning?
Plotting weather systems. Height= intensity of rainfall.
Layers of the earth and displaying selected mineral strata.
More weather systems.
Game of Thrones intro credits as an isosurface. Designers characterized data about locations and represented these as a map that represent size, population density, importance to narrative, etc. 

Is Evan Roth's work an isosurface?

Evan Roth produced 3D prints of 2D graffiti by measuring velocity, speed, duration and density.

Heat map

A heat map is a representation of data in maps or diagrams in which values (mostly continuous data) are encoded as color in form of a gradient, which can range from two color hues to the use of the full rainbow spectrum.

It is not necessary to have every single point of a heat map representing a distinct value. A hybrid form can also combine points to (geographical, political, logical) areas.

Heat maps are specially useful in scenarios where they can rely on and make use of a commonly established set of conventions in color encoding, for example the most obvious: the representation of temperature in a weather map.

Color

When used in other domains one should consider that color can be a complicated visual encoding for several reasons: There is no intuitively predominant ordering of color hues, cultural conventions in other contexts might override the reading you intended by your color choice and it is a visual property that doesn’t allow for perception of many distinct values (less than 20). Hence color is generally considered to be a better option for categorial visual encoding.

Color (hue) is not naturally ordered in our brains. Brightness (lightness or luminance, sometimes called tint) and intensity (saturation) are, but color itself is not. We have strong social conventions about color, and there is an ordering by wavelength in the physical world, but color does not have a non-negotiable natural ordering built into the brain. – Designing Data Visualizations by Julie Steele, Noah Iliinsky, Chapter 4 (https://www.oreilly.com/library/view/designing-data-visualizations/9781449314774/ch04.html)

Different types (use cases) of heat maps

Weather maps

> A map showing maximum temperatures across the U.S. for July 10-19, 2013. Gray represents temperatures of 70°F while dark red represents temperatures above 107°F.Credit: NOAA Environmental Visualization Laboratory (http://www.climatecentral.org/blogs/mid-july-heat-wave-bakes-the-us-from-coast-to-coast-16276)

This map represents the distribution of the maximum temperature in the week of July 10 through 19 in 2013 across the US. The scale of 70 °F to 107 °F is encoded in a gradient from grey to dark red. While the choice of grey for the “background” of the map, that is the geographical context of the area that was investigated and is represented, is helpful for focus and avoiding any misleadings, the use of a very light grey for the lowest temperature can cause confusion due to our collective memory of iconic images of volcanoes or furnaces teaching us that the hottest parts of material are the brightest ones.

Variables in this visualization:
  • X and y position for the geographical map.
  • Temperature is encoded in color.

Thermal imaging

Even though thermal imaging or thermography are more related to digital imaging processes I wanted to point out that the translation and scaling of the captured infra-red wavelengths to parts of our visible color spectrum is also a design choice and thus essentially a form of data visualization, too. This example uses the widespread convention of blue indicating cold and a specific convention for thermograms which indicate warm by yellow/white. But there are a lot of examples with different gradients as well.

A heat map of a home captured by a thermal-imaging car. (http://news.mit.edu/2015/startup-essess-heat-mapping-cars-0105)

Web heat maps

are used to visualize which pages of an online service are used or visited most or even more specifically indicate which parts of a page are clicked on or looked at the most (as a result of collected eye-tracking data).

Example of a web heat map of google search results in this case to promote SEO (http://www.seodesignsolutions.com/blog/search-engine-optimization/keyword-research-and-search-engine-positioning/
Variables in this visualization:

This map shows the number of clicks encoded in colored areas ranging from bright red to dark blue and finally transparent areas over the original screenshot of a google search result page. Instead of a smooth gradient rendering in this representations the authors opted for discrete borders between different ranges of values. In regard of the color coding I think the use is conventional enough to be intuitively understood. The highlighted triangle and text is more of a gimmick in this case to promote SEO services.

  • Screenshot of the google search result page
  • X-position on the screen
  • Y-position on the screen
  • Number of clicks encoded in colored areas
  • Added a highlighted area to show “The Golden Triangle” of click

Biology heat maps

visualize arrays of samples and different categories of within each sample. It’s‚ commonly used for gene samples, but other applications are possible:

Yale research: Coding of bitter tastants by a model taste system. (https://peb.yale.edu/heat-map)
Coding of bitter tastants by a model taste system.  The heat map shows the electrophysiological responses elicited by a panel of diverse bitter tastants from the sensilla of a Drosophila taste organ.
Variables visualized in this example (my guess):

This is a representation of an experiment testing the electrophysiological reaction of flies on bitter testing chemicals. As the position in the diagram is not representing spatial information one might argue that it is technically not a map, but it is another example of the use of color hues over a gradient encoding continuous values. Being unfamiliar with the testing method what is peculiar to me is that the scale of reactions ranges from -10 to 60 which leads to the question is 0 is the neutral state, -10 should be considered a mild reaction as well. In this case the absolute neutral value might have been better represented in a completely different color, for example grey.

  • Various bitter testants, codified in the position on the y-axis (categorial)
  • Samples (actually unspecified moments in time of feeding the substance to the fly), codified in the position on the x-axis
  • Another categorization with symbols on the x-axis
  • Reaction, codified in the color mapping (-10, 60)

Heatmap-hybrid

Here’s an example for a heat map with a color gradient encoding the median household income, but instead of assigning every single point in the map a distinct value this visualization combines areas certainly in respect to the data that is available.

What U.S. counties have the lowest and the highest median household income? (http://www.visualcapitalist.com/interactive-median-income-u-s-counties/)

Visual Diff

Visual Diff is a differencing representation that shows the difference between two objects(Text documents, pictures, etc). For instance, two columns of text connected by lines to show where changes have been made.  or two documents with the color bar on the text which highlights the adding and deleting have been done between the two versions.

This type of visualization is wildly used in information technology like version control system, in order to find out the difference or updating have been made in files.

Way of Mapping

There are various comparison strategies visual diff can use, like gradient, color bar, text, pointer.

This screenshot shows how Visual Diff is used in a Programming environment. 
This screenshot shows how Visual Diff is used for text. 
Without line connecting two panels, the Visual Diff is less effective.
This screenshot shows how Visual Diff can be used in computer vision to point out the difference between pictures.

star/radar/spider chart

What

>> arranged radially as equi-angular spokes around a central point
>> the values for adjacent variables in a single series are connected by lines
>> the scale of any variable is represented as it's distance from the centre (making it effortless to find out the outliers)
>> can be used with both Cartesian and polar co-ordinate systems

When

>> What variables are dominant for a given observation?
>> Which observations are most similar clusters of observations?

**The quantitative variables and their values represented on the various axes of a radar chart are distinct and unrelated.

>> categories on the x axis in the image above are simply named entities that have no intrinsic order
>> patterns our visual perception can really discern in a data set presented as a radar chart are similarity & extreme outliers
>> comparison between two/more entities based on various variables
Why

>> performance analysis
>> comparative analysis
>> designed to plot one or more series of values over multiple common quantitative variables by providing an axis for each variable


Weaknesses

>> they are limited to displaying a few variables at a time (practically speaking, no more than 20 ideally or (the web becomes overwhelming)
>> comparing values across access is cumbersome/error-prone and encouraged by this design although not always necessary
>> comparison in radar charts requires conscious thought to mentally project an arc of rotation to map a value from one axis onto another, something we are not particularly adept at
>> Solution? Grid-lines! but they bring in more issues -> they tend to add confusion around axis value, labels, reducing the readability
>> significant occlusion (overlap)
>> the only patterns our visual perception can discern: similarity & extreme outliers.

Better Alternatives

>> parallel coordinate charts
>> small multiples

Permutation Matrix

Published by Jacques Bertin 1967.  (A nice blog post on Bertin is here.)

bertin from source

Source: https://www.researchgate.net/figure/Permuted-matrix-display-from-Bertin-1967-This-figure-was-devised-to-illustrate-the_fig4_227368971

Shipshape Examples

  1. "Scalogram display from Rondinelli (1980), based on Guttman (1950). Visualization of the settlements in the Bicol River Basin, Phillipines."
    Scalogram-display-from-Rondinelli-1980-based-on-Guttman-1950-This-manually-sorted
  2. "Shaded matrix display from Loua (1873). This was designed as a summary of 40 separate maps of Paris, showing the characteristics (national origin, professions, age, social classes, etc.) of 20 districts, using a color scale that ranged from white (low) through yellow and blue to red (high)."
    Shaded-matrix-display-from-Loua-1873-This-was-designed-as-a-summary-of-40-separate
  3. "Cluster heat map from Wilkinson (1994).. Visualization of social statistics (urbanization, literacy, life expectancy for females, GDP, health expenditures, educational expenditures, military expenditures, death rate, infant mortality, birth rate, and ratio of birth to death rate) from a UN survey of world countries."
    Cluster-heat-map-from-Wilkinson-1994-The-data-are-social-statistics-urbanization

Classical Example (Perhaps it is just a name collision)

  1. Classical Permutation Matrix (e.g. below from PlanetMath)
    PlanetMath

Deficient Examples

Overall, I really couldn't find 'deficient examples' on the web.
Some notes on cases where this type of visualization may not work:

  1. In respect the theme of the permutation matrix, in some cases (for example time) where the row/column headings are shuffled continuously may not work well in certain instances when an axis continually changes so that it's difficult for the human eye to make a comparison.
  2. In some cases, for example this link, the visualization may be too dense so that nothing is gained at all from the visualization other to emphasize it's density.
  3. In addition to #2 above, in the case of sparse data, this overall visualization may not add insights other than emphasize it's sparsity.

Histogram review

Overview

Histograms are a powerful visualization tool, but are often confused with bar charts and as we will see below many of the bad examples of histograms come from people trying to hack a histogram out of a bar chart.  

Histograms are generally used for continuous data sets, where the goal is to understand the distribution of a data set.

The data sets are arranged in bins where a total count of observations in a bin is shown to create the distribution. Depending on the data set, the algorithm to arrange the data in the bins and determining the optimal number of bins given spacial constraints can be relatively complex.  While this is a heavy layer of processing, most people rely on existing tools to do this rather than working on first principals.  The mapping of data is relatively easy and achieved heavily in the bin selection and population stage, after that apart from axis differences the process is similar to working with a bar chart.

Good Examples

The first example of a good histogram, is something that I've created in the past. There were a number of elements that I was trying to control for in the image, including (1) correct bin labeling (2) summary data presented spatially (3) controlling for the long right tail in the second last bin (4) controlling for N/M data

Image 1: Good Histogram 1 - Controlling for data issues

In the second example of a good histogram, I selected a tiled histogram, that compares alternative histograms, and provides a nice high level comparison across the datasets.  Personally, I find tiled histograms to be of high value, especially in a three tile example where focusing on series A and B, and the delta between A and B.

Image 2: Good Histogram 2 - Tiled Histogram

In the final good example I have selected an example of a histogram displaying multiple data series.  While there are some design issues, I think the best thing coming away from the chart is the fact that all series are centered at the 0 axis. Often with histograms with multiple series people stack the series which eliminates the ability to examine a data series in its own right.  While there are instances that this is interesting to do with I find that people default to stacking when they should be defaulting to the way in which the below chart is displayed

Image 3: Good Histogram 3 - Multiple Series

Bad Examples

Perhaps the biggest issue with histograms comes from incorrect bin labeling.  This arises mainly from people hacking together histograms in basic charting packages such as Excel and using a bar chart as a means to create a histogram.  While on first glance this often works well - on closer inspection it's nearly impossible to interpret what the chart is representing.  I previously wrote a short article on this issue that's available on my blog.

In the first sample of a bad histogram displayed below, one of the most common examples of an error with a histogram is shown.  As can be seen below the bin axis labels are placed in the middle of the bucket - where the correct labeling should be placed on either side of the bin.  In the example below it's exceptionally hard to try and determine what the data is actually saying given the labelling issue.   Interestingly, this is how Excel labels histograms

Image 4: Bad Histogram 1 - Bar Chart Axis Labeling on a Histogram

In the second bad example of histogram, an alternative label issue is evident, in this instance the user has tried to hack the labeling using a bar chart label rather than a native histogram.  This results in over-labeling on the bin axis.  On a more aesthetic front the use of 3-D rendering is exceptionally questionable, and because of the fixed fade area on different length bars causes serious interpretation issues and spatial biases.

Image 5: Bad Histogram 2 - Bar Chart Labeling Hack, Still Not Histogram Labeling

In the third bad example, I've focused on a chart that has correct bin labeling, but the number of labels along with the bin sizing diminishes the usefulness of the chart.

Image 6: Bad Histogram 3 - Weird Labeling 

table

Not much detailed description is needed when speaking about a table. One of, if not the, purest forms of visualization, a table simply displays data in an organized manner, more specifically, in rows and columns.

With this simplicity comes flexibility in what data is represented. Whether it’s text, numbers, emojis, pictures, audio, the possible data types to display are, essentially, endless. However, the unifying characteristic of all tables containing any data type is the row and column structure, which has one value—i.e, one piece of data—in each cell.

In fact, because there is the option to display multiple data types, comparison can be made between them. More broadly, tables encourage a raw act of comparison—there is little design leading users to any conclusions. Instead, the users themselves are drawing comparisons in the actual rows and columns.

However, little design doesn’t have to mean no design. There are ways to craft engaging tables that represent a story through data for the user to explore, without distracting from the raw data and subsequent comparisons.

For example, in this interesting article by The New York Times, journalists Katie Rogers and Karen Yourish decided to display data of White House officials’ flight costs with a table. In the table, they used multiple data types: text and numbers. One column represents different trips the official in question took, with accompanying short descriptions. The other columns display the price of flying with a military plane alongside the price of flying coach. Because the differences in prices were startling enough, there was no need to design a visualization past a simple table.

In this example by The Pudding, Journalist-Engineers Amber Thomas and Jan Diehm dove into the data of women’s pockets. They measured the size of pockets on men and women’s jeans, comparing different brands and styles. To visualize this data, they used a combination of images and text in a table format, creating an engaging result for the user to draw conclusions and compare not only men and women’s pockets, but also style and brand as well.

FiveThirtyEight often includes templated visualizations in their articles. In this final nice table example, MLB predictions are displayed through multiple data types (text, images, and numbers). Additionally, the designers incorporated a characteristic of many FiveThirtyEight tables: a heat map-style coloring to columns that represents another dimension of data.

Again, even though tables are simple, there are some guiding principles in crafting them and design techniques that can be incorporated. First, tables should have column and row labels. In this first not-so-great example, there is no label of what each column represents, no indication what “n/a” is referring to, and no title giving context to the data.

(This is data on my listening habits I’ve been tracking for the Data is Material course.)

While I couldn’t find an image for it, I learned during my undergraduate thesis through a journalism and anthropology instructor that old newspapers, which obviously didn’t have the ability to include interactivity in print, used to print long tables of data, such as of crime records. Even though it was due to resource restrictions, we spoke about how ineffective this technique was because it showed an overwhelming and unnecessary amount of data to readers, leaving them little to no tools to effectively parse through all the information and come to a conclusion.

The last example of a less-than-effective table combines some of these previously-discussed points and comes from a homework assignment I did in a machine learning tutorial last semester. It came from training a support vector machine in R. There is a utility to this table—for the researcher training a SVM, it may give them what they need to make decisions about their work. However, if we’re talking about it in the context of my previous examples, where a layperson is reading the table to understand the information it displays, there are some shortcomings. The column labels and title are not descriptive to understand what the data means, and there is potentially more data displayed than is needed to reach a solid conclusion. Additionally, the overall lack of thought in design I believe hurts the story the table is trying to tell.

On the pre-processing end, little work needs to be done between the raw data and the ink/pixels in the resulting table. This is because the table itself houses the raw data. There is the ability to convert the raw data into a form that is more digestible or flows more with the story a designer is trying to tell. For example, with numbers, a designer can choose to present them in decimals or percentages. With pictures, the designer may choose to present them in grayscale. However, these actions are not necessary to create a table visualization. Similarly, no mapping is required when it comes to tables. The data can simply be shown. Again, there is the option to map, such as the heated columns in the FiveThirtyEight example, but it is not a required step in visualizing a table.

Dendrogram

  1. What is a Dendrogram?

A Dendrogram demonstrates the hierarchical relationship between objects.

We can think of Dendrograms as a way to represents nested clusters.

2. How to read a Dendrogram?

The key is to focus on the height at which any two objects are joined together.

Look at the image above, we see:

  • E and F are the closest to each other.
  • The cluster of A and B and the cluster of C,D,E and F are the furthest from each other.

3. Applications

An Animal Classes Dendrogram

A Dog Breed Dendrogram

4. Why Dendrogram can be bad?

  • It does not accurately show how many clusters there actually are.

If we cut the single linkage tree at the point shown below, we would say that there are two clusters.

However, if we cut the tree lower we might say that there is one cluster and two singletons.

Matrix & Half Matrix

A matrix is any two dimensional set of numbers, colors, intensities, sized dots or other glyphs. With ‘simple’ matrices, variations along a third or even fourth variable are often represented by color ranges and other types of visual variations between cells on the matrix. Half matrices are usually used for similarities or when two items are being compared against one another. Matrices are useful for illuminating variation and providing handy visual tools for decision-making. Pre-processing is minimal but can include selecting color ranges for heat maps, while mapping can range from simple selection of fonts to glyph designs on to interpolating numeric values for heat map colors.

‘Good Uses’

This matrix is a heatmap of flight-passenger density over time on a specific route, with the X axis representing years and the Y axis months. To achieve the ‘heat’ effect a third variable, monthly passenger totals, has been converted into colors, with greater numbers mapped along a range of values. The use of color values effectively enables a comparison of flight density by month and year. The 'raw' data of flight numbers have apparently been converted into the hex color value system.

Project Schedule Matrix

This project management matrix places months on the X axis and stages of business development on the Y axis. Glyphs represent non-numeric values of progress, enabling the viewer to quickly compare which business stage required the most investment of time. In terms of ‘pre-processing’, it’s likely that numerical ‘progress’ values have been assigned to the 360 degrees of the glyph circles, and then 'mapped' onto the circles, while a checkmark indicates completion.

This useful matrix aimed at pilots of small aircraft looks at cost vs speed from a number of different perspectives. The X axis represents variables of speed, fuel efficiency, and cost. The Y axis lists different models of aircraft. As numbers fill the cells, there is only simple ‘mapping’ in terms of font selection and style. However, the raw data must have involved considerable calculation of aircraft performance. This matrix is sophisticated in that it offers pilots tools to find the ‘true’ cost of speed for their own flying distance and budget. Each pilot must decide what ‘works’ for them based on their own flying habits and needs.

This ‘double’ half matrix for Tasmanian drive travel makes efficient use of available space by devoting one triangle to estimated travel (drive) time and one to distance. Pre-processing was unnecessary and mapping consists only of selecting column and row dimensions, cell colors and fonts.

‘Poor Uses’

This ‘customer portfolio matrix’ is intended to ‘map the business customer portfolio within marketing research...and visualize the results using the matrix.’ The X axis represents loyalty and the Y profitability defined as ‘rentability.’ The matrix is deceptive and visually ‘noisy’ in three ways. Firstly, it appears to be a color-based heat map, but in fact there is no third variable represented by the lighter/darker shades. Secondly, randomly placed figures accomplish little purpose. Thirdly, arrows (and darker colors) serve no goal aside from visually stating the obvious: that business should increase profitability and customer loyalty.

This confusing visualization of birds’ seed preference suffers from organizational and color overload, making it difficult to compare preferences and popularity of seed type. A simpler heat map with bird species on one axis and seed type on the other would have been more effective.

This matrix of journalist deaths assigns year to the X axis and country to the Y axis. The third variable, number of journalists killed, is represented in a red-based heat chart. I feel this matrix is misleading in that, it seems to indicate which country is most dangerous for journalists, but in fact only represents absolute fatality figures in a given year. Instead of absolute deaths, making the third variable a ratio of journalist fatalities/number of journalists in the country would likely change the heat map considerably and give this matrix more relevance.

Box Plot

a two dimensional plot featuring a box capped by the 1st and 3rd quartiles, spliced by the median line, and with "whiskers" extending to min and max values

alternatively, if outliers are present (1.5 x IQR), the whiskers may span the least and greatest non outlier range, with outliers as individually denoted dots

advantages: distills large data to 5 points, simple check of symmetry, indicates outliers
disadvantages: less distribution resolution within quartiles

https://www.nytimes.com/2018/01/04/learning/whats-going-on-in-this-graph-jan-9-2018.html

Parallel and Radial Coordinates Plots

This viz-type belongs to the same family as Sankey Diagrams and Radar Charts. The best use cases apply to multi-variate datasets, which require plotting individual data elements across many dimensions.

Basic Properties:

Each of the dimensions corresponds to a vertical axis and each data element is displayed as a series of connected points along the dimensions/axes.

To show a set of points in an n-dimensional space, a backdrop is drawn consisting of n parallel lines, typically vertical and equally spaced. A point in n-dimensional space is represented as a polyline with vertices on the parallel axes; the position of the vertex on the i-th axis corresponds to the i-th coordinate of the point.

The value of parallel coordinates is that certain geometrical properties in high dimensions transform into easily seen 2D patterns. For example, a set of points on a line in n-space transforms to a set of polylines in parallel coordinates all intersecting at n − 1 points.

Famous Example: Jason Davies' Plot of Multiple car marques and their specs

https://bl.ocks.org/jasondavies/raw/1341281/

Analogue to the Parallel Coordinates Chart: Sankey Diagrams (Flow and Dimensionality)

Radial (Spider) Chart depicting departmental budget expenditures

Dimensionality- each vertex of the spider web represents a department and the radial plot illustrates the departmental spend relative to adjacent departments in cartesian space.

Analogue to Spider chart: The Chord Diagram (Flow and Dimensionality)

https://public.tableau.com/profile/christchild22#!/vizhome/PhoneChord_4/ChordDiagramBarChart

History

Philbert Maurice d'Ocagne introduced the design in 1885. The Parallel coordinates plot was re-popularized by Alfred Inselberg in 1959 and it gained currency in the 1970s as a way to visualize high-dimensional data. These charts are more often found in academic and scientific communities than in business and consumer data visualizations. This isn’t too surprising as parallel coordinate charts can become very dense and difficult to comprehend. Stephen Few has a typical reaction (PDF):

The first time that I saw a parallel coordinates visualization, I almost laughed out loud. My initial impression was "How absurd!" I couldn’t imagine how anyone could make sense of the dense clutter caused by hundreds of overlapping lines. This certainly isn’t a chart that you would present to the board of directors or place on your Web site for the general public. In fact, the strength of parallel coordinates isn’t in their ability to communicate some truth in the data to others, but rather in their ability to bring meaningful multivariate patterns and comparisons to light when used interactively for analysis.

Applications:

Collision avoidance algorithmsfor air traffic control (1987—3 USA patents)

Data mining (USA patent),

Computer vision (USA patent),

Optimization, process control,

More recently in intrusion detection and elsewhere.

Why Use Parallel Plots

help in showing many dimensions, limited only by horizontal space.

Like all good visualizations, parallel coordinates can also show both the forest and the tree. The big picture can be seen in the patterns of lines; individual lines can be highlighted to see detailed performance of specific data element

Benefits:

The order the axes are arranged in can impact the way how the reader understands the data. One reason for this is that the relationships between adjacent variables are easier to perceive, then for non-adjacent variables. So re-ordering the axes can help in discovering patterns or correlations across variables.

Downside:

The downside to Parallel Coordinates Plots, is that they can become over-cluttered and therefore, illegible when they’re very data-dense. The best way to remedy this problem is through interactivity and a technique known as “Brushing”. Brushing highlights a selected line or collection of lines while fading out all the others. This allows you to isolate sections of the plot you’re interested in while filtering out the noise.

Bad Examples: An Extreme Case

Attempts to solve a complex multi-variate problem, but is completely inscrutable

Problems with this:

  1. Meaningful patterns are obscured in the clutter of lines
  2. Lack of interactivity to guide the user

Voronoi Diagrams

Definition

A Voronoi diagram consists of a plane partitioned by a set of n points into convex polygons, such that each polygon contains one generating point and represents the region of points around it that is closer to this generating point than any other.

Basic Properties

  • Generators/sites/seeds: finite set of points in a given plane
  • Voronoi cells: the region of points in which the distance to a given generator is less than equal to the distance to any other generator
  • Voronoi line segments: points in the plane equidistant to two generators
  • Voronoi nodes: points equidistant to three or more sites
A) Line segment marks points equidistant from both sites. B) Three sites produce a node, a point that is equidistant from all sites. C) Four sites produce a cell. Fig adapted from DataGenetics.
When you color the regions demarcated by line segments, you get something like this.
Modulation of Voronoi cell regions as sites move.

Try making your own Voronoi diagram here. Click to add sites, and see how the polygonal regions change shape.

Optimal Usage

Voronoi diagrams are advantageous in visualizing data that depends on spatial distribution. Its mapping depends on the properties of the plane and constraints in which the set of points exist (i.e. Euclidean, Manhattan, etc)

Voronoi diagram based on Euclidian plane (straight line distance between two points)
Voronoi diagram based on Manhattan plane (taxicab geometry in which the distance between two points is the sum of the absolute value of the differences of their cartesian coordinates)

Origins and Applications

The use of Voronoi diagrams can be traced back to Descartes in 1644, in which he mapped the distribution of matter in the universe. He predicted that matter forms vortices centered at fixed stars (sites).

Descartes' diagram of vortices around stars

Another seminal use of Voronoi diagrams was demonstrated by Dr. John Snow, during the 1854 London cholera outbreak. Snow theorized that cholera was reproduced in the human body and was spread through contaminated water. London’s water supply system consisted of public wells where people could pump their own water and carry it home. The cholera outbreak in September 1854 centered around the Soho district. In order to investigate the relationship between water contamination and cholera death, Snow mapped all of the public wells in this area along with all of the known cholera deaths. As one can see in his map, the majority of cholera deaths centered around the Broad Street pump. He confirmed that there was an unknown bacterial sample in the water of the Broad Street pump, and had this pump removed; the cholera outbreak subsided shortly after.

Pump marked as a circular P; deaths marked as black rectangle

Modern Applications

There are a broad range of applications for Voronoi Diagrams. Some examples include:

  • Epidemeology (investigate origin and distribution of infectious diseases)
  • Biology (model physical constraints of cell growth)
  • Ecology (define growth patterns of plants and forests)
  • User Interface (best hover state for a given location on screen)
  • City Planning (nearest school for a student in given county)
  • Robotic/Automatic Navigation (furthest distance from obstacles in a given route)

London Tube Map

What is the nearest tube station in any location in London (could be implemented for any major city public transit system)?

Source Code

World Airport Map

What is the nearest airport a pilot can go to if an emergency landing is necessary?

Interactive version can be found here

Sources and More Explorations

  1. http://datagenetics.com/blog/may12017/index.html
  2. http://mathworld.wolfram.com/VoronoiDiagram.html
  3. https://www1.udel.edu/johnmack/frec682/cholera/
  4. https://www.ics.uci.edu/~eppstein/gina/voronoi.html

Robert Simmon - Subtleties of Color

A NASA data visualization expert, Simmon explores best practices for color, grounding his presentation in the science of visual perception and visual culture.

Simmon begins by stating that the purpose of data visualization is to illuminate patterns and relationships hidden in numbers. He illustrates this with an early map of Mars' surface that was hand colored in to reflect numbers transmitted by a space probe.
Screen-Shot-2018-09-30-at-6.27.45-PM

He then goes on to discuss the divergence between the objective reality of colors and the colors that we see as a 'construct of brain processing.' Simmon points out that our vision evolved to 'see the lion hiding in the brush.'

Since color ramps on computer monitors are linear but our response is not, we need a better approximation of visual perception than the RGB scale. While the HSL scale is closer to human perception, this need resulted in the creation of the LCH color scale as per below.
Screen-Shot-2018-09-30-at-6.34.35-PM

Following his presentation of basic color theory, Simmons next turns to best practices for using colors in data visualization. He refers to the long history of cartography and outlines three types of data that require differing approaches: sequential, divergent, and qualitative.

He prefaces his discussion of best practices by referring to the problems inherent with rainbow and grayscale palettes. Simmons says rainbow colors are suitable for divergences, but less so for other types of data. Grayscale is problematic due to surrounding color tones effecting perception of lightness. For an example of the problems inherent to the rainbow palette, the below example shows little difference in green hues, despite the number values being an even progression.
Screen-Shot-2018-09-30-at-6.42.00-PM

Colin Ware, however, has proposed palettes that cycle through hues and saturation while increasing in lightness. These are useful for sequential data with a progression from low to high values.
Screen-Shot-2018-09-30-at-6.44.08-PM

Divergent palettes on the other hand are suitable for cases when emphasizing outliers, as in anomaly data, or profit/loss visualizations.
Screen-Shot-2018-09-30-at-6.47.19-PM

For qualitative data, such as for example different political parties in a multiparty system, he proposes a rule of thumb called 'magic 7' in which 7 colors are used. This can be extended by plus or minus 2 for 5-9 categories altogether.

Simmons next discusses issues involving color blindness, presenting safe palettes available online for common green-blue issues.
Screen-Shot-2018-09-30-at-6.52.39-PM

Symantic, emotional and cultural associations of color also need to be considered in visualizing data. He presents as one example the fact that in the west the color red is associated with anxiety and danger whereas in China it's linked with good luck. He also displays a fascinating chart of qualities people associate with different colors.
Screen-Shot-2018-09-30-at-6.53.53-PM

He makes the point about our intuitions regarding color dramatically with two examples of deaths in the Iraq war, one in red and one in blue, conveying rather different messages with the same data.
Screen-Shot-2018-09-30-at-6.56.28-PM

Simmons stresses the usefulness of color in indicating thresholds, or to indicate no data at all, as in a hurricane map of the oceans where gray indicates land.
Screen-Shot-2018-09-30-at-7.01.27-PM

He ends his presentation by listing available tools, such as the online Color Brewer palettes, and stressing that aesthetics matter to data visualization, because 'creating something attractive is a tool to make our data visualizations more effective.'

Aside from its wealth of useful, evidence-based tips for selecting color, what stood out to me from Simmons' presentation is the divergence between objective color values, and the way they are perceived. This presents challenges that, while cartographers have been solving them intuitively for centuries, have only been understood scientifically quite recently.