Data analysis, such as the analysis of production processes, includes a number of activities that
cannot be automated completely. Therefore, the work of human analysts is often required. Both,
information visualization and sonification the representation of data with images or sounds
are considered effective methods to involve humans in data analysis. These two fields utilize the
highly sophisticated visual and auditory information processing capabilities of humans. While
information visualization approaches explore computer-based, interactive visual representations
of data, sonification illustrates information through the use of nonspeech audio. With the
increasing amount and complexity of data, both approaches have reached their limits, which is
also the case for the human perceptual capacities serving as the basis for interpreting images and
sounds.
Although extensive research has been carried out on auditory and visual represent ation of data,
there have been few attempts to combine these two channels in a systematic and complementary
manner. So far, way too little attention has been paid to the interrelation of these modalities.
Existing research on combinations has often focused on one modality while neglecting the other. A
methodical approach to combine information visualization and sonification with regard to a
complementary framework is still missing. Due to the rapidly increasing amounts of complex data
to be analyzed, each individual approach reaches its limits. For this reason, more capable methods
are urgently needed.
Our project SoniVis aims to bridge the gap between sonification and visualization. To do this, we
are working on creating a basis for a unified design theory for audio-visual analytics that combines
these two modalities in a complementary way for exploratory data analysis. Within the framework
of this project, we will (1) outline the range of design options for complementary audio-visual data
analysis approaches; (2) examine the practical feasibility in the form of a design study based on
the analysis of production processes; and (3) conduct a controlled experiment to empirically
compare different complementary audio-visual analytics approaches. We will follow a human-
centered and problem-driven research process and we will closely link design and evaluation
phases to review our approaches in a timely manner, thus reducing the risk of unreliable results.
Research Outputs (6)
publications (6)
Title
Year(s)
DOI / Link
Parallel Chords: an audio-visual analytics design for parallel coordinatesPersonal and Ubiquitous Computing