SoniVis: Data Analytics using Sonification and Visualization

Data analysis, such as the analysis of production processes, includes a number of activities that cannot be automated completely. Therefore, the work of human analysts is often required. Both, information visualization and sonification the representation of data with images or sounds are considered effective methods to involve humans in data analysis. These two fields utilize the highly sophisticated visual and auditory information processing capabilities of humans. While information visualization approaches explore computer-based, interactive visual representations of data, sonification illustrates information through the use of nonspeech audio. With the increasing amount and complexity of data, both approaches have reached their limits, which is also the case for the human perceptual capacities serving as the basis for interpreting images and sounds. Although extensive research has been carried out on auditory and visual represent ation of data, there have been few attempts to combine these two channels in a systematic and complementary manner. So far, way too little attention has been paid to the interrelation of these modalities. Existing research on combinations has often focused on one modality while neglecting the other. A methodical approach to combine information visualization and sonification with regard to a complementary framework is still missing. Due to the rapidly increasing amounts of complex data to be analyzed, each individual approach reaches its limits. For this reason, more capable methods are urgently needed. Our project SoniVis aims to bridge the gap between sonification and visualization. To do this, we are working on creating a basis for a unified design theory for audio-visual analytics that combines these two modalities in a complementary way for exploratory data analysis. Within the framework of this project, we will (1) outline the range of design options for complementary audio-visual data analysis approaches; (2) examine the practical feasibility in the form of a design study based on the analysis of production processes; and (3) conduct a controlled experiment to empirically compare different complementary audio-visual analytics approaches. We will follow a human- centered and problem-driven research process and we will closely link design and evaluation phases to review our approaches in a timely manner, thus reducing the risk of unreliable results.