A Network of Noise: Designing with a Decade of Data to Sonify JANET
23 Aug 2017-pp 36
TL;DR: Using a variety of sonification techniques, this work examines the user context, how this sonification leads to system design considerations, and feeds back into the user experience.
Abstract: The existing sonification of networks mainly focuses on security. Our novel approach is framed by the ways in which network traffic changes over the national JANET network. Using a variety of sonification techniques, we examine the user context, how this sonification leads to system design considerations, and feeds back into the user experience.
Citations
More filters
15 Jul 2018
TL;DR: The initial research insights of an ongoing research project that focuses upon understanding the role of landscape, its use as a resource for designing interfaces for musical expression, and as a tool for leveraging ethnographic understandings about space, place, design and musical expression are presented.
Abstract: This short paper presents the initial research insights of an ongoing research project that focuses upon understanding the role of landscape, its use as a resource for designing interfaces for musical expression, and as a tool for leveraging ethnographic understandings about space, place, design and musical expression. We briefly discuss the emerging research and reasoning behind our approach, the site that we are focusing on, our participatory methodology and conceptual designs. This innovative research is envisaged as something that can engage and interest the conference participants, encourage debate and act as an exploratory platform, which will in turn inform our research, practice and design.
4 citations
Cites background or methods from "A Network of Noise: Designing with ..."
...The national academic network [23] is sonified in various methods to show how part of academia’s fabric using white nose and identifying the sections....
[...]
...Work with museum visitors with visual impairments [23] concluded that non-linear, interaction with...
[...]
19 Dec 2017
TL;DR: Kallionpaa et al. as mentioned in this paper presented some initial work on the development of an opera using such technologies that is being composed by Kallion paa and Chamberlain, which is being performed on the Max/MSP platform.
Abstract: New technologies, such as Virtual Reality (VR), Robotics and Artificial Intelligence (AI) are steadily having an impact upon the world of opera. The evolving use of performance-based software such as Ableton Live and Max/MSP has created new and exciting compositional techniques that intertwine theatrical and musical performance. This poster presents some initial work on the development of an opera using such technologies that is being composed by Kallionpaa and Chamberlain.
2 citations
25 Aug 2017
TL;DR: In this article, a piece called Numbers into Notes (N2N) is presented, where individuals are given the chance to create an algorithm, which is made into a physical entity (containing a sequence), which is then gifted to the composer; these together are combined and used to compose a piece.
Abstract: This piece brings together, participation, algorithmic composition and augmentation (as a mechanism by which people can work together to augment and support a composer’s workflow). The performance is about understanding the ways in which composition and performance can be understood, socially, aesthetically and scientifically. This performance becomes a piece of research and design in its own right, a more experimental manifestation of HCI, but it also demonstrates and disrupts conventional production and performance by making the multiple layers of practice and provenance obvious. *See Program notes for a fuller description of the piece for public consumption. We also aim to discuss this further and demo at the Performance workshop that we have submitted.
This is part the on going research of the FAST project and aims to engage the wider interdisciplinary Audio Mostly community.
• Program notes
This piece expands upon Chamberlain’s work into compositional practices that explore autonomy and control, and builds upon the Numbers into Notes system as developed by De Roure. The piece (which is an evolving work) uses the symbolism of the gift to frame parts of the interactions that have occurred in the development of the piece. Individuals are given the chance to create an algorithm. This is made into a physical entity (containing a sequence), which is then gifted to the composer; these together are combined and used to compose a piece. The piece is then performed and given back to the audience (live), of which some members have created the original algorithms. The performance creates a gift, a souvenir, a memento of the experience which some of the audience members can take away. The performance also acts as a way in which we can also understand the interplay between algorithms, art, performance, provenance and participation.
1 citations
26 Aug 2017
TL;DR: The Audio Mostly workshop as mentioned in this paper examines the interplay between people, musical instruments, performance and technology, and brings together performers, artists, designers and researchers to explore the use and design of new and evolving technologies for performance.
Abstract: Rationale
There has been little chance for researchers, performers and designers in the UK to come together in order to explore the use and design of new and evolving technologies for performance. This workshop examines the interplay between people, musical instruments, performance and technology. Now, more than ever technology is enabling us to augment the body, develop new ways to play and perform, and augment existing instruments that can span the physical and digital realms. By bringing together performers, artists, designers and researchers we aim to develop new understandings how we might design new performance technologies.
Some Topics
- Methods and Approaches; What are the methods and approaches that we can employ to understanding interaction and interplay in performance and what impact does technology have on this?
- Sonic Augmentation; can performance and sound change the experiential attributes of places, e.g. make them more accessible, more playful?
-Physical/digital augmentation; how can one augment one’s self or existing musical instruments and artifacts physically and digitally?
- Meaning and Mediation; can people narrate or make sense and movement as part of performance – how does the audience understand this?
- Mobility and Immobility; performance and movement, what are the dynamics of performing at rest or whilst mobile, how can technology supported co-located and distributed performance and reception?
- Locating Content and Spatialisation; how is performance located, how does sound and performance become part of the spatial fabric and what software tools can support this?
- Personalization and Reflection; how can people use new performance technologies to narrate and reflect upon experiences – both as performer and spectator?
These are some tentative implications and questions that we expect to address in the workshop.
Goals
The main goal of the workshop is to bring people together to discuss the issues mentioned previously and to explore this emergent space. As part of Audio Mostly we would like to build this community and develop a network that would engender ongoing participation, debate, scholarship and collaboration. The workshop would also like to encourage early career researchers and PhD students to attend in order to grow the community.
1 citations
21 Jun 2021
TL;DR: In this paper, the authors take a more experimental view of the ways in which network data might be used in compositions to help us to move beyond traditional sonification techniques into more musical territories which enables us to start to understand how archival data and tools can be used as a creative response to the data and provide a more human way of engaging with the data archive.
Abstract: In this paper, we present our initial findings in using digital methods to consider the way that different devices can connect to the same object We take a more experimental view of the ways in which network data might be used in compositions to help us to move beyond traditional sonification techniques into more musical territories which enables us to start to understand the ways in which archival data and tools might be used as a creative response to the data and provide a more human way of engaging with the data archive Such approaches can inform the ways in which future research platforms for Web Science can be developed in a truly multidisciplinary way which matches the needs of the wider research community and supports public engagement
References
More filters
[...]
TL;DR: The process behind the design of Audio Aura, a system to provide serendipitous information, via background auditory cues, that is tied to people’s physical actions in the workplace, and a number of trade-offs in the use of legacy systems and client-server design are described.
Abstract: In this paper. we describe the process behind the design of Audio Aura. The goal of Audio Aura is to provide serendipitous information, via background auditory cues, that is tied to people’s physical actions in the workplace. We used scenarios to explore issues in serendipitous information such as privacy and work practice. Our sound design was guided by a number of strategies for creating peripheral sounds grouped in cohesive ecologies. Faced with an physical and software infrastructure under development in a laboratory distant f?om our sound studio. we prototyped different sonic landscapes in VRML worlds. In our infrastructure design, we made a number of trade-offs in our use of legacy systems and our client-server design.
256 citations
"A Network of Noise: Designing with ..." refers background in this paper
...[6] presents the concept of serendipitous information derived from background auditory clues....
[...]
Proceedings Article•
08 Dec 2000TL;DR: Peep is a network monitoring system that replaces visual monitoring with a sonic 'ecology' of natural sounds, where each kind of sound represents a specific kind of network event.
Abstract: Activities in complex networks are often both too important to ignore and too tedious to watch. We created a network monitoring system, Peep, that replaces visual monitoring with a sonic 'ecology' of natural sounds, where each kind of sound represents a specific kind of network event. This system combines network state information from multiple data sources, by mixing audio signals into a single audio stream in real time. Using Peep, one can easily detect common network problems such as high load, excessive traffic, and email spam, by comparing sounds being played with those of a normally functioning network. This allows the system administrator to concentrate on more important things while monitoring the network via peripheral hearing.
74 citations
"A Network of Noise: Designing with ..." refers background in this paper
...Previous work on sonifying networks [1][3][4] has focused upon security and monitoring....
[...]
...Previous work on the sonification of network focused on monitoring tasks, such as Peep [4], SonNet [3] and [1]....
[...]
01 Jul 2003
TL;DR: The lively development of SonificationDesignPatterns by the ICAD community may help build sonification-specific vocabulary, identify sonification hypotheses, and allow product designers to pick up and apply the research.
Abstract: Most product designers have little or no experience with sonifications. Designers from a range of different domains use a common method called Design Patterns to describe “solutions to problems in context” in a way that can be readily understood and reused. Design Patterns may provide a way to communicate sonification research results with product designers and other design communities. I have written a handful of prototype Sonification Design Patterns from papers in the ICAD 2002 proceedings. The papers I selected had clear statements of hypotheses, results to support them, and repeated examples elsewhere in the proceedings. These Patterns are now on the SonificationDesignPatterns site on the WikiWeb and can be edited and added to using any internet browser. The lively development of SonificationDesignPatterns by the ICAD community may help build sonification-specific vocabulary, identify sonification hypotheses, and allow product designers to pick up and apply our research. Keywords: Sonification, Auditory Display, Design Patterns
53 citations
"A Network of Noise: Designing with ..." refers methods in this paper
...4 DISCUSSION The Perceiving Patterns in Data pattern [2] argues that time varying sonifications, where the data is high dimensional and hard to read in tabular form, can be used to perceptually group data together and show attributes....
[...]
10 Oct 2004
TL;DR: ChucK is described - a programming language and programming model for writing precisely timed, concurrent audio synthesis and multimedia programs and can be extended to write code on-the-fly -- while the program is running.
Abstract: In this paper, we describe ChucK - a programming language and programming model for writing precisely timed, concurrent audio synthesis and multimedia programs. Precise concurrent audio programming has been an unsolved (and ill-defined) problem. ChucK provides a concurrent programming model that solves this problem and significantly enhances designing, developing, and reasoning about programs with complex audio timing. ChucK employs a novel data-driven timing mechanism and a related time-based synchronization model, both implemented in a virtual machine. We show how these features enable precise, concurrent audio programming and provide a high degree of programmability in writing real-time audio and multimedia programs. As an extension, programmers can use this model to write code on-the-fly -- while the program is running. These features provide a powerful programming tool for building and experimenting with complex audio synthesis and multimedia programs.
46 citations
"A Network of Noise: Designing with ..." refers background in this paper
...[9] argues that this allows network traffic to be monitored as a peripheral task supporting situational awareness and the self-organised criticality of the network as a background task, in order that the sonification can be part of another task....
[...]
TL;DR: The goals for the aural rendering are to make certain conditions immediately apparent to untrained listeners, and to create a sound model capable of enough nuance that there is the possibility of unexpected patterns becoming apparent to a seasoned listener.
Abstract: Building on our previous work, we extend sonification techniques to common network security data. In this current work, we examine packet flow and the creation of socket connections between a requestor's IP address and port number with the server's IP address and port number. Our goals for the aural rendering are twofold: to make certain conditions immediately apparent to untrained listeners, and to create a sound model capable of enough nuance that there is the possibility of unexpected patterns becoming apparent to a seasoned listener. This system could be used to potentially provide better cognitive refinement capabilities for data fusion systems, especially when multiple sources of data at various levels of refinement are presented to the human analyst.
38 citations
"A Network of Noise: Designing with ..." refers background in this paper
...Previous work on sonifying networks [1][3][4] has focused upon security and monitoring....
[...]
...Previous work on the sonification of network focused on monitoring tasks, such as Peep [4], SonNet [3] and [1]....
[...]