A Comparative Analysis of Speaker and Headphone-Based Immersive Audio in VR and Gaming Applications:
- Authors: Marais, Kyle , Foss, Richard
- Date: 2023
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426705 , vital:72384 , https://ieeexplore.ieee.org/abstract/document/10289435
- Description: Precise and accurate audio spatialization is crucial for gaming and Virtual Reality (VR) applications, as it is an essential aspect of the immersion experienced by users. When the audio of a virtual environment is synchronized with its visual sources and localized accurately, users are more likely to feel deeply engaged and suspend their disbelief. Audio Middleware software is commonly used in cooperation with game engines to meet the audio requirements of virtual environments created by game developers. This research paper presents a comparative analysis of speaker-and headphone-based immersive audio systems within the context of VR. The research findings indicate that, despite the headphone-based system offering more accurate audio localization and a higher ‘perceived audio quality’, the speaker-based system resulted in a greater sense of ‘immersion.’.
- Full Text:
- Date Issued: 2023
Enhancing Object Audio Control within an Immersive Sound System
- Authors: Klingebiel, Lukas , Foss, Richard
- Date: 2023
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426771 , vital:72390 , https://ieeexplore.ieee.org/abstract/document/10289235
- Description: Real time control over sound source positioning and movement is a primary advantage of object-based sound systems over channel-based systems. This paper describes a controller, processing engine, and associated library that enhances this object control. Apart from graphic spatialization control, the controller allows, for each object, the selection of its rendering algorithm, distance-based level, high frequency attenuation, reverb parameters and speaker isolation or locking. OSC control within the controller enables further control options.
- Full Text:
- Date Issued: 2023
Employing the Processing Capability of Mixing Consoles and Audio Interfaces to Spatialize Sound:
- Authors: Foss, Richard
- Date: 2019
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426758 , vital:72389 , https://www.aes.org/e-lib/browse.cfm?elib=22211
- Description: Many audio interfaces and all mixing consoles have signal mixing capabilities. This paper describes an immersive sound system that employs these capabilities in order to spatialise sound sources, where these sources could be any of the inputs to these mix-capable devices. Graphic spatialisation control is provided on client devices, and 3D coordinates are sent to a server. The server uses these coordinates and speaker positions to render mix level and reverb parameter values. These values are sent to the mixer device using a control protocol. Advantages of this approach are that all inputs can be spatialised, and low-level processing is offloaded from the computer.
- Full Text:
- Date Issued: 2019
A Flexible Approach for the Application of Immersive Audio to an Installation Performance:
- Authors: Devonport, Sean , Foss, Richard
- Date: 2018
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426720 , vital:72385 , https://www.isea-international.org/symposia/1988-2022/
- Description: This paper investigates the use of the ImmerGo spatial audio system and Ethernet AVB as a platform for the creation and deployment of immersive audio content. An analysis of Ethernet AVB and ImmerGo’s features is given. This is followed by a practical implementation of ImmerGo within an installation setting of a choreographed performance. This approach provided key features such as user control from a mobile device to render positions of audio tracks and control DAW transport. The Ethernet AVB network allowed for real-time synchronized audio streaming, audio device interoperability, distributed endpoint processing and simple audio routing schemes.
- Full Text:
- Date Issued: 2018
An Immersive Audio Control System Using Mobile Devices and Ethernet AVB-Capable Speakers:
- Authors: Foss, Richard , Devonport, Sean
- Date: 2018
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426745 , vital:72388 , https://www.aes.org/e-lib/browse.cfm?elib=19714
- Description: Immersive Sound is commonly used to create the localization of sound sources above, below, and around listeners. To achieve this immersive goal, sound systems are employing an ever-increasing number of speakers. Given that immersive sound systems have large speaker configurations such as in cinemas, theaters, museums, and home theater installations, there is a need to provide control for these various contexts and also to provide a means of automating this control. An immersive sound system has been created that allows for the real-time control over sound source localization. It is a multi-user client/server system where the client devices are mobile devices, thereby allowing remote control over sound source localization. Touch and orientation capabilities of mobile devices are used for the generation of three-dimensional coordinates. The server receives localization control messages from the client and uses an Ethernet AVB (audio video bridging) network to distribute appropriate mix levels to speakers with built-in signal processing. These localization messages can be recorded by users for later playback.
- Full Text:
- Date Issued: 2018
Principles of Control Protocol Design and Implementation
- Authors: Eales, Andrew , Foss, Richard
- Date: 2016
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426801 , vital:72392 , https://www.aes.org/e-lib/online/browse.cfm?elib=18238
- Description: Control protocols are used within audio networks to manage both audio streams and networked audio devices. A number of control protocols for audio devices have been recently developed, including the AES standards AES64-2012 and AES70-2015. Despite these developments, an ontology of control protocol design and implementation does not exist. This paper proposes design and implementation heuristics for control protocols. Different categories of control protocol design and implementation heuristics are presented and the implications of individual heuristics are discussed. These heuristics allow the features provided by different control protocols to be compared and evaluated and provide guidelines for future control protocol development.
- Full Text:
- Date Issued: 2016
A Connection Management System to Enable the Wireless Transmission of MIDI Messages
- Authors: Shaw, Brent , Foss, Richard
- Date: 2015
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426829 , vital:72394 , https://www.aes.org/e-lib/browse.cfm?elib=18030
- Description: This paper examines the design and implementation of a wireless system for the distribution of MIDI messages for show control and studio environments. The system makes use of the MIDI and MIDINet protocols, creating wireless nodes that will enable the transmission of MIDI between devices on a wireless network with connection management capabilities through the use of embedded web servers. The paper describes the current state of the art, configuration of the system, hardware architectures, software design, and implementation.
- Full Text:
- Date Issued: 2015
Immersive audio content creation using mobile devices and ethernet avb
- Authors: Rouget, Antoine , Foss, Richard
- Date: 2015
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426786 , vital:72391 , https://www.aes.org/e-lib/browse.cfm?elib=18009
- Description: The goal of immersive sound systems is to localize multiple sound sources such that listeners are enveloped in sound. This paper describes an immersive sound system that allows for the creation of immersive sound content and real time control over sound source localization. It is a client/server system where the client is a mobile device. The server receives localization control messages from the client and uses an Ethernet AVB network to distribute appropriate mix levels to speakers with in-built signal processing.
- Full Text:
- Date Issued: 2015
A Flexible Approach for the Application of Immersive Audio to an Installation Performance:
- Authors: Gurdan, Robby , Foss, Richard
- Date: 2014
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426732 , vital:72387 , https://patentimages.storage.googleapis.com/28/4a/94/1113bd7074ad90/US8862755.pdf /
- Description: An apparatus for modifying a command message (CMD) received from a source apparatus to control a target device parameter of a target apparatus within a digital multimedia network, wherein a hierarchical parameter address (HPA) or a parameter value contained in said command message (CMD) is changed according to at least one change script to provide a modified command message (CMD′).
- Full Text:
- Date Issued: 2014
An Associative Shared Memory Approach to Audio Connection Management
- Authors: Eales, Andrew , Foss, Richard
- Date: 2014
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426841 , vital:72395 , https://www.aes.org/e-lib/browse.cfm?elib=17539
- Description: A distributed, associative memory that advertises audio streams and represents audio connections between networked audio devices is described. Characteristic features of a shared, associative memory are discussed, and three parameter-based models that represent audio signals and audio connections are introduced. Connection management is then discussed with reference to a distributed, associative memory environment. This environment allows changes made to audio connections to be automatically propagated to all networked devices, while also eliminating potential race conditions between connection requests. Additionally, connection management applications can be shared between different networked devices and controllers.
- Full Text:
- Date Issued: 2014
Digital multimedia network with parameter join mechanism
- Authors: Gurdan, Robby , Foss, Richard
- Date: 2014
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/427059 , vital:72411 , https://patentimages.storage.googleapis.com/ae/e3/6a/0afc332b8afaea/US8855008.pdf
- Description: A digital multimedia network with a parameter join mechanism comprising at least one apparatus. A requesting device parameter of a source apparatus updates a local parameter group list by adding an entry for each device parameter of a target apparatus which joins the parameter group.
- Full Text:
- Date Issued: 2014
Utilizing gesture recognition and Ethernet AVB for distributed surround sound control
- Authors: Hedges, Mitchell , Foss, Richard
- Date: 2014
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426816 , vital:72393 , https://www.aes.org/e-lib/online/browse.cfm?elib=17540
- Description: Gesture recognition has become a preferred approach to the control of various systems. This allows users of the system to interact without having to use any controls or equipment. This paper investigates the use of gesture recognition in order to select and transport audio tracks over an Ethernet AVB network to speaker endpoints. The research uses equipment that is commercially available and relatively cost efficient. The endpoints receive audio samples that are encapsulated within network packets and processes them. The audio tracks are mixed at the endpoints according to gain ratios that will change and be different for each endpoint.
- Full Text:
- Date Issued: 2014
Audio Device Representation, Control, and Monitoring Using SNMP
- Authors: Eales, Andrew , Foss, Richard
- Date: 2013
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426855 , vital:72396 , https://www.aes.org/e-lib/browse.cfm?elib=17012
- Description: The Simple Network Management Protocol (SNMP) is widely used to configure and monitor networked devices. The architecture of complex audio devices can be elegantly represented using SNMP tables. Carefully considered table indexing schemes support a logical device model that can be accessed using standard SNMP commands. This paper examines the use of SNMP tables to represent the architecture of audio devices. A representational scheme that uses table indexes to provide direct-access to context-sensitive SNMP data objects is presented. The monitoring of parameter values and the implementation of connection management using SNMP are also discussed.
- Full Text:
- Date Issued: 2013
Control protocol command translation for device interoperability on ethernet AVB networks
- Authors: Foss, Richard , Igumbor, Osedum P
- Date: 2013
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426978 , vital:72405 , https://www.aes.org/e-lib/browse.cfm?elib=16707
- Description: Audio/Video Bridging (AVB) on Ethernet refers to a suite of standards that allows for deterministic and guaranteed delivery of audio and video content on Virtual Local Area Networks (VLAN). A requirement for the networking of audio devices is to allow for remote establishment and destruction of audio stream connections. There are a number of sound control protocols that utilize AVB transport, and this paper describes an approach for common control and interoperability among them. To demonstrate this approach, this paper describes the design and implementation of a command translator that enables communication between AES64 and OSC-networked AVB devices. Results from a quantitative analysis reveal that when a proxy is used for connection management, noticeable delays are not added to a user’s visual and auditory perception.
- Full Text:
- Date Issued: 2013
Digital multimedia network with latency control
- Authors: Gurdan, Robby , Foss, Richard
- Date: 2013
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/427043 , vital:72410 , https://patentimages.storage.googleapis.com/59/e3/43/6b49b528623ea3/US8477812.pdf
- Description: The present invention relates to a digital multimedia network 1 with latency control comprising apparatuses for processing of data streams, wherein a borderline input apparatus providing a data stream generates a latency time stamp (LTS) which contains an absolute time indicating a creation time of said data stream and an accumulated delay time which is updated by each apparatus processing said data stream, wherein said latency time stamp (LTS) of said data stream is evaluated by a borderline output apparatus of said network which synchronizes said data stream.
- Full Text:
- Date Issued: 2013
Implementation of AES-64 connection management for Ethernet Audio/Video Bridging devices
- Authors: Dibley, James , Foss, Richard
- Date: 2013
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426875 , vital:72397 , https://www.aes.org/e-lib/online/browse.cfm?elib=17014
- Description: AES-64 is a standard for the discovery, enumeration, connection management, and control of multimedia network devices. This paper describes the implementation of an AES-64 protocol stack and control application on devices that support the IEEE Ethernet Audio/Video Bridging standards for streaming multimedia, enabling connection management of network audio streams.
- Full Text:
- Date Issued: 2013
Modeling Complex Networked Audio Devices
- Authors: Eales, Andrew , Foss, Richard
- Date: 2013
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/427012 , vital:72408 , https://www.aes.org/e-lib/browse.cfm?elib=16706
- Description: The lack of a universally accepted standard control protocol, as well as a lack of interoperability among existing protocols, limits how audio software can support a wide range of networked devices. To address this issue, the authors propose an abstract standard audio device model that is independent of any particular technology. This standard device model supports service discovery and enumeration, while also specifying device parts, the representation of parameter addresses, and the visual appearance of controls. The discussion explores the model in the context of a self-configuring discovery and control environment. Within this environment, controllers do not “pull” descriptions from a device; but rather, devices “push” full-service implementations to controllers.
- Full Text:
- Date Issued: 2013
The AES64 Connection Management and Control Protocol
- Authors: Foss, Richard , Gurdan, Robby , Klinkradt, Bradley , Chigwamba, Nyasha
- Date: 2013
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426933 , vital:72402 , https://www.aes.org/e-lib/browse.cfm?elib=16705
- Description: AES64, which is an IP-based peer-to-peer network control protocol, integrates the connection management and control capabilities across digital audio networks. This enables the streaming of all types of media content among devices from different manufactures because it provides a common approach for device control. This paper describes this protocol. Each parameter of a device can be addressed with a 7-level hierarchical structure that reflects the functional layout of the device. The protocol has been implemented in many different types of networks.
- Full Text:
- Date Issued: 2013
Parameter relationships in high-speed audio networks
- Authors: Chigwamba, Nyasha , Foss, Richard , Gurdan, Robby , Klinkradt, Bradley
- Date: 2012
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/427027 , vital:72409 , https://www.aes.org/e-lib/browse.cfm?elib=16211
- Description: When related audio control parameters are distributed in many devices in a high-speed audio network, a means for centralizing remote control and monitoring is required. Changes in one parameter may need to affect other parameters. The XFN protocol enables management of distributed parameters. This paper focuses on how to group related parameters that are physically separated and provides a corresponding implementation using the protocol. A comprehensive grouping theory is presented.
- Full Text:
- Date Issued: 2012
Service discovery using open sound control
- Authors: Eales, Andrew , Foss, Richard
- Date: 2012
- Language: English
- Type: text , article
- Identifier: http://hdl.handle.net/10962/426890 , vital:72398 , https://www.aes.org/e-lib/online/browse.cfm?elib=16432
- Description: The Open Sound Control (OSC) control protocol does not have service discovery capabilities. The approach to adding service discovery to OSC proposed in this paper uses the OSC address space to represent services within the context of a logical device model. This model allows services to be represented in a context-sensitive manner by relating parameters representing services to the logical organization of a device. Implementation of service discovery is done using standard OSC messages and requires that the OSC address space be designed to support these messages. This paper illustrates how these enhancements to OSC allow a device to advertise its services. Controller applications can then explore the device’s address space to discover services and retrieve the services required by the application. The Open Sound Control (OSC) control protocol does not have service discovery capabilities. The approach to adding service discovery to OSC proposed in this paper uses the OSC address space to represent services within the context of a logical device model. This model allows services to be represented in a context-sensitive manner by relating parameters representing services to the logical organization of a device. Implementation of service discovery is done using standard OSC messages and requires that the OSC address space be designed to support these messages. This paper illustrates how these enhancements to OSC allow a device to advertise its services. Controller applications can then explore the device’s address space to discover services and retrieve the services required by the application.
- Full Text:
- Date Issued: 2012