Ritz, Christian H.

Top Publications

Year	Title
2018	Multizone Soundfield Reproduction With Privacy- and Quality-Based Speech Masking Filters Published in IEEE Transactions on Audio, Speech and Language Processing
2013	A general compression approach to multi-channel three-dimensional audio Published in IEEE Transactions on Audio, Speech and Language Processing
2013	Collaborative blind source separation using location informed spatial microphones Published in IEEE Signal Processing Letters
2009	Using social networking and collections to enable video semantics acquisition Published in IEEE MultiMedia Magazine
2018	Separation of multiple speech sources by recovering sparse and non-sparse components from B-format microphone recordings Published in Speech Communication
2016	Encoding and communicating navigable speech soundfields Published in Multimedia Tools and Applications
2016	Enhancing project-based learning through student and industry engagement in a video-augmented 3-D virtual trade fair Published in IEEE Transactions on Education
2016	Planogram compliance checking based on detection of recurring patterns Published in IEEE MultiMedia Magazine
2015	Encoding multiple audio objects using intra-object sparsity Published in IEEE Transactions on Audio, Speech and Language Processing

Research Areas

0906 - ELECTRICAL AND ELECTRONIC ENGINEERING

Research Overview

Current research interests include single and multichannel speech signal processing, speech and audio coding, spatial audio signal processing, multimedia Quality of Experience (QoE) and signal processing for new media services.

Current projects include spatial and multichannel speech and audio signal processing and compression, acoustic vectors sensors and other co-located microphone arrays for sound source localisation and enhancement, microphone array signal processing, semantic analysis and processing of multimedia content, perceptual processing and Quality of Experience (QoE) estimation for media content.
I am a member of the Visual and Audio Signal Processing Lab, part of the ICT Research Institute. I am also the director of the University of Wollongong’s anechoic recording and playback facility.

Available as Research Supervisor

Selected Publications

Journal Article

Year	Title
2020	Attention-based residual network with scattering transform features for hyperspectral unmixing with limited training samples Published In Remote Sensing
2020	Deep Gabor Neural Network for Automatic Detection of Mine-like Objects in Sonar Imagery Published In IEEE Access
2020	Distributed microphone arrays, emerging speech and audio signal processing platforms: A review Published In Advances in Science, Technology and Engineering Systems
2020	Unbalanced hybrid aoa/rssi localization for simplified wireless sensor networks Published In Sensors (Switzerland)
2019	Robust Entangled-Photon Ghost Imaging with Compressive Sensing
2019	Scattering transform framework for unmixing of hyperspectral data Published In Remote Sensing
2018	Design of Chirp Waveforms for Multiple-access Ultrasonic Indoor Positioning Published In IEEE Sensors Journal
2018	Enhancing target speech based on nonlinear soft masking using a single acoustic vector sensor Published In Applied Sciences (Switzerland)
2018	Multiple-to-single sound source localization by applying single-source bins detection Published In Applied Acoustics
2018	Multizone Soundfield Reproduction With Privacy- and Quality-Based Speech Masking Filters Published In IEEE Transactions on Audio, Speech and Language Processing
2018	Separation of multiple speech sources by recovering sparse and non-sparse components from B-format microphone recordings Published In Speech Communication
2018	The role of deep learning and radiomic feature extraction in cancer-specific predictive modelling: A review Published In Translational Cancer Research
2017	Achieving maximum utilization of peer’s upload capacity in p2p networks using SVC Published In Peer-to-peer networking and publications
2016	Encoding and communicating navigable speech soundfields Published In Multimedia Tools and Applications
2016	Enhancing project-based learning through student and industry engagement in a video-augmented 3-D virtual trade fair Published In IEEE Transactions on Education
2016	Just for you: how to create sounds that only you can hear in a venue Published In The Conversation
2016	Multi-source DOA estimation using an acoustic vector sensor array under a spatial sparse representation framework Published In Circuits, Systems and Signal Processing
2016	Planogram compliance checking based on detection of recurring patterns Published In IEEE MultiMedia Magazine
2015	Decoding student satisfaction: how to manage and improve the laboratory experience Published In IEEE Transactions on Education
2015	Encoding multiple audio objects using intra-object sparsity Published In IEEE Transactions on Audio, Speech and Language Processing
2015	Feature selection for low bit rate mobile augmented reality applications Published In Signal Processing: Image Communication
2015	Improving the laboratory learning experience: a process to train and manage teaching assistants Published In IEEE Transactions on Education
2014	Speech enhancement with an acoustic vector sensor: an effective adaptive beamforming and post-filtering approach Published In Eurasip Journal on Audio, Speech, and Music Processing
2013	A general compression approach to multi-channel three-dimensional audio Published In IEEE Transactions on Audio, Speech and Language Processing
2013	Collaborative blind source separation using location informed spatial microphones Published In IEEE Signal Processing Letters
2013	Encoding navigable speech sources: a psychoacoustic-based analysis-by-synthesis approach Published In IEEE Transactions on Audio, Speech and Language Processing
2011	A hot metal temperature predictor based on hybrid decision tree techniques Published In International Journal of Technology, Knowledge and Society
2010	Efficient multimedia query-by-content from mobile devices Published In Computers and Electrical Engineering
2009	Using social networking and collections to enable video semantics acquisition Published In IEEE MultiMedia Magazine
2008	Format-independent rich media delivery using the bitstream binding language Published In IEEE Transactions on Multimedia
2008	Psychoacoustic-based quantisation of spatial audio cues Published In Electronics Letters
2007	Is that a fish in your ear? A universal metalanguage for multimedia Published In IEEE MultiMedia Magazine

Chapter

Year	Title
2017	Supporting Student Projects through Feedback from Transnational Peers and Industry Experts in a Mixed-Reality Immersive Environment Published In The e-Learning Excellence Awards 2017: An Anthology of Case Histories Publisher Reading, United Kingdom
2017	Supporting the conceptualization of student innovation projects through peer and expert feedback on virtual pitches Published In Unplugging the Classroom: Teaching with Technologies to Promote Students' Lifelong Learning Publisher Cambridge, United States
2012	Enhancing multimedia search using human motion Published In Multimedia - A Multidisciplinary Approach to Complex Issues
2011	Backward compatible spatialized teleconferencing based on squeezed recordings Published In Advances in Sound Localization
2011	What are you trying to say? Format-independent semantic-aware streaming and delivery Published In Recent Advances on Video Coding
2010	Symbolic modelling of dynamic human motions Published In Biosensors

Conference Paper

Year	Title
2019	A Survey on Ad Hoc Signal Processing: Applications, Challenges and State-of-the-Art Techniques Published In 2019 IEEE 19th International Symposium on Signal Processing and Information Technology, ISSPIT 2019
2019	Co-prime Circular Microphone Arrays and Their Application to Direction of Arrival Estimation of Speech Sources Published In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
2019	Identifying Optimal Features for Multi-channel Acoustic Scene Classification Published In 2019 2nd International Conference on Signal Processing and Information Security, ICSPIS 2019
2019	Scalogram Neural Network Activations with Machine Learning for Domestic Multi-channel Audio Classification Published In 2019 IEEE 19th International Symposium on Signal Processing and Information Technology, ISSPIT 2019
2019	Semi-coprime microphone arrays for estimating direction of arrival of speech sources Published In 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2019
2019	Using Data Mining and Machine Learning Approaches to Observe Technology-Enhanced Learning Published In Proceedings of 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering, TALE 2018
2018	A Deep Learning Approach to the Acoustic Condition Monitoring of a Sintering Plant Published In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings
2018	A comparative study of machine learning techniques for the improved prediction of NSCLC survival analysis Published In 2018 IEEE Nuclear Science Symposium and Medical Imaging Conference, NSS/MIC 2018 - Proceedings
2018	Investigating Co-Prime Microphone Arrays for Speech Direction of Arrival Estimation Published In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings
2018	On the Comparison of Two Room Compensation / Dereverberation Methods Employing Active Acoustic Boundary Absorption Published In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP): Proceedings
2017	Active Speech Control using Wave-Domain Processing with a Linear Wall of Dipole Secondary Sources Published In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2017)
2017	Assessing the prognostic impact of 3D CT image tumour rind texture features on lung cancer survival Published In IEEE Global Conference on Signal and Information Processing (GlobalSIP 2017)
2017	Blind speaker counting in highly reverberant environments by clustering coherence features Published In 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2017)
2017	Learning a robust DOA estimation model with acoustic vector sensor cues Published In 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2017)
2017	Robust speaker DOA estimation based on the inter-sensor data ratio model and binary mask estimation in the bispectrum domain Published In 2017 IEEE International Conference on Acoustics, Speech, and Signal Processing
2017	Spatial multi-channel linear prediction for dereverberation of ad-hoc microphones Published In 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2017)
2017	Towards real-time source counting by estimation of coherent-to-diffuse ratios from ad-hoc microphone array recordings Published In 2017 Hands-Free Speech Communications and Microphone Arrays, HSCMA 2017 - Proceedings
2016	3D Modelling and Printing of Microtonal Flutes Published In Proceedings of the 16th International Conference on New Interfaces for Musical Expression (NIME 2016)
2016	Addressing misconceptions about engineering through student–industry interaction in a video-augmented 3D immersive virtual world Published In IEEE Frontiers in Education Conference (FIE)
2016	Detecting multiple, simultaneous talkers through localising speech recorded by ad-hoc microphone arrays Published In 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2016
2016	Improving speech privacy in personal sound zones Published In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
2016	Reproducing personal sound zones using a hybrid synthesis of dynamic and parametric loudspeakers Published In IEEE Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)
2015	An efficient approach to dynamically weighted multizone wideband reproduction of speech soundfields Published In Signal and Information Processing (ChinaSIP), 2015 IEEE China Summit and International Conference on
2015	Clustered multi-channel dereverberation for ad-hoc microphone arrays Published In Proceedings of APSIPA Annual Summit and Conference 2015
2015	Design and analysis of miniature and three tiered B-format microphones manufactured using 3D printing Published In Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on
2015	Forming ad-hoc microphone arrays through clustering of acoustic room impulse responses Published In Signal and Information Processing (ChinaSIP), 2015 IEEE China Summit and International Conference on
2015	Informed source location and DOA estimation using acoustic room impulse response parameters Published In 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT)
2015	Multizone reproduction of speech soundfields: A perceptually weighted approach Published In 2015 IEEE Asia-Pacific Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC)
2015	QoE based P2P scalable video streaming over mobile Ad Hoc Networks Published In Next Generation Mobile Applications, Services and Technologies, 2015 9th International Conference on
2015	Single-channel speech separation by including spectral structure information within non-negative matrix factorization Published In Signal and Information Processing (ChinaSIP), 2015 IEEE China Summit and International Conference on
2015	Spectral mask estimation using deep neural networks for inter-sensor data ratio model based robust DOA estimation Published In Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on
2014	Adaptive and robust feature selection for low bitrate mobile augmented reality applications Published In 2014 8th International Conference on Signal Processing and Communication Systems (ICSPCS)
2014	An effective doa estimation by exploring the spatial sparse representation of the inter-sensor data ratio model Published In 2014 IEEE China Summit and International Conference on Signal and Information Processing, IEEE ChinaSIP 2014 - Proceedings
2014	An effective target speech enhancement with single acoustic vector sensor based on the speech time-frequency sparsity Published In Digital Signal Processing (DSP), 2014 19th International Conference on
2014	Analysing the Quality of Experience of multisensory media from measurements of physiological responses Published In Sixth International Workshop on Quality of Multimedia Experience (QoMEX)
2014	Efficient utilization of peer's upload capacity in P2P networks using SVC Published In Communications and Information Technologies (ISCIT), 2014 14th International Symposium on
2014	Fast and accurate low bit rate retrieval-by-capture applications Published In Digital Signal Processing (DSP), 2014 19th International Conference on
2014	Packet loss protection for interactive speech object rendering: A multiple description approach Published In 2014 IEEE China Summit and International Conference on Signal and Information Processing, IEEE ChinaSIP 2014 - Proceedings
2014	Quality of experience-based image feature selection for mobile augmented reality applications Published In 2014, 8th International Conference on Signal Processing and Communication Systems, ICSPCS 2014 - Proceedings
2013	A psychoacoustic-based analysis-by-synthesis scheme for jointly encoding multiple audio objects into independent mixtures Published In IEEE International Conference on Acoustics, Speech and Signal Processing
2013	How much longer to go? The influence of waiting time and progress indicators on quality of experience for mobile visual search applied to print media Published In 5th International Workshop on Quality of Multimedia Experience, QoMEX - Proceedings
2013	Multisource DOA estimation based on time-frequency sparsity and joint inter-sensor data ratio with single acoustic vector sensor Published In IEEE International Conference on Acoustics, Speech and Signal Processing
2013	Noise robust keyword spotting for user generated video blogs Published In IEEE International Conference on Multimedia and Expo
2013	Speech dereverberation based on Linear Prediction: an Acoustic Vector Sensor approach Published In IEEE International Conference on Acoustics, Speech and Signal Processing
2013	Temporal sentiment detection for user generated video product reviews Published In 13th International Symposium on Communications and Information Technologies: Communication and Information Technology for New Life Style Beyond the Cloud, ISCIT 2013
2013	The joint effect of image blur and illumination distortions for Mobile Visual Search of print media Published In 13th International Symposium on Communications and Information Technologies: Communication and Information Technology for New Life Style Beyond the Cloud, ISCIT 2013
2013	Variance-wise segmentation for a temporal-adaptive SAX Published In AusDM 2012: Tenth Australasian Data Mining Conference
2012	An improved template-based approach to keyword spotting applied to the spoken content of user generated video blogs Published In ICME 2012: IEEE International Conference on Multimedia and Expo
2012	Detecting offensive user video blogs: an adaptive keyword spotting approach Published In Third International Conference on Audio, Language and Image Processing
2012	Encoding navigable speech sources: an analysis by synthesis approach Published In ICASSP 2012: IEEE International Conference on Acoustics, Speech and Signal Processing
2012	Ensuring quality of experience for markerless image recognition applied to print media content Published In QoMEX 2012: 4th International Workshop on Quality of Multimedia Experience
2012	Image compression and retrieval for Mobile Visual Search Published In 2012 International Symposium on Communications and Information Technologies (ISCIT)
2012	Investigating the impact of sensory effects on the Quality of Experience and emotional response in web videos Published In QoMEX 2012: 4th International Workshop on Quality of Multimedia Experience
2012	Packet loss protection for interactive audio object rendering: A multiple description approach Published In QoMEX 2012: 4th International Workshop on Quality of Multimedia Experience
2012	Toward human motion search using fingerprinting Published In 2012 International Symposium on Communications and Information Technologies (ISCIT)
2011	An ambient multimedia user experience feedback framework based on user tagging and EEG biosignals Published In 4th International Workshop on Semantic Ambient Media Experience (SAME 2011)
2011	Compression of navigable speech soundfield zones Published In 2011 IEEE 13rd International Workshop on Multimedia Signal Processing (MMSP)
2011	Hybrid FEC and MDC models for low-delay packet-loss recovery Published In 5th International Conference on Signal Processing and Telecommunication Systems, ICSPCS'2011
2011	Keyword spotting based on the analysis of template matching distances Published In 5th International Conference on Signal Processing and Telecommunication Systems, ICSPCS'2011
2011	Limb-based feature description of human motion Published In ICSPCS'2011: 5th International Conference on Signal Processing and Telecommunication Systems
2011	Linear predictive perceptual filtering for acoustic vector sensors: exploiting directional recordings for high quality speech enhancement Published In Proceeding of 2011 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
2011	Multimedia user feedback based on augmenting user tags with EEG emotional states Published In 3rd International Workshop on Quality of Multimedia Experience, QoMEX 2011
2011	Separation of speech sources using an acoustic vector sensor Published In 13rd IEEE International Workshop on Multimedia Signal Processing, MMSP 2011
2010	Multimedia adaptation based on semantics from social network users interacting with media Published In International Workshop on Quality of Multimedia Experience
2010	Speech enhancement via separation of sources from co-located microphone recordings Published In International Conference on Acoustics, Speech, and Signal Processing
2010	Using in-air acoustic vector sensors for tracking moving speakers Published In International Conference on Signal Processing and Communication Systems
2010	What’s your contribution? An online system for assessing each member’s participation in team based projects Published In The 4th International Conference on Signal Processing and Communication Systems
2009	Designing Acoustic Vector Sensors for localisation of sound sources in air Published In European Signal Processing Conference
2009	Semantic-Aware Delivery of Multimedia Published In International Symposium on Communications and Information Technologies
2009	Spatial audio coding by squeezing: analysis and application to compressing multiple soundfields Published In European Signal Processing Conference
2009	The effect of microphone directivity patterns on spatial cues for reverberant multichannel meeting speech analysis Published In European Signal Processing Conference
2008	A spatial squeezing approach to ambisonic audio compression Published In International Conference on Acoustics, Speech, and Signal Processing
2008	An anechoic configurable hemispheric environment for spatialised sound Published In Australasian Computer Music Conference
2008	Binaural reproduction of spatially squeezed surround audio Published In International Conference on Signal Processing
2008	Motion classification using Dynamic Time Warping Published In International Workshop on Multimedia Signal Processing
2008	Multivariate autoregressive modelling of multichannel reverberant speech Published In International Workshop on Multimedia Signal Processing
2008	Spatialized teleconferencing: recording and 'Squeezed' rendering of multiple distributed sites Published In Australian Telecommunication Networks and Applications Conference
2007	Encoding independent sources in Spatially Squeezed Surround Audio Coding Published In Pacific-Rim Conference on Multimedia
2007	Intelligent multimedia delivery? It's a question of semantics Published In International Symposium on Communications and Information Technologies
2007	MQF: an XML based multimedia query format Published In International Conference on Multimedia & Expo
2007	Principles and analysis of the squeezing approach to low bit rate spatial audio coding Published In International Conference on Acoustics, Speech, and Signal Processing
2007	Query Streaming for Multimedia Query by Content from Mobile Devices Published In International Conference on Signal Processing and Communication Systems
2007	Reconfigurable media coding: self-describing multimedia bitstreams Published In Workshop on Signal Processing Systems
2007	The MPEG-7 query format: a new standard in progress for multimedia query by content Published In International Symposium on Communications and Information Technologies
2007	Time delay estimation of reverberant meeting speech: on the use of multichannel linear prediction Published In International Conference on Signal Image Technology & Internet Based Systems

Investigator On

Year	Title
2019 - 2021	A Novel Non-GPS Based Positioning, Navigation and Timing Solution for Reconnaissance Missions Awarded by: Defence Innovation Network (DIN) Funding Scheme: Pilot Projects
2019	Spatial Audio Scene Analysis and Synthesis Technology Awarded by: Electronics and Telecommunications Research Institute Funding Scheme: Collaborative Research
2018 - 2019	Classification of Sonar Snapshot Images for Autonomous Underwater Vehicle On-board Processing Awarded by: Defence Innovation Network (DIN) Funding Scheme: Pilot Projects
2010	Encoding and Communicating Navigable Soundfields Awarded by: Australian Research Council (ARC) Funding Scheme: Discovery Projects
	Cancelling neighbouring voices for enhanced audio-visual collaboration Awarded by: Australian Research Council (ARC) Funding Scheme: Linkage Projects
	Real-time ATR of Naval Mines with AUV Sonar Imaging Awarded by: Defence Science and Technology Group Funding Scheme: Defence Innovation Network PhD Project

Impact Story

Underwater Mine Detection with Sonar Imaging
Summary
Underwater mines are a cost-effective tool in asymmetric warfare and are commonly used to block shipping lanes and restrict naval operations. The aim of this research is develop an automatic system based on sonar imaging for locating naval mines and then recognizing their various types. It involves investigating the latest advances in deep learning and artificial intelligence for object detection, image segmentation, and image classification. This on-going research, supported by the NSW Defence Innovation Network (DIN), is conducted in collaboration with Defence and Science Technology Group (DSTG) and a defence software company. The research team includes Assoc. Prof. Son Lam Phung (CI, Technical Lead, Principal Supervisor), Mr Hoang Thanh Le (PhD Student), Mr Luca Russo (PhD student), Dr. Thi N. A. Nguyen (Associate Research Fellow), Senior Prof. Salim Bouzerdoum (CI), Prof. Christian Ritz (CI), and Dr. Le Chung Tran (CI). In this project, we have developed a deep learning-based tool for underwater mine detection. Further discussions are in progress to apply the project outcomes. Publication: H. T. Le, S. L. Phung, P. B. Chapple, A. Bouzerdoum, C. H. Ritz, L. C. Tran, "Deep Gabor neural network for automatic detection of mine-like objects in sonar imagery," IEEE Access, vol. 8, no. 1, pp. 94126-94139, 2020.

Detail View

Detail View Summary View
Field of Research
Countries / Regions
Beneficiaries

Beneficiary Quantification Description
External Partners
Evidence of Impact

Evidence Description
UOW Centres / Programs
UOW Researchers / Collaborators

Available as Research Supervisor

Potential Supervision Topics

- Spatial audio signal processing
- Microphone array speech enhancement.
- Ad-hoc microphone arrays for recording and enhancement of speech and audio.
- Quality of Experience (QoE) of spatial audio and interactive multimedia applications.
- Loudspeaker array signal processing.
- Acoustic Echo Cancellation and Suppression

Advisees

Graduate Advising Relationship

Degree	Research Title	Advisee
Doctor of Philosophy	Domestic Multi-channel Acoustic Scene Detection and Classification for Monitoring of Dementia Patients using Neural Networks
Doctor of Philosophy	Machine Learnt Radiomics Models for the Treatment of Non-Metastatic Non-Small Cell Lung Cancer	Vial, Alanna
Doctor of Philosophy	Multi- Camera Structured-light 3D Measurement System	Zhu, Yuewen
Doctor of Philosophy	Coprome Microphone Array Speech and Audio Signal Processing	Zhao, Jiahong
Doctor of Philosophy	Real-time Automatic Target Recognition of Naval Mines with Autonomous Underwater Vehicle Sonar Imaging	Russo, Luca
Doctor of Philosophy	3D Face Modelling and Recognition for Automatic Selection of Worker Respiratory Protective Equipment	Nguyen, Tran Thanh Phong

Orcid Id

http://orcid.org/0000-0002-3768-7569 (confirmed)

Top Publications

Year	Title
2018	Multizone Soundfield Reproduction With Privacy- and Quality-Based Speech Masking Filters Published in IEEE Transactions on Audio, Speech and Language Processing
2013	A general compression approach to multi-channel three-dimensional audio Published in IEEE Transactions on Audio, Speech and Language Processing
2013	Collaborative blind source separation using location informed spatial microphones Published in IEEE Signal Processing Letters
2009	Using social networking and collections to enable video semantics acquisition Published in IEEE MultiMedia Magazine
2018	Separation of multiple speech sources by recovering sparse and non-sparse components from B-format microphone recordings Published in Speech Communication
2016	Encoding and communicating navigable speech soundfields Published in Multimedia Tools and Applications
2016	Enhancing project-based learning through student and industry engagement in a video-augmented 3-D virtual trade fair Published in IEEE Transactions on Education
2016	Planogram compliance checking based on detection of recurring patterns Published in IEEE MultiMedia Magazine
2015	Encoding multiple audio objects using intra-object sparsity Published in IEEE Transactions on Audio, Speech and Language Processing

Research Areas

0906 - ELECTRICAL AND ELECTRONIC ENGINEERING

Research Overview

Current research interests include single and multichannel speech signal processing, speech and audio coding, spatial audio signal processing, multimedia Quality of Experience (QoE) and signal processing for new media services.

Current projects include spatial and multichannel speech and audio signal processing and compression, acoustic vectors sensors and other co-located microphone arrays for sound source localisation and enhancement, microphone array signal processing, semantic analysis and processing of multimedia content, perceptual processing and Quality of Experience (QoE) estimation for media content.
I am a member of the Visual and Audio Signal Processing Lab, part of the ICT Research Institute. I am also the director of the University of Wollongong’s anechoic recording and playback facility.

Selected Publications

Journal Article

Year	Title
2020	Attention-based residual network with scattering transform features for hyperspectral unmixing with limited training samples Published In Remote Sensing
2020	Deep Gabor Neural Network for Automatic Detection of Mine-like Objects in Sonar Imagery Published In IEEE Access
2020	Distributed microphone arrays, emerging speech and audio signal processing platforms: A review Published In Advances in Science, Technology and Engineering Systems
2020	Unbalanced hybrid aoa/rssi localization for simplified wireless sensor networks Published In Sensors (Switzerland)
2019	Robust Entangled-Photon Ghost Imaging with Compressive Sensing
2019	Scattering transform framework for unmixing of hyperspectral data Published In Remote Sensing
2018	Design of Chirp Waveforms for Multiple-access Ultrasonic Indoor Positioning Published In IEEE Sensors Journal
2018	Enhancing target speech based on nonlinear soft masking using a single acoustic vector sensor Published In Applied Sciences (Switzerland)
2018	Multiple-to-single sound source localization by applying single-source bins detection Published In Applied Acoustics
2018	Multizone Soundfield Reproduction With Privacy- and Quality-Based Speech Masking Filters Published In IEEE Transactions on Audio, Speech and Language Processing
2018	Separation of multiple speech sources by recovering sparse and non-sparse components from B-format microphone recordings Published In Speech Communication
2018	The role of deep learning and radiomic feature extraction in cancer-specific predictive modelling: A review Published In Translational Cancer Research
2017	Achieving maximum utilization of peer’s upload capacity in p2p networks using SVC Published In Peer-to-peer networking and publications
2016	Encoding and communicating navigable speech soundfields Published In Multimedia Tools and Applications
2016	Enhancing project-based learning through student and industry engagement in a video-augmented 3-D virtual trade fair Published In IEEE Transactions on Education
2016	Just for you: how to create sounds that only you can hear in a venue Published In The Conversation
2016	Multi-source DOA estimation using an acoustic vector sensor array under a spatial sparse representation framework Published In Circuits, Systems and Signal Processing
2016	Planogram compliance checking based on detection of recurring patterns Published In IEEE MultiMedia Magazine
2015	Decoding student satisfaction: how to manage and improve the laboratory experience Published In IEEE Transactions on Education
2015	Encoding multiple audio objects using intra-object sparsity Published In IEEE Transactions on Audio, Speech and Language Processing
2015	Feature selection for low bit rate mobile augmented reality applications Published In Signal Processing: Image Communication
2015	Improving the laboratory learning experience: a process to train and manage teaching assistants Published In IEEE Transactions on Education
2014	Speech enhancement with an acoustic vector sensor: an effective adaptive beamforming and post-filtering approach Published In Eurasip Journal on Audio, Speech, and Music Processing
2013	A general compression approach to multi-channel three-dimensional audio Published In IEEE Transactions on Audio, Speech and Language Processing
2013	Collaborative blind source separation using location informed spatial microphones Published In IEEE Signal Processing Letters
2013	Encoding navigable speech sources: a psychoacoustic-based analysis-by-synthesis approach Published In IEEE Transactions on Audio, Speech and Language Processing
2011	A hot metal temperature predictor based on hybrid decision tree techniques Published In International Journal of Technology, Knowledge and Society
2010	Efficient multimedia query-by-content from mobile devices Published In Computers and Electrical Engineering
2009	Using social networking and collections to enable video semantics acquisition Published In IEEE MultiMedia Magazine
2008	Format-independent rich media delivery using the bitstream binding language Published In IEEE Transactions on Multimedia
2008	Psychoacoustic-based quantisation of spatial audio cues Published In Electronics Letters
2007	Is that a fish in your ear? A universal metalanguage for multimedia Published In IEEE MultiMedia Magazine

Chapter

Year	Title
2017	Supporting Student Projects through Feedback from Transnational Peers and Industry Experts in a Mixed-Reality Immersive Environment Published In The e-Learning Excellence Awards 2017: An Anthology of Case Histories Publisher Reading, United Kingdom
2017	Supporting the conceptualization of student innovation projects through peer and expert feedback on virtual pitches Published In Unplugging the Classroom: Teaching with Technologies to Promote Students' Lifelong Learning Publisher Cambridge, United States
2012	Enhancing multimedia search using human motion Published In Multimedia - A Multidisciplinary Approach to Complex Issues
2011	Backward compatible spatialized teleconferencing based on squeezed recordings Published In Advances in Sound Localization
2011	What are you trying to say? Format-independent semantic-aware streaming and delivery Published In Recent Advances on Video Coding
2010	Symbolic modelling of dynamic human motions Published In Biosensors

Conference Paper

Year	Title
2019	A Survey on Ad Hoc Signal Processing: Applications, Challenges and State-of-the-Art Techniques Published In 2019 IEEE 19th International Symposium on Signal Processing and Information Technology, ISSPIT 2019
2019	Co-prime Circular Microphone Arrays and Their Application to Direction of Arrival Estimation of Speech Sources Published In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
2019	Identifying Optimal Features for Multi-channel Acoustic Scene Classification Published In 2019 2nd International Conference on Signal Processing and Information Security, ICSPIS 2019
2019	Scalogram Neural Network Activations with Machine Learning for Domestic Multi-channel Audio Classification Published In 2019 IEEE 19th International Symposium on Signal Processing and Information Technology, ISSPIT 2019
2019	Semi-coprime microphone arrays for estimating direction of arrival of speech sources Published In 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2019
2019	Using Data Mining and Machine Learning Approaches to Observe Technology-Enhanced Learning Published In Proceedings of 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering, TALE 2018
2018	A Deep Learning Approach to the Acoustic Condition Monitoring of a Sintering Plant Published In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings
2018	A comparative study of machine learning techniques for the improved prediction of NSCLC survival analysis Published In 2018 IEEE Nuclear Science Symposium and Medical Imaging Conference, NSS/MIC 2018 - Proceedings
2018	Investigating Co-Prime Microphone Arrays for Speech Direction of Arrival Estimation Published In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings
2018	On the Comparison of Two Room Compensation / Dereverberation Methods Employing Active Acoustic Boundary Absorption Published In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP): Proceedings
2017	Active Speech Control using Wave-Domain Processing with a Linear Wall of Dipole Secondary Sources Published In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2017)
2017	Assessing the prognostic impact of 3D CT image tumour rind texture features on lung cancer survival Published In IEEE Global Conference on Signal and Information Processing (GlobalSIP 2017)
2017	Blind speaker counting in highly reverberant environments by clustering coherence features Published In 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2017)
2017	Learning a robust DOA estimation model with acoustic vector sensor cues Published In 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2017)
2017	Robust speaker DOA estimation based on the inter-sensor data ratio model and binary mask estimation in the bispectrum domain Published In 2017 IEEE International Conference on Acoustics, Speech, and Signal Processing
2017	Spatial multi-channel linear prediction for dereverberation of ad-hoc microphones Published In 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2017)
2017	Towards real-time source counting by estimation of coherent-to-diffuse ratios from ad-hoc microphone array recordings Published In 2017 Hands-Free Speech Communications and Microphone Arrays, HSCMA 2017 - Proceedings
2016	3D Modelling and Printing of Microtonal Flutes Published In Proceedings of the 16th International Conference on New Interfaces for Musical Expression (NIME 2016)
2016	Addressing misconceptions about engineering through student–industry interaction in a video-augmented 3D immersive virtual world Published In IEEE Frontiers in Education Conference (FIE)
2016	Detecting multiple, simultaneous talkers through localising speech recorded by ad-hoc microphone arrays Published In 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2016
2016	Improving speech privacy in personal sound zones Published In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
2016	Reproducing personal sound zones using a hybrid synthesis of dynamic and parametric loudspeakers Published In IEEE Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)
2015	An efficient approach to dynamically weighted multizone wideband reproduction of speech soundfields Published In Signal and Information Processing (ChinaSIP), 2015 IEEE China Summit and International Conference on
2015	Clustered multi-channel dereverberation for ad-hoc microphone arrays Published In Proceedings of APSIPA Annual Summit and Conference 2015
2015	Design and analysis of miniature and three tiered B-format microphones manufactured using 3D printing Published In Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on
2015	Forming ad-hoc microphone arrays through clustering of acoustic room impulse responses Published In Signal and Information Processing (ChinaSIP), 2015 IEEE China Summit and International Conference on
2015	Informed source location and DOA estimation using acoustic room impulse response parameters Published In 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT)
2015	Multizone reproduction of speech soundfields: A perceptually weighted approach Published In 2015 IEEE Asia-Pacific Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC)
2015	QoE based P2P scalable video streaming over mobile Ad Hoc Networks Published In Next Generation Mobile Applications, Services and Technologies, 2015 9th International Conference on
2015	Single-channel speech separation by including spectral structure information within non-negative matrix factorization Published In Signal and Information Processing (ChinaSIP), 2015 IEEE China Summit and International Conference on
2015	Spectral mask estimation using deep neural networks for inter-sensor data ratio model based robust DOA estimation Published In Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on
2014	Adaptive and robust feature selection for low bitrate mobile augmented reality applications Published In 2014 8th International Conference on Signal Processing and Communication Systems (ICSPCS)
2014	An effective doa estimation by exploring the spatial sparse representation of the inter-sensor data ratio model Published In 2014 IEEE China Summit and International Conference on Signal and Information Processing, IEEE ChinaSIP 2014 - Proceedings
2014	An effective target speech enhancement with single acoustic vector sensor based on the speech time-frequency sparsity Published In Digital Signal Processing (DSP), 2014 19th International Conference on
2014	Analysing the Quality of Experience of multisensory media from measurements of physiological responses Published In Sixth International Workshop on Quality of Multimedia Experience (QoMEX)
2014	Efficient utilization of peer's upload capacity in P2P networks using SVC Published In Communications and Information Technologies (ISCIT), 2014 14th International Symposium on
2014	Fast and accurate low bit rate retrieval-by-capture applications Published In Digital Signal Processing (DSP), 2014 19th International Conference on
2014	Packet loss protection for interactive speech object rendering: A multiple description approach Published In 2014 IEEE China Summit and International Conference on Signal and Information Processing, IEEE ChinaSIP 2014 - Proceedings
2014	Quality of experience-based image feature selection for mobile augmented reality applications Published In 2014, 8th International Conference on Signal Processing and Communication Systems, ICSPCS 2014 - Proceedings
2013	A psychoacoustic-based analysis-by-synthesis scheme for jointly encoding multiple audio objects into independent mixtures Published In IEEE International Conference on Acoustics, Speech and Signal Processing
2013	How much longer to go? The influence of waiting time and progress indicators on quality of experience for mobile visual search applied to print media Published In 5th International Workshop on Quality of Multimedia Experience, QoMEX - Proceedings
2013	Multisource DOA estimation based on time-frequency sparsity and joint inter-sensor data ratio with single acoustic vector sensor Published In IEEE International Conference on Acoustics, Speech and Signal Processing
2013	Noise robust keyword spotting for user generated video blogs Published In IEEE International Conference on Multimedia and Expo
2013	Speech dereverberation based on Linear Prediction: an Acoustic Vector Sensor approach Published In IEEE International Conference on Acoustics, Speech and Signal Processing
2013	Temporal sentiment detection for user generated video product reviews Published In 13th International Symposium on Communications and Information Technologies: Communication and Information Technology for New Life Style Beyond the Cloud, ISCIT 2013
2013	The joint effect of image blur and illumination distortions for Mobile Visual Search of print media Published In 13th International Symposium on Communications and Information Technologies: Communication and Information Technology for New Life Style Beyond the Cloud, ISCIT 2013
2013	Variance-wise segmentation for a temporal-adaptive SAX Published In AusDM 2012: Tenth Australasian Data Mining Conference
2012	An improved template-based approach to keyword spotting applied to the spoken content of user generated video blogs Published In ICME 2012: IEEE International Conference on Multimedia and Expo
2012	Detecting offensive user video blogs: an adaptive keyword spotting approach Published In Third International Conference on Audio, Language and Image Processing
2012	Encoding navigable speech sources: an analysis by synthesis approach Published In ICASSP 2012: IEEE International Conference on Acoustics, Speech and Signal Processing
2012	Ensuring quality of experience for markerless image recognition applied to print media content Published In QoMEX 2012: 4th International Workshop on Quality of Multimedia Experience
2012	Image compression and retrieval for Mobile Visual Search Published In 2012 International Symposium on Communications and Information Technologies (ISCIT)
2012	Investigating the impact of sensory effects on the Quality of Experience and emotional response in web videos Published In QoMEX 2012: 4th International Workshop on Quality of Multimedia Experience
2012	Packet loss protection for interactive audio object rendering: A multiple description approach Published In QoMEX 2012: 4th International Workshop on Quality of Multimedia Experience
2012	Toward human motion search using fingerprinting Published In 2012 International Symposium on Communications and Information Technologies (ISCIT)
2011	An ambient multimedia user experience feedback framework based on user tagging and EEG biosignals Published In 4th International Workshop on Semantic Ambient Media Experience (SAME 2011)
2011	Compression of navigable speech soundfield zones Published In 2011 IEEE 13rd International Workshop on Multimedia Signal Processing (MMSP)
2011	Hybrid FEC and MDC models for low-delay packet-loss recovery Published In 5th International Conference on Signal Processing and Telecommunication Systems, ICSPCS'2011
2011	Keyword spotting based on the analysis of template matching distances Published In 5th International Conference on Signal Processing and Telecommunication Systems, ICSPCS'2011
2011	Limb-based feature description of human motion Published In ICSPCS'2011: 5th International Conference on Signal Processing and Telecommunication Systems
2011	Linear predictive perceptual filtering for acoustic vector sensors: exploiting directional recordings for high quality speech enhancement Published In Proceeding of 2011 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
2011	Multimedia user feedback based on augmenting user tags with EEG emotional states Published In 3rd International Workshop on Quality of Multimedia Experience, QoMEX 2011
2011	Separation of speech sources using an acoustic vector sensor Published In 13rd IEEE International Workshop on Multimedia Signal Processing, MMSP 2011
2010	Multimedia adaptation based on semantics from social network users interacting with media Published In International Workshop on Quality of Multimedia Experience
2010	Speech enhancement via separation of sources from co-located microphone recordings Published In International Conference on Acoustics, Speech, and Signal Processing
2010	Using in-air acoustic vector sensors for tracking moving speakers Published In International Conference on Signal Processing and Communication Systems
2010	What’s your contribution? An online system for assessing each member’s participation in team based projects Published In The 4th International Conference on Signal Processing and Communication Systems
2009	Designing Acoustic Vector Sensors for localisation of sound sources in air Published In European Signal Processing Conference
2009	Semantic-Aware Delivery of Multimedia Published In International Symposium on Communications and Information Technologies
2009	Spatial audio coding by squeezing: analysis and application to compressing multiple soundfields Published In European Signal Processing Conference
2009	The effect of microphone directivity patterns on spatial cues for reverberant multichannel meeting speech analysis Published In European Signal Processing Conference
2008	A spatial squeezing approach to ambisonic audio compression Published In International Conference on Acoustics, Speech, and Signal Processing
2008	An anechoic configurable hemispheric environment for spatialised sound Published In Australasian Computer Music Conference
2008	Binaural reproduction of spatially squeezed surround audio Published In International Conference on Signal Processing
2008	Motion classification using Dynamic Time Warping Published In International Workshop on Multimedia Signal Processing
2008	Multivariate autoregressive modelling of multichannel reverberant speech Published In International Workshop on Multimedia Signal Processing
2008	Spatialized teleconferencing: recording and 'Squeezed' rendering of multiple distributed sites Published In Australian Telecommunication Networks and Applications Conference
2007	Encoding independent sources in Spatially Squeezed Surround Audio Coding Published In Pacific-Rim Conference on Multimedia
2007	Intelligent multimedia delivery? It's a question of semantics Published In International Symposium on Communications and Information Technologies
2007	MQF: an XML based multimedia query format Published In International Conference on Multimedia & Expo
2007	Principles and analysis of the squeezing approach to low bit rate spatial audio coding Published In International Conference on Acoustics, Speech, and Signal Processing
2007	Query Streaming for Multimedia Query by Content from Mobile Devices Published In International Conference on Signal Processing and Communication Systems
2007	Reconfigurable media coding: self-describing multimedia bitstreams Published In Workshop on Signal Processing Systems
2007	The MPEG-7 query format: a new standard in progress for multimedia query by content Published In International Symposium on Communications and Information Technologies
2007	Time delay estimation of reverberant meeting speech: on the use of multichannel linear prediction Published In International Conference on Signal Image Technology & Internet Based Systems

Investigator On

Year	Title
2019 - 2021	A Novel Non-GPS Based Positioning, Navigation and Timing Solution for Reconnaissance Missions Awarded by: Defence Innovation Network (DIN) Funding Scheme: Pilot Projects
2019	Spatial Audio Scene Analysis and Synthesis Technology Awarded by: Electronics and Telecommunications Research Institute Funding Scheme: Collaborative Research
2018 - 2019	Classification of Sonar Snapshot Images for Autonomous Underwater Vehicle On-board Processing Awarded by: Defence Innovation Network (DIN) Funding Scheme: Pilot Projects
2010	Encoding and Communicating Navigable Soundfields Awarded by: Australian Research Council (ARC) Funding Scheme: Discovery Projects
	Cancelling neighbouring voices for enhanced audio-visual collaboration Awarded by: Australian Research Council (ARC) Funding Scheme: Linkage Projects
	Real-time ATR of Naval Mines with AUV Sonar Imaging Awarded by: Defence Science and Technology Group Funding Scheme: Defence Innovation Network PhD Project

Impact Story

Underwater Mine Detection with Sonar Imaging
Summary
Underwater mines are a cost-effective tool in asymmetric warfare and are commonly used to block shipping lanes and restrict naval operations. The aim of this research is develop an automatic system based on sonar imaging for locating naval mines and then recognizing their various types. It involves investigating the latest advances in deep learning and artificial intelligence for object detection, image segmentation, and image classification. This on-going research, supported by the NSW Defence Innovation Network (DIN), is conducted in collaboration with Defence and Science Technology Group (DSTG) and a defence software company. The research team includes Assoc. Prof. Son Lam Phung (CI, Technical Lead, Principal Supervisor), Mr Hoang Thanh Le (PhD Student), Mr Luca Russo (PhD student), Dr. Thi N. A. Nguyen (Associate Research Fellow), Senior Prof. Salim Bouzerdoum (CI), Prof. Christian Ritz (CI), and Dr. Le Chung Tran (CI). In this project, we have developed a deep learning-based tool for underwater mine detection. Further discussions are in progress to apply the project outcomes. Publication: H. T. Le, S. L. Phung, P. B. Chapple, A. Bouzerdoum, C. H. Ritz, L. C. Tran, "Deep Gabor neural network for automatic detection of mine-like objects in sonar imagery," IEEE Access, vol. 8, no. 1, pp. 94126-94139, 2020.

Detail View

Detail View Summary View
Field of Research
Countries / Regions
Beneficiaries

Beneficiary Quantification Description
External Partners
Evidence of Impact

Evidence Description
UOW Centres / Programs
UOW Researchers / Collaborators

Potential Supervision Topics

- Spatial audio signal processing
- Microphone array speech enhancement.
- Ad-hoc microphone arrays for recording and enhancement of speech and audio.
- Quality of Experience (QoE) of spatial audio and interactive multimedia applications.
- Loudspeaker array signal processing.
- Acoustic Echo Cancellation and Suppression

Advisees

Graduate Advising Relationship

Degree	Research Title	Advisee
Doctor of Philosophy	Domestic Multi-channel Acoustic Scene Detection and Classification for Monitoring of Dementia Patients using Neural Networks
Doctor of Philosophy	Machine Learnt Radiomics Models for the Treatment of Non-Metastatic Non-Small Cell Lung Cancer	Vial, Alanna
Doctor of Philosophy	Multi- Camera Structured-light 3D Measurement System	Zhu, Yuewen
Doctor of Philosophy	Coprome Microphone Array Speech and Audio Signal Processing	Zhao, Jiahong
Doctor of Philosophy	Real-time Automatic Target Recognition of Naval Mines with Autonomous Underwater Vehicle Sonar Imaging	Russo, Luca
Doctor of Philosophy	3D Face Modelling and Recognition for Automatic Selection of Worker Respiratory Protective Equipment	Nguyen, Tran Thanh Phong

Orcid Id

http://orcid.org/0000-0002-3768-7569 (confirmed)

Overview

Top Publications

Research Areas

Research Overview

Available as Research Supervisor

Publications

Selected Publications

Journal Article

Chapter

Conference Paper

Funding

Investigator On

Impact

Impact Story

Underwater Mine Detection with Sonar Imaging

Supervision

Available as Research Supervisor

Potential Supervision Topics

Advisees

Graduate Advising Relationship

Identity

Orcid Id

Overview

Top Publications

Research Areas

Research Overview

Publications

Selected Publications

Journal Article

Chapter

Conference Paper

Funding

Investigator On

Impact

Impact Story

Underwater Mine Detection with Sonar Imaging

Supervision

Potential Supervision Topics

Advisees

Graduate Advising Relationship

Identity

Orcid Id

Visualisations

Research Areas