PhD Scholarship in 6 Degree of Freedom (DoF) Augmented Reality / Mixed Reality Audio Rendering – DTU Electro

This PhD position will investigate the state-of-the-art AR/VR/MR audio rendering techniques with nearly real-time acoustic simulations. Ultimately you will research the state-of-the-art audio generation/acoustic simulation method for 6 DoF virtual audio rendering in challenging multi-talker situations.
If you are establishing your career as a scientist and you are looking for the best possible foundation for fulfilling your dreams and ambitions, it is right here in front of you.

At DTU Electro you will break new ground at the absolute forefront of what is possible. Particularly the acoustic technology group is leading the virtual rendering techniques in the field of room acoustics.

Room acoustics is a critical field of study focused on how sound behaves within an enclosed space. This encompasses everything from how sound waves travel and reflect off surfaces, to how they interact with the objects within the room. The ultimate goal is to achieve an optimal auditory experience, whether it be for listening to music, watching a movie, or delivering a speech. The importance of acoustics is particularly pronounced in environments like concert halls, recording studios, home theaters, and large auditoriums. To evaluate the acoustic performance of a given room design, we could use audio reproduction methods that require sound stimuli to play. This project is all about developing the best audio rendering methods aimed for 6 DoF AR/MR rendering by combining the state-of-the-art signal processing, acoustic simulations, and potentially scientific machine learning.

Responsibilities and qualifications
Your overall focus is to create immersive audio experiences that dynamically adapt to a user’s movements in physical and virtual spaces. 6DoF audio data require lots of storage, computing power, and real-time playback systems. Current challenges include insufficient tracking system, insufficient real time playback solution, high computing expenditure, insufficient scalability, finally inaccuracy of audio rendering systems.

Therefore, DTU and KAIST (Korea Advanced Institute of Science and Technology), a leading technical university in South Korea, join forces to develop the state-of-the-art audio rendering system, primarily aimed for 6DoF rendering systems that reproduce multi-talker situations.

While KAIST focuses on the object separation from sound field recordings via, e.g., high-order Ambisonics or binaural recordings, DTU will focus on binaural syntheses for 6DoF scenarios. We think scientific machine learning is a promising way, but we would not rule out any other conventional numerical methods to achieve our goal. For such a challenging 6DoF task to be nearly real time, parametrization is the key to success. As we repeatedly solve the same governing equation for different parameter values (i.e., boundary surfaces, source location, receivers) we don’t need to recalculate the solutions from scratch. There are several good methods known to work well in parameterizing with the wave equation, to name a few, the certified reduced order method, physics informed neural networks, and neural operators. Our focus is to develop a useful almost real time audio rendering system requiring low power consumption.

Again, this is a collaboration with KAIST to push the boundary of the virtual rendering of room acoustics. Therefore, the candidate is expected to stay at KAIST for about 6 months during the PhD and actively participate in organizing joint events and sessions in relevant conferences. You will also be actively participating in the department’s teaching and supervision activities during the PhD too.

Your primary tasks will be

• Develop audio rendering systems that can adapt 6 DoF computational and hardware resources as little as possible
• Research acoustic simulation techniques, such as, finite element, and boundary element simulations, and / or geometrical acoustics methods
• Apply relevant audio signal processing methos, e.g., Ambisonics, to be incorporated in the rendering system to make it naturally sounding
• Potentially run subjective listening tests
• Disseminating scientific works in various relevant scientific events
• Finally, teaching and supervising various BSc and MSc projects

You must have a two-year master's degree (120 ECTS points) in acoustics or a similar degree with an academic level equivalent to a two-year master's degree.

Approval and Enrolment
The scholarship for the PhD degree is subject to academic approval, and the candidate will be enrolled in one of the general degree programmes at DTU. For information about our enrolment requirements and the general planning of the PhD study programme, please see DTU's rules for the PhD education. Please note that DTU does have a strict PhD enrolment requirement, so please read it carefully to make sure that you fulfil the academic requirements.

Assessment
The assessment of the applicants will be made by head of the group, Finn Agerkvist and main supervisor Cheol-Ho Jeong.

We offer
DTU is a leading technical university globally recognized for the excellence of its research, education, innovation and scientific advice. We offer a rewarding and challenging job in an international environment. We strive for academic excellence in an environment characterized by collegial respect and academic freedom tempered by responsibility.

Salary and appointment terms
The appointment will be based on the collective agreement with the Danish Confederation of Professional Associations. The allowance will be agreed upon with the relevant union.

The period of employment is 3 years. The starting date of this position is 1 February/March 2025 and is a full-time position.

You can read more about career paths at DTU here.

Further information
Further information may be obtained from Cheol-Ho Jeong, [email protected].

You can read more about DTU Electro at www.electro.dtu.dk.

If you are applying from abroad, you may find useful information on working in Denmark and at DTU at DTU – Moving to Denmark. Furthermore, you have the option of joining our monthly free seminar “PhD relocation to Denmark and startup “Zoom” seminar” for all questions regarding the practical matters of moving to Denmark and working as a PhD at DTU.

Application procedure
Your complete online application must be submitted no later than 18 October 2024 (Danish time). Applications must be submitted as one PDF file containing all materials to be given consideration. To apply, please open the link "Apply now", fill out the online application form, and attach all your materials in English in one PDF file. The file must include:

• A letter motivating the application (cover letter)
• Curriculum vitae
• Grade transcripts and BSc/MSc diploma (in English) including official description of grading scale

You may apply prior to ob­tai­ning your master's degree but cannot begin before having received it.

Applications received after the deadline will not be considered.

All interested candidates irrespective of age, gender, race, disability, religion or ethnic background are encouraged to apply.

DTU Electro is the central DTU department within electrical and photonics engineering. We research into understanding the nature of light and electronics and all the ways in which we can control and use these. Research in electrical and photonics engineering will determine the future and new breakthroughs are needed to contribute to solving the Global Goals.

Technology for people
DTU develops technology for people. With our international elite research and study programs, we are helping to create a better world and to solve the global challenges formulated in the UN’s 17 Sustainable Development Goals. Hans Christian Ørsted founded DTU in 1829 with a clear mission to develop and create value using science and engineering to benefit society. That mission lives on today. DTU has 13,500 students and 6,000 employees. We work in an international atmosphere and have an inclusive, evolving, and informal working environment. DTU has campuses in all parts of Denmark and in Greenland, and we collaborate with the best universities around the world.

Adresse:

Ørsteds Plads
2800 Kgs. Lyngby