Student Assistant - Erlangen, Deutschland - Fraunhofer-Institut für Integrierte Schaltungen IIS

Fraunhofer-Institut für Integrierte Schaltungen IIS

Geprüftes Unternehmen

Erlangen, Deutschland

vor 2 Wochen

Geschrieben von:

Lena Wagner

beBee Recruiter

Beschreibung

Smart speakers should be able to adapt to their environment for optimizing sound reproduction [1]. To achieve this, it is necessary to estimate the geometry of the room in which they are placed.

There are two main approaches to accomplishing this:
The first approach is through acoustic methods.

These methods involve sending out sound waves from the smart speaker and measuring the time it takes for the waves to return.

By analyzing this data, the geometry of the room can be derived. Alternatively, geometry information can also be obtained through the use of images taken from different perspectives. This methods rely on fundamental principles of structure for motion, allowing for the derivation of a 3D model.

To contribute to the improvement of future smart speaker technology, your task is to compare these two modalities and identify their respective strengths and weaknesses.

This analysis will serve as a foundation for finding clever ways to combine them in order to achieve higher quality reconstruction results.

You are interested in improving the technology of future smart speakers?

Then have a look at our offer
What you will do

You capture visual and acoustic data for several room types
You do the visual processing including camera calibration, voxel reconstruction [2], and mesh generation
You convert audio room geometry into a visual model
You align the visual and acoustic model for comparison
You evaluate strengths, weaknesses, precisions and completeness of the two modalities

What you bring to the table

You are currently studying computer science, computer graphics or signal processing.
You are interested in 3D modelling or 3D reconstruction
You have knowledge in Python, Pytorch and basic signal processing
Optional you have basic skills in using Blender

What you can expect
-
Flexible working hours
-
Open and
friendly team work:

Varied tasks with room for
creativity:
Exciting
seminars and
events:

-
Networking with scientists
-
Active contribution in applied research
-
Interesting an
innovative projects

Weekly working hours are determined by agreement.

You can start from now on (as a student assistant from 10 to 20 hours a week or as an intern for a period of at least three months).

You can reduce your hours before exams and increase them during semester breaks. You can flexibly determine the working days. After your studies, you have the option of working with us full or part time.

References:
[1] C. Tuna et al., '3D Room Geometry Inference Using a Linear Loudspeaker Array and a Single Microphone', IEEEACM Trans. Audio Speech Lang. Process., vol.

28, pp , 2020,

doi:
/TASLP
[2] M

Tancik et al, 'Nerfstudio:
A Modular Framework for Neural Radiance Field Development'. arXiv, Feb. 08, 2023.

doi:
/arXiv

Interested?
Fraunhofer-Institute for Integrated Circuits IIS

Application Deadline:
none