The Optics and Sensing Laboratory at the Max Planck Institute for Intelligent Systems in Tübingen has an open position for a

Research Engineer for Statistical 3D Model of Quadrupeds (f/m/div)

to join the ongoing research efforts in the development of statistical 3D models of Quadrupeds.

About us

We are creating the world’s most realistic human and animal avatars for use in research, film, virtual reality, biology and medicine. Using unique 3D & 4D capture facilities, machine learning, computer vision and advanced graphics, we are modeling every nuance of how humans and animals look and move. We develop algorithms to estimate human shape and motion in images, videos, RGB-D sequences, etc. Our approaches define the current state of the art, and we are constantly pushing these methods and systems in order to achieve a better accuracy and greater usability.

Department website:

The Project

Horses are one of the most beloved animals. They are beautiful in shape and motion, they have been used for carrying people, goods, for helping in farming, for racing, and also for therapy. We are interested in capturing horse motion from motion capture data, with the goal of building marker-less motion capture systems for horses. We are collaborating with the Swedish University of Agricultural Sciences and IMATI-CNR in developing a system for the markerless motion capture of horses. Our approach is based on creating a highly realistic 3D articulated model of horses from data. To this goal, we need to capture partial 3D scans of real animals and register them to a predefined horse template. Doing this enables us to model the shape of real horses and the shape variability across a range of individuals with different characteristics. In this research context, we are looking for talented research engineer to pursue the project.

Figure: a) Data capture setup, b) 3D Scan of horse, c) Model fit of scanned horse

Roles & Responsibilities

• Investigation, implementation and evaluation of potential model improvements, for example: skeleton/joint paradigms, shape space encoding variations, pose dependent deformations, etc.
• Conceptualization and development of model evaluation procedures, including quantitative and qualitative metrics.
• Development of various Minimum-Viable-Product pipelines, including image/video mesh recovery models and use-case applications (e.g. body conformation scoring from model outputs).
• Enhancement of the process for re-training and establishing a continuous learning pipeline.
• Improvement of established robust method for registering 3D parametric model templates to cleaned 3D scans.
• Project management: definition and evaluation of projects steps and directions.

Education & Experience

• Experience with 3D parametric body models (i.e. SMPL/MANO/ATLAS/VAREN/etc.)
• Experience in Computational Geometry, Computer Vision and Deep Learning
• Accepted publications in one of these fields is a big advantage
• Good programming skills in Python or C++; PyTorch (or similar) experience
• Project management experience and the ability to work independently in dynamic environments
• Experience in one or more of the following: Point-cloud libraries, OpenCV, 3D rendering pipelines and deep-learning frameworks
• Good oral and written communication skills in Englis
• Enjoyment for collaborative work and multidisciplinary projects
• A minimum of a Master’s degree is required
• Experience writing production level code is a plus

Our offer

In this working environment, you will be exposed to cutting-edge technologies related to computer vision and multi-sensor systems. The MPI for Intelligent Systems is one of the world's leading research institutions for machine learning, computer vision and robotics, and studying the concepts of intelligence and autonomous behavior in artificial systems at different length scales. The position is ideally suited for candidates looking to extend their scientific and cultural horizons particularly in the area of 3D Motion Capture. You will be a part of a dynamic team of international scientists, engineers, and administrative staff.

The Max Planck Society is committed to increasing the number of individuals with disabilities in its workforce and therefore encourages applications from such qualified individuals. The Max Planck Society strives for gender equality and diversity. Furthermore, the Max Planck Society seeks to increase the number of women in its workforce in those areas where they are underrepresented and therefore explicitly encourages women to apply.

The position is available as of now and will be open until filled or no longer needed.

Application

Any questions regarding the position should be forwarded to Keiko Kitagawa at and Dr. Senya Polikovsky at

Candidates should send their:

1. Curriculum Vitae

2. References

3. GitHub account showing us your programming skills

4. Two-page response to the following:

5. Motivation and why you are a good fit, and how this position contributes to your career aspirations. 2. Please provide your thoughts on a) what makes your code production ready, or b) what would need to be addressed to do so. 3. The existing (public) state of the art 3D parametric model for horses (VAREN) sees limited success when modelling small horses (e.g. Shetland Ponies). What is your intuition as to why this may be and (briefly) how you would address this.

Your answers to number 4 should be limited to two pages. Feel free to include images/figures.

Please send the requested documents as a single application package, in a single PDF file, to the . Application without these documents including the letter will not be considered.

If you prefer to send a hardcopy application, you may do so. Please send it to: MPI-IS, Keiko Kitagawa, Max-Planck-Ring 4, 72076 Tübingen.

Closing date for applications

The posting is open until filled or no longer needed.