Developing real world

technologies for mixed

reality worlds

About

The merging of real and virtual worlds to produce mixed reality (MR) environments is becoming a realistic component of future society. The effective use of MR demands a natural visual experience without physiological side effects for the user. REALHOLO is a project developed to meet these needs by researching advanced micro-mirror-based piston-type spatial light modulator (SLM) modulating the phase of visible light with optical features far superior to any liquid crystal-based alternative.The SLM will facilitate 3D display applications and active illumination and sensing. REALHOLO will develop dedicated core hardware concepts and modules for integration. The goal is an application-specific demonstration of the MMA in automotive use in real holographic MR head-up display (HUD) and active head lamp projection system and to enable future applications like real holographic head-mounted displays (HMD).

Vision

REALHOLO will pave the way for main stream mixed reality environments by using micro mirror arrays to provide the best possible experience for the user without physiological side effects like eye fatigue, misjudgement, motion sickness and accommodation-vergence conflict, which are known from alternative and intermediate technologies such as stereoscopic 3D. The required natural visual experience can only be achieved with real holographic displays which have been principally demonstrated on the basis of available component technologies -both for direct view (TFT-LCD) and projection (micro displays). REALHOLO will research and develop a new type of SLM, a micro-electro-mechanical system (MEMS) based reflective micro-display: a micro mirror array (MMA) component with a unique set of properties. The newly developed MEMS technology and MMA will be especially suited for real holographic MR displays but also for many other applications from high value to high volume will also benefit from the fast modulating MMA's for a precise phase modulation with a large number of pixels.

Keyfacts

Reference

Reference Number:
101014977
Programme type:
H2020-ICT-2020-2
Programme acronym:
REALHOLO

Duration

Project Start: 01.01.2021
48 Months

Cost and Funding

Costs:
€ 5.997.582,50
Funding:
100% EU-funded

Motivation

The REALHOLO project will take the next step towards developing commercially available real holographic projection displays usable in a wide range of applications from automotive head-up displays (HUD) to active automotive head-lamps and personal head-mounted displays (HMD). The REALHOLO consortium is constructed with the whole value chain represented for subsequent development of market-ready MR displays for the automotive industry as well as other holographic and optical solutions.The consortium enables a revolutionary next generation light modulating device for a variety of new and proprietary applications with unique features in natural 3D imaging, highly efficient active illumination, irradiation and sensing. REALHOLO will focus on the ethical aspects of research and exploitation as well as dissemination and training activities for the industries and institutions ranging from optical, electronics, automotive to biomedical, agricultural and outer space.

Mission and Objectives

To be able to develop an application-specific demonstration of the MMA in automotive use in real holographic MR head-up display HUD and active head lamp projection system, enabling future applications like real holographic head-mounted displays HMD. The aim is to develop an advanced micro-mirror-based piston type spatial light modulator SLM for real holographic 3D mixed reality MR display applications, active illumination and sensing. REALHOLO will focus on the following objectives:
  • Development of a novel MMA-based SLM
  • Demo of a MR display - a real holographic MR application implemented as a head-up display (HUD) module for future vehicles.
  • Demo of a projector -Active head lamp

Work Packages

WP1

Use cases and target specifications
56%
01.01.2021
01.09.2021
In WP1, the REALHOLO target specification will be finalized. This includes the specification of the MMA component and demonstrator systems, including all the underlying technologies, circuits, algorithms and components as well as electrical, optical and mechanical interfaces. This WP provides the input to all other WPs. The output is a specification that ensures that all the individual components will properly work together and that the developed demonstrator system will have an impressive performance.

WP2

Backplane and driving electronics development
26%
01.01.2021
01.07.2022
WP2 includes all the tasks for developing and fabricating the CMOS backplane featuring a 200 Giga-bits per second bandwidth digital interface, low power data receiver, fast but low power digital-analog converter, row and column drivers, the pixel storage cell array and the electronics for driving the component.

WP3

MEMS process and MMAcomponent development
11%
01.01.2021
31.10.2024
The core component of the REALHOLO system, the MEMS micro mirror array (MMA) will be developed together with a suitable fabrication process for the actuators and mirrors. Two different types of the component will be fabricated: one with and one without the precision-made optical window.

WP4

Application demonstration in realholographic MR Head Up Display
0%
01.07.2022
31.12.2023
The focus of WP4 will be on integration of the component into a principle holographic HUD demonstrator. Objective is the “validation in application settings” for future automotive use -including the design, building up and execution of use case tests.

WP5

Application demonstration in active head lamp
0%
01.09.2022
31.12.2024
This WP will focus on the integration of the component into a principle holographic head lamp demonstrator. The demonstrator system will be based on the component without precision-made optical window because this allows a most efficient use of light and does not require real-time hologram encoding.

WP6

Dissemination, Communication and Exploitation
10%
01.01.2021
31.12.2024
Dedicated to the communication, dissemination and exploitation of the project and its developments. The main objectives refer to the targeted communication of project results, the dissemination and contribution to a European Research Union as well as the exploitation of the scientific results to create competitive advantage with innovative products.

WP7

Project, risk and innovationmanagement
10%
01.01.2021
31.12.2024
Responsible for the operational management and technical vitality of the REALHOLO project encompassing management tasks on contractual, financial, legal, technical, administrative and ethical levels.

Follow us on