Developing real world
technologies for mixed
The merging of real and virtual worlds to produce mixed reality (MR) environments is becoming a realistic component of future society. The effective use of MR demands a natural visual experience without physiological side effects for the user. REALHOLO is a project developed to meet these needs by researching advanced micro-mirror-based piston-type spatial light modulator (SLM) modulating the phase of visible light with optical features far superior to any liquid crystal-based alternative.The SLM will facilitate 3D display applications and active illumination and sensing. REALHOLO will develop dedicated core hardware concepts and modules for integration. The goal is an application-specific demonstration of the MMA in automotive use in real holographic MR head-up display (HUD) and active head lamp projection system and to enable future applications like real holographic head-mounted displays (HMD).
REALHOLO will pave the way for main stream mixed reality environments by using micro mirror arrays to provide the best possible experience for the user without physiological side effects like eye fatigue, misjudgement, motion sickness and accommodation-vergence conflict, which are known from alternative and intermediate technologies such as stereoscopic 3D. The required natural visual experience can only be achieved with real holographic displays which have been principally demonstrated on the basis of available component technologies -both for direct view (TFT-LCD) and projection (micro displays). REALHOLO will research and develop a new type of SLM, a micro-electro-mechanical system (MEMS) based reflective micro-display: a micro mirror array (MMA) component with a unique set of properties. The newly developed MEMS technology and MMA will be especially suited for real holographic MR displays but also for many other applications from high value to high volume will also benefit from the fast modulating MMA's for a precise phase modulation with a large number of pixels.
Reference Number: 101014977
Programme type: H2020-ICT-2020-2
Programme acronym: REALHOLO
Project Start: 01.01.2021
Cost and Funding
Costs: € 5.997.582,50
Funding: 100% EU-funded
The REALHOLO project will take the next step towards developing commercially available real holographic projection displays usable in a wide range of applications from automotive head-up displays (HUD) to active automotive head-lamps and personal head-mounted displays (HMD). The REALHOLO consortium is constructed with the whole value chain represented for subsequent development of market-ready MR displays for the automotive industry as well as other holographic and optical solutions.The consortium enables a revolutionary next generation light modulating device for a variety of new and proprietary applications with unique features in natural 3D imaging, highly efficient active illumination, irradiation and sensing. REALHOLO will focus on the ethical aspects of research and exploitation as well as dissemination and training activities for the industries and institutions ranging from optical, electronics, automotive to biomedical, agricultural and outer space.
Mission and Objectives
To be able to develop an application-specific demonstration of the MMA in automotive use in real holographic MR head-up display HUD and active head lamp projection system, enabling future applications like real holographic head-mounted displays HMD. The aim is to develop an advanced micro-mirror-based piston type spatial light modulator SLM for real holographic 3D mixed reality MR display applications, active illumination and sensing. REALHOLO will focus on the following objectives:
- Development of a novel MMA-based SLM
- Demo of a MR display - a real holographic MR application implemented as a head-up display (HUD) module for future vehicles.
- Demo of a projector -Active head lamp
Use cases and target specifications
In WP1, the REALHOLO target specification will be finalized. This includes the specification of the MMA component and demonstrator systems, including all the underlying technologies, circuits, algorithms and components as well as electrical, optical and mechanical interfaces. This WP provides the input to all other WPs. The output is a specification that ensures that all the individual components will properly work together and that the developed demonstrator system will have an impressive performance.
Backplane and driving electronics development
WP2 includes all the tasks for developing and fabricating the CMOS backplane featuring a 200 Giga-bits per second bandwidth digital interface, low power data receiver, fast but low power digital-analog converter, row and column drivers, the pixel storage cell array and the electronics for driving the component.
MEMS process and MMAcomponent development
The core component of the REALHOLO system, the MEMS micro mirror array (MMA) will be developed together with a suitable fabrication process for the actuators and mirrors. Two different types of the component will be fabricated: one with and one without the precision-made optical window.
Application demonstration in realholographic MR Head Up Display
The focus of WP4 will be on integration of the component into a principle holographic HUD demonstrator. Objective is the “validation in application settings” for future automotive use -including the design, building up and execution of use case tests.
Application demonstration in active head lamp
This WP will focus on the integration of the component into a principle holographic head lamp demonstrator. The demonstrator system will be based on the component without precision-made optical window because this allows a most efficient use of light and does not require real-time hologram encoding.
Dissemination, Communication and Exploitation
Dedicated to the communication, dissemination and exploitation of the project and its developments. The main objectives refer to the targeted communication of project results, the dissemination and contribution to a European Research Union as well as the exploitation of the scientific results to create competitive advantage with innovative products.
Project, risk and innovationmanagement
Responsible for the operational management and technical vitality of the REALHOLO project encompassing management tasks on contractual, financial, legal, technical, administrative and ethical levels.