Automotive gaze and eye tracking solution introduced by OmniVision and Smart Eye
OmniVision Technologies, Inc. and Swedish eye tracking company Smart Eye have announced a collaboration to develop a turnkey driver and cabin monitoring solution that targets automotive OEMs.
The system will integrate Smart Eye’s sensing algorithm library with OmniVision’s new OV2311 CMOS image sensor. The OV2311, according to OmniVision, is the industry’s first 2 MPixel sensor with global shutter and an Automotive Safety Integrity Level (ASIL) B rating in a small package, which are reportedly crucial features for automotive applications that require high-precision gaze and eye tracking. Measuring 7.2 x 6.2 mm, the sensor features a 3 µm pixel size and captures full frame video at up to 60 fps and consumes half the power of competing 1 MPixel sensors, keeping the temperature under control without sacrificing performance, according to OmniVision. The sensor will provide a wide field of view of a larger headbox, to adjust for various driver seat positions, along with images for tracking gaze and sensing throughout the cabin interior, including passengers as well as the driver.
Coupled with the algorithms from Smart Eye, the sensor enables the "full range of driver and cabin monitoring implementations, from safety applications to augmented reality displays and interior sensing with deep neural networks and artificial intelligence," according to OmniVision.
"Automotive OEMs need image sensors that are certified to ASIL B for level-3 autonomous vehicles, beginning with 2021 models," said Marius Evensen, senior automotive technical marketing manager at OmniVision. "The OV2311’s ASIL B certification includes advanced safety features. Additionally, by pairing it with Smart Eye’s sensing algorithm, we are providing OEMs with a robust, turnkey solution that meets the most demanding automotive industry requirements."
Karolina Wikander, head of business management at Smart Eye, also commented: "Our long-term, close working relationship allowed us to seamlessly merge our proven eye-tracking algorithm expertise with OmniVision’s industry-leading image sensors," said Wikander. "OmniVision’s OV2311 is now the benchmark for the driver monitoring industry. Our combined solution benefits automotive OEMs needing a complete hardware and software package that has been thoroughly tested and is ready to implement in a wide variety of vehicles."
The two companies are reportedly in discussions with multiple automotive OEMs, covering a significant number of upcoming car models.