Cutting-edge vision chip brings human eye-like perception to machines

The demo platform for autonomous driving notion. Credit: Tsinghua University

With the speedy development of synthetic intelligence, unmanned programs resembling autonomous driving and embodied intelligence are repeatedly being promoted and utilized in real-world situations, resulting in a brand new wave of technological revolution and industrial transformation. Visible notion, a core means of knowledge acquisition, performs a vital position in these clever programs. Nonetheless, attaining environment friendly, exact, and sturdy visible notion in dynamic, numerous, and unpredictable environments stays an open problem.

In open-world situations, intelligent systems should not solely course of huge quantities of information but in addition deal with numerous excessive occasions, resembling sudden risks, drastic gentle modifications at tunnel entrances, and robust flash interference at night time in driving situations.

Conventional visible sensing chips, constrained by the “power wall” and “bandwidth wall,” typically face problems with distortion, failure, or excessive latency when coping with these situations, severely impacting the soundness and security of the system.

To handle these challenges, the Heart for Mind Impressed Computing Research (CBICR) at Tsinghua University has centered on brain-inspired imaginative and prescient sensing applied sciences, and proposed an revolutionary complementary sensing paradigm comprising a primitive-based illustration and two complementary visible pathways.

The analysis paper based mostly on these outcomes, “A Vision Chip with Complementary Pathways for Open-world Sensing,” was featured as the duvet article of Nature within the May 30, 2024 difficulty.

Impressed by the elemental rules of the human visible system, this method decomposes visible info into primitive-based visible representations. By combining these primitives, it mimics the options of the human visible system, forming two complementary and information-complete visual perception pathways.

Cutting-edge vision chip brings human eye-like perception to machines
A Tianmouc chip (left) and a notion system (proper). Credit: Tsinghua University

Based mostly on this new paradigm, CBICR has developed the world’s first brain-inspired complementary imaginative and prescient chip, Tianmouc. This chip achieves high-speed visible info acquisition at 10,000 frames per second, 10-bit precision, and a high dynamic range of 130 dB, all whereas lowering bandwidth by 90% and sustaining low power consumption. It not solely overcomes the efficiency bottlenecks of conventional visible sensing paradigms but in addition effectively handles numerous excessive situations, guaranteeing system stability and security.

Leveraging the Tianmouc chip, the staff has developed high-performance software program and algorithms, and validated their efficiency on a vehicle-mounted notion platform working in open environments. In numerous excessive situations, the system demonstrated low-latency, high-performance real-time notion, showcasing its immense potential for functions within the discipline of clever unmanned programs.

The profitable improvement of Tianmouc is a major breakthrough within the discipline of visible sensing chips. It not solely gives robust technological assist for the development of the clever revolution but in addition opens new avenues for essential functions resembling autonomous driving and embodied intelligence.

Mixed with CBICR’s established technological basis in brain-inspired computing chips like Tianjic, toolchains, and brain-inspired robotics, the addition of Tianmouc will additional improve the brain-inspired intelligence ecosystem, powerfully driving the progress of synthetic common intelligence.

Extra info:
Zheyu Yang et al, A imaginative and prescient chip with complementary pathways for open-world sensing, Nature (2024). DOI: 10.1038/s41586-024-07358-4

Slicing-edge imaginative and prescient chip brings human eye-like notion to machines (2024, June 5)
retrieved 5 June 2024

This doc is topic to copyright. Aside from any truthful dealing for the aim of personal examine or analysis, no
half could also be reproduced with out the written permission. The content material is supplied for info functions solely.

Click Here To Join Our Telegram Channel

Source link

If in case you have any considerations or complaints relating to this text, please tell us and the article shall be eliminated quickly. 

Raise A Concern

Show More

Related Articles

Back to top button