学警狙击(全文在线阅读)>
学警狙击Chinese team develops intelligent vision sensor that turns light signals into AI-ready tokens, reducing use of energy_我的网站
A | 1月13日消息:2019年市场上可能会出现几款可折叠屏幕手机,但之前人们对可折叠屏幕手机的实用性有些担心。 ![]() A Chinese research team from Nanjing University has developed a new ultra-low-power intelligent vision sensor chip, dubbed "LightTok," that can convert light signals into tokens within the sensor, significantly reducing the high energy consumption caused by frequent transfers of massive amounts of redundant data, the principal investigator told the Global Times. According to a release from the Institute of Brain-Inspired Intelligence of Nanjing University, tokens generated by the LightTok chip can be directly fed into a Transformer encoder for image recognition. "Our design idea was to move token generation onto the sensor itself, allowing the chip to directly produce tokens that AI models can process once light reaches the sensor," Miao Feng, director of the Institute of Brain-Inspired Intelligence at Nanjing University, told the Global Times on Thursday. "These tokens contain complete image information." Physical AI refers to intelligent systems capable of autonomously perceiving, reasoning, acting and receiving feedback in the real world, representing a key pathway for AI to move from the digital realm into the physical world. Vision-based physical AI systems powered by large AI models need to convert visual information from real-world environments into tokens that can be processed by AI models before feeding these tokens into Transformers for subsequent tasks. In traditional visual perception pipelines, light signals must go through multiple stages, including image sensing, analog-to-digital conversion, data buffering and transfer, digital image patching and embedding, before being transformed into tokens that AI models can process. The frequent transfer of massive amounts of redundant data has resulted in high energy consumption at the edge, according to a report by Science and Technology Daily. The LightTok chip directly addresses a key challenge in physical AI hardware: how to efficiently acquire and tokenize visual information from the physical world with low energy consumption, Miao said. The LightTok chip consists of a photosensitive memory array and peripheral circuits. The team built the array based on single-layer molybdenum disulfide (MoS₂) floating-gate phototransistors, with each pixel capable of sensing light, storing information and performing analog computing. By processing optical information directly within the chip, the device can convert captured visual signals into tokens for AI models, according to the research team. The current LightTok prototype has a resolution of 32×32 pixels, or 1,024 photosensitive pixels, which is still smaller than that of smartphone cameras and industrial imaging systems. However, Miao said the technology is compatible with CMOS manufacturing processes and can be scaled up. With wafer-level growth of molybdenum disulfide materials, the chip could potentially achieve a scale comparable to existing imaging devices. Miao said the chip also draws inspiration from the information-processing mechanism of human vision. Similar to how the retina extracts key visual information before transmitting it to the brain, the chip also aims to process visual information at an early stage. The research was conducted in collaboration with another research team from the National University of Singapore. The findings were published on Wednesday in Nature Sensors, an internationally renowned journal in the field of sensing technology, according to the release. Potential applications for LightTok include drone systems, autonomous remote sensing and small-scale embodied AI systems, Miao said. In these scenarios, devices need to continuously detect, understand and track targets, generating massive amounts of visual data. By reducing the energy required for visual processing, the technology could extend the operating time of drones, satellites and small robots with limited power supplies, the expert said. 。据传闻,微软也正在建造表面仙女座折叠双屏设备。目前,我们还不清楚该设备的外观细节,但根据微软Surface双屏设备专利,我们有一个大致的了解。
B | 仙女座表面概念图比专利更激进。概念设计师总是以更理想化的方式呈现新的设备形式,这是非常创新的。Conception Creator最近发布了一款微软Surface Andromeda设备概念视频,该视频不仅具有可折叠的大屏幕,而且在设备的折叠外层具有子屏幕显示设备内容。虽然这个设备看起来很奇怪,但有趣的是,像边到边的角屏幕这样的元素越来越普遍。
C | 然而,对于柔性屏幕折叠手机来说,如何最大限度地减小屏幕折叠半径是最关键的,这就要求屏幕制造商取得技术突破。_Surface Andromeda Concept Map_Surface Andromeda Concept Map爆炸性信息,微软已经搁置或严重推迟了他们的表面电话项目,但可能正在开发具有类似形状尺寸的更大设备,如Surface Centraurus或Surface Januss设备。 Current article:http://wdu.yindabobiehonggaonumiao.bond/list_973x/56ttwio.html Published on:15:49:58 |




