当前位置:主页 > 国内 >

秘密

Chinese team develops intelligent vision sensor that turns light signals into AI-ready tokens, reducing use of energy_我的网站

太极张三丰

一 |     今日(8月19日),《诡秘之主》正式开启公测客户端预下载,角色预创同步开放,游戏将于8月21日上午10点开启公测。

二 |     

The new ultra-low-power intelligent vision sensor chip
    The new ultra-low-power intelligent vision sensor chip "LightTok" developed by a research team from Nanjing University. Photo: from Science and Technology Daily
A Chinese research team from Nanjing University has developed a new ultra-low-power intelligent vision sensor chip, dubbed "LightTok," that can convert light signals into tokens within the sensor, significantly reducing the high energy consumption caused by frequent transfers of massive amounts of redundant data, the principal investigator told the Global Times.
According to a release from the Institute of Brain-Inspired Intelligence of Nanjing University, tokens generated by the LightTok chip can be directly fed into a Transformer encoder for image recognition.
"Our design idea was to move token generation onto the sensor itself, allowing the chip to directly produce tokens that AI models can process once light reaches the sensor," Miao Feng, director of the Institute of Brain-Inspired Intelligence at Nanjing University, told the Global Times on Thursday. "These tokens contain complete image information."
Physical AI refers to intelligent systems capable of autonomously perceiving, reasoning, acting and receiving feedback in the real world, representing a key pathway for AI to move from the digital realm into the physical world. Vision-based physical AI systems powered by large AI models need to convert visual information from real-world environments into tokens that can be processed by AI models before feeding these tokens into Transformers for subsequent tasks.
In traditional visual perception pipelines, light signals must go through multiple stages, including image sensing, analog-to-digital conversion, data buffering and transfer, digital image patching and embedding, before being transformed into tokens that AI models can process. The frequent transfer of massive amounts of redundant data has resulted in high energy consumption at the edge, according to a report by Science and Technology Daily.
The LightTok chip directly addresses a key challenge in physical AI hardware: how to efficiently acquire and tokenize visual information from the physical world with low energy consumption, Miao said.
The LightTok chip consists of a photosensitive memory array and peripheral circuits. The team built the array based on single-layer molybdenum disulfide (MoS₂) floating-gate phototransistors, with each pixel capable of sensing light, storing information and performing analog computing. By processing optical information directly within the chip, the device can convert captured visual signals into tokens for AI models, according to the research team.
The current LightTok prototype has a resolution of 32×32 pixels, or 1,024 photosensitive pixels, which is still smaller than that of smartphone cameras and industrial imaging systems. However, Miao said the technology is compatible with CMOS manufacturing processes and can be scaled up. With wafer-level growth of molybdenum disulfide materials, the chip could potentially achieve a scale comparable to existing imaging devices.
Miao said the chip also draws inspiration from the information-processing mechanism of human vision. Similar to how the retina extracts key visual information before transmitting it to the brain, the chip also aims to process visual information at an early stage. 
The research was conducted in collaboration with another research team from the National University of Singapore. The findings were published on Wednesday in Nature Sensors, an internationally renowned journal in the field of sensing technology, according to the release.
Potential applications for LightTok include drone systems, autonomous remote sensing and small-scale embodied AI systems, Miao said. In these scenarios, devices need to continuously detect, understand and track targets, generating massive amounts of visual data. By reducing the energy required for visual processing, the technology could extend the operating time of drones, satellites and small robots with limited power supplies, the expert said.    
4.png本作支持PC、安卓、iOS、鸿蒙多端游玩,快手游戏官网账号可以实现多设备进度互通。

三 | 需要注意,B站渠道账号的数据,仅支持该渠道下安卓与PC端互通,和官网账号体系相互独立,数据无法跨渠道共用。参与过绯红测试、灰雾测试的玩家需要留意,过往测试客户端不能继续沿用,测试数据也不会继承到公测版本。玩家需要卸载旧客户端,清理残留文件,再下载全新公测安装包。

四 | 1.png不同设备的硬件门槛已经对外公布。

五 | PC台式机最低需要i7‑7700或者锐龙53400G处理器,搭配16G内存与80G硬盘空间,显卡要求GTX10606G、RX5500;想要高画质稳定运行,官方推荐i7‑12700、锐龙77700X,内存提升至32G,游戏安装在SSD固态硬盘。笔记本平台、移动端也划分了对应的高低标准,安卓最低需要骁龙855机型,iPhone方面最低支持iPhone12。移动端存储至少预留30G可用空间。2.png从官方放出的FAQ可以看到,预下载阶段就会遇到不少高频问题。安卓安装时会弹出风险提示,属于第三方安装包的正常现象,给予授权即可完成安装。PC端的问题更为多样,启动器识别不到游戏目录、下载解压失败、Windows安全拦截、杀毒软件误删文件,都是玩家反馈较多的情况。大部分故障可以通过检查磁盘剩余空间、调整文件夹路径、关闭安全软件、以管理员身份运行启动器来处理。3.png正式进游戏之后,黑屏、闪退、程序无响应也有对应的处理手段。优先核对硬件配置,更新显卡驱动,把游戏目录加入杀毒软件白名单,启动器自带一键修复功能,可以校验本地游戏文件完整性。部分报错提示,代表系统缺失VC++运行库,玩家需要前往微软官网下载对应组件完成安装。另外游戏不支持Windows7系统,还在使用这套系统的玩家需要升级系统才能正常游玩。

六 | 80G的客户端体积不算小,官方也建议玩家在稳定WiFi环境完成下载,优先下载核心资源,减少开服之后的等待时间。

七 | 不少玩家会直接把游戏装在机械硬盘,会造成加载速度缓慢,SSD固态硬盘可以明显改善加载表现。你会去下载尝试《诡秘之主》吗?欢迎在评论区留下你的看法~详细内容:1.jpg2.jpg3.jpg4.jpg

Current article:http://geijuanpobanmumennong.bond/list_zk7pmf/tlh.html

Published on:14:47:41


相关新闻

最后更新

热门新闻