Research and application of multi-modal sensing and data-driven intelligent process planning technology for industrial robot
基於多模態感知和數據驅動的工業機器人智能作業系統研究及應用

2020-06-18|Tags: , , , |

Robots are autonomous intelligent machines. As a carrier of artificial intelligence, its development and application has become the core driving force in a new round of technological revolution and industrial transformation. Intelligent robots can assist or even replace humans to complete dangerous, heavy and complex operations, which could improve work efficiency and quality and thus are widely used in smart manufacturing and security monitoring in smart cities. This study focuses on two major scientific issues: “instant perception of complex operating objects in an unstructured environment, and the collection, analysis, data mining and optimization of big data from the process parameters”. Integrating the emerging technologies such as artificial intelligence, Internet of Things, big data, and electromechanical automation, this project explores the key technologies of multi-modal deep three-dimensional object perceptions, studies the optimization of big data process and intelligent process planning in virtual reality interactive scenes, and carries out industrial robot application and verification for typical complex operation tasks.

The research team of this project is composed of domestic and international universities, research institutes and enterprises with leading advantages in the field of robotics, including South China University of Technology, University of Leeds, Shenzhen Institutes of Advanced Technology and Institute of Microelectronics of the Chinese Academy of Sciences, and Foshan Huashu Robot Co., Ltd. This project is funded by the Macao Funding Scheme for Key R&D Projects of the Science and Technology Development Fund, Macao SAR (File no.: 0018/2019/AKP). Prof. Zhixin Yang, who is the Associate Professor at the State Key Laboratory of Internet of Things for Smart City and the Department of Electromechanical Engineering of the Faculty of Science and Technology of the University of Macau, is in charge of this project. This project is expected to provide core technical support for the design and development of robots in the future through in-depth internationalized industry-university-research cooperation, enhance Macao’s R&D and industrialization level in the field of artificial intelligence, and promote the appropriate diversified development of Macao’s economy through technological innovation.

機器人是能自主工作的智慧型機器,其作為人工智能的一個載體,相關研發與應用成為新一輪科技革命和產業變革的核心驅動力。智能機器人可輔助甚至替代人類完成危險、繁重、複雜的操作,提高工作效率與量,在智能製造,智慧城市安全監控等領域具有廣泛應用。本項研究圍繞“非結構化環境下複雜操作象的即時感知,及工藝參數大數據搜集分析、挖掘和優化” 兩大科學問題,融合人工智能、物聯網、大數據、機電自動化等新興技術,探索多模態深度三維感知關鍵技術,研究虛擬與現實場景大數據工藝優化及智能作業技術,以及開展面向複雜作業任務的工業機器人應用驗證。

此專項的研究團隊由國內外在機器人領域具領先優勢的高校、研究院及企業組成,包括華南理工大學、茲大學、中國科學院深圳先進技術研究院、中國科學院微電子研究所和佛山華數機器人有限公司。項目獲得澳門特別行政區科學技術發展基金重點研發專項資助(檔案編號: 0018/2019/AKP)。項目負責人由澳門大學智慧城市物聯網國家重點實驗室、科技學院機電工程系副教授楊志新擔任。此項目期望通過深內外產學研合作,為未來機器人的設計開發提供核心技術支撐,提升澳門在人工智能領域的研發和產業化水準,以科技創新助推澳門經濟適度多元化發展。

Prof. Yang Zhixin’s research team studies 
intelligent process planning technology for robots
科技學院副教授及研究服務及
知識轉移辦公室主任楊志新

Prof. Yang Zhixin’s research team studies 
intelligent process planning technology for robots
楊志新教授(左二)及其團隊研究
機器人智能作業系統

A disinfecting intelligent robot is now developing by Faculty of Science and Technology for the fight against novel coronavirus pneumonia
科技學院研製醫護智能機器人以應對新型冠狀病毒肺炎

2020-03-26|Tags: , , , |

As a public university with the most state key laboratories in the west of the Guangdong-Hong Kong-Macao Greater Bay Area, UM has attained research breakthroughs in science research. In response to the prevention and control work of novel coronavirus pneumonia of the Macao SAR governments, FST has for the first time conducted a research about disinfecting intelligent robots, aims to provide strong scientific and technological support to fight against the epidemic.

Breaking free from safe thinking: To explore the future of intelligent robots

Facing the threat of novel coronavirus pneumonia, the technology of disinfection has become one of the key technologies in virus elimination. However, as of today, many regions are still conducting disinfection manually, which leads to a heavy workload of front-line medical staff and high risk of spreading infection. Although there are a few disinfection robots available in the market, they are too costly to afford and difficult to be widely deployed. This research project is led by Prof. Xu QingSong of FST to develop an artificial intelligence robot for automatic disinfection and sterilization in response to the threat of novel coronavirus pneumonia. The artificial intelligence robot can replace manual disinfection with both indoor and outdoor automatic disinfection. As the robot can be remotely controlled with a mobile app, it will greatly prevent cross infection and reduce the risk of infection of medical staff. Laser radar, ultrasonic sensor and camera lens are used for the robot for real-time environmental ranging and sensing. With the autonomous navigation and obstacle avoidance functions, users can use the camera lens to monitor the status of disinfection. In addition, the robot can decide its own route, analyze the size of cleaning space, adjust and spray disinfectant with precise dosage. The robots adapts advanced dry fog hydrogen peroxide (hydrogen peroxide) to conduct disinfection due to the high bactericidal force of hydrogen peroxide and its fast volatile speed. Also, the security of hydrogen peroxide is much higher compared with bleach. The robot can help to save the use of disinfectants after the auto- calculation of disinfectants. It ensures 360° disinfection as the disinfectants penetrate in the small gaps that are difficult to reach during normal cleaning work.

Prof. Xu QingSong shared that the price of artificial intelligence robot today is still expensive until today. In order to offer a cost effective robot, the research team will try to reduce the cost of disinfecting intelligent robot as much as possible so that it could be widely adapted at high-risk areas such as hospital, schools and university. During this difficult time, the research and analysis of intelligent robots have rapidly developed, the application of intelligent robots has also increased, such as medicine delivery, food and water delivery, remote consultation and temperature screening inspection. Professor Xu expected that the research results can provide core technology support for the design, development and application of intelligent robots in the future.

Successfully achieved the Macau Science and Technology Development Fund (FDCT)

This project has successfully achieved the fund from Macau Science and Technology Development (FDCT). Only 26 projects were approved out of 74 applications. The funding period ranges from 6 to 12 months. Thanks to the support of the central and Macao SAR governments, the disinfecting intelligent robot project was made possible. Professor Xu said that the University of Macau provides superior equipment and the best talents, it is perfect for the development of smart robots in the future. He wished to gather local scientific power and resources to help to recover the society from the epidemic, contribute more to Macao, serve more for the society and build a better future.

作為粵港澳大灣區西岸擁有最多國家級科研單位的公立大學,澳門大學科研技術再有新突破。科技學院為了響應澳門特區政府對新型冠狀病毒肺炎的防控工作,首次進行了醫護抗疫智能機器人的研發,期望能夠為疫情提供有力的科技支撐,以創新的科研建立更美好的未來。

居危思變 — 探索智能機器人未來發展之路

面對新型冠狀病毒肺炎肆虐,消毒技術成為抑制病毒關鍵技術之一。但目前大多數地區仍然依賴人手作業消毒,導致前線醫護工作量大增且面臨具大的感染風險,雖然目前有少數消毒機器人供應,但價格偏高,難以大規模普及應用。是次研究項目是由科技學院教授徐青松帶領團隊進行研發,針對新型冠狀病毒肺炎疫情危機,研製一種人工智能機器人用於自動化消毒滅菌,可以代替目前人手消毒,實現室內室外自動消毒工作。由於可以用手機應用程式遠程控制機器人,投入使用後將可大幅降低醫護人員感染風險,避免交叉感染。設計採用雷射雷達、超聲波感測器以及攝像鏡頭等進行即時環境測距及傳感,具有自主導航以及避障等功能,用戶可以利用攝像鏡頭實況觀察消毒情況。此外,機器人可以自行規劃路線,自行分析空間大小,自行調節及噴灑精準劑量的消毒劑。設計更採用先進的乾霧過氧化氫(雙氧水) 消毒,雙氧水殺菌力高,揮發速度快,與漂白水等比較,雙氧水安全度更高。精準計算後噴出的霧氣除了可以節省消毒劑量之外,更可深入平常難以接觸的細微縫隙,真正地實現360°無死角自動消毒。

徐青松教授表示鑑於目前市面的消毒機器人價格較高,在不影響效果的前提下,他和研究團隊會盡量降低機器人的成本,以增加普及率,期望未來可以在醫院﹅學校等人多高風險地區投入使用。疫症下,除了更快地推動智慧機器人的研發外,也大大增加了智慧機器人的應用,如藥品配送、食物運送、遠程問診及體溫篩查巡檢等等。徐教授期望本次研究成果可為未來智慧機器人的設計、開發和應用普及提供核心技術支撐。

成功爭取澳門科學技術發展基金資助 (FDCT)為科研貢獻

此研究項目更成功爭取到澳門科學技術發展基金資助,74個申請中僅批出26個項目。資助期由6個月到12個月不等。是次智能消毒機器人研究得以成功啟動,有賴國家和澳門特區政府的支持。徐教授認為澳門大學提供優越的設備,優秀的人才,未來將會有更多的空間發展智慧機器人,期望能集合本地科研力量及資源協助疫症後社會復甦,以貢獻澳門、服務社會、構建美好未來。

Prof. Xu QingSong shared the research about disinfecting intelligent robot
徐青松教授分享消毒智能機器人研究

Prof. Xu QingSong and his research team
徐青松教授和他的研究團隊

Go to Top