Yueguang Ge

Yueguang Ge

Auto-generated profile, based on publicly available information

Yueguang Ge

State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 November 2021 in International Journal of Automation and Computing
Verified
Journal Article
Closed access
PDF file
SZShao-Lin Zhang
Shao-Lin Zhang
YGYue-Guang Ge
Yue-Guang Ge
HWHai-Tao Wang
Hai-Tao Wang
SWShuo Wang
Shuo Wang

21 April 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
HWHaitao Wang
Haitao Wang
SZShaolin Zhang
Shaolin Zhang
SWShuo Wang
Shuo Wang
TJTianyu Jiang
Tianyu Jiang
YGYueguang Ge
Yueguang Ge
Large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, in real-world robotic tasks, LLMs face grounding issues and lack precise feedback, resulting in the generated solutions deviating from the actual situation. In this paper, we propose Double-Feedback, a method that enhances LLMs reasoning by Knowledge graphs (KGs). The KGs play three key roles in Double-Feedback: prompting the LLMs to generate solutions, representing the task scenes, and verifying the solutions to provide feedback. We design structured knowledge prompts that convey the task knowledge background, example solutions, revision principles, and robotic tasks to the LLMs. We also introduce the distributed representation to quantify the task scene with interpretability. Based on the structured knowledge prompts and the distributed representation, we employ the KGs to evaluate the feasibility of each step before execution and verify the effects of the solutions after completing the tasks. The LLMs can adjust and replan the solutions based on the feedback from the KGs. Extensive experiments demonstrate that Double-Feedback outperforms prior works in the ALFRED benchmark. In addition, ablation studies show that Double-Feedback guides LLMs in generating solutions aligned with robotic tasks in the real world.

13 August 2024 in IEEE Transactions on Cognitive and Developmental Systems
Verified
Journal Article
Closed access
YGYueguang Ge
Yueguang Ge
YCYinghao Cai
Yinghao Cai
SWShuo Wang
Shuo Wang
SZShaolin Zhang
Shaolin Zhang
TLTao Lu
Tao Lu
JWJunhang Wei
Junhang Wei
The location reasoning of target objects in robotoperated environment is a challenging task. Objects that robots need to interact with are often located at a distance or are contained within containers, making them inaccessible for direct observation by the robot. The uncertainty of the storage location of the target objects and the lacking of the reasoning ability present considerable challenges. In this paper, we propose a method for semantic localization of robot-operated objects based on human common sense and robot experiences. Instead of reasoning the object storage locations solely based on the category of the target object, a probabilistic ontology model is introduced to represent uncertain knowledge in the task of object localization, which combines the expressive power of classical first-order logic and the inference capability of Bayesian inference. The target location is then estimated using the probabilistic ontologies with dynamic integration of human common sense and robot experiences. Experimental results in both simulation and real-world environments demonstrate the effectiveness of the proposed integration of human common sense and robot experiences in the task of semantic localization of robot-operated objects.

16 February 2022 in Cobot
Verified
Journal Article
Open access
YGYueguang Ge
Yueguang Ge
SZShaolin Zhang
Shaolin Zhang
YCYinghao Cai
Yinghao Cai
TLTao Lu
Tao Lu
DWDayong Wen
Dayong Wen
SWShuo Wang
Shuo Wang
Background: A robot needs to acquire the location of objects when performing daily tasks. Compared to industrial robots, a service robot faces a more complex and unstructured working environment where the location of the target object is usually uncertain. For example, due to diversity in personal habits and seasons, apples may be located in refrigerators, tables, or other places in the living environment. Methods: We propose a novel method for semantic localization of the robot-operated object based on probabilistic ontologies (PR-OWL) and multi-entity Bayesian networks (MEBN). The probabilistic web ontology language is used to describe and model the highly uncertain knowledge about the storage location of objects in the human household environment. Furthermore, the target location is inferred based on the multi-entity Bayesian network. Results: The proposed method is capable to adapting to environmental changes and achieves reliable probability estimation of object location. Experiments on simulated robotic tasks verify the effectiveness of the method. Conclusions: We show that applying PR-OWL combined with MEBN to locate the target object for the robot is feasible, which can improve the cognitive and self-adaptive ability of the robot.

29 September 2023 in Cobot
Verified
Journal Article
Open access
SZShaolin Zhang
Shaolin Zhang
YGYueguang Ge
Yueguang Ge
WCWenkai Chang
Wenkai Chang
HWHaitao Wang
Haitao Wang
SWShuo Wang
Shuo Wang
The grasping operation task in service scenes faces several problems including too many kinds of objects and a large amount of training data. This paper focuses on the grasping strategy and pose detection in desktop object grasping tasks. A grasping strategy is given based on the combination of desktop normal vector detection, object category detection, and grasping pose detection. The grasping pose is calculated by ellipse fitting on the depth map. An optimal function is designed to evaluate the possibility of the object sliding along the ellipse axis and the stability of the grasping height. The most reliable grasping pose is selected. Finally, experiments were carried out with a six-degree-of-freedom manipulator, and the proposed grasping method achieved effective grasping of desktop objects without prior knowledge of the object.

20 May 2022 in Cobot
Verified
Journal Article
Open access
SZShaolin Zhang
Shaolin Zhang
YGYueguang Ge
Yueguang Ge
WCWenkai Chang
Wenkai Chang
HWHaitao Wang
Haitao Wang
SWShuo Wang
Shuo Wang
The grasping operation task in service scenes faces several problems including too many kinds of objects and a large amount of training data. This paper focuses on the grasping strategy and pose detection in desktop object grasping tasks. A grasping strategy is given based on the combination of desktop normal vector detection, object category detection, and grasping pose detection. The grasping pose is calculated by ellipse fitting on the depth map. An optimal function is designed to evaluate the possibility of the object sliding along the ellipse axis and the stability of the grasping height. The most reliable grasping pose is selected. Finally, experiments were carried out with a six-degree-of-freedom manipulator, and the proposed grasping method achieved effective grasping of desktop objects without prior knowledge of the object.