Haoyue Jiao

Ms. Haoyue Jiao

orcid

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 July 2025 in International Journal of Applied Earth Observation and Geoinformation
Verified
Journal Article
Open access
JLJianyuan Liang
Jianyuan Liang
SHShuyang Hou
Shuyang Hou
Haoyue JiaoHaoyue Jiao
Haoyue Jiao
YQYaxian Qing
Yaxian Qing
AZAnqi Zhao
Anqi Zhao
Huayi WuHuayi Wu
Huayi Wu

1 August 2025 in Geo-spatial Information Science
Verified
Journal Article
Open access
SHShuyang Hou
Shuyang Hou
ZSZhangxiao Shen
Zhangxiao Shen
JLJianyuan Liang
Jianyuan Liang
Haoyue JiaoHaoyue Jiao
Haoyue Jiao
AZAnqi Zhao
Anqi Zhao
Huayi WuHuayi Wu
Huayi Wu

Verified
Journal Article
Open access
PDF file
Huayi WuHuayi Wu
Huayi Wu
ZSZhangxiao Shen
Zhangxiao Shen
SHShuyang Hou
Shuyang Hou
JLJianyuan Liang
Jianyuan Liang
Haoyue JiaoHaoyue Jiao
Haoyue Jiao
LXLonggang Xiang
Longgang Xiang
Geospatial code generation is emerging as a key direction in the integration of artificial intelligence and geoscientific analysis. However, there remains a lack of standardized tools for automatic evaluation in this domain. To address this gap, we propose AutoGEEval, the first multimodal, unit-level automated evaluation framework for geospatial code generation tasks on the Google Earth Engine (GEE) platform powered by large language models (LLMs). Built upon the GEE Python API, AutoGEEval establishes a benchmark suite (AutoGEEval-Bench) comprising 1325 test cases that span 26 GEE data types. The framework integrates both question generation and answer verification components to enable an end-to-end automated evaluation pipeline—from function invocation to execution validation. AutoGEEval supports multidimensional quantitative analysis of model outputs in terms of accuracy, resource consumption, execution efficiency, and error types. We evaluate 18 state-of-the-art LLMs—including general-purpose, reasoning-augmented, code-centric, and geoscience-specialized models—revealing their performance characteristics and potential optimization pathways in GEE code generation. This work provides a unified protocol and foundational resource for the development and assessment of geospatial code generation models, advancing the frontier of automated natural language to domain-specific code translation.

22 August 2025 in International Journal of Geographical Information Science
Verified
Journal Article
Closed access
SHShuyang Hou
Shuyang Hou
Haoyue JiaoHaoyue Jiao
Haoyue Jiao
JLJianyuan Liang
Jianyuan Liang
ZSZhangxiao Shen
Zhangxiao Shen
AZAnqi Zhao
Anqi Zhao
Huayi WuHuayi Wu
Huayi Wu

Verified
Journal Article
Open access
PDF file
GCGuanyu Chen
Guanyu Chen
Haoyue JiaoHaoyue Jiao
Haoyue Jiao
SHShuyang Hou
Shuyang Hou
ZLZiqi Liu
Ziqi Liu
LXLutong Xie
Lutong Xie
Zhipeng GuiZhipeng Gui
Zhipeng Gui
With the widespread adoption of large language models (LLMs) in code generation tasks, geospatial code generation has emerged as a critical frontier in the integration of artificial intelligence and geoscientific analysis. This growing trend underscores the urgent need for systematic evaluation methodologies to assess the generation capabilities of LLMs in geospatial contexts. In particular, geospatial computation and visualization tasks in the JavaScript environment rely heavily on the orchestration of diverse frontend libraries and ecosystems, posing elevated demands on a model’s semantic comprehension and code synthesis capabilities. To address this challenge, we propose GeoJSEval—the first multimodal, function-level automatic evaluation framework for LLMs in JavaScript-based geospatial code generation tasks. The framework comprises three core components: a standardized test suite (GeoJSEval-Bench), a code submission engine, and an evaluation module. It includes 432 function-level tasks and 2071 structured test cases, spanning five widely used JavaScript geospatial libraries that support spatial analysis and visualization functions, as well as 25 mainstream geospatial data types. GeoJSEval enables multidimensional quantitative evaluation across metrics such as accuracy, output stability, resource consumption, execution efficiency, and error type distribution. Moreover, it integrates boundary testing mechanisms to enhance robustness and evaluation coverage. We conduct a comprehensive assessment of 20 state-of-the-art LLMs using GeoJSEval, uncovering significant performance disparities and bottlenecks in spatial semantic understanding, code reliability, and function invocation accuracy. GeoJSEval offers a foundational methodology, evaluation resource, and practical toolkit for the standardized assessment and optimization of geospatial code generation models, with strong extensibility and promising applicability in real-world scenarios. This manuscript represents the peer-reviewed version of our earlier preprint previously made available on arXiv.

27 March 2026 in Expert Systems with Applications
Verified
Journal Article
Closed access
SHShuyang Hou
Shuyang Hou
Haoyue JiaoHaoyue Jiao
Haoyue Jiao
ZLZiqi Liu
Ziqi Liu
LXLutong Xie
Lutong Xie
GCGuanyu Chen
Guanyu Chen
HWHuayi Wu
Huayi Wu