Eric Kildebeck

Eric Kildebeck

Auto-generated profile, based on publicly available information

Eric Kildebeck

Center for Engineering Innovation, University of Texas at Dallas, Richardson, USA

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 June 2024 in Nature Machine Intelligence
Verified
Journal Article
Closed access
PDF file
Mayank KejriwalMayank Kejriwal
Mayank Kejriwal
EKEric Kildebeck
Eric Kildebeck
RSRobert Steininger
Robert Steininger
ASAbhinav Shrivastava
Abhinav Shrivastava

1 January 2017 in Journal of the Neurological Sciences
Verified
Journal Article
Closed access
SBShin C. Beh
Shin C. Beh
EKEric Kildebeck
Eric Kildebeck
RNRam Narayan
Ram Narayan
ADAllen Desena
Allen Desena
DSDoug Schell
Doug Schell
EFElliot M. Frohman
Elliot M. Frohman

26 April 2019 in Nature Communications
Verified
Journal Article
Open access
PDF file
MPMara Pavel-Dinu
Mara Pavel-Dinu
VWVolker Wiebking
Volker Wiebking
BDBeruh T. Dejene
Beruh T. Dejene
WSWaracharee Srifa
Waracharee Srifa
SMSruthi Mantri
Sruthi Mantri
MPMatthew H. Porteus
Matthew H. Porteus
The original version of this Article omitted the following from the Acknowledgements: “G.B. acknowledges the support from the Cancer Prevention and Research Institute of Texas (RR140081 and RR170721).”This has now been corrected in both the PDF and HTML versions of the Article.

21 December 2023 in arXiv
Verified
Preprint
Open access
PDF file
KDKatarina Doctor
Katarina Doctor
Mayank KejriwalMayank Kejriwal
Mayank Kejriwal
Lawrence HolderLawrence Holder
Lawrence Holder
EKEric Kildebeck
Eric Kildebeck
EREmma Resmini
Emma Resmini
DODaniel V. Olivença
Daniel V. Olivença
Artificial Intelligence (AI) systems, trained in controlled environments, often struggle in real-world complexities. We propose a general framework for estimating domain complexity across diverse environments, like open-world learning and real-world applications. This framework distinguishes between intrinsic complexity (inherent to the domain) and extrinsic complexity (dependent on the AI agent). By analyzing dimensionality, sparsity, and diversity within these categories, we offer a comprehensive view of domain challenges. This approach enables quantitative predictions of AI difficulty during environment transitions, avoids bias in novel situations, and helps navigate the vast search spaces of open-world domains.

27 January 2023 in arXiv
Verified
Preprint
Open access
PDF file
SGStephen A. Goss
Stephen A. Goss
RSRobert J. Steininger
Robert J. Steininger
DNDhruv Narayanan
Dhruv Narayanan
DODaniel V. Olivença
Daniel V. Olivença
YSYutong Sun
Yutong Sun
EKEric J. Kildebeck
Eric J. Kildebeck
As artificial intelligence research advances, the platforms used to evaluate AI agents need to adapt and grow to continue to challenge them. We present the Polycraft World AI Lab (PAL), a task simulator with an API based on the Minecraft mod Polycraft World. Our platform is built to allow AI agents with different architectures to easily interact with the Minecraft world, train and be evaluated in multiple tasks. PAL enables the creation of tasks in a flexible manner as well as having the capability to manipulate any aspect of the task during an evaluation. All actions taken by AI agents and external actors (non-player-characters, NPCs) in the open-world environment are logged to streamline evaluation. Here we present two custom tasks on the PAL platform, one focused on multi-step planning and one focused on navigation, and evaluations of agents solving them. In summary, we report a versatile and extensible AI evaluation platform with a low barrier to entry for AI researchers to utilize.

7 March 2023 in arXiv
Verified
Preprint
Open access
PDF file
KDKatarina Doctor
Katarina Doctor
CTChristine Task
Christine Task
EKEric Kildebeck
Eric Kildebeck
Mayank KejriwalMayank Kejriwal
Mayank Kejriwal
Lawrence HolderLawrence Holder
Lawrence Holder
RLRussell Leong
Russell Leong
Artificial Intelligence (AI) systems planned for deployment in real-world applications frequently are researched and developed in closed simulation environments where all variables are controlled and known to the simulator or labeled benchmark datasets are used. Transition from these simulators, testbeds, and benchmark datasets to more open-world domains poses significant challenges to AI systems, including significant increases in the complexity of the domain and the inclusion of real-world novelties; the open-world environment contains numerous out-of-distribution elements that are not part in the AI systems' training set. Here, we propose a path to a general, domain-independent measure of domain complexity level. We distinguish two aspects of domain complexity: intrinsic and extrinsic. The intrinsic domain complexity is the complexity that exists by itself without any action or interaction from an AI agent performing a task on that domain. This is an agent-independent aspect of the domain complexity. The extrinsic domain complexity is agent- and task-dependent. Intrinsic and extrinsic elements combined capture the overall complexity of the domain. We frame the components that define and impact domain complexity levels in a domain-independent light. Domain-independent measures of complexity could enable quantitative predictions of the difficulty posed to AI systems when transitioning from one testbed or environment to another, when facing out-of-distribution data in open-world tasks, and when navigating the rapidly expanding solution and search spaces encountered in open-world domains.