Large language models (LLMs) have recently soared in popularity due to their ease of access and the unprecedented ability to synthesize text responses to diverse user questions. However, LLMs like ChatGPT present significant limitations in supporting complex information tasks due to the insufficient affordances of the text-based medium and linear conversational structure. Through a formative study with ten participants, we found that LLM interfaces often present long-winded responses, making it difficult for people to quickly comprehend and interact flexibly with various pieces of information, particularly during more complex tasks. We present Graphologue, an interactive system that converts text-based responses from LLMs into graphical diagrams to facilitate information-seeking and question-answering tasks. Graphologue employs novel prompting strategies and interface designs to extract entities and relationships from LLM responses and constructs node-link diagrams in real-time. Further, users can interact with the diagrams to flexibly adjust the graphical presentation and to submit context-specific prompts to obtain more information. Utilizing diagrams, Graphologue enables graphical, non-linear dialogues between humans and LLMs, facilitating information exploration, organization, and comprehension.
Logging is a widely used technique for inspecting and understanding programs. However, the presentation of logs still often takes its ancient form of a linear stream of text that resides in a terminal, console, or log file. Despite its simplicity, interpreting log output is often challenging due to the large number of textual logs that lack structure and context. We conducted content analysis and expert interviews to understand the practices and challenges inherent in logging. These activities demonstrated that the current representation of logs does not provide the rich structures programmers need to interpret them or the program’s behavior. We present Log-it, a logging interface that enables programmers to interactively structure and visualize logs in situ. A user study with novices and experts showed that Log-it’s syntax and interface have a minimal learning curve, and the interactive representations and organizations of logs help programmers easily locate, synthesize, and understand logs.
Self-reflection during maker activities is known to enhance conceptual comprehension and lead to better skill learning. While educational makerspaces commonly leverage reflective exercises guided by instructors, this practice often goes amiss in scenarios when makers interested in self-directed learning use online tutorials like Instructables. In this short paper, we explore the approach of using Large Language Models (LLMs), specifically OpenAI's GPT-4 for generating reflection prompts with the existing Instructable tutorials and aligning them with a list of learning goals adapted from prior work on maker skills learning. We built a system to generate Reflectables: Instructables designed for self-reflection while making. To exemplify the approach, we generated 9 Reflectables consisting of 128 prompts and evaluated them on seven attributes: goal-oriented, timely, contextual, sequential, multilevel, clear, and personalized. Our analysis highlights the benefits and limitations of this approach and points to further research directions for designing AI-based systems for reflection-focused self-directed learning in makerspaces.