Nowadays, portrait drawing has gained significance in cultivating painting skills and human sentiments. In practice, novices often struggle with this art form without proper guidance from professionals, since they lack understanding of the proportions and structures of facial features. To solve this limitation, we have developed a Portrait Drawing Learning Assistant System (PDLAS) to assist novices in learning portrait drawing. The PDLAS provides auxiliary lines as references for facial features that are extracted by applying OpenPose and OpenCV libraries to a face photo image of the target. A learner can draw a portrait on an iPad using drawing software where the auxiliary lines appear on a different layer to the portrait. However, in the current implementation, the PDLAS does not offer a function to assess the exactness of the drawing result for feedback to the learner. In this paper, we present a drawing exactness assessment method using a Localized Normalized Cross-Correlation (NCC) algorithm in the PDLAS. NCC gives a similarity score between the original face photo and drawing result images by calculating the correlation of the brightness distributions. For precise feedback, the method calculates the NCC for each face component by extracting the bounding box. In addition, in this paper, we improve the auxiliary lines for the nose. For evaluations, we asked students at Okayama University, Japan, to draw portraits using the PDLAS, and applied the proposed method to their drawing results, where the application results validated the effectiveness by suggesting improvements in drawing components. The system usability was also confirmed through a questionnaire with a SUS score. The main finding of this research is that the implementation of the NCC algorithm within the PDLAS significantly enhances the accuracy of novice portrait drawings by providing detailed feedback on specific facial features, proving the system’s efficacy in art education and training.
Nowadays, portrait drawing has become increasingly popular as a means of developing artistic skills and nurturing emotional expression. However, it is challenging for novices to start learning it, as they usually lack a solid grasp of proportions and structural foundations of the five senses. To address this problem, we have studied Portrait Drawing Learning Assistant System (PDLAS) for guiding novices by providing auxiliary lines of facial features, generated by utilizing OpenPose and OpenCV libraries. For PDLAS, we have also presented the exactness assessment method to evaluate drawing accuracy using the Normalized Cross-Correlation (NCC) algorithm. It calculates the similarity score between the drawing result and the initial portrait photo. Unfortunately, the current method does not assess the hair drawing, although it occupies a large part of a portrait and often determines its quality. In this paper, we present a hair drawing evaluation algorithm for the exactness assessment method to offer comprehensive feedback to users in PDLAS. To emphasize hair lines, this algorithm extracts the texture of the hair region by computing the eigenvalues and eigenvectors of the hair image. For evaluations, we applied the proposal to drawing results by seven students from Okayama University, Japan and confirmed the validity. In addition, we observed the NCC score improvement in PDLAS by modifying the face parts with low similarity scores from the exactness assessment method.
Nowadays, Python is very popular as the first programming language for novices, including high school students, to learn due to its short code features with rich libraries. Thus, it is important to provide a learning environment supporting studies starting from the fundamentals, since students have no knowledge on how a program runs on a computer. Previously, we have developed a web-based programming learning assistant system (PLAS) to allow the self-study of major programming languages, including Python, by university students. It offers several types of exercise problems that have different learning goals and levels for step-by-step study. Any student answer is automatically marked at the answer interface for quick feedback. However, PLAS has not implemented functions to assist the learning needs of high school-level students. In this paper, we propose a novice-friendly answer interface for a Python programming learning assistant system (PyPLAS) that introduces a code behavior visualization and an AI assistant with learning logs. The visualization allows learners to observe the changes in variable states and the control flow. The assistant provides multi-level hints during learning and reflective feedback after it by analyzing the logs based on engagement, reasoning strategies, learning pace, and tool usage. For evaluation, we implemented the proposed interface using Python Flask for the web platform and Ollama as a locally deployed AI model. A pilot application was conducted with high school students solving introductory Python exercises in PyPLAS. The results showed high task completion, positive questionnaire responses toward embedded visualization and interface usability, and teacher-observed usefulness of the four-dimensional learning analytics for interpreting learner behaviors. These findings provide preliminary evidence for the feasibility and practical value of the proposed interface, while larger controlled studies are required to validate its instructional effectiveness.
Portrait drawing is effective in cultivating artistic skills and visual understanding for a lot of people. Since drawing facial features with proper proportions, structures, and spatial relationships is hard for novices with no professional guidance, we developed the Portrait-Drawing Learning Assistance System, which offers auxiliary lines to assist in the drawing of portraits by acting as references; these auxiliary lines are extracted by applying OpenPose and OpenCV to a facial image. The drawing exactness assessment method using the Localized Normalized Cross-Correlation algorithm is also implemented to evaluate drawing accuracy. Unfortunately, previous experiments involving the use of the Portrait-Drawing Learning Assistance System by novices found that Localized Normalized Cross-Correlation scores for eyes are relatively low compared with others because of two drawbacks: (1) eye boundaries are often blurred by eyelids and eyelashes, which can make eyes bigger, and (2) the iris and pupil are not considered in auxiliary lines. In this paper, we propose an improved eye auxiliary line for the Portrait-Drawing Learning Assistance System to address these concerns. For the first drawback, we shift the lines for eye boundaries outside and add hatching (a series of short line segments) to them. For the second one, we expand region of interest of an eye and apply the Canny edge detector to capture its iris and pupil. In a preliminary within-subject evaluation, eight graduate students at Okayama University used the previous and proposed eye auxiliary lines in Procreate on an iPad. The average localized NCC scores increased for both eye regions under the tested conditions. These results suggest that the proposed auxiliary line may improve immediate eye-region reproduction accuracy; however, they do not constitute definitive validation of drawing-skill learning.