Conceptual design is a pivotal phase of product design and development, encompassing user requirement exploration and informed solution generation. Recent generative models with their powerful content generation capabilities have been applied to conceptual design to support designers’ ideation. However, the lack of transparency in their generation process and the shallow nature of their generated solutions constrain their performance in complex conceptual design tasks. In this study, we first introduce a conceptual design generation approach that combines generative models with classic design theory. This approach decomposes the conceptual design task based on design process and design attributes, and uses the who, what, where, when, why, how (5W1H) method, function-behavior-structure model, and Kansei Engineering to guide generative models to generate conceptual design solutions through multi-step reasoning. Then we present an interactive system using a mind-map layout to visualize multi-step reasoning, called DesignFusion. This empowers designers to track the generation process and control inputs/outputs at each reasoning step. Two user studies show that our approach significantly enhances the quality of generated design solutions and enriches designer experience in human–artificial intelligence co-creation.
Rapid creation of novel product appearance designs that align with consumer emotional requirements poses a significant challenge. Text-to-image models, with their excellent image generation capabilities, have demonstrated potential in providing inspiration to designers. However, designers still encounter issues including aligning emotional needs, expressing design intentions, and comprehending generated outcomes in practical applications. To address these challenges, we introduce AutoSpark, an interactive system that integrates Kansei Engineering and generative AI to provide creativity support for designers in creating automobile appearance designs that meet emotional needs. AutoSpark employs a Kansei Engineering engine powered by generative AI and a semantic network to assist designers in emotional need alignment, design intention expression, and prompt crafting. It also facilitates designers’ understanding and iteration of generated results through fine-grained image-image similarity comparisons and text-image relevance assessments. The design-thinking map within its interface aids in managing the design process. Our user study indicates that AutoSpark effectively aids designers in producing designs that are more aligned with emotional needs and of higher quality compared to a baseline system, while also enhancing the designers’ experience in the human-AI co-creation process.
Data-driven design is a process to reuse data sources and provide valuable information to provoke creative ideas in the stages of design. However, existing semantic networks for design creativity are built on data sources restricted to technological and scientific information. Existing studies build the edges of a semantic network on statistical or semantic relationships, which are less likely to make full use of the benefits from both types of relationships and discover implicit knowledge for design creativity. Therefore, to overcome the gaps, we constructed WikiLink, a semantic network based on Wikipedia, which is an integrated source of general knowledge and specific knowledge, with broad coverage of disciplines. The weight in WikiLink fuses both the statistic and semantic weights between concepts instead of simply one type of weight, and four algorithms are developed for inspiring new ideas. Evaluation experiments are undertaken, and the results show that the network is characterised by high coverage of terms, relationships and disciplines, which demonstrates and supports the network’s effectiveness and usefulness. A demonstration and case study results indicate that WikiLink can serve as an idea generation tool for creativity in conceptual design. The source code of WikiLink and the backend data are provided open-source for more users to explore and develop.
Layout is essential for the product listing pages (PLPs) in mobile shopping applications. To clearly convey the information that consumers require and to achieve specific functions, PLPs layouts often have many variations driven by scenarios. In this work, we study the PLPs layout design for different scenarios and propose a design space to guide the large-scale creation of PLPs. We propose LayoutVQ-VAE, a novel model specialized in generating layouts with internal and external constraints. LayoutVQ-VAE differs from previous methods as it learns a discrete latent representation of layout and can model the relationship between layout representation and scenarios without applying heuristics. Experiments on publicly available benchmarks for different layout types validate that our method performs comparably or favorably against the state-of-the-art methods. Case studies show that the proposed approach including the design space and model is effective in producing large-scale high-quality PLPs layouts for mobile shopping platforms.
In graphic design, layout is a result of the interaction between the design elements in the foreground and background images. However, prevalent research f