Prompt2Color: A prompt-based framework for image-derived color generation and visualization optimization

Color is powerful in communicating information in visualizations. However, crafting palettes that improve readability and capture readers’ attention often demands substantial effort, even for seasoned designers. Existing text-based palette generation results in limited and predictable combinations, and finding suitable reference images to extract colors without a clear idea is both tedious and frustrating. In this work, we present Prompt2Color, a novel framework for generating color palettes using prompts. To simplify the process of finding relevant images, we first adopt a concretization approach to visualize the prompts. Furthermore, we introduce an attention-based method for color extraction, which allows for the mining of the visual representations of the prompts. Finally, we utilize a knowledge base to refine the palette and generate the background color to meet aesthetic and design requirements. Evaluations, including quantitative metrics and user experiments, demonstrate the effectiveness of our method.