BannerRequest400 is the first multimodal benchmark specifically designed to evaluate advertising banner generation systems. It addresses gaps in existing design datasets by providing both visual and textual inputs.
The dataset pairs 100 unique brand logos (provided in both PNG and SVG formats) with 400 diverse banner design requests (textual modality). The logos were synthetically generated using Claude 3.5 Sonnet, then refined by experts to ensure authentic aesthetics and avoid bias.
Researchers leveraged GPT-4o to expand each design intention into four distinct banner requests targeting different audience-purpose combinations. This systematic expansion yielded 400 diverse specifications, further extended across 13 standard banner dimensions for a comprehensive evaluation set of 5,200 multimodal banner specifications.
The benchmark enables the first rigorous evaluation of banner generation approaches across diverse design requests, multiple contexts (different audience segments and campaign purposes), and industry-standard display sizes.
This dataset can be used for:
The dataset is in English (en). All banner requests, target audience descriptions, and design specifications are written in English.
The dataset provides two configurations:
Abstract Configuration (400 examples):
{
"id": 1,
"banner_request": "Design a banner ad image of size 300x250 for a discussion on the ethical issues surrounding artificial intelligence...",
"logo_png": <PIL.Image>,
"logo_svg": "<svg>...</svg>"
}
Concrete Configuration (100 examples):
{
"id": 1,
"banner_request": "Design a banner ad image for a discussion on the ethical issues surrounding artificial intelligence",
"advertiser": "ETHIC AI",
"logo_name": "001_ethicai.png",
"logo_description": "A shield-shaped logo with geometric diamond pattern...",
"logo_png": <PIL.Image>,
"logo_svg": "<svg>...</svg>",
"advertising_variations": {
"pair_1": {
"target_audience": "Tech enthusiasts and AI developers",
"primary_purpose": "Event registration and networking",
"concrete_request_300x250": "Design a banner ad image...",
"concrete_request_728x90": "Design a banner ad image...",
...
},
"pair_2": {...},
"pair_3": {...},
"pair_4": {...}
}
}
Abstract Configuration:
id (int32): Unique identifier (1-400)banner_request (string): Text description of the banner design requestlogo_png (Image): Brand logo in PNG format (PIL Image object)logo_svg (string): Brand logo in SVG format (XML string)Concrete Configuration:
id (int32): Unique campaign identifier (1-100)banner_request (string): Base banner design requestadvertiser (string): Brand/advertiser namelogo_name (string): Logo filenamelogo_description (string): Detailed visual description of the logologo_png (Image): Brand logo in PNG formatlogo_svg (string): Brand logo in SVG formatadvertising_variations (nested structure):
pair_1 through pair_4: Each contains:
target_audience (string): Description of target demographicprimary_purpose (string): Marketing goal/call-to-actionconcrete_request_<dimension> (string): Design request for specific banner size
The dataset contains only a training split:
| Configuration | Train |
|---|---|
| abstract | 400 |
| concrete | 100 |
The abstract configuration provides 400 individual banner requests with logos (cycling through 100 logos 4 times). The concrete configuration provides 100 campaigns, each with 4 audience variations Γ 13 banner dimensions = 5,200 total specifications.
BannerRequest400 was created to fill a critical gap in banner generation evaluation. Existing datasets for graphic design focus primarily on single-image generation without considering the multimodal nature of advertising design, which requires integrating brand logos with textual specifications.
The dataset enables:
The dataset origins trace to 100 design intentions from the DESIGNERINTENTION dataset. These were:
Created by researchers at Sony as part of the BannerAgency project. The dataset was curated through a combination of AI-generated content (logos via Claude 3.5 Sonnet, requests via GPT-4o) and expert refinement.
This dataset is released under the MIT License. See the original repository for full license details.
@inproceedings{wang-etal-2025-banneragency,
title = {{B}anner{A}gency: Advertising Banner Design with Multimodal {LLM} Agents},
author = {Wang, Heng and Shimose, Yotaro and Takamatsu, Shingo},
booktitle = {Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing},
month = {November},
year = {2025},
address = {Suzhou, China},
publisher = {Association for Computational Linguistics},
pages = {4304--4329},
doi = {10.18653/v1/2025.emnlp-main.214},
url = {https://aclanthology.org/2025.emnlp-main.214/}
}
This Hugging Face dataset implementation was created by the creative-graphic-design organization to make BannerRequest400 more accessible to the research community.
8 commits
BannerRequest400 is the first multimodal benchmark specifically designed to evaluate advertising banner generation systems. It addresses gaps in existing design datasets by providing both visual and textual inputs.
The dataset pairs 100 unique brand logos (provided in both PNG and SVG formats) with 400 diverse banner design requests (textual modality). The logos were synthetically generated using Claude 3.5 Sonnet, then refined by experts to ensure authentic aesthetics and avoid bias.
Researchers leveraged GPT-4o to expand each design intention into four distinct banner requests targeting different audience-purpose combinations. This systematic expansion yielded 400 diverse specifications, further extended across 13 standard banner dimensions for a comprehensive evaluation set of 5,200 multimodal banner specifications.
The benchmark enables the first rigorous evaluation of banner generation approaches across diverse design requests, multiple contexts (different audience segments and campaign purposes), and industry-standard display sizes.
This dataset can be used for:
The dataset is in English (en). All banner requests, target audience descriptions, and design specifications are written in English.
The dataset provides two configurations:
Abstract Configuration (400 examples):
{
"id": 1,
"banner_request": "Design a banner ad image of size 300x250 for a discussion on the ethical issues surrounding artificial intelligence...",
"logo_png": <PIL.Image>,
"logo_svg": "<svg>...</svg>"
}
Concrete Configuration (100 examples):
{
"id": 1,
"banner_request": "Design a banner ad image for a discussion on the ethical issues surrounding artificial intelligence",
"advertiser": "ETHIC AI",
"logo_name": "001_ethicai.png",
"logo_description": "A shield-shaped logo with geometric diamond pattern...",
"logo_png": <PIL.Image>,
"logo_svg": "<svg>...</svg>",
"advertising_variations": {
"pair_1": {
"target_audience": "Tech enthusiasts and AI developers",
"primary_purpose": "Event registration and networking",
"concrete_request_300x250": "Design a banner ad image...",
"concrete_request_728x90": "Design a banner ad image...",
...
},
"pair_2": {...},
"pair_3": {...},
"pair_4": {...}
}
}
Abstract Configuration:
id (int32): Unique identifier (1-400)banner_request (string): Text description of the banner design requestlogo_png (Image): Brand logo in PNG format (PIL Image object)logo_svg (string): Brand logo in SVG format (XML string)Concrete Configuration:
id (int32): Unique campaign identifier (1-100)banner_request (string): Base banner design requestadvertiser (string): Brand/advertiser namelogo_name (string): Logo filenamelogo_description (string): Detailed visual description of the logologo_png (Image): Brand logo in PNG formatlogo_svg (string): Brand logo in SVG formatadvertising_variations (nested structure):
pair_1 through pair_4: Each contains:
target_audience (string): Description of target demographicprimary_purpose (string): Marketing goal/call-to-actionconcrete_request_<dimension> (string): Design request for specific banner size
The dataset contains only a training split:
| Configuration | Train |
|---|---|
| abstract | 400 |
| concrete | 100 |
The abstract configuration provides 400 individual banner requests with logos (cycling through 100 logos 4 times). The concrete configuration provides 100 campaigns, each with 4 audience variations Γ 13 banner dimensions = 5,200 total specifications.
BannerRequest400 was created to fill a critical gap in banner generation evaluation. Existing datasets for graphic design focus primarily on single-image generation without considering the multimodal nature of advertising design, which requires integrating brand logos with textual specifications.
The dataset enables:
The dataset origins trace to 100 design intentions from the DESIGNERINTENTION dataset. These were:
Created by researchers at Sony as part of the BannerAgency project. The dataset was curated through a combination of AI-generated content (logos via Claude 3.5 Sonnet, requests via GPT-4o) and expert refinement.
This dataset is released under the MIT License. See the original repository for full license details.
@inproceedings{wang-etal-2025-banneragency,
title = {{B}anner{A}gency: Advertising Banner Design with Multimodal {LLM} Agents},
author = {Wang, Heng and Shimose, Yotaro and Takamatsu, Shingo},
booktitle = {Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing},
month = {November},
year = {2025},
address = {Suzhou, China},
publisher = {Association for Computational Linguistics},
pages = {4304--4329},
doi = {10.18653/v1/2025.emnlp-main.214},
url = {https://aclanthology.org/2025.emnlp-main.214/}
}
This Hugging Face dataset implementation was created by the creative-graphic-design organization to make BannerRequest400 more accessible to the research community.
8 commits