Japan-Specific Question-Answer Evaluation Dataset

An evaluation dataset created by native Japanese annotators, collecting questions and their answers related to information specific to Japan.

Definition of “Japan-specific”

This refers to situations where the answer to a question differs between Japan and other countries.

For example, whether cars drive on the left or the right side of the road: although some places outside Japan also have left-side driving, the rule is determined by each country, and there are countries where right-side driving is standard. Therefore, this can be considered Japan-specific.

The dataset targets questions for which answers may differ between Japan and other countries due to social, cultural, or legal reasons.

Examples

• From what age are people allowed to vote in elections? (選挙が行えるのは何歳からですか？)
• Please explain the staple food and how it is prepared. (主食とその調理方法を説明してください。)
• What are the differences between “year,” “fiscal year,” and “era name”? (「年」「年度」「年号」は何が違うのですか？)
• What is the penetration rate of landline telephones? (固定電話の普及率を教えて下さい。)
• Are there any things to be careful about when using chopsticks? (お箸を使うときに気をつけることはありますか)

Send Questions to

llm-jp(at)nii.ac.jp

Model Card Authors

Kouta Nakayama, Takashi Kodama, Yusuke Miyao.