So-Fake-OOD-v3

So-Fake-OOD-v3 is the updated out-of-distribution evaluation split for So-Fake. It contains platform-native real images, fully synthetic images from held-out commercial generators, and locally tampered images with pixel-level masks.

Release Structure

The release is split according to platform redistribution constraints:

• test_image: examples whose image content can be redistributed. This split includes Reddit, Tumblr, and Bluesky real images, all FULL_SYNTHETIC images, all TAMPERED images, and tamper masks.
• manifests/oodv3_real_x_instagram_download_links.json: X and Instagram real-image entries released only as direct download/access links.

The OOD-v3 release uses a class-balanced manifest. The composition is:

The release-form breakdown is:

Important Notes

Released images and masks preserve their original file bytes. We do not resize, crop, decode/re-encode, or normalize images during dataset packaging. Native image size and compression characteristics are therefore retained.

For X and Instagram, we release only direct download/access links in JSON format, following platform redistribution constraints. Users who need these images should retrieve them in accordance with the corresponding platform terms.

For TAMPERED examples, the mask field is the authoritative localization annotation. The bbox_xyxy field is optional metadata and may be empty; evaluation should use the released mask when mask-level localization is required.

Fields

• image: original image bytes for redistributable rows.
• mask: tamper mask bytes for TAMPERED rows; absent for REAL and FULL_SYNTHETIC rows.
• label: one of REAL, FULL_SYNTHETIC, TAMPERED.
• authenticity: REAL or FAKE.
• scope: same three-way scope as label.
• source_type: platform, generator, or editor.
• source_name: the platform, generator, or editor name associated with the row.
• source_platform: real-image platform for REAL rows.
• generator: generator name for FULL_SYNTHETIC rows.
• editor: editor name for TAMPERED rows.
• release_form: image for redistributable rows; X and Instagram entries are provided only through the external link JSON.
• relative_image_path, relative_mask_path: original relative paths in the internal dataset layout when redistribution is permitted.
• version: fixed to oodv3.

Counts by Source

REAL:

• Reddit: 19,538
• X: 6,685
• Instagram: 2,832
• Tumblr: 2,351
• Bluesky: 1,449

FULL_SYNTHETIC:

• Flux.1_pro: 3,130
• GPT4o: 3,130
• Hidream: 3,129
• Imagen4: 3,129
• Recraftv3: 3,129
• Seedream3.0: 3,129
• GPT-image-1.5: 2,778
• Ideogram3: 2,583
• imagen3: 2,489
• Ideogram2: 1,413
• FLUX_2: 1,388
• GPT-image-2: 1,334
• nano_banana: 1,301
• seedream4.5: 997
• nano_banana_2: 987

TAMPERED:

• openai: 32,761
• ideogram: 1,285

Manifests

The manifests/ directory contains:

• oodv3_balanced_full34046_seed42_public.jsonl: public metadata for the default balanced release.
• oodv3_balanced_full34046_seed42_public.csv: CSV version of the default balanced release.
• oodv3_real_x_instagram_download_links.json: direct download/access links for X and Instagram real-image entries.
• oodv3_validation_issues.csv: validation issue report.