McAuley-Lab/Amazon-Reviews-2023

Dataset

Amazon Reviews 2023

364

45 commits

1 linked in READMEs

updated Dec 8, 2024

See the code

README

Amazon Reviews 2023

Please also visit amazon-reviews-2023.github.io/ for more details, loading scripts, and preprocessed benchmark files.

[April 7, 2024] We add two useful files:

  1. all_categories.txt: 34 lines (33 categories + "Unknown"), each line contains a category name.
  2. asin2category.json: A mapping between parent_asin (item ID) to its corresponding category name.

This is a large-scale Amazon Reviews dataset, collected in 2023 by McAuley Lab, and it includes rich features such as:

  1. User Reviews (ratings, text, helpfulness votes, etc.);
  2. Item Metadata (descriptions, price, raw image, etc.);
  3. Links (user-item / bought together graphs).

What's New?

In the Amazon Reviews'23, we provide:

  1. Larger Dataset: We collected 571.54M reviews, 245.2% larger than the last version;
  2. Newer Interactions: Current interactions range from May. 1996 to Sep. 2023;
  3. Richer Metadata: More descriptive features in item metadata;
  4. Fine-grained Timestamp: Interaction timestamp at the second or finer level;
  5. Cleaner Processing: Cleaner item metadata than previous versions;
  6. Standard Splitting: Standard data splits to encourage RecSys benchmarking.

Basic Statistics

We define the #R_Tokens as the number of tokens in user reviews and #M_Tokens as the number of tokens if treating the dictionaries of item attributes as strings. We emphasize them as important statistics in the era of LLMs.

We count the number of items based on user reviews rather than item metadata files. Note that some items lack metadata.

Compared to Previous Versions

Year#Review#User#Item#R_Token#M_Token#DomainTimespan
201334.69M6.64M2.44M5.91B--28Jun'96 - Mar'13
201482.83M21.13M9.86M9.16B4.14B24May'96 - Jul'14
2018233.10M43.53M15.17M15.73B7.99B29May'96 - Oct'18
2023571.54M54.51M48.19M30.14B30.78B33May'96 - Sep'23

Grouped by Category

Category#User#Item#Rating#R_Token#M_TokenDownload
All_Beauty632.0K112.6K701.5K31.6M74.1M review, meta
Amazon_Fashion2.0M825.9K2.5M94.9M510.5M review, meta
Appliances1.8M94.3K2.1M92.8M95.3M review, meta
Arts_Crafts_and_Sewing4.6M801.3K9.0M350.0M695.4M review, meta
Automotive8.0M2.0M20.0M824.9M1.7B review, meta
Baby_Products3.4M217.7K6.0M323.3M218.6M review, meta
Beauty_and_Personal_Care11.3M1.0M23.9M1.1B913.7M review, meta
Books10.3M4.4M29.5M2.9B3.7B review, meta
CDs_and_Vinyl1.8M701.7K4.8M514.8M287.5M review, meta
Cell_Phones_and_Accessories11.6M1.3M20.8M935.4M1.3B review, meta
Clothing_Shoes_and_Jewelry22.6M7.2M66.0M2.6B5.9B review, meta
Digital_Music101.0K70.5K130.4K11.4M22.3M review, meta
Electronics18.3M1.6M43.9M2.7B1.7B review, meta
Gift_Cards132.7K1.1K152.4K3.6M630.0K review, meta
Grocery_and_Gourmet_Food7.0M603.2K14.3M579.5M462.8M review, meta
Handmade_Products586.6K164.7K664.2K23.3M125.8M review, meta
Health_and_Household12.5M797.4K25.6M1.2B787.2M review, meta
Health_and_Personal_Care461.7K60.3K494.1K23.9M40.3M review, meta
Home_and_Kitchen23.2M3.7M67.4M3.1B3.8B review, meta
Industrial_and_Scientific3.4M427.5K5.2M235.2M363.1M review, meta
Kindle_Store5.6M1.6M25.6M2.2B1.7B review, meta
Magazine_Subscriptions60.1K3.4K71.5K3.8M1.3M review, meta
Movies_and_TV6.5M747.8K17.3M1.0B415.5M review, meta
Musical_Instruments1.8M213.6K3.0M182.2M200.1M review, meta
Office_Products7.6M710.4K12.8M574.7M682.8M review, meta
Patio_Lawn_and_Garden8.6M851.7K16.5M781.3M875.1M review, meta
Pet_Supplies7.8M492.7K16.8M905.9M511.0M review, meta
Software2.6M89.2K4.9M179.4M67.1M review, meta
Sports_and_Outdoors10.3M1.6M19.6M986.2M1.3B review, meta
Subscription_Boxes15.2K64116.2K1.0M447.0K review, meta
Tools_and_Home_Improvement12.2M1.5M27.0M1.3B1.5B review, meta
Toys_and_Games8.1M890.7K16.3M707.9M848.3M review, meta
Video_Games2.8M137.2K4.6M347.9M137.3M review, meta
Unknown23.1M13.2M63.8M3.3B232.8M review, meta

Check Pure ID files and corresponding data splitting strategies in Common Data Processing section.

Quick Start

Load User Reviews

from datasets import load_dataset

dataset = load_dataset("McAuley-Lab/Amazon-Reviews-2023", "raw_review_All_Beauty", trust_remote_code=True)
print(dataset["full"][0])
{'rating': 5.0,
 'title': 'Such a lovely scent but not overpowering.',
 'text': "This spray is really nice. It smells really good, goes on really fine, and does the trick. I will say it feels like you need a lot of it though to get the texture I want. I have a lot of hair, medium thickness. I am comparing to other brands with yucky chemicals so I'm gonna stick with this. Try it!",
 'images': [],
 'asin': 'B00YQ6X8EO',
 'parent_asin': 'B00YQ6X8EO',
 'user_id': 'AGKHLEW2SOWHNMFQIJGBECAF7INQ',
 'timestamp': 1588687728923,
 'helpful_vote': 0,
 'verified_purchase': True}

Load Item Metadata

dataset = load_dataset("McAuley-Lab/Amazon-Reviews-2023", "raw_meta_All_Beauty", split="full", trust_remote_code=True)
print(dataset[0])
{'main_category': 'All Beauty',
 'title': 'Howard LC0008 Leather Conditioner, 8-Ounce (4-Pack)',
 'average_rating': 4.8,
 'rating_number': 10,
 'features': [],
 'description': [],
 'price': 'None',
 'images': {'hi_res': [None,
   'https://m.media-amazon.com/images/I/71i77AuI9xL._SL1500_.jpg'],
  'large': ['https://m.media-amazon.com/images/I/41qfjSfqNyL.jpg',
   'https://m.media-amazon.com/images/I/41w2yznfuZL.jpg'],
  'thumb': ['https://m.media-amazon.com/images/I/41qfjSfqNyL._SS40_.jpg',
   'https://m.media-amazon.com/images/I/41w2yznfuZL._SS40_.jpg'],
  'variant': ['MAIN', 'PT01']},
 'videos': {'title': [], 'url': [], 'user_id': []},
 'store': 'Howard Products',
 'categories': [],
 'details': '{"Package Dimensions": "7.1 x 5.5 x 3 inches; 2.38 Pounds", "UPC": "617390882781"}',
 'parent_asin': 'B01CUPMQZE',
 'bought_together': None,
 'subtitle': None,
 'author': None}

Check data loading examples and Huggingface datasets APIs in Common Data Loading section.

Data Fields

For User Reviews

FieldTypeExplanation
ratingfloatRating of the product (from 1.0 to 5.0).
titlestrTitle of the user review.
textstrText body of the user review.
imageslistImages that users post after they have received the product. Each image has different sizes (small, medium, large), represented by the small_image_url, medium_image_url, and large_image_url respectively.
asinstrID of the product.
parent_asinstrParent ID of the product. Note: Products with different colors, styles, sizes usually belong to the same parent ID. The “asin” in previous Amazon datasets is actually parent ID. Please use parent ID to find product meta.
user_idstrID of the reviewer
timestampintTime of the review (unix time)
verified_purchaseboolUser purchase verification
helpful_voteintHelpful votes of the review

For Item Metadata

FieldTypeExplanation
main_categorystrMain category (i.e., domain) of the product.
titlestrName of the product.
average_ratingfloatRating of the product shown on the product page.
rating_numberintNumber of ratings in the product.
featureslistBullet-point format features of the product.
descriptionlistDescription of the product.
pricefloatPrice in US dollars (at time of crawling).
imageslistImages of the product. Each image has different sizes (thumb, large, hi_res). The “variant” field shows the position of image.
videoslistVideos of the product including title and url.
storestrStore name of the product.
categorieslistHierarchical categories of the product.
detailsdictProduct details, including materials, brand, sizes, etc.
parent_asinstrParent ID of the product.
bought_togetherlistRecommended bundles from the websites.

Citation

@article{hou2024bridging,
  title={Bridging Language and Items for Retrieval and Recommendation},
  author={Hou, Yupeng and Li, Jiacheng and He, Zhankui and Yan, An and Chen, Xiusi and McAuley, Julian},
  journal={arXiv preprint arXiv:2403.03952},
  year={2024}
}

Contact Us

  • Report Bugs: To report bugs in the dataset, please file an issue on our GitHub.

  • Others: For research collaborations or other questions, please email yphou AT ucsd.edu.

recommendation
reviews

McAuley-Lab/Amazon-Reviews-2023

Dataset

Amazon Reviews 2023

364

45 commits

1 linked in READMEs

updated Dec 8, 2024

See the code

README

Amazon Reviews 2023

Please also visit amazon-reviews-2023.github.io/ for more details, loading scripts, and preprocessed benchmark files.

[April 7, 2024] We add two useful files:

  1. all_categories.txt: 34 lines (33 categories + "Unknown"), each line contains a category name.
  2. asin2category.json: A mapping between parent_asin (item ID) to its corresponding category name.

This is a large-scale Amazon Reviews dataset, collected in 2023 by McAuley Lab, and it includes rich features such as:

  1. User Reviews (ratings, text, helpfulness votes, etc.);
  2. Item Metadata (descriptions, price, raw image, etc.);
  3. Links (user-item / bought together graphs).

What's New?

In the Amazon Reviews'23, we provide:

  1. Larger Dataset: We collected 571.54M reviews, 245.2% larger than the last version;
  2. Newer Interactions: Current interactions range from May. 1996 to Sep. 2023;
  3. Richer Metadata: More descriptive features in item metadata;
  4. Fine-grained Timestamp: Interaction timestamp at the second or finer level;
  5. Cleaner Processing: Cleaner item metadata than previous versions;
  6. Standard Splitting: Standard data splits to encourage RecSys benchmarking.

Basic Statistics

We define the #R_Tokens as the number of tokens in user reviews and #M_Tokens as the number of tokens if treating the dictionaries of item attributes as strings. We emphasize them as important statistics in the era of LLMs.

We count the number of items based on user reviews rather than item metadata files. Note that some items lack metadata.

Compared to Previous Versions

Year#Review#User#Item#R_Token#M_Token#DomainTimespan
201334.69M6.64M2.44M5.91B--28Jun'96 - Mar'13
201482.83M21.13M9.86M9.16B4.14B24May'96 - Jul'14
2018233.10M43.53M15.17M15.73B7.99B29May'96 - Oct'18
2023571.54M54.51M48.19M30.14B30.78B33May'96 - Sep'23

Grouped by Category

Category#User#Item#Rating#R_Token#M_TokenDownload
All_Beauty632.0K112.6K701.5K31.6M74.1M review, meta
Amazon_Fashion2.0M825.9K2.5M94.9M510.5M review, meta
Appliances1.8M94.3K2.1M92.8M95.3M review, meta
Arts_Crafts_and_Sewing4.6M801.3K9.0M350.0M695.4M review, meta
Automotive8.0M2.0M20.0M824.9M1.7B review, meta
Baby_Products3.4M217.7K6.0M323.3M218.6M review, meta
Beauty_and_Personal_Care11.3M1.0M23.9M1.1B913.7M review, meta
Books10.3M4.4M29.5M2.9B3.7B review, meta
CDs_and_Vinyl1.8M701.7K4.8M514.8M287.5M review, meta
Cell_Phones_and_Accessories11.6M1.3M20.8M935.4M1.3B review, meta
Clothing_Shoes_and_Jewelry22.6M7.2M66.0M2.6B5.9B review, meta
Digital_Music101.0K70.5K130.4K11.4M22.3M review, meta
Electronics18.3M1.6M43.9M2.7B1.7B review, meta
Gift_Cards132.7K1.1K152.4K3.6M630.0K review, meta
Grocery_and_Gourmet_Food7.0M603.2K14.3M579.5M462.8M review, meta
Handmade_Products586.6K164.7K664.2K23.3M125.8M review, meta
Health_and_Household12.5M797.4K25.6M1.2B787.2M review, meta
Health_and_Personal_Care461.7K60.3K494.1K23.9M40.3M review, meta
Home_and_Kitchen23.2M3.7M67.4M3.1B3.8B review, meta
Industrial_and_Scientific3.4M427.5K5.2M235.2M363.1M review, meta
Kindle_Store5.6M1.6M25.6M2.2B1.7B review, meta
Magazine_Subscriptions60.1K3.4K71.5K3.8M1.3M review, meta
Movies_and_TV6.5M747.8K17.3M1.0B415.5M review, meta
Musical_Instruments1.8M213.6K3.0M182.2M200.1M review, meta
Office_Products7.6M710.4K12.8M574.7M682.8M review, meta
Patio_Lawn_and_Garden8.6M851.7K16.5M781.3M875.1M review, meta
Pet_Supplies7.8M492.7K16.8M905.9M511.0M review, meta
Software2.6M89.2K4.9M179.4M67.1M review, meta
Sports_and_Outdoors10.3M1.6M19.6M986.2M1.3B review, meta
Subscription_Boxes15.2K64116.2K1.0M447.0K review, meta
Tools_and_Home_Improvement12.2M1.5M27.0M1.3B1.5B review, meta
Toys_and_Games8.1M890.7K16.3M707.9M848.3M review, meta
Video_Games2.8M137.2K4.6M347.9M137.3M review, meta
Unknown23.1M13.2M63.8M3.3B232.8M review, meta

Check Pure ID files and corresponding data splitting strategies in Common Data Processing section.

Quick Start

Load User Reviews

from datasets import load_dataset

dataset = load_dataset("McAuley-Lab/Amazon-Reviews-2023", "raw_review_All_Beauty", trust_remote_code=True)
print(dataset["full"][0])
{'rating': 5.0,
 'title': 'Such a lovely scent but not overpowering.',
 'text': "This spray is really nice. It smells really good, goes on really fine, and does the trick. I will say it feels like you need a lot of it though to get the texture I want. I have a lot of hair, medium thickness. I am comparing to other brands with yucky chemicals so I'm gonna stick with this. Try it!",
 'images': [],
 'asin': 'B00YQ6X8EO',
 'parent_asin': 'B00YQ6X8EO',
 'user_id': 'AGKHLEW2SOWHNMFQIJGBECAF7INQ',
 'timestamp': 1588687728923,
 'helpful_vote': 0,
 'verified_purchase': True}

Load Item Metadata

dataset = load_dataset("McAuley-Lab/Amazon-Reviews-2023", "raw_meta_All_Beauty", split="full", trust_remote_code=True)
print(dataset[0])
{'main_category': 'All Beauty',
 'title': 'Howard LC0008 Leather Conditioner, 8-Ounce (4-Pack)',
 'average_rating': 4.8,
 'rating_number': 10,
 'features': [],
 'description': [],
 'price': 'None',
 'images': {'hi_res': [None,
   'https://m.media-amazon.com/images/I/71i77AuI9xL._SL1500_.jpg'],
  'large': ['https://m.media-amazon.com/images/I/41qfjSfqNyL.jpg',
   'https://m.media-amazon.com/images/I/41w2yznfuZL.jpg'],
  'thumb': ['https://m.media-amazon.com/images/I/41qfjSfqNyL._SS40_.jpg',
   'https://m.media-amazon.com/images/I/41w2yznfuZL._SS40_.jpg'],
  'variant': ['MAIN', 'PT01']},
 'videos': {'title': [], 'url': [], 'user_id': []},
 'store': 'Howard Products',
 'categories': [],
 'details': '{"Package Dimensions": "7.1 x 5.5 x 3 inches; 2.38 Pounds", "UPC": "617390882781"}',
 'parent_asin': 'B01CUPMQZE',
 'bought_together': None,
 'subtitle': None,
 'author': None}

Check data loading examples and Huggingface datasets APIs in Common Data Loading section.

Data Fields

For User Reviews

FieldTypeExplanation
ratingfloatRating of the product (from 1.0 to 5.0).
titlestrTitle of the user review.
textstrText body of the user review.
imageslistImages that users post after they have received the product. Each image has different sizes (small, medium, large), represented by the small_image_url, medium_image_url, and large_image_url respectively.
asinstrID of the product.
parent_asinstrParent ID of the product. Note: Products with different colors, styles, sizes usually belong to the same parent ID. The “asin” in previous Amazon datasets is actually parent ID. Please use parent ID to find product meta.
user_idstrID of the reviewer
timestampintTime of the review (unix time)
verified_purchaseboolUser purchase verification
helpful_voteintHelpful votes of the review

For Item Metadata

FieldTypeExplanation
main_categorystrMain category (i.e., domain) of the product.
titlestrName of the product.
average_ratingfloatRating of the product shown on the product page.
rating_numberintNumber of ratings in the product.
featureslistBullet-point format features of the product.
descriptionlistDescription of the product.
pricefloatPrice in US dollars (at time of crawling).
imageslistImages of the product. Each image has different sizes (thumb, large, hi_res). The “variant” field shows the position of image.
videoslistVideos of the product including title and url.
storestrStore name of the product.
categorieslistHierarchical categories of the product.
detailsdictProduct details, including materials, brand, sizes, etc.
parent_asinstrParent ID of the product.
bought_togetherlistRecommended bundles from the websites.

Citation

@article{hou2024bridging,
  title={Bridging Language and Items for Retrieval and Recommendation},
  author={Hou, Yupeng and Li, Jiacheng and He, Zhankui and Yan, An and Chen, Xiusi and McAuley, Julian},
  journal={arXiv preprint arXiv:2403.03952},
  year={2024}
}

Contact Us

  • Report Bugs: To report bugs in the dataset, please file an issue on our GitHub.

  • Others: For research collaborations or other questions, please email yphou AT ucsd.edu.

recommendation
reviews