datasocial/tiktok-5.6B-videos

Dataset

TikTok Videos: 5.6 billion

9

1 commits

updated Oct 3, 2026

See the code

README

TikTok Videos: 5.6 billion

5,597,462,038 public TikTok videos (2014 β†’ Oct 2026): captions, hashtags, sounds, TikTok Shop links and engagement stats. One Parquet file per month in data/. Snapshot of 2026-10-03.

Need more? β†’ datasocial.ai

Creator profiles, sounds, daily history, a live database updated every day, and the scraper code.

Query it

DuckDB (reads only the columns it needs):

SELECT hashtag, count(*) AS videos
FROM (SELECT unnest(hashtags) AS hashtag FROM 'hf://datasets/datasocial/tiktok-5.6B-videos/data/2026-09.parquet')
GROUP BY hashtag ORDER BY videos DESC LIMIT 20;

Python:

import pandas as pd
df = pd.read_parquet("hf://datasets/datasocial/tiktok-5.6B-videos/data/2026-09.parquet",
                     columns=["video_id", "posted_at", "views", "caption"])

Columns

ColumnTypeNotes
video_idUInt64tiktok.com/@_/video/{video_id}
posted_atDateTimeUTC
countryStringregion TikTok gives the video
languageStringun = undetermined
typeStringvideo or photo
duration_msUInt320 on photos
image_countUInt8photo posts
width, heightUInt16pixels
captionString
hashtags, hashtag_idsArraylower-case, parallel arrays
mentionsArray(UInt64)creator_ids
on_screen_textArray(String)text stickers
sound_idUInt640 = none
is_adUInt8Spark Ads
branded_contentStringpaid_partnership, shop_affiliate or empty
product_id, seller_idUInt64TikTok Shop; 0 = none
is_shop_videoUInt8
is_ai_generatedUInt8, nullablenull = TikTok did not say
not_recommended_for_fypUInt8, nullableTikTok keeps it off the For You page
sound_mutedUInt8audio removed for copyright
views, likes, comments, shares, saves, downloadsUInt64as of stats_updated_at
engagement_rateFloat32, nullable(likes+comments+shares+saves) / views
stats_updated_atDateTimeUTC

Older videos come from an archive: some fields are 0 or null there (size, downloads, AI flag), and duration is rounded to the second.

License

CC BY-NC 4.0: free for research and personal use. Commercial use, creator profiles and daily updates: datasocial.ai.

creators
short-video
social-media
tiktok

datasocial/tiktok-5.6B-videos

Dataset

TikTok Videos: 5.6 billion

9

1 commits

updated Oct 3, 2026

See the code

README

TikTok Videos: 5.6 billion

5,597,462,038 public TikTok videos (2014 β†’ Oct 2026): captions, hashtags, sounds, TikTok Shop links and engagement stats. One Parquet file per month in data/. Snapshot of 2026-10-03.

Need more? β†’ datasocial.ai

Creator profiles, sounds, daily history, a live database updated every day, and the scraper code.

Query it

DuckDB (reads only the columns it needs):

SELECT hashtag, count(*) AS videos
FROM (SELECT unnest(hashtags) AS hashtag FROM 'hf://datasets/datasocial/tiktok-5.6B-videos/data/2026-09.parquet')
GROUP BY hashtag ORDER BY videos DESC LIMIT 20;

Python:

import pandas as pd
df = pd.read_parquet("hf://datasets/datasocial/tiktok-5.6B-videos/data/2026-09.parquet",
                     columns=["video_id", "posted_at", "views", "caption"])

Columns

ColumnTypeNotes
video_idUInt64tiktok.com/@_/video/{video_id}
posted_atDateTimeUTC
countryStringregion TikTok gives the video
languageStringun = undetermined
typeStringvideo or photo
duration_msUInt320 on photos
image_countUInt8photo posts
width, heightUInt16pixels
captionString
hashtags, hashtag_idsArraylower-case, parallel arrays
mentionsArray(UInt64)creator_ids
on_screen_textArray(String)text stickers
sound_idUInt640 = none
is_adUInt8Spark Ads
branded_contentStringpaid_partnership, shop_affiliate or empty
product_id, seller_idUInt64TikTok Shop; 0 = none
is_shop_videoUInt8
is_ai_generatedUInt8, nullablenull = TikTok did not say
not_recommended_for_fypUInt8, nullableTikTok keeps it off the For You page
sound_mutedUInt8audio removed for copyright
views, likes, comments, shares, saves, downloadsUInt64as of stats_updated_at
engagement_rateFloat32, nullable(likes+comments+shares+saves) / views
stats_updated_atDateTimeUTC

Older videos come from an archive: some fields are 0 or null there (size, downloads, AI flag), and duration is rounded to the second.

License

CC BY-NC 4.0: free for research and personal use. Commercial use, creator profiles and daily updates: datasocial.ai.

creators
short-video
social-media
tiktok