Major-TOM/Core-S1RTC

Dataset

Core-S1RTC

14

500 commits

1 linked in READMEs

updated Aug 29, 2024

See the code

README

Core-S1RTC

Contains a global coverage of Sentinel-1 (RTC) patches, each of size 1,068 x 1,068 pixels.

SourceSensing TypeNumber of PatchesPatch SizeTotal Pixels
Sentinel-1 RTCSynthetic Aperture Radar1,469,9551,068 x 1,068 (10 m)> 1.676 Trillion

Content

ColumnDetailsResolution
VVReceived Linear Power in the VV Polarization10m
VHReceived Linear Power in the VV Polarization10m
thumbnailRescaled false colour1 saved as png10m

1 False colour composites are made with decibel-scale values with red green and blue defined as R:VV G:VV+VH B:VH. For each channel, a contrast-stretch is applied, transforming minimum-maximum to 0-255. This means bluer areas have relatively higher VH values, whilst brightness is a function of overall intensity. This is relative within each thumbnail because of the normalisation, and so cannot be compared across different samples.

Spatial Coverage

This is a global monotemporal dataset. Nearly every piece of Earth captured by Sentinel-1 is contained at least once in this dataset (and only once, excluding some marginal overlaps). The coverage is about 35% lower than for Core Sentinel-2 dataset due to the sensor coverage limitations.

The following figure demonstrates the spatial coverage (only black pixels are absent): image/png

Example Use

Interface scripts are available at https://github.com/ESA-PhiLab/Major-TOM

Here's a sneak peek with a thumbnail image:

from fsspec.parquet import open_parquet_file
import pyarrow.parquet as pq
from io import BytesIO
from PIL import Image

PARQUET_FILE = 'part_03900' # parquet number
ROW_INDEX = 42 # row number (about 500 per parquet)

url = "https://huggingface.co/datasets/Major-TOM/Core-S1RTC/resolve/main/images/{}.parquet".format(PARQUET_FILE)
with open_parquet_file(url,columns = ["thumbnail"]) as f:
    with pq.ParquetFile(f) as pf:
        first_row_group = pf.read_row_group(ROW_INDEX, columns=['thumbnail'])

stream = BytesIO(first_row_group['thumbnail'][0].as_py())
image = Image.open(stream)

Cite

arxiv

@inproceedings{Major_TOM,
  title={Major TOM: Expandable Datasets for Earth Observation}, 
  author={Alistair Francis and Mikolaj Czerkawski},
  year={2024},
  booktitle={IGARSS 2024 - 2024 IEEE International Geoscience and Remote Sensing Symposium}, 
  eprint={2402.12095},
  archivePrefix={arXiv},
  primaryClass={cs.CV}
}

Powered by Ξ¦-lab, European Space Agency (ESA) πŸ›°οΈ

earth-observation
geospatial
remote-sensing
satellite
sentinel-1
synthethic-aperture-radar

Major-TOM/Core-S1RTC

Dataset

Core-S1RTC

14

500 commits

1 linked in READMEs

updated Aug 29, 2024

See the code

README

Core-S1RTC

Contains a global coverage of Sentinel-1 (RTC) patches, each of size 1,068 x 1,068 pixels.

SourceSensing TypeNumber of PatchesPatch SizeTotal Pixels
Sentinel-1 RTCSynthetic Aperture Radar1,469,9551,068 x 1,068 (10 m)> 1.676 Trillion

Content

ColumnDetailsResolution
VVReceived Linear Power in the VV Polarization10m
VHReceived Linear Power in the VV Polarization10m
thumbnailRescaled false colour1 saved as png10m

1 False colour composites are made with decibel-scale values with red green and blue defined as R:VV G:VV+VH B:VH. For each channel, a contrast-stretch is applied, transforming minimum-maximum to 0-255. This means bluer areas have relatively higher VH values, whilst brightness is a function of overall intensity. This is relative within each thumbnail because of the normalisation, and so cannot be compared across different samples.

Spatial Coverage

This is a global monotemporal dataset. Nearly every piece of Earth captured by Sentinel-1 is contained at least once in this dataset (and only once, excluding some marginal overlaps). The coverage is about 35% lower than for Core Sentinel-2 dataset due to the sensor coverage limitations.

The following figure demonstrates the spatial coverage (only black pixels are absent): image/png

Example Use

Interface scripts are available at https://github.com/ESA-PhiLab/Major-TOM

Here's a sneak peek with a thumbnail image:

from fsspec.parquet import open_parquet_file
import pyarrow.parquet as pq
from io import BytesIO
from PIL import Image

PARQUET_FILE = 'part_03900' # parquet number
ROW_INDEX = 42 # row number (about 500 per parquet)

url = "https://huggingface.co/datasets/Major-TOM/Core-S1RTC/resolve/main/images/{}.parquet".format(PARQUET_FILE)
with open_parquet_file(url,columns = ["thumbnail"]) as f:
    with pq.ParquetFile(f) as pf:
        first_row_group = pf.read_row_group(ROW_INDEX, columns=['thumbnail'])

stream = BytesIO(first_row_group['thumbnail'][0].as_py())
image = Image.open(stream)

Cite

arxiv

@inproceedings{Major_TOM,
  title={Major TOM: Expandable Datasets for Earth Observation}, 
  author={Alistair Francis and Mikolaj Czerkawski},
  year={2024},
  booktitle={IGARSS 2024 - 2024 IEEE International Geoscience and Remote Sensing Symposium}, 
  eprint={2402.12095},
  archivePrefix={arXiv},
  primaryClass={cs.CV}
}

Powered by Ξ¦-lab, European Space Agency (ESA) πŸ›°οΈ

earth-observation
geospatial
remote-sensing
satellite
sentinel-1
synthethic-aperture-radar