article · draft

Choosing an Earth embedding

Seven open sources of satellite embeddings set side by side, with the questions that decide between them: ready-made or run yourself, pixel or patch or place, one date or a year, and the licence.

Cities & placesLiving systems

An embedding is a list of numbers that a trained model gives to a piece of the Earth, chosen so that places that look alike get similar lists. With embeddings in hand, mapping crops or finding every quarry in a region comes down to labelling some examples and training a small classifier, which TESSERA's makers say runs on an ordinary CPU.2 Several groups now publish open models that make embeddings, and some publish the numbers already computed.1,2,3 Four questions decide between seven of them.

Do you want the numbers ready-made, or will you run a model? Ready-made is far easier. TESSERA publishes yearly embeddings for the whole land surface from 2017 to 2025 under CC0, free to download.2 Google's AlphaEarth publishes yearly embeddings inside Earth Engine.3 The company lgnd.ai publishes monthly Clay embeddings of Sentinel-2 for the world from January 2017 to April 2026,11 and Clay has embedded the US NAIP aerial archive from 2010 to 2021.12 Ai2 publishes yearly OlmoEarth embeddings on Source Cooperative, worldwide for 2023 to 2025 and for some countries back to 2017, with the earlier years still being computed.1 TerraMind has to be run on imagery you choose.6,13

What does one embedding describe? TESSERA, AlphaEarth and OlmoEarth's published set give one per 10 metre square.1,2,3 Clay and TerraMind give one per patch of pixels, so the ground each covers depends on the imagery and the settings, and so does OlmoEarth when you run it yourself.1,10,14 SatCLIP is different in kind: it takes a longitude and latitude, needs no image at all, and describes the broad character of a region, so it suits regional questions such as temperature or population density rather than one field.7,15

One moment or a whole year? TESSERA folds a year of radar and optical passes into each embedding, so a field that greens and browns is told apart from evergreen forest.2 AlphaEarth is also annual.3 Clay describes one place at one time, so seasons come from comparing dates.4 OlmoEarth reads a time series of monthly mosaics, and its published set is one embedding per year.1 TerraMind reads a single date unless wrapped for time series.6

What does the licence allow? TESSERA's embeddings are CC0 and its code MIT.2 Clay's weights and TerraMind's are Apache 2.0, and SatCLIP's MIT, though its model cards say it is for research, not production.4,6,7,15 OlmoEarth's own licence, which covers its published embeddings as well as the weights, lets anyone use and change them free of charge.1,9 It bars military, surveillance and policing work and the extraction of oil, gas and minerals.9 Anything built from OlmoEarth carries the same limits.9

Ready-made embeddings One embedding per Time Numbers Licence
TESSERA yes, global, 2017 to 2025 10 m square a year 128 MIT model, CC0 embeddings2
AlphaEarth yes, in Earth Engine 10 m square a year 64 see Earth Engine3
Clay v1.5 yes: S2 monthly global, NAIP US patch of 8 pixels one date 1,024 Apache 2.0; embeddings CC BY4,10,11,12
OlmoEarth yes, global 2023 to 2025, some countries earlier 10 m square a year 128 (or the first 64) own licence, with use limits1,9
TerraMind no 16 by 16 pixel patch one date 768 (base) Apache 2.013,14
SatCLIP not needed a coordinate fixed varies MIT, research use7,15

To compare models on one place, ESA's Φ-lab runs Major TOM. It cuts the world into cells about 10 km apart.8 Imagery, elevation, night lights and the embeddings of several models, among them Clay, SatCLIP and a subset of AlphaEarth, are all keyed to the same cells.8,16,17

TerraMind does one thing the others do not: from an ordinary Sentinel-2 picture it can generate a radar image or a land-cover map, and use the imagined layer to improve its answer.6,14 Its model card warns against reading a generated layer as a reconstruction.13

TESSERA's Python library can download a year for a small box and paint three of its 128 bands as a colour map.18 Looking at that map shows quickly whether fields, roofs or wetlands in your area stand apart.

is about this entity

  • TESSERA tool draft

    Open Earth observation foundation model from the University of Cambridge: one 128-number summary of a year of Sentinel-1 and Sentinel-2 imagery for every 10 metre square of land, with the embeddings free to download.

    open sourceopen dataAPIopen participation

  • Geospatial foundation models from Google DeepMind (AlphaEarth Foundations, released as an embeddings dataset in Google Earth Engine) and from NASA with IBM (Prithvi Geospatial, open source on Hugging Face), for mapping and land-change tasks.

    partly open sourcepartly open data

  • Clay tool draft

    Open Earth observation foundation model, now a program of Renaissance Philanthropy: it turns satellite or aerial imagery with any number of bands, along with its place and date, into 1,024-number embeddings.

    open sourceopen dataopen participation

  • OlmoEarth tool draft

    Family of Earth observation foundation models from the Allen Institute for AI (Ai2), trained on Sentinel-1, Sentinel-2 and Landsat time series, with open weights under a licence that bars military and extractive uses.

    partly open sourcepartly open dataAPIopen participation

  • TerraMind tool draft

    Open generative foundation model for Earth observation from IBM and the European Space Agency: it reads radar, optical, elevation and land-cover layers and can generate any one of them from the others.

    open sourceopen participation

  • SatCLIP tool draft

    Open location encoder published by Microsoft that turns any longitude and latitude into an embedding summarising what the place looks like in Sentinel-2 imagery, for use as an input to prediction models.

    open sourceopen datano APIopen participation

  • Major TOM datasource draft

    Shared global grid and open satellite datasets from ESA's Φ-lab: Sentinel-2 and Sentinel-1 imagery, elevation, night lights and AI embeddings, cut to the same 10 km cells, on Hugging Face.

    open sourceopen dataopen participation

Tags: embeddings, foundation model, satellite, comparison

staging: drafts and proposals shown