atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networks

ICLR 2024 · Label-efficient and robust learning › Recognition and long-tail · approach: Dense features and foundation priors · 11 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes spherical harmonic positional embeddings combined with SirenNet for global location encoding, showing SirenNets act as learned Double Fourier Sphere embeddings and reporting state-of-the-art results on checkerboard, land-ocean, ERA5, and iNaturalist 2018 tasks.

Problem

Location encoders for globally distributed geographic data often assume a rectangular lon/lat domain, causing artifacts near the poles; the choice of neural network paired with positional embeddings is also under-explored.

Approach

Use real spherical harmonic basis functions (eigenfunctions of the sphere Laplacian) as well-defined global positional embeddings, paired with sinusoidal representation networks (SirenNet), and show that a SirenNet with direct coordinates can be written as a learned DFS-style embedding.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace the strongest non-SH embedding with SHLinear location encoder · Checkerboard classificationaccuracy: 64.0 \pm 0.1 -> 94.8 \pm 0.1Helped
Replace Grid with SHFcNet location encoder · Checkerboard classificationaccuracy: 93.5 \pm 0.3 -> 94.9 \pm 0.1Helped
Replace Cartesian3D with SHSirenNet location encoder · Checkerboard classificationaccuracy: 95.7 \pm 0.2 -> 95.8 \pm 0.0No clear effect
Replace Theory with SHLinear location encoder · Land-Ocean classificationaccuracy: 86.9 \pm 0.1 -> 94.4 \pm 0.1Helped
Replace SphereC+ with SHFcNet location encoder · Land-Ocean classificationaccuracy: 95.3 \pm 0.1 -> 95.9 \pm 0.1Helped
Replace Grid with SHSirenNet location encoder · Land-Ocean classificationaccuracy: 95.5 \pm 0.2 -> 95.8 \pm 0.1Helped
Replace SphereC+ with SHLinear location encoder · ERA5 interpolationMSE: 8.50 \pm 0.02 -> 1.39 \pm 0.02Helped
Replace SphereC+ with SHFcNet location encoder · ERA5 interpolationMSE: 1.38 \pm 0.03 -> 0.58 \pm 0.02Helped
Replace Cartesian3D with SHSirenNet location encoder · ERA5 interpolationMSE: 1.57 \pm 0.11 -> 1.19 \pm 0.04Helped
Replace SphereC with SHSirenNet location encoder · iNaturalist 2018top-1 accuracy improvement: +12.3 \pm 0.1 -> +12.3 \pm 0.2No clear effect
Replace SphereC with SHSirenNet location encoder · iNaturalist 2018top-3 accuracy improvement: +8.8 \pm 0.1 -> +9.0 \pm 0.1Helped
Increase Legendre polynomials from 10 to 20 (ablation)SH + Linear · Checkerboard resolutionresolvable resolution: 9- and 18-degree resolutionsHelped

Surprising findings

Limitations

Experimental setup

Datasets: Fibonacci-lattice checkerboard (synthetic) Natural Earth land shapefile (land-ocean) ERA5 reanalysis (Jan 1 2018) iNaturalist 2018

Benchmarks: Fibonacci-lattice checkerboard Land-Ocean classification ERA5 interpolation iNaturalist 2018

Metrics: classification accuracy mean squared error relative top-1 and top-3 accuracy increase inference runtime

Baselines: Direct Cartesian3D Wrap Grid Theory SphereC SphereC+ SphereM SphereM+ FcNet Linear

Builds on: Double Fourier Sphere SirenNet Wrap positional encoding Grid location encoder SphereM+

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy