Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Cloud storage

delta-explain reads s3://, az://, and gs:// tables directly. Credentials come in by environment, by profile, or by explicit options.

Credentials

  • On cloud infrastructure (EC2/ECS, EKS, AKS, GKE): with no explicit credentials the storage layer uses the provider's ambient chain (instance profile, Managed Identity, Workload Identity). Add --env-creds when the credentials live in environment variables instead.
  • On a laptop (AWS): --profile <name> resolves static keys, session token, and region from ~/.aws/credentials / ~/.aws/config. Profiles that rely on SSO, credential_process, or role assumption are not resolved — export them first and use --env-creds:
    eval $(aws configure export-credentials --profile corp --format env)
    delta-explain --env-creds s3://bucket/table -w "..."
    
  • Static keys (MinIO, local dev): pass them via repeated --option KEY=VALUE, expanding from environment variables to keep secrets out of argv.

Examples

# S3 with credentials from the environment
delta-explain --env-creds s3://bucket/path/to/table -w "date = '2024-01-01'"

# S3 public bucket
delta-explain --region us-east-1 --public s3://my-public-bucket/table -w "id > 100"

# Azure
delta-explain --env-creds az://container/table -w "region = 'eu-west-1'"

# GCS (Workload Identity on GKE, or service-account JSON via env)
delta-explain gs://bucket/table -w "day >= DATE '2026-01-01'"

The end-to-end walkthroughs for MinIO/S3 and GCS live in examples/.

Valid --option keys pass through to the object_store builders; see upstream for the per-backend list.