Welcome to Zuora Product Documentation

Explore our rich library of product information

Mount S3 Delta Lake to Snowflake

Learn how to S3 Delta Lake to Snowflake

Note:

Protocol MinReader Version: Snowflake requires delta lake tables compatible with Protocol MinReader Version 2.

  1. Open a Snowflake client.
  2. Execute the following SQL, choose your frequency based on desired data freshness:
    CREATE OR REPLACE CATALOG INTEGRATION delta_catalog_name
      CATALOG_SOURCE = OBJECT_STORE
      TABLE_FORMAT = DELTA
      ENABLED = TRUE;
    
    CREATE OR REPLACE EXTERNAL VOLUME ext_volume_name
      STORAGE_LOCATIONS = (
        (
          NAME = 'some_name'
          STORAGE_PROVIDER = S3
          ...
        )
      )
      ALLOW_WRITES = FALSE;
    
    
    CREATE ICEBERG TABLE schema.table_name
      CATALOG = delta_catalog_name
      EXTERNAL_VOLUME = ext_volume_name
      BASE_LOCATION = '<configured_path>/<table_name>';
    
    CREATE OR REPLACE TASK task_name
      SCHEDULE = 'USING CRON 0/5 * * * * America/Los_Angeles' -- Runs every 5 minutes, change cron to match desired freshness
      ...
    AS
       ALTER ICEBERG TABLE schema.table_name REFRESH;