Skip to content

Can't use ducklake core_nightly with postgres #698

@robertonowcast

Description

@robertonowcast

What happens?

I was following #638 (which I think it's now merged)
because I thought it would improve performances in our setup, see #640

However I tested with this setup:
Duckdb 1.4.3
Python 3.12.11

The attached very simple script fails.

To Reproduce

import duckdb

if __name__ == "__main__":
    duckdb.sql("FORCE INSTALL ducklake FROM core_nightly;")
    duckdb.sql(
        "CREATE OR REPLACE SECRET secret (TYPE s3, PROVIDER config, KEY_ID xxx, SECRET xxx, URL_STYLE 'path', REGION xxx, USE_SSL false, ENDPOINT xxx)"
    )
    duckdb.sql(
        f"ATTACH 'ducklake:postgres:dbname=postgres host=xxx port=xxx user=xxx password=xxx as mylake (DATA_PATH 's3://data-lake');"
    )

    duckdb.sql(f"USE mylake;")

fails with

Traceback (most recent call last):
  File "/workspaces/scratch/test_pg_query.py", line 17, in <module>
    duckdb.sql(f"USE ducklake;")
_duckdb.BinderException: Binder Error: Failed to query most recent snapshot for DuckLake: Failed to prepare query "
        SELECT * FROM postgres_query('__ducklake_metadata_ducklake',
                'SELECT snapshot_id, schema_version, next_catalog_id, next_file_id
                 FROM "public".ducklake_snapshot WHERE snapshot_id = (
                     SELECT MAX(snapshot_id) FROM "public".ducklake_snapshot
                 );')": ERROR:  function postgres_query(unknown, unknown) does not exist
LINE 2:  SELECT * FROM postgres_query('__ducklake_metadata_ducklake'...
                       ^
HINT:  No function matches the given name and argument types. You might need to add explicit type casts.

OS:

6.8.0-58-generic #60-Ubuntu SMP PREEMPT_DYNAMIC Fri Mar 14 18:29:48 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

DuckDB Version:

1.4.3

DuckLake Version:

From core_nightly

DuckDB Client:

Python

Hardware:

No response

Full Name:

Roberto Pellegrini

Affiliation:

DXT Commodities

What is the latest build you tested with? If possible, we recommend testing with the latest nightly build.

I have tested with a nightly build

Did you include all relevant data sets for reproducing the issue?

No - I cannot share the data sets because they are confidential

Did you include all code required to reproduce the issue?

  • Yes, I have

Did you include all relevant configuration (e.g., CPU architecture, Python version, Linux distribution) to reproduce the issue?

  • Yes, I have

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions