Skip to content

Search docs and blog

SQL Compatibility Skip Reference

Rules the registry applies to queries, benchmarks, and DDL statements. Split into two sections based on whether the outcome is user-visible in result counts. Each entry names the platform, the scope the rule applies to, the registered reason, and the rule_id you can grep for in benchbox/sql_compat/rules/.

Total rules: 337

Platforms with rules: 22

Will not run

Queries or benchmarks that are omitted from the result set - either because the benchmark is refused at preflight (BLOCKED) or a specific query is excluded from execution (SKIPPED_QUERY). Users see these as missing entries in result counts.

bigquery

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterBigQuery does not support DuckDB LIST aggregates and LIST lambda functions in this variant.execution_filter.bigquery.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=2_v2execution_filterBigQuery rejects the correlated scalar subquery in this grouped variant.execution_filter.bigquery.tpchavoc.2_v2
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_create_temp_tableexecution_filterBigQuery runs each multi-statement script as chained single-statement jobs, so a TEMP TABLE created in one statement is invisible to the next.execution_filter.bigquery.transaction_primitives.transaction_create_temp_table
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_read_committedexecution_filterBigQuery rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.bigquery.transaction_primitives.transaction_isolation_read_committed
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_repeatable_readexecution_filterBigQuery rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.bigquery.transaction_primitives.transaction_isolation_repeatable_read
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_serializableexecution_filterBigQuery rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.bigquery.transaction_primitives.transaction_isolation_serializable
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_deep_nestingexecution_filterBigQuery has no SAVEPOINT statement.execution_filter.bigquery.transaction_primitives.transaction_savepoint_deep_nesting
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_nestedexecution_filterBigQuery has no SAVEPOINT statement.execution_filter.bigquery.transaction_primitives.transaction_savepoint_nested

clickhouse-cloud

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=tpchavoc, query=10_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.10_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=11_v4execution_filterClickHouse rejects an aggregate over a select-list-alias aggregate (nested aggregate, Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-cloud.tpchavoc.11_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=13_v8execution_filterClickHouse cannot lower this variant’s correlated subquery (CommonSubplan plan step, Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.13_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=14_v8execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.14_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.16_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v4execution_filterClickHouse cannot lower this variant’s correlated subquery (DelayedCreatingSets plan step, Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.16_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v10execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.17_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v7execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.17_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v10execution_filterClickHouse rejects a GROUP BY whose key is a CASE aliased to the same name as a column it references (alias shadowing, Code 215 NOT_AN_AGGREGATE).execution_filter.clickhouse-cloud.tpchavoc.1_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterClickHouse has no DuckDB LIST aggregate / list_transform/list_zip lambda forms this variant uses (Syntax error at the -> lambda).execution_filter.clickhouse-cloud.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.3_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v10execution_filterClickHouse cannot SUM a Variant(Decimal, Float64) column produced by this variant’s mixed-type CASE (Code 43 ILLEGAL_TYPE_OF_ARGUMENT).execution_filter.clickhouse-cloud.tpchavoc.3_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v9execution_filterClickHouse rejects a window function used in WHERE (Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-cloud.tpchavoc.3_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v10execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.4_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v7execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.4_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-cloud.tpchavoc.5_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v10execution_filterClickHouse cannot SUM a Variant(Decimal, Float64) column produced by this variant’s mixed-type CASE (Code 43 ILLEGAL_TYPE_OF_ARGUMENT).execution_filter.clickhouse-cloud.tpchavoc.5_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v4execution_filterClickHouse rejects an aggregate over a select-list-alias aggregate (nested aggregate, Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-cloud.tpchavoc.5_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=7_v1execution_filterClickHouse cannot execute this correlated revenue subquery (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-cloud.tpchavoc.7_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=8_v1execution_filterClickHouse cannot execute the two correlated market-share subqueries (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-cloud.tpchavoc.8_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=9_v1execution_filterClickHouse cannot execute this correlated profit subquery (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-cloud.tpchavoc.9_v1

clickhouse-local

supportscopephasereasonrule_id
BLOCKEDbenchmark=metadata_primitivesbenchmark_gateEmbedded ClickHouse Local has no privileged ACL introspection contract.benchmark_gate.clickhouse-local.metadata_primitives.unsupported
SKIPPED_QUERYbenchmark=tpchavoc, query=10_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.10_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=11_v4execution_filterClickHouse rejects an aggregate over a select-list-alias aggregate (nested aggregate, Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-local.tpchavoc.11_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=13_v8execution_filterClickHouse cannot lower this variant’s correlated subquery (CommonSubplan plan step, Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.13_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=14_v8execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.14_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.16_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v4execution_filterClickHouse cannot lower this variant’s correlated subquery (DelayedCreatingSets plan step, Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.16_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v10execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.17_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v7execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.17_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v10execution_filterClickHouse rejects a GROUP BY whose key is a CASE aliased to the same name as a column it references (alias shadowing, Code 215 NOT_AN_AGGREGATE).execution_filter.clickhouse-local.tpchavoc.1_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterClickHouse has no DuckDB LIST aggregate / list_transform/list_zip lambda forms this variant uses (Syntax error at the -> lambda).execution_filter.clickhouse-local.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.3_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v10execution_filterClickHouse cannot SUM a Variant(Decimal, Float64) column produced by this variant’s mixed-type CASE (Code 43 ILLEGAL_TYPE_OF_ARGUMENT).execution_filter.clickhouse-local.tpchavoc.3_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v9execution_filterClickHouse rejects a window function used in WHERE (Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-local.tpchavoc.3_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v10execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.4_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v7execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.4_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-local.tpchavoc.5_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v10execution_filterClickHouse cannot SUM a Variant(Decimal, Float64) column produced by this variant’s mixed-type CASE (Code 43 ILLEGAL_TYPE_OF_ARGUMENT).execution_filter.clickhouse-local.tpchavoc.5_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v4execution_filterClickHouse rejects an aggregate over a select-list-alias aggregate (nested aggregate, Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-local.tpchavoc.5_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=7_v1execution_filterClickHouse cannot execute this correlated revenue subquery (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-local.tpchavoc.7_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=8_v1execution_filterClickHouse cannot execute the two correlated market-share subqueries (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-local.tpchavoc.8_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=9_v1execution_filterClickHouse cannot execute this correlated profit subquery (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-local.tpchavoc.9_v1

clickhouse-server

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=tpchavoc, query=10_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.10_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=11_v4execution_filterClickHouse rejects an aggregate over a select-list-alias aggregate (nested aggregate, Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-server.tpchavoc.11_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=13_v8execution_filterClickHouse cannot lower this variant’s correlated subquery (CommonSubplan plan step, Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.13_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=14_v8execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.14_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.16_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v4execution_filterClickHouse cannot lower this variant’s correlated subquery (DelayedCreatingSets plan step, Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.16_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v10execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.17_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v7execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.17_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v10execution_filterClickHouse rejects a GROUP BY whose key is a CASE aliased to the same name as a column it references (alias shadowing, Code 215 NOT_AN_AGGREGATE).execution_filter.clickhouse-server.tpchavoc.1_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterClickHouse has no DuckDB LIST aggregate / list_transform/list_zip lambda forms this variant uses (Syntax error at the -> lambda).execution_filter.clickhouse-server.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.3_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v10execution_filterClickHouse cannot SUM a Variant(Decimal, Float64) column produced by this variant’s mixed-type CASE (Code 43 ILLEGAL_TYPE_OF_ARGUMENT).execution_filter.clickhouse-server.tpchavoc.3_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v9execution_filterClickHouse rejects a window function used in WHERE (Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-server.tpchavoc.3_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v10execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.4_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v7execution_filterClickHouse does not support correlated subqueries in an aggregate-function argument (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.4_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v1execution_filterClickHouse does not support correlated subqueries in ORDER BY (Code 48 NOT_IMPLEMENTED).execution_filter.clickhouse-server.tpchavoc.5_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v10execution_filterClickHouse cannot SUM a Variant(Decimal, Float64) column produced by this variant’s mixed-type CASE (Code 43 ILLEGAL_TYPE_OF_ARGUMENT).execution_filter.clickhouse-server.tpchavoc.5_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v4execution_filterClickHouse rejects an aggregate over a select-list-alias aggregate (nested aggregate, Code 184 ILLEGAL_AGGREGATION).execution_filter.clickhouse-server.tpchavoc.5_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=7_v1execution_filterClickHouse cannot execute this correlated revenue subquery (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-server.tpchavoc.7_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=8_v1execution_filterClickHouse cannot execute the two correlated market-share subqueries (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-server.tpchavoc.8_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=9_v1execution_filterClickHouse cannot execute this correlated profit subquery (Code 1/48 correlated subquery planning failure).execution_filter.clickhouse-server.tpchavoc.9_v1

databricks

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterDatabricks SQL has array aggregation but not DuckDB’s LIST_SUM and LIST_ZIP functions used here.execution_filter.databricks.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_create_temp_tableexecution_filterDatabricks SQL rejects CREATE TEMPORARY TABLE … IF NOT EXISTS, and temporary views are not allowed inside a transaction (TRANSACTION_NOT_SUPPORTED.COMMAND).execution_filter.databricks.transaction_primitives.transaction_create_temp_table
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_read_committedexecution_filterDatabricks SQL rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.databricks.transaction_primitives.transaction_isolation_read_committed
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_repeatable_readexecution_filterDatabricks SQL rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.databricks.transaction_primitives.transaction_isolation_repeatable_read
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_serializableexecution_filterDatabricks SQL rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.databricks.transaction_primitives.transaction_isolation_serializable
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_deep_nestingexecution_filterDatabricks SQL multi-statement transactions do not support SAVEPOINT.execution_filter.databricks.transaction_primitives.transaction_savepoint_deep_nesting
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_nestedexecution_filterDatabricks SQL multi-statement transactions do not support SAVEPOINT.execution_filter.databricks.transaction_primitives.transaction_savepoint_nested
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_truncate_in_transactionexecution_filterDatabricks SQL does not allow TRUNCATE TABLE inside a transaction (TRANSACTION_NOT_SUPPORTED.COMMAND).execution_filter.databricks.transaction_primitives.transaction_truncate_in_transaction

datafusion

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=tpchavoc, query=12_v1execution_filterDataFusion scalar_subquery_to_join optimizer rule reports an ambiguous count(*) for this variant.execution_filter.datafusion.tpchavoc.12_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=14_v8execution_filterDataFusion physical planning does not support EXISTS in this variant shape.execution_filter.datafusion.tpchavoc.14_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v10execution_filterDataFusion physical planning does not support the IN sub-query in this variant shape.execution_filter.datafusion.tpchavoc.16_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v7execution_filterDataFusion physical planning does not support the IN sub-query in this variant shape.execution_filter.datafusion.tpchavoc.16_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v10execution_filterDataFusion physical planning does not support the scalar sub-query in this variant shape.execution_filter.datafusion.tpchavoc.17_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v7execution_filterDataFusion physical planning does not support the scalar sub-query in this variant shape.execution_filter.datafusion.tpchavoc.17_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterDataFusion has no LIST aggregate used by this variant (Invalid function 'list').execution_filter.datafusion.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v10execution_filterDataFusion physical planning does not support EXISTS in this variant shape.execution_filter.datafusion.tpchavoc.4_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v7execution_filterDataFusion physical planning does not support EXISTS in this variant shape.execution_filter.datafusion.tpchavoc.4_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=7_v1execution_filterDataFusion physical planning does not support the scalar sub-query in this variant shape.execution_filter.datafusion.tpchavoc.7_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=8_v1execution_filterDataFusion scalar_subquery_to_join optimizer rule fails to resolve a sub-query field for this variant.execution_filter.datafusion.tpchavoc.8_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=9_v1execution_filterDataFusion physical planning does not support the scalar sub-query in this variant shape.execution_filter.datafusion.tpchavoc.9_v1

duckdb

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_read_committedexecution_filterDuckDB rejects explicit SET TRANSACTION ISOLATION LEVEL syntax.execution_filter.duckdb.transaction_primitives.transaction_isolation_read_committed
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_repeatable_readexecution_filterDuckDB rejects explicit SET TRANSACTION ISOLATION LEVEL syntax.execution_filter.duckdb.transaction_primitives.transaction_isolation_repeatable_read
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_serializableexecution_filterDuckDB rejects explicit SET TRANSACTION ISOLATION LEVEL syntax.execution_filter.duckdb.transaction_primitives.transaction_isolation_serializable
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_deep_nestingexecution_filterDuckDB rejects SAVEPOINT syntax in transaction_primitives operations.execution_filter.duckdb.transaction_primitives.transaction_savepoint_deep_nesting
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_nestedexecution_filterDuckDB rejects SAVEPOINT syntax in transaction_primitives operations.execution_filter.duckdb.transaction_primitives.transaction_savepoint_nested
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_upsert_modeexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.bulk_load_upsert_mode
SKIPPED_QUERYbenchmark=write_primitives, query=merge_computed_valuesexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_computed_values
SKIPPED_QUERYbenchmark=write_primitives, query=merge_conditional_insertexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_conditional_insert
SKIPPED_QUERYbenchmark=write_primitives, query=merge_conditional_updateexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_conditional_update
SKIPPED_QUERYbenchmark=write_primitives, query=merge_date_arithmeticexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_date_arithmetic
SKIPPED_QUERYbenchmark=write_primitives, query=merge_deduplication_window_functionexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_deduplication_window_function
SKIPPED_QUERYbenchmark=write_primitives, query=merge_error_handlingexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_error_handling
SKIPPED_QUERYbenchmark=write_primitives, query=merge_etl_aggregation_patternexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_etl_aggregation_pattern
SKIPPED_QUERYbenchmark=write_primitives, query=merge_from_subquery_aggregatedexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_from_subquery_aggregated
SKIPPED_QUERYbenchmark=write_primitives, query=merge_full_overlap_all_updateexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_full_overlap_all_update
SKIPPED_QUERYbenchmark=write_primitives, query=merge_multi_column_updateexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_multi_column_update
SKIPPED_QUERYbenchmark=write_primitives, query=merge_no_overlap_all_insertexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_no_overlap_all_insert
SKIPPED_QUERYbenchmark=write_primitives, query=merge_overlap_10pctexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_overlap_10pct
SKIPPED_QUERYbenchmark=write_primitives, query=merge_overlap_50pctexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_overlap_50pct
SKIPPED_QUERYbenchmark=write_primitives, query=merge_overlap_90pctexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_overlap_90pct
SKIPPED_QUERYbenchmark=write_primitives, query=merge_returning_clauseexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_returning_clause
SKIPPED_QUERYbenchmark=write_primitives, query=merge_simple_upsert_smallexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_simple_upsert_small
SKIPPED_QUERYbenchmark=write_primitives, query=merge_string_operationsexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_string_operations
SKIPPED_QUERYbenchmark=write_primitives, query=merge_upsert_with_deleteexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_upsert_with_delete
SKIPPED_QUERYbenchmark=write_primitives, query=merge_with_cte_sourceexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_with_cte_source
SKIPPED_QUERYbenchmark=write_primitives, query=merge_with_join_conditionexecution_filterDuckDB 1.3.2 rejects the catalog’s MERGE INTO statements; keep them explicit skips until the bundled driver supports MERGE. Portable merge operations written as UPDATE/INSERT run normally.execution_filter.duckdb.write_primitives.merge_with_join_condition

lakesail

supportscopephasereasonrule_id
BLOCKEDbenchmark=ai_primitivesbenchmark_gateAI primitives requires LLM/tool execution APIs and has no SQL schema contract for LakeSail/Sail.benchmark_gate.lakesail.ai_primitives.unsupported
BLOCKEDbenchmark=metadata_primitivesbenchmark_gateLakeSail/Sail does not expose the INFORMATION_SCHEMA catalog contract required by metadata_primitives.benchmark_gate.lakesail.metadata_primitives.unsupported
BLOCKEDbenchmark=transaction_primitivesbenchmark_gateLakeSail/Sail SQL mode does not expose the DBAPI transactional contract required by transaction_primitives.benchmark_gate.lakesail.transaction_primitives.unsupported
BLOCKEDbenchmark=vector_searchbenchmark_gateLakeSail/Sail does not currently expose the vector-distance query contract required by vector_search.benchmark_gate.lakesail.vector_search.unsupported
BLOCKEDbenchmark=write_primitivesbenchmark_gateLakeSail/Sail SQL mode does not expose the SQL operation-executor contract required by write_primitives.benchmark_gate.lakesail.write_primitives.unsupported
SKIPPED_QUERYbenchmark=vector_search, query=Q1query_sourceLakeSail/Sail has no native vector-distance functions for this benchmark and rejects Spark SQL lambda fallback expressions.query_source.lakesail.vector_search.q1_unsupported
SKIPPED_QUERYbenchmark=vector_search, query=Q2query_sourceLakeSail/Sail has no native vector-distance functions for this benchmark and rejects Spark SQL lambda fallback expressions.query_source.lakesail.vector_search.q2_unsupported
SKIPPED_QUERYbenchmark=vector_search, query=Q3query_sourceLakeSail/Sail has no native vector-distance functions for this benchmark and rejects Spark SQL lambda fallback expressions.query_source.lakesail.vector_search.q3_unsupported
SKIPPED_QUERYbenchmark=vector_search, query=Q4query_sourceLakeSail/Sail has no native vector-distance functions for this benchmark and rejects Spark SQL lambda fallback expressions.query_source.lakesail.vector_search.q4_unsupported
SKIPPED_QUERYbenchmark=vector_search, query=Q5query_sourceLakeSail/Sail has no native vector-distance functions for this benchmark and rejects Spark SQL lambda fallback expressions.query_source.lakesail.vector_search.q5_unsupported
SKIPPED_QUERYbenchmark=vector_search, query=Q6query_sourceLakeSail/Sail has no native vector-distance functions for this benchmark and rejects Spark SQL lambda fallback expressions.query_source.lakesail.vector_search.q6_unsupported
SKIPPED_QUERYbenchmark=read_primitives, query=approx_quantiles_arrayexecution_filterSail returns a Spark Connect metadata/resource error for array approximate quantiles.execution_filter.lakesail.read_primitives.approx_quantiles_array
SKIPPED_QUERYbenchmark=read_primitives, query=approx_top_k_lineitemexecution_filterSail rejects APPROX_TOP_K with unknown function: APPROX_TOP_K.execution_filter.lakesail.read_primitives.approx_top_k_lineitem
SKIPPED_QUERYbenchmark=read_primitives, query=asof_join_basicexecution_filterSail parser rejects ASOF JOIN syntax.execution_filter.lakesail.read_primitives.asof_join_basic
SKIPPED_QUERYbenchmark=read_primitives, query=fulltext_boolean_searchexecution_filterSail parser rejects MySQL full-text boolean search syntax.execution_filter.lakesail.read_primitives.fulltext_boolean_search
SKIPPED_QUERYbenchmark=read_primitives, query=fulltext_phrase_searchexecution_filterSail parser rejects MySQL full-text phrase search syntax.execution_filter.lakesail.read_primitives.fulltext_phrase_search
SKIPPED_QUERYbenchmark=read_primitives, query=fulltext_simple_searchexecution_filterSail parser rejects MySQL full-text MATCH ... AGAINST syntax.execution_filter.lakesail.read_primitives.fulltext_simple_search
SKIPPED_QUERYbenchmark=read_primitives, query=groupby_all_complexexecution_filterSail treats GROUP BY ALL as an unresolved ALL attribute.execution_filter.lakesail.read_primitives.groupby_all_complex
SKIPPED_QUERYbenchmark=read_primitives, query=groupby_all_simpleexecution_filterSail treats GROUP BY ALL as an unresolved ALL attribute.execution_filter.lakesail.read_primitives.groupby_all_simple
SKIPPED_QUERYbenchmark=read_primitives, query=json_aggregatesexecution_filterSail parser rejects the JSON object syntax with found :.execution_filter.lakesail.read_primitives.json_aggregates
SKIPPED_QUERYbenchmark=read_primitives, query=json_extract_nestedexecution_filterSail lacks JSON_VALID and reports unknown function: JSON_VALID.execution_filter.lakesail.read_primitives.json_extract_nested
SKIPPED_QUERYbenchmark=read_primitives, query=list_filterexecution_filterSail rejects the lambda function form used by the list primitive.execution_filter.lakesail.read_primitives.list_filter
SKIPPED_QUERYbenchmark=read_primitives, query=list_reduceexecution_filterSail rejects the lambda function form used by the list primitive.execution_filter.lakesail.read_primitives.list_reduce
SKIPPED_QUERYbenchmark=read_primitives, query=list_transformexecution_filterSail rejects the lambda function form used by the list primitive.execution_filter.lakesail.read_primitives.list_transform
SKIPPED_QUERYbenchmark=read_primitives, query=optimizer_scalar_subquery_flatteningexecution_filterSail planner reports Ambiguous reference to unqualified field __always_true.execution_filter.lakesail.read_primitives.optimizer_scalar_subquery_flattening
SKIPPED_QUERYbenchmark=read_primitives, query=orderby_all_descexecution_filterSail treats ORDER BY ALL DESC as an unresolved sort expression.execution_filter.lakesail.read_primitives.orderby_all_desc
SKIPPED_QUERYbenchmark=read_primitives, query=orderby_all_simpleexecution_filterSail treats ORDER BY ALL as an unresolved sort expression.execution_filter.lakesail.read_primitives.orderby_all_simple
SKIPPED_QUERYbenchmark=read_primitives, query=pivot_basicexecution_filterSail parser rejects the PIVOT query form emitted by the catalog.execution_filter.lakesail.read_primitives.pivot_basic
SKIPPED_QUERYbenchmark=read_primitives, query=window_moving_frameexecution_filterSail rejects the interval RANGE window frame with an invalid argument error.execution_filter.lakesail.read_primitives.window_moving_frame
SKIPPED_QUERYbenchmark=tpcdi, query=A1execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.a1
SKIPPED_QUERYbenchmark=tpcdi, query=A2execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.a2
SKIPPED_QUERYbenchmark=tpcdi, query=A3execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.a3
SKIPPED_QUERYbenchmark=tpcdi, query=A5execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.a5
SKIPPED_QUERYbenchmark=tpcdi, query=AQ1execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq1
SKIPPED_QUERYbenchmark=tpcdi, query=AQ10execution_filterSail lacks the JULIANDAY function used by this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq10
SKIPPED_QUERYbenchmark=tpcdi, query=AQ2execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq2
SKIPPED_QUERYbenchmark=tpcdi, query=AQ3execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq3
SKIPPED_QUERYbenchmark=tpcdi, query=AQ4execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq4
SKIPPED_QUERYbenchmark=tpcdi, query=AQ5execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq5
SKIPPED_QUERYbenchmark=tpcdi, query=AQ6execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq6
SKIPPED_QUERYbenchmark=tpcdi, query=AQ7execution_filterSail lacks the JULIANDAY function used by this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq7
SKIPPED_QUERYbenchmark=tpcdi, query=AQ8execution_filterSail lacks the JULIANDAY function used by this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq8
SKIPPED_QUERYbenchmark=tpcdi, query=AQ9execution_filterSail cannot infer a common comparison argument type for this TPC-DI analytical query.execution_filter.lakesail.tpcdi.aq9
SKIPPED_QUERYbenchmark=tpcdi, query=EQ4execution_filterSail cannot infer a common comparison argument type for this TPC-DI ETL query.execution_filter.lakesail.tpcdi.eq4
SKIPPED_QUERYbenchmark=tpcdi, query=EQ5execution_filterSail cannot infer a common comparison argument type for this TPC-DI ETL query.execution_filter.lakesail.tpcdi.eq5
SKIPPED_QUERYbenchmark=tpcdi, query=EQ7execution_filterSail cannot resolve sibling derived-table score aliases in this TPC-DI ETL query.execution_filter.lakesail.tpcdi.eq7
SKIPPED_QUERYbenchmark=tpcdi, query=V1execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.v1
SKIPPED_QUERYbenchmark=tpcdi, query=V2execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.v2
SKIPPED_QUERYbenchmark=tpcdi, query=VQ10execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.vq10
SKIPPED_QUERYbenchmark=tpcdi, query=VQ12execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.vq12
SKIPPED_QUERYbenchmark=tpcdi, query=VQ3execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.vq3
SKIPPED_QUERYbenchmark=tpcdi, query=VQ4execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.vq4
SKIPPED_QUERYbenchmark=tpcdi, query=VQ6execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.vq6
SKIPPED_QUERYbenchmark=tpcdi, query=VQ7execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.vq7
SKIPPED_QUERYbenchmark=tpcdi, query=VQ8execution_filterSail cannot infer a common comparison argument type for this TPC-DI validation query.execution_filter.lakesail.tpcdi.vq8
SKIPPED_QUERYbenchmark=tpchavoc, query=10_v1execution_filterSail planner rejects this correlated scalar subquery placement.execution_filter.lakesail.tpchavoc.10_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=11_v4execution_filterSail physical planning rejects the aggregate expression in this variant shape.execution_filter.lakesail.tpchavoc.11_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=11_v9execution_filterSail planner reports Unsupported predicate type.execution_filter.lakesail.tpchavoc.11_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=12_v1execution_filterSail reports an ambiguous __always_true field for the optimizer-flattening variant.execution_filter.lakesail.tpchavoc.12_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=14_v2execution_filterSail parser rejects the generated empty subquery syntax.execution_filter.lakesail.tpchavoc.14_v2
SKIPPED_QUERYbenchmark=tpchavoc, query=14_v8execution_filterSail physical planning rejects EXISTS in this variant shape.execution_filter.lakesail.tpchavoc.14_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v1execution_filterSail planner rejects this correlated scalar subquery placement.execution_filter.lakesail.tpchavoc.16_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v10execution_filterSail reports duplicate unqualified field names for the DISTINCT CASE variant.execution_filter.lakesail.tpchavoc.16_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=16_v7execution_filterSail reports duplicate unqualified field names for the DISTINCT/FILTER variant.execution_filter.lakesail.tpchavoc.16_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v10execution_filterSail physical planning rejects the scalar subquery expression.execution_filter.lakesail.tpchavoc.17_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v2execution_filterSail reports an ambiguous l_partkey attribute for the variant shape.execution_filter.lakesail.tpchavoc.17_v2
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v4execution_filterSail has no dual table for this scalar-subquery variant.execution_filter.lakesail.tpchavoc.17_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=17_v7execution_filterSail physical planning rejects the scalar subquery expression.execution_filter.lakesail.tpchavoc.17_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterSail rejects the LIST aggregate variant with unknown function: LIST.execution_filter.lakesail.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v8execution_filterSail rejects the named-window variant with named window.execution_filter.lakesail.tpchavoc.1_v8
SKIPPED_QUERYbenchmark=tpchavoc, query=2_v5execution_filterSail reports an ambiguous ps_partkey attribute for the variant shape.execution_filter.lakesail.tpchavoc.2_v5
SKIPPED_QUERYbenchmark=tpchavoc, query=2_v7execution_filterSail rejects the nested MIN window expression as an invalid window function.execution_filter.lakesail.tpchavoc.2_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=3_v1execution_filterSail planner rejects this correlated scalar subquery placement.execution_filter.lakesail.tpchavoc.3_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v10execution_filterSail physical planning rejects EXISTS in this variant shape.execution_filter.lakesail.tpchavoc.4_v10
SKIPPED_QUERYbenchmark=tpchavoc, query=4_v7execution_filterSail physical planning rejects EXISTS in this variant shape.execution_filter.lakesail.tpchavoc.4_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v4execution_filterSail physical planning rejects the aggregate expression in this variant shape.execution_filter.lakesail.tpchavoc.5_v4
SKIPPED_QUERYbenchmark=tpchavoc, query=6_v2execution_filterSail parser rejects the generated empty subquery syntax.execution_filter.lakesail.tpchavoc.6_v2
SKIPPED_QUERYbenchmark=tpchavoc, query=7_v1execution_filterSail loses qualified field names in this variant and cannot resolve l2.l_shipdate.execution_filter.lakesail.tpchavoc.7_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=8_v1execution_filterSail loses projected field names in this variant and cannot resolve the subquery field.execution_filter.lakesail.tpchavoc.8_v1
SKIPPED_QUERYbenchmark=tpchavoc, query=9_v1execution_filterSail loses qualified field names in this variant and cannot resolve n2.n_name.execution_filter.lakesail.tpchavoc.9_v1

pg-duckdb

supportscopephasereasonrule_id
BLOCKEDbenchmark=ai_primitivesbenchmark_gateAI primitives is an LLM/tooling benchmark, not a PostgreSQL-family SQL engine workload. Runs fail before schema creation with argument should be a str or an os.PathLike object on pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.pg-duckdb.ai_primitives.unsupported
BLOCKEDbenchmark=read_primitivesbenchmark_gateRead primitives currently includes a DuckDB-heavy SQL primitive catalog without PostgreSQL-family variants for approximate aggregates, arg_min/arg_max, GROUP BY ALL, ORDER BY ALL, ASOF JOIN, UNPIVOT, struct/map/list intrinsics, and related functions, so runs hit repeated unsupported-function and syntax failures across pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.pg-duckdb.read_primitives.duckdb_intrinsics
BLOCKEDbenchmark=vector_searchbenchmark_gateVector search requires a VECTOR column type and vector-distance operators. Schema creation fails with type "vector" does not exist on pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.pg-duckdb.vector_search.no_vector_type
SKIPPED_QUERYbenchmark=tpchavoc, query=10_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-duckdb.tpchavoc.10_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=11_v9execution_filterPostgreSQL-family engines reject this window expression in WHERE.execution_filter.pg-duckdb.tpchavoc.11_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=13_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-duckdb.tpchavoc.13_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterPostgreSQL-family engines do not provide DuckDB’s LIST() aggregate used by this variant.execution_filter.pg-duckdb.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-duckdb.tpchavoc.5_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=7_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-duckdb.tpchavoc.7_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=9_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-duckdb.tpchavoc.9_v9
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_repeatable_readexecution_filterpg_duckdb rejects non-default transaction isolation changes during operation execution.execution_filter.pg-duckdb.transaction_primitives.transaction_isolation_repeatable_read
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_serializableexecution_filterpg_duckdb rejects non-default transaction isolation changes during operation execution.execution_filter.pg-duckdb.transaction_primitives.transaction_isolation_serializable
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_deep_nestingexecution_filterpg_duckdb routes through DuckDB and reports SAVEPOINT is not supported in DuckDB.execution_filter.pg-duckdb.transaction_primitives.transaction_savepoint_deep_nesting
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_nestedexecution_filterpg_duckdb routes through DuckDB and reports SAVEPOINT is not supported in DuckDB.execution_filter.pg-duckdb.transaction_primitives.transaction_savepoint_nested

pg-mooncake

supportscopephasereasonrule_id
BLOCKEDbenchmark=ai_primitivesbenchmark_gateAI primitives is an LLM/tooling benchmark, not a PostgreSQL-family SQL engine workload. Runs fail before schema creation with argument should be a str or an os.PathLike object on pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.pg-mooncake.ai_primitives.unsupported
BLOCKEDbenchmark=read_primitivesbenchmark_gateRead primitives currently includes a DuckDB-heavy SQL primitive catalog without PostgreSQL-family variants for approximate aggregates, arg_min/arg_max, GROUP BY ALL, ORDER BY ALL, ASOF JOIN, UNPIVOT, struct/map/list intrinsics, and related functions, so runs hit repeated unsupported-function and syntax failures across pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.pg-mooncake.read_primitives.duckdb_intrinsics
BLOCKEDbenchmark=tpcdsbenchmark_gatepg_mooncake loads TPC-DS data, but several queries cannot be planned. Queries 4, 11, 23a, 23b, 74, and 95 fail during PGDuckDB plan creation because mooncake_scan is not registered, and query 90 fails in the same plan path on PostgreSQL-style numeric casts. pg-duckdb and TimescaleDB run the same benchmark, so this is a Mooncake query-planning gap rather than a benchmark loader issue.benchmark_gate.pg-mooncake.tpcds.moonlink_scan_plan_gaps
BLOCKEDbenchmark=transaction_primitivesbenchmark_gatepg_mooncake benchmark tables are promoted to mooncake mirrors for analytical execution, but transaction_primitives requires repeated transactional writes against the TPC-H corpus. Runs fail in the same promotion/write path, including Moonlink duplicate replication registration.benchmark_gate.pg-mooncake.transaction_primitives.moonlink_read_only_mirrors
BLOCKEDbenchmark=vector_searchbenchmark_gateVector search requires a VECTOR column type and vector-distance operators. Schema creation fails with type "vector" does not exist on pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.pg-mooncake.vector_search.no_vector_type
BLOCKEDbenchmark=write_primitivesbenchmark_gatepg_mooncake benchmark tables are promoted to mooncake mirrors for analytical execution, and those mirrors do not support the write_primitives setup/write contract. Even with raised replication sender limits, setup fails with DuckDB does not support modifying Postgres tables.benchmark_gate.pg-mooncake.write_primitives.moonlink_read_only_mirrors
SKIPPED_QUERYbenchmark=tpchavoc, query=10_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-mooncake.tpchavoc.10_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=11_v9execution_filterPostgreSQL-family engines reject this window expression in WHERE.execution_filter.pg-mooncake.tpchavoc.11_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=13_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-mooncake.tpchavoc.13_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterPostgreSQL-family engines do not provide DuckDB’s LIST() aggregate used by this variant.execution_filter.pg-mooncake.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-mooncake.tpchavoc.5_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=7_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-mooncake.tpchavoc.7_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=9_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.pg-mooncake.tpchavoc.9_v9

postgres

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_append_modeexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_append_mode
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_column_subsetexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_column_subset
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_large_bzip2execution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_large_bzip2
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_large_gzipexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_large_gzip
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_large_uncompressedexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_large_uncompressed
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_large_zstdexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_large_zstd
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_medium_bzip2execution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_medium_bzip2
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_medium_gzipexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_medium_gzip
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_medium_uncompressedexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_medium_uncompressed
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_medium_zstdexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_medium_zstd
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_small_bzip2execution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_small_bzip2
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_small_gzipexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_small_gzip
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_small_uncompressedexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_small_uncompressed
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_csv_small_zstdexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_csv_small_zstd
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_date_format_customexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_date_format_custom
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_delimited_customexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_delimited_custom
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_encoding_utf8execution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_encoding_utf8
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_error_handling_skip_bad_rowsexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_error_handling_skip_bad_rows
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_null_handlingexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_null_handling
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parallel_multi_fileexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parallel_multi_file
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_large_gzipexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_large_gzip
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_large_snappyexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_large_snappy
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_large_uncompressedexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_large_uncompressed
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_large_zstdexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_large_zstd
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_medium_gzipexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_medium_gzip
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_medium_snappyexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_medium_snappy
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_medium_uncompressedexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_medium_uncompressed
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_medium_zstdexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_medium_zstd
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_small_gzipexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_small_gzip
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_small_snappyexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_small_snappy
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_small_uncompressedexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_small_uncompressed
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_parquet_small_zstdexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_parquet_small_zstd
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_quoted_fieldsexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_quoted_fields
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_replace_modeexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_replace_mode
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_upsert_modeexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_upsert_mode
SKIPPED_QUERYbenchmark=write_primitives, query=bulk_load_with_transformationexecution_filterPostgreSQL-family operation execution cannot run the catalog’s server-side file COPY/read_csv path.execution_filter.postgres.write_primitives.bulk_load_with_transformation
SKIPPED_QUERYbenchmark=write_primitives, query=merge_conditional_updateexecution_filterPostgreSQL MERGE requires an explicit INSERT VALUES clause; the catalog uses DuckDB shorthand.execution_filter.postgres.write_primitives.merge_conditional_update
SKIPPED_QUERYbenchmark=write_primitives, query=merge_error_handlingexecution_filterPostgreSQL MERGE requires an explicit INSERT VALUES clause; the catalog uses DuckDB shorthand.execution_filter.postgres.write_primitives.merge_error_handling
SKIPPED_QUERYbenchmark=write_primitives, query=merge_no_overlap_all_insertexecution_filterPostgreSQL MERGE requires an explicit INSERT VALUES clause; the catalog uses DuckDB shorthand.execution_filter.postgres.write_primitives.merge_no_overlap_all_insert
SKIPPED_QUERYbenchmark=write_primitives, query=merge_overlap_10pctexecution_filterPostgreSQL MERGE requires an explicit INSERT VALUES clause; the catalog uses DuckDB shorthand.execution_filter.postgres.write_primitives.merge_overlap_10pct
SKIPPED_QUERYbenchmark=write_primitives, query=merge_overlap_50pctexecution_filterPostgreSQL MERGE requires an explicit INSERT VALUES clause; the catalog uses DuckDB shorthand.execution_filter.postgres.write_primitives.merge_overlap_50pct
SKIPPED_QUERYbenchmark=write_primitives, query=merge_overlap_90pctexecution_filterPostgreSQL MERGE requires an explicit INSERT VALUES clause; the catalog uses DuckDB shorthand.execution_filter.postgres.write_primitives.merge_overlap_90pct
SKIPPED_QUERYbenchmark=write_primitives, query=merge_returning_clauseexecution_filterpg_duckdb rejects the catalog’s MERGE RETURNING form.execution_filter.postgres.write_primitives.merge_returning_clause
SKIPPED_QUERYbenchmark=write_primitives, query=merge_simple_upsert_smallexecution_filterPostgreSQL MERGE requires an explicit INSERT VALUES clause; the catalog uses DuckDB shorthand.execution_filter.postgres.write_primitives.merge_simple_upsert_small
SKIPPED_QUERYbenchmark=write_primitives, query=merge_upsert_with_deleteexecution_filterPostgreSQL MERGE does not support the catalog’s NOT MATCHED BY SOURCE form.execution_filter.postgres.write_primitives.merge_upsert_with_delete
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_cpc_create_persistent_tableexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_cpc_create_persistent_table
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_cpc_drop_persistent_tableexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_cpc_drop_persistent_table
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_cpc_insert_per_partitionexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_cpc_insert_per_partition
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_cpc_query_union_mergeexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_cpc_query_union_merge
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_ddl_create_persistent_tableexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_ddl_create_persistent_table
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_drop_persistent_tableexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_drop_persistent_table
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_insert_kll_per_partitionexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_insert_kll_per_partition
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_insert_theta_per_partitionexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_insert_theta_per_partition
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_insert_topk_per_shardexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_insert_topk_per_shard
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_kll_quantiles_mergeexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_kll_quantiles_merge
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_kll_quantiles_merge_k100execution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_kll_quantiles_merge_k100
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_kll_quantiles_merge_k1000execution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_kll_quantiles_merge_k1000
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_theta_union_mergeexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_theta_union_merge
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_theta_union_merge_lgk10execution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_theta_union_merge_lgk10
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_theta_union_merge_lgk14execution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_theta_union_merge_lgk14
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_topk_combineexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_topk_combine
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_topk_combine_lgmm10execution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_topk_combine_lgmm10
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_query_topk_combine_lgmm8execution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_query_topk_combine_lgmm8
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_req_create_persistent_tableexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_req_create_persistent_table
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_req_drop_persistent_tableexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_req_drop_persistent_table
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_req_insert_per_partitionexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_req_insert_per_partition
SKIPPED_QUERYbenchmark=write_primitives, query=sketch_req_query_quantile_mergeexecution_filterPostgreSQL-family engines do not expose DuckDB DataSketches INSTALL/LOAD SQL.execution_filter.postgres.write_primitives.sketch_req_query_quantile_merge

questdb

supportscopephasereasonrule_id
BLOCKEDbenchmark=vector_searchbenchmark_gateQuestDB 9.3.4 has no VECTOR column type. Schema creation fails immediately. No fix planned: requires QuestDB to add native vector support.benchmark_gate.questdb.vector_search.unsupported

snowflake

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterSnowflake does not support DuckDB LIST aggregates and LIST lambda functions in this variant.execution_filter.snowflake.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=2_v2execution_filterSnowflake rejects the correlated scalar subquery in this grouped variant.execution_filter.snowflake.tpchavoc.2_v2
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_read_committedexecution_filterSnowflake rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.snowflake.transaction_primitives.transaction_isolation_read_committed
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_repeatable_readexecution_filterSnowflake rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.snowflake.transaction_primitives.transaction_isolation_repeatable_read
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_serializableexecution_filterSnowflake rejects SET TRANSACTION ISOLATION LEVEL.execution_filter.snowflake.transaction_primitives.transaction_isolation_serializable
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_deep_nestingexecution_filterSnowflake has no SAVEPOINT statement.execution_filter.snowflake.transaction_primitives.transaction_savepoint_deep_nesting
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_savepoint_nestedexecution_filterSnowflake has no SAVEPOINT statement.execution_filter.snowflake.transaction_primitives.transaction_savepoint_nested

starrocks

supportscopephasereasonrule_id
SKIPPED_QUERYbenchmark=vector_search, query=Q2query_sourceStarRocks <3.2 does not support l2_distance - skip Q2 rather than fail at runtimequery_source.starrocks.vector_search.q2_lt_32_skip

timescaledb

supportscopephasereasonrule_id
BLOCKEDbenchmark=ai_primitivesbenchmark_gateAI primitives is an LLM/tooling benchmark, not a PostgreSQL-family SQL engine workload. Runs fail before schema creation with argument should be a str or an os.PathLike object on pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.timescaledb.ai_primitives.unsupported
BLOCKEDbenchmark=read_primitivesbenchmark_gateRead primitives currently includes a DuckDB-heavy SQL primitive catalog without PostgreSQL-family variants for approximate aggregates, arg_min/arg_max, GROUP BY ALL, ORDER BY ALL, ASOF JOIN, UNPIVOT, struct/map/list intrinsics, and related functions, so runs hit repeated unsupported-function and syntax failures across pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.timescaledb.read_primitives.duckdb_intrinsics
BLOCKEDbenchmark=vector_searchbenchmark_gateVector search requires a VECTOR column type and vector-distance operators. Schema creation fails with type "vector" does not exist on pg-duckdb, pg-mooncake, and TimescaleDB.benchmark_gate.timescaledb.vector_search.no_vector_type
SKIPPED_QUERYbenchmark=tpchavoc, query=10_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.timescaledb.tpchavoc.10_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=11_v9execution_filterPostgreSQL-family engines reject this window expression in WHERE.execution_filter.timescaledb.tpchavoc.11_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=13_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.timescaledb.tpchavoc.13_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=1_v7execution_filterPostgreSQL-family engines do not provide DuckDB’s LIST() aggregate used by this variant.execution_filter.timescaledb.tpchavoc.1_v7
SKIPPED_QUERYbenchmark=tpchavoc, query=5_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.timescaledb.tpchavoc.5_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=7_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.timescaledb.tpchavoc.7_v9
SKIPPED_QUERYbenchmark=tpchavoc, query=9_v9execution_filterPostgreSQL-family engines reject aggregate expressions inside window definitions.execution_filter.timescaledb.tpchavoc.9_v9
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_repeatable_readexecution_filterTimescaleDB rejects non-default transaction isolation changes once the benchmark operation wrapper has already executed statements on the connection.execution_filter.timescaledb.transaction_primitives.transaction_isolation_repeatable_read
SKIPPED_QUERYbenchmark=transaction_primitives, query=transaction_isolation_serializableexecution_filterTimescaleDB rejects non-default transaction isolation changes once the benchmark operation wrapper has already executed statements on the connection.execution_filter.timescaledb.transaction_primitives.transaction_isolation_serializable

Runs with caveats

Benchmarks that run end-to-end but with documented internal gaps - either an auxiliary DDL statement is suppressed (SKIPPED_DDL_FRAGMENT) or a platform-level semantic guarantee is not enforced (INFORMATIONAL). Result counts are not affected; the caveat is noted for audit purposes.

bigquery

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on bigquery - lock table bypass required to prevent concurrent double-populationschema_emit.bigquery.transaction_primitives.pk_not_enforced
INFORMATIONALbenchmark=write_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on bigquery - lock table bypass required to prevent concurrent double-populationschema_emit.bigquery.write_primitives.pk_not_enforced

databricks

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on databricks - lock table bypass required to prevent concurrent double-populationschema_emit.databricks.transaction_primitives.pk_not_enforced
INFORMATIONALbenchmark=write_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on databricks - lock table bypass required to prevent concurrent double-populationschema_emit.databricks.write_primitives.pk_not_enforced

datafusion

supportscopephasereasonrule_id
SKIPPED_DDL_FRAGMENTbenchmark=transaction_primitivesschema_emitDataFusion does not support PRIMARY KEY syntax; skip lock table DDLschema_emit.datafusion.transaction_primitives.pk_lock_table_unsupported
SKIPPED_DDL_FRAGMENTbenchmark=write_primitivesschema_emitDataFusion does not support PRIMARY KEY syntax; skip lock table DDLschema_emit.datafusion.write_primitives.pk_lock_table_unsupported

doris

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitDoris does not enforce standard SQL PRIMARY KEY uniqueness; skip lock table DDLschema_emit.doris.transaction_primitives.pk_lock_table_unsupported
INFORMATIONALbenchmark=write_primitivesschema_emitDoris does not enforce standard SQL PRIMARY KEY uniqueness; skip lock table DDLschema_emit.doris.write_primitives.pk_lock_table_unsupported

ducklake

supportscopephasereasonrule_id
SKIPPED_DDL_FRAGMENTbenchmark=transaction_primitivesschema_emitDuckLake rejects PRIMARY KEY syntax; skip lock table DDL and omit PK clausesschema_emit.ducklake.transaction_primitives.pk_lock_table_unsupported
SKIPPED_DDL_FRAGMENTbenchmark=write_primitivesschema_emitDuckLake rejects PRIMARY KEY syntax; skip lock table DDL and omit PK clausesschema_emit.ducklake.write_primitives.pk_lock_table_unsupported

presto

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on presto - lock table bypass required to prevent concurrent double-populationschema_emit.presto.transaction_primitives.pk_not_enforced
INFORMATIONALbenchmark=write_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on presto - lock table bypass required to prevent concurrent double-populationschema_emit.presto.write_primitives.pk_not_enforced

redshift

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on redshift - lock table bypass required to prevent concurrent double-populationschema_emit.redshift.transaction_primitives.pk_not_enforced
INFORMATIONALbenchmark=write_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on redshift - lock table bypass required to prevent concurrent double-populationschema_emit.redshift.write_primitives.pk_not_enforced

snowflake

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on snowflake - lock table bypass required to prevent concurrent double-populationschema_emit.snowflake.transaction_primitives.pk_not_enforced
INFORMATIONALbenchmark=write_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on snowflake - lock table bypass required to prevent concurrent double-populationschema_emit.snowflake.write_primitives.pk_not_enforced

spark

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on spark - lock table bypass required to prevent concurrent double-populationschema_emit.spark.transaction_primitives.pk_not_enforced
INFORMATIONALbenchmark=write_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on spark - lock table bypass required to prevent concurrent double-populationschema_emit.spark.write_primitives.pk_not_enforced

starrocks

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitStarRocks accepts PRIMARY KEY DDL but does not enforce uniqueness; skip lock table DDLschema_emit.starrocks.transaction_primitives.pk_lock_table_unsupported
INFORMATIONALbenchmark=write_primitivesschema_emitStarRocks accepts PRIMARY KEY DDL but does not enforce uniqueness; skip lock table DDLschema_emit.starrocks.write_primitives.pk_lock_table_unsupported

trino

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on trino - lock table bypass required to prevent concurrent double-populationschema_emit.trino.transaction_primitives.pk_not_enforced
INFORMATIONALbenchmark=write_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on trino - lock table bypass required to prevent concurrent double-populationschema_emit.trino.write_primitives.pk_not_enforced

tsql

supportscopephasereasonrule_id
INFORMATIONALbenchmark=transaction_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on tsql - lock table bypass required to prevent concurrent double-populationschema_emit.tsql.transaction_primitives.pk_not_enforced
INFORMATIONALbenchmark=write_primitivesschema_emitWorkload runs; PRIMARY KEY uniqueness is not enforced on tsql - lock table bypass required to prevent concurrent double-populationschema_emit.tsql.write_primitives.pk_not_enforced

BenchBox is open source under the MIT License.