Skip to content

API Reference

This page lists the benchmark classes and the import path to use for each. For detailed API documentation, see Python API Reference.

Each benchmark class takes scale_factor and output_dir and inherits from BaseBenchmark; see Base Benchmark API for the methods they share. The canonical import is the one exported from the top-level benchbox package. The module import in the third column returns the same object.

BenchmarkCanonical importModule importContract
AMPLab Big Datafrom benchbox import AMPLabfrom benchbox.amplab import AMPLabAMPLab Big Data Benchmark API
Base classfrom benchbox import BaseBenchmarkfrom benchbox.base import BaseBenchmarkBase Benchmark API
ClickBenchfrom benchbox import ClickBenchfrom benchbox.clickbench import ClickBenchClickBench Benchmark API
CoffeeShopfrom benchbox import CoffeeShopfrom benchbox.coffeeshop import CoffeeShopCoffeeShop Benchmark API
Data Vaultfrom benchbox import DataVaultfrom benchbox.datavault import DataVaultData Vault Benchmark API
Flight Datafrom benchbox import FlightDatafrom benchbox.flightdata import FlightDataFlightData Benchmark API
H2O.ai database benchmarkfrom benchbox import H2ODBfrom benchbox.h2odb import H2ODBH2O.ai Database Benchmark API
Join Orderfrom benchbox import JoinOrderfrom benchbox.joinorder import JoinOrderJoin Order Benchmark API
Metadata Primitivesfrom benchbox import MetadataPrimitivesfrom benchbox.metadata_primitives import MetadataPrimitivesMetadataPrimitives Benchmark API
NYC Taxifrom benchbox import NYCTaxifrom benchbox.nyctaxi import NYCTaxiNYCTaxi Benchmark API
Read Primitivesfrom benchbox import ReadPrimitivesfrom benchbox.read_primitives import ReadPrimitivesRead Primitives Benchmark API
Star Schema Benchmarkfrom benchbox import SSBfrom benchbox.ssb import SSBSSB (Star Schema Benchmark) API
TPC-DIfrom benchbox import TPCDIfrom benchbox.tpcdi import TPCDITPC-DI Benchmark API
TPC-DSfrom benchbox import TPCDSfrom benchbox.tpcds import TPCDSTPC-DS Benchmark API
TPC-DS One Big Tablefrom benchbox import TPCDSOBTfrom benchbox.tpcds_obt import TPCDSOBTTPCDSOBT Benchmark API
TPC-Hfrom benchbox import TPCHfrom benchbox.tpch import TPCHTPC-H Benchmark API
TPC-Havocfrom benchbox import TPCHavocfrom benchbox.tpchavoc import TPCHavocTPC-Havoc API
TPC-H Skewfrom benchbox import TPCHSkewfrom benchbox.tpch_skew import TPCHSkewTPC-H Skew API
Transaction Primitivesfrom benchbox import TransactionPrimitivesfrom benchbox.transaction_primitives import TransactionPrimitivesTransaction Primitives API
TSBS DevOpsfrom benchbox import TSBSDevOpsfrom benchbox.tsbs_devops import TSBSDevOpsTSBS DevOps API
Vector Searchfrom benchbox import VectorSearchfrom benchbox.vector_search import VectorSearchVector Search API
Write Primitivesfrom benchbox import WritePrimitivesfrom benchbox.write_primitives import WritePrimitivesWrite Primitives Benchmark API

TPC-DI needs the tpcdi extra (pip install "benchbox[tpcdi]").