Skip to content

Add TPC-H SF10 benchmark scripts - #2

Open
rampage644 wants to merge 2 commits into
mainfrom
rampage644/tpch-sf10-benchmark
Open

Add TPC-H SF10 benchmark scripts#2
rampage644 wants to merge 2 commits into
mainfrom
rampage644/tpch-sf10-benchmark

Conversation

@rampage644

Copy link
Copy Markdown
Contributor

Summary

  • Adds scripts to load all 8 TPC-H SF10 tables from s3://embucket-testdata/tpch/10/ (parquet) and run all 22 standard TPC-H queries against Embucket Lambda, reporting per-query timing and row counts.
  • All 22 queries pass on a 10 GB Lambda (total ~154s). Q18 uses a CTE rewrite to avoid OOM on the large lineitem self-join.

Test plan

  • Verified 22/22 queries pass on embucket-demo-ramp-1775514830 stack with 10 GB Lambda

🤖 Generated with Claude Code

rampage644 and others added 2 commits April 6, 2026 20:30
Add scripts to load TPC-H SF10 data from S3 and run all 22 standard
TPC-H queries against Embucket Lambda, reporting timing and row counts.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Rewrite the query runner to use `dbt show --inline` instead of direct
Lambda invocation. Handles LIMIT extraction to avoid conflicts with
dbt's own query wrapping.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant