Skip to content

Add BigQuery SpatialBench benchmark run#121

Draft
paleolimbot wants to merge 3 commits into
apache:mainfrom
paleolimbot:bigquery-runs
Draft

Add BigQuery SpatialBench benchmark run#121
paleolimbot wants to merge 3 commits into
apache:mainfrom
paleolimbot:bigquery-runs

Conversation

@paleolimbot

Copy link
Copy Markdown
Member

This is a work in progress, but thought this would be a productive place to put this while I work out the details.

The gist of this is that BigQuery has a mature and fully featured Geography implementation that is a good comparison for newer ones (like SedonaDB and Sedona Spark).

@paleolimbot

Copy link
Copy Markdown
Member Author

@jiayuasu kindly reminded me that we don't put the cloud vendor versions here because they need credentials/money to run (and so there's no way for CI to validate that the code added here will actually run!).

For completeness, I'll put the scale factor 1 results here...as one might imagine, the per-query overhead is high but it does at least complete most of the queries.

============================================================
Running Bigquery Benchmark
============================================================
Bigquery version: 3.42.1
  Pre-loading tables to BigQuery (scale factor: 1)...
  Table loading complete: 63.818s total
    building_sf1: 4.96s (external: 1.632s, internal: 3.328s)
    customer_sf1: 4.383s (external: 1.502s, internal: 2.881s)
    driver_sf1: 6.459s (external: 1.246s, internal: 5.213s)
    trip_sf1: 10.9s (external: 1.641s, internal: 9.259s)
    vehicle_sf1: 4.216s (external: 1.36s, internal: 2.856s)
    zone_sf1: 32.9s (external: 1.262s, internal: 31.638s)

Results saved to bigquery_sf1_results.json
  Running q1... 1.79s (114 rows)

Results saved to bigquery_sf1_results.json
  Running q2... 2.78s (1 rows)

Results saved to bigquery_sf1_results.json
  Running q3... 2.71s (22 rows)

Results saved to bigquery_sf1_results.json
  Running q4... 163.18s (258 rows)

Results saved to bigquery_sf1_results.json
  Running q5... 10.49s (316691 rows)

Results saved to bigquery_sf1_results.json
  Running q6... 171.93s (3 rows)

Results saved to bigquery_sf1_results.json
  Running q7... 15.95s (6000000 rows)

Results saved to bigquery_sf1_results.json
  Running q8... 4.46s (415 rows)

Results saved to bigquery_sf1_results.json
  Running q9... 2.03s (37 rows)

Results saved to bigquery_sf1_results.json
  Running q10... TIMEOUT: Query q10 timed out after 600 seconds (process killed)

Results saved to bigquery_sf1_results.json
  Running q11... 312.18s (1 rows)

Results saved to bigquery_sf1_results.json
  Running q12... TIMEOUT: Query q12 timed out after 600 seconds (process killed)

Results saved to bigquery_sf1_results.json

================================================================================
BENCHMARK SUMMARY
================================================================================
Query     bigquery       
-------------------------
q1        1.79s          
q2        2.78s          
q3        2.71s          
q4        163.18s        
q5        10.49s         
q6        171.93s        
q7        15.95s         
q8        4.46s          
q9        2.03s          
q10       TIMEOUT        
q11       312.18s        
q12       TIMEOUT        
-------------------------
Total     687.50s         
Load Time 63.82s         
Combined  751.32s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant