Test database performance with Profile-Guided Optimization (PGO)

[zamazan4ik]

Hi!

Recently I did some benchmarks of applying Profile-Guided Optimization (PGO) on different databases - link. I think the most interesting results for you are the results from RocksDB (link) and SQLite (link).

I guess the same approach could be beneficial for ReDB as well. Would be great to see the results!

[cberner]

Neat. Seems like it gives a ~10% improvement on some benchmarks.

PGO:
redb: Bulk loaded 1000000 items in 2209ms
redb: Wrote 100 individual items in 226ms
redb: Wrote 100 x 1000 items in 2254ms
redb: Random read 1000000 items in 939ms
redb: Random read 1000000 items in 857ms
redb: Random range read 10000000 elements in 2315ms
redb: Random range read 10000000 elements in 2319ms
redb: Random read (4 threads) 1000000 items in 319ms
redb: Random read (8 threads) 1000000 items in 185ms
redb: Random read (16 threads) 1000000 items in 130ms
redb: Random read (32 threads) 1000000 items in 114ms
redb: Removed 500000 items in 1620ms

non-PGO:
redb: Bulk loaded 1000000 items in 2394ms
redb: Wrote 100 individual items in 224ms
redb: Wrote 100 x 1000 items in 2173ms
redb: Random read 1000000 items in 1010ms
redb: Random read 1000000 items in 922ms
redb: Random range read 10000000 elements in 2445ms
redb: Random range read 10000000 elements in 2429ms
redb: Random read (4 threads) 1000000 items in 332ms
redb: Random read (8 threads) 1000000 items in 188ms
redb: Random read (16 threads) 1000000 items in 129ms
redb: Random read (32 threads) 1000000 items in 110ms
redb: Removed 500000 items in 1750ms

[zamazan4ik]

@cberner Since PGO helps to achieve better performance with ReDB, can we write a note somewhere in the documentation about PGO and its impact on ReDB? In this case, the users will be aware of the additional way to improve ReDB performance for their use cases. Probably a note in the README file would be fine.

Here are the examples from other projects:

• ClickHouse: https://clickhouse.com/docs/en/operations/optimizing-performance/profile-guided-optimization
• Databend: https://databend.rs/doc/contributing/pgo
• Vector: https://vector.dev/docs/administration/tuning/pgo/
• Nebula: https://docs.nebula-graph.io/3.5.0/8.service-tuning/enable_autofdo_for_nebulagraph/
• GCC: Official docs, section "Building with profile feedback" (even AutoFDO build is supported)
• Clang:
  • https://llvm.org/docs/HowToBuildWithPGO.html
  • https://llvm.org/docs/AdvancedBuilds.html