TPC-R
Overview of TPC-R based test
The TPC Benchmark™R (TPC-R) is a decision support benchmark, but which allows additional optimizations based on advanced knowledge of the queries. It consists of a suite of business-oriented queries.
Now TPC-R is marked as obsolete at tpc.org, but we thought it is still looked pretty useful for our goals. TPC-R contains the kinds of “heavy queries” which are hard for optimizers.
Our test is not TPC-R test, but it is based on TPC-R: we use similar database structure, scripts and tools.
We use TPC-R based test to check optimizer workings and the performance of access methods in all new versions of InterBase and Firebird. The goal is to check that new versions will be at least not worse than the old.
Also TPC-R based test generates high load to a system and can be considered useful as a stability test. In fact, the test based on TPC-R for InterBase or Firebird contains a database creation script, a tool for populating the test database and 22 scripts. We measure execution time of these queries and consider the query plans generated for them.
