We recently added support for running the dbt2 benchmark as part of our drizzle automation suite. dbt2 is an OLTP transactional performance test. It simulates a wholesale parts supplier where several workers access a database, update customer information and check on parts inventories. We currently are using the defaults (10 warehouses, 5 minute test runs and running various number of connections for each run up to 1024. The initial runs exposed a race condition in our TemporalFormat::match() code at 1024 connections.
We now have a very nice suite of tools to help us with tracking performance and scalability of Drizzle, besides dbt2 we also are running sysbench, sqlbench, crash-me and randgen for all of our builds in the staging branch of Drizzle. Of course we are always looking for more, so if you have any suggestions on other benchmarks or tools to add, please let us know.
If you want to receive all of the various benchmark results you can subscribe to the mailing list.
Note also we are in the process of getting our changes to dbt2 merged to the dbt2 trunk, it should be there very soon.
Happy New Year to all!
-Lee