[Miwi-middleware] Benchmark branch

[Dmitri Rubinstein]

Hi, I would like to describe the tools in the benchmark branch since we 
had no time to discuss this yesterday.

Tools, result logs and test source code are in the directory:

kiara/src/benchmarks

mnb - Unmodified boost tests from MNB paper: 
http://mnb.ociweb.com/mnb/MiddlewareNewsBrief-201004.html

mnb2 - Slightly modified tests from MNB paper. Data structure was 
changed due to current limitations of KIARA.

ThriftTest - Benchmark for Thrift. Same data structures as in mnb2.

IceTest - Benchmark for Ice. Same data structures as in mnb2.

kiara - Benchmark for KIARA. Same data structures as in mnb2.

kiara2 - Simplified benchmark for KIARA, a single 32-bit integer is 
sent. This is not a part of a benchmark table.

benchmarks.ods - Table with benchmark results that we presented.

tools - Tools for running localhost benchmarks from MNB paper. Copied 
from source code provided with MNB paper.

run_benchmarks.sh - Tool for running benchmarks. It will work on Windows 
and Linux when executed in activated devenv environment.
Note: It assumes that ICE is installed on Windows in c:\Program Files 
(x86)\ZeroC\Ice-3.5.1.
Also it assumes that on Linux local installation is in ~/local-install.

1. Building benchmark programs

Only boost benchmarks are built automatically when you build KIARA (de 
build kiara). IceTest and ThriftTest must be built manually since I had 
no time to integrate ICE and Thrift into devenv.

First build or install Ice 3.5.1 and Thrift 0.9.1. When you install 
locally on Linux please use --prefix=$HOME/local-install option for 
configure.

Building Thrift on Windows: 
http://technicaltidbit.blogspot.de/2012/12/apache-thrift-in-windows.html 
(Please build Thrift 0.9.1 !)

Finally build IceTest and ThriftTest.

On Linux run scons in IceTest / ThriftTest subdirectory.

For Windows / Visual Studio 2010 I created Project files. You need to 
modify properties and setup correct search paths. Note that projects are 
only configured to build for Release / x64 configuration.

2. Running benchmarks

For benchmarking on localhost (loopback device) just run
run_benchmarks.sh tool. For testing in the network you need to run 
separately client and server. See examples in the log files:

Linux: currywurst_to_bratwurst_network_benchmark.txt
Windows: hurricane_to_uragan_network_benchmark.txt

Don't hesitate to ask me when something is not clear.

Best,

Dmitri