Hi, As for the resources used by Orion Context Broker I got this. If it’s too long to read, it is basically saying that Orion can handle around 1500 transactions per second when run in this particular machine. Regards, Leandro Scenario User impact Vs CB Behaivour Sistem Under Test Type Virtual OPs Base How affects the use of serveral users at the same time to the Time response and the TPS avg. Total Threads = XML threads + JSON threads Orion BIG (XXL) (NO) CPU 16 Cores MEM 16 GB Append + Update + Query Comment: The Average Throughput is similar to lastest version (0.10.1). In this case, we add a append request and we add validations by status code and the response body in all requests (append, update and query) Test exec ~/test/apache-jmeter-2.11/bin/jmeter.sh -n -t ~/JMXs/orionPerfTest_v1.2.jmx -p ~/test/jmeter.prop -JPROJECT="Scenarios_0.11.0" -JTEST_NAME="HILOS" -JHOST=10.95.20.2 -JPORT=1026 -JHILOS=???? -JITERATIONS=1 -JRAMPUP=50 -JRUNTIME=180 Threads Metrics Results without verbose logs Latest Version Comments Results with verbose logs Lastest Version 1 Average Response Time, ms: 1 1 Maximum Response Time, ms: 104 96 Average Throughput (TPS): 1323.17 1329.87 Average Virtual Users: 1.98895 1.98895 Max Virtual Users: 2 2 Url: https://loadosophia.org/gui/125418 <https://loadosophia.org/gui/125418> 5 Average Response Time, ms: 5 5 Maximum Response Time, ms: 105 105 Average Throughput (TPS): 1452.97 1477.12 Average Virtual Users: 8.19545 8.1448 Max Virtual Users: 10 10 Url: https://loadosophia.org/gui/125420 <https://loadosophia.org/gui/125420> 50 Average Response Time, ms: 54 52 Maximum Response Time, ms: 286 318 Average Throughput (TPS): 1452.47 1506.84 Average Virtual Users: 78.2609 78.655 Max Virtual Users: 100 100 Url: https://loadosophia.org/gui/125426 <https://loadosophia.org/gui/125426> 250 Average Response Time, ms: 256 244 Maximum Response Time, ms: 1706 1308 Average Throughput (TPS): 1452.37 1514.26 Average Virtual Users: 389.931 389.81 Max Virtual Users: 500 500 Url: https://loadosophia.org/gui/125428 <https://loadosophia.org/gui/125428> 500 Average Response Time, ms: 547 519 500 - Recheck with verbose logs 1416 Maximum Response Time, ms: 2816 2643 6169 Average Throughput (TPS): 1402.55 1511.81 635.641 Average Virtual Users: 777.474 776.612 779.444 Max Virtual Users: 1000 1000 1006 Url: https://loadosophia.org/gui/125460 <https://loadosophia.org/gui/125460> https://loadosophia.org/gui/125773 <https://loadosophia.org/gui/125773> 750 Average Response Time, ms: 830 Error rate: 0.38% Caused by: java.net.ConnectException: Connection timed out See in Extra 1 page "Aggregate Report for 750 Threads" 750 - Recheck with verbose logs 1718 Maximum Response Time, ms: 146957 148008 Average Throughput (TPS): 1458.46 664.524 Average Virtual Users: 1234.48 1230.91 Max Virtual Users: 1734 1721 Url: https://loadosophia.org/gui/125768 <https://loadosophia.org/gui/125768> https://loadosophia.org/gui/125777 <https://loadosophia.org/gui/125777> 1000 Average Response Time, ms: 1040 1042 Error rate: 0.73% Caused by: java.net.ConnectException: Connection timed out See in Extra 1 page "Aggregate Report for 1000 Threads" 1000 - Recheck with verbose logs 2463 Maximum Response Time, ms: 155109 155261 156280 Average Throughput (TPS): 1551.09 1678.95 649.606 Average Virtual Users: 1586.16 1794.97 1691.05 Max Virtual Users: 2467 2475 2465 Url: https://loadosophia.org/gui/125467 <https://loadosophia.org/gui/125467> https://loadosophia.org/gui/125778 <https://loadosophia.org/gui/125778> 1500 Average Response Time, ms: 1633 1574 Error rate: 1.63% Caused by: java.net.ConnectException: Connection timed out See in Extra 1 page "Aggregate Report for 1500 Threads" 1500 - Recheck with verbose logs 3142 3177 Maximum Response Time, ms: 163372 162967 164486 164091 Average Throughput (TPS): 1504.44 1710.55 736.204 812.517 Average Virtual Users: 2529.98 2792.82 2516.73 2781.36 Max Virtual Users: 3926 3940 3928 3941 Url: https://loadosophia.org/gui/125729 <https://loadosophia.org/gui/125729> https://loadosophia.org/gui/125744 <https://loadosophia.org/gui/125744> 2000 Average Response Time, ms: Error rate: 42.33% Caused by: java.net.ConnectException: Connection timed out See in Extra 1 page "Aggregate Report for 2000 Threads" Max Used: CPU 21% and MEM 8Gb 2000 - Recheck with verbose logs Maximum Response Time, ms: Average Throughput (TPS): Average Virtual Users: Max Virtual Users: Url: https://loadosophia.org/gui/125753 <https://loadosophia.org/gui/125753> https://loadosophia.org/gui/125784 <https://loadosophia.org/gui/125784> 3000 Average Response Time, ms: Maximum Response Time, ms: Average Throughput (TPS): 0 Average Virtual Users: Max Virtual Users: Url: 5000 Average Response Time, ms: Maximum Response Time, ms: Average Throughput (TPS): Average Virtual Users: Max Virtual Users: Url: > El 20/2/2015, a las 20:05, Franck Le Gall <franck.le-gall at eglobalmark.com> escribió: > > Hello > > 2 questions (sorry for spamming these days but I try to spend at least 15 min with all og the 80 FICHE SME preparing for their phase 2 evaluation… I answer majority of questions but some remain mystery for me): > > * Are you aware of any benchmark regarding the use of memory and computing resources by the Orion Pub/Sub Broker and Proteus ? > * Do we have any measure of the reliability of the security framework ? > > > Thank you > Franck > _______________________________________________ > Fiware-coaches mailing list > Fiware-coaches at lists.fi-ware.org <mailto:Fiware-coaches at lists.fi-ware.org> > https://lists.fi-ware.org/listinfo/fiware-coaches <https://lists.fi-ware.org/listinfo/fiware-coaches> -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://lists.fiware.org/private/fiware-coaches/attachments/20150302/9a828efc/attachment.html>
You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy Cookies policy