From franck.le-gall at eglobalmark.com Thu Apr 2 16:58:58 2015 From: franck.le-gall at eglobalmark.com (Franck Le Gall) Date: Thu, 2 Apr 2015 14:58:58 +0000 Subject: [Fiware-fic3-coaching] Fi-ware Keyrock : Security point. In-Reply-To: References: Message-ID: De : J?r?my Harris Envoy? : mardi 24 mars 2015 09:57 ? : Franck Le Gall; thomas.van.der.auwermeulen at vub.ac.be; vincent LEROY Objet : Fi-ware Keyrock : Security point. Dear Mr. Le Gall, I'm Jeremy Harris, working for Neveo which is supported by Fi-C3. You were recommended by Thomas Van Der Auwermeulen to help with our issue. We currently have an issue with the Keyrock integration. In short, we noticed that install Keyrock on our server present some security risk. I add an attachment file with the detail of the problem. There is a problem with KeyRock Identity Management framework from Fi-Ware. KeyRock uses quite outdated versions of Ruby programming language (1.9.3), and Ruby on Rails framework (3.2.14). Both of those have a pretty big list of known security vulnerabilities: 1. http://www.cvedetails.com/vulnerability-list/vendor_id-7252/product_id-12215/version_id-136531/Ruby-lang-Ruby-1.9.3.html 2. http://www.cvedetails.com/vulnerability-list/vendor_id-12043/product_id-22568/version_id-153894/Rubyonrails-Ruby-On-Rails-3.2.14.html At the same time, i'm contacting other Keyrock specialist (only 2 found on the internet) to get more information. Best Regards, -------------- next part -------------- An HTML attachment was scrubbed... URL: From franck.le-gall at eglobalmark.com Thu Apr 2 17:00:25 2015 From: franck.le-gall at eglobalmark.com (Franck Le Gall) Date: Thu, 2 Apr 2015 15:00:25 +0000 Subject: [Fiware-fic3-coaching] Fi-ware Keyrock : Security point. In-Reply-To: References: Message-ID: <870e706180a242cab3ab10a092150a39@winhexbeeu17.win.mail> Hello, Answer we got from Joaqu?n Salvach?a is that they are going to deploy in the next weeks a new versi?n based on Python and different Openstack Keystone components. So this ruby versi?n will be outdated. Franck De : fiware-fic3-coaching-bounces at lists.fi-ware.org [mailto:fiware-fic3-coaching-bounces at lists.fi-ware.org] De la part de Franck Le Gall Envoy? : jeudi 2 avril 2015 16:59 ? : fiware-fic3-coaching at lists.fi-ware.org Objet : [Fiware-fic3-coaching] Fi-ware Keyrock : Security point. De : J?r?my Harris Envoy? : mardi 24 mars 2015 09:57 ? : Franck Le Gall; thomas.van.der.auwermeulen at vub.ac.be; vincent LEROY Objet : Fi-ware Keyrock : Security point. Dear Mr. Le Gall, I'm Jeremy Harris, working for Neveo which is supported by Fi-C3. You were recommended by Thomas Van Der Auwermeulen to help with our issue. We currently have an issue with the Keyrock integration. In short, we noticed that install Keyrock on our server present some security risk. I add an attachment file with the detail of the problem. There is a problem with KeyRock Identity Management framework from Fi-Ware. KeyRock uses quite outdated versions of Ruby programming language (1.9.3), and Ruby on Rails framework (3.2.14). Both of those have a pretty big list of known security vulnerabilities: 1. http://www.cvedetails.com/vulnerability-list/vendor_id-7252/product_id-12215/version_id-136531/Ruby-lang-Ruby-1.9.3.html 2. http://www.cvedetails.com/vulnerability-list/vendor_id-12043/product_id-22568/version_id-153894/Rubyonrails-Ruby-On-Rails-3.2.14.html At the same time, i'm contacting other Keyrock specialist (only 2 found on the internet) to get more information. Best Regards, -------------- next part -------------- An HTML attachment was scrubbed... URL: From jack at tturquoise.com Thu Apr 9 13:32:10 2015 From: jack at tturquoise.com (Jack Hooper) Date: Thu, 9 Apr 2015 12:32:10 +0100 Subject: [Fiware-fic3-coaching] Examples of Key Rock in use Message-ID: Hi Franck, I was wondering if there is any detailed documentation of usage for the Key Rock API particularly any usage example code in Java or Objective C? It seems as though it doesn't allow the creation of users (it needs to be done via web rather than app), which will be a problem for us. Thanks, Jack -- *Jack Hooper* / Director m: (+44) 7 766 951 298 *Team Turquoise* One Bermondsey Square, SE1 3UN London *@tturqoise | /teamturquoise * -------------- next part -------------- An HTML attachment was scrubbed... URL: From franck.le-gall at eglobalmark.com Wed Apr 15 16:40:10 2015 From: franck.le-gall at eglobalmark.com (Franck Le Gall) Date: Wed, 15 Apr 2015 14:40:10 +0000 Subject: [Fiware-fic3-coaching] Context broker load test Message-ID: Dear Federico, Following our discussion, below are some load tests kindly provided by Leandro Guillen (IMDEA) on the ORION Broker It basically says that Orion can handle around 1500 transactions per second when run in this particular machine. I will be pleased to hear more from load tests you are going to run on your system Kind regards Franck Scenario User impact Vs CB Behaivour Sistem Under Test Type Virtual OPs Base How affects the use of serveral users at the same time to the Time response and the TPS avg. Total Threads = XML threads + JSON threads Orion BIG (XXL) (NO) CPU 16 Cores MEM 16 GB Append + Update + Query Comment: The Average Throughput is similar to lastest version (0.10.1). In this case, we add a append request and we add validations by status code and the response body in all requests (append, update and query) Test exec ~/test/apache-jmeter-2.11/bin/jmeter.sh -n -t ~/JMXs/orionPerfTest_v1.2.jmx -p ~/test/jmeter.prop -JPROJECT="Scenarios_0.11.0" -JTEST_NAME="HILOS" -JHOST=10.95.20.2 -JPORT=1026 -JHILOS=???? -JITERATIONS=1 -JRAMPUP=50 -JRUNTIME=180 Threads Metrics Results without verbose logs Latest Version Comments Results with verbose logs Lastest Version 1 Average Response Time, ms: 1 1 Maximum Response Time, ms: 104 96 Average Throughput (TPS): 1323.17 1329.87 Average Virtual Users: 1.98895 1.98895 Max Virtual Users: 2 2 Url: https://loadosophia.org/gui/125418 5 Average Response Time, ms: 5 5 Maximum Response Time, ms: 105 105 Average Throughput (TPS): 1452.97 1477.12 Average Virtual Users: 8.19545 8.1448 Max Virtual Users: 10 10 Url: https://loadosophia.org/gui/125420 50 Average Response Time, ms: 54 52 Maximum Response Time, ms: 286 318 Average Throughput (TPS): 1452.47 1506.84 Average Virtual Users: 78.2609 78.655 Max Virtual Users: 100 100 Url: https://loadosophia.org/gui/125426 250 Average Response Time, ms: 256 244 Maximum Response Time, ms: 1706 1308 Average Throughput (TPS): 1452.37 1514.26 Average Virtual Users: 389.931 389.81 Max Virtual Users: 500 500 Url: https://loadosophia.org/gui/125428 500 Average Response Time, ms: 547 519 500 - Recheck with verbose logs 1416 Maximum Response Time, ms: 2816 2643 6169 Average Throughput (TPS): 1402.55 1511.81 635.641 Average Virtual Users: 777.474 776.612 779.444 Max Virtual Users: 1000 1000 1006 Url: https://loadosophia.org/gui/125460 https://loadosophia.org/gui/125773 750 Average Response Time, ms: 830 Error rate: 0.38% Caused by: java.net.ConnectException: Connection timed out See in Extra 1 page "Aggregate Report for 750 Threads" 750 - Recheck with verbose logs 1718 Maximum Response Time, ms: 146957 148008 Average Throughput (TPS): 1458.46 664.524 Average Virtual Users: 1234.48 1230.91 Max Virtual Users: 1734 1721 Url: https://loadosophia.org/gui/125768 https://loadosophia.org/gui/125777 1000 Average Response Time, ms: 1040 1042 Error rate: 0.73% Caused by: java.net.ConnectException: Connection timed out See in Extra 1 page "Aggregate Report for 1000 Threads" 1000 - Recheck with verbose logs 2463 Maximum Response Time, ms: 155109 155261 156280 Average Throughput (TPS): 1551.09 1678.95 649.606 Average Virtual Users: 1586.16 1794.97 1691.05 Max Virtual Users: 2467 2475 2465 Url: https://loadosophia.org/gui/125467 https://loadosophia.org/gui/125778 1500 Average Response Time, ms: 1633 1574 Error rate: 1.63% Caused by: java.net.ConnectException: Connection timed out See in Extra 1 page "Aggregate Report for 1500 Threads" 1500 - Recheck with verbose logs 3142 3177 Maximum Response Time, ms: 163372 162967 164486 164091 Average Throughput (TPS): 1504.44 1710.55 736.204 812.517 Average Virtual Users: 2529.98 2792.82 2516.73 2781.36 Max Virtual Users: 3926 3940 3928 3941 Url: https://loadosophia.org/gui/125729 https://loadosophia.org/gui/125744 2000 Average Response Time, ms: Error rate: 42.33% Caused by: java.net.ConnectException: Connection timed out See in Extra 1 page "Aggregate Report for 2000 Threads" Max Used: CPU 21% and MEM 8Gb 2000 - Recheck with verbose logs Maximum Response Time, ms: Average Throughput (TPS): Average Virtual Users: Max Virtual Users: Url: https://loadosophia.org/gui/125753 https://loadosophia.org/gui/125784 3000 Average Response Time, ms: Maximum Response Time, ms: Average Throughput (TPS): 0 Average Virtual Users: Max Virtual Users: Url: 5000 Average Response Time, ms: Maximum Response Time, ms: Average Throughput (TPS): Average Virtual Users: Max Virtual Users: Url: -------------- next part -------------- An HTML attachment was scrubbed... URL: From feloes at gmail.com Wed Apr 15 17:00:53 2015 From: feloes at gmail.com (Federico Lopez) Date: Wed, 15 Apr 2015 17:00:53 +0200 Subject: [Fiware-fic3-coaching] Context broker load test In-Reply-To: References: Message-ID: Thank you very much!! 2015-04-15 16:40 GMT+02:00 Franck Le Gall : > Dear Federico, > > > > Following our discussion, below are some load tests kindly provided by > Leandro Guillen (IMDEA) on the ORION Broker > > > > It basically says that Orion can handle around 1500 transactions per > second when run in this particular machine. > > > > I will be pleased to hear more from load tests you are going to run on > your system > > > > Kind regards > > Franck > > > > *Scenario* > > *User impact Vs CB Behaivour * > > *Sistem Under Test* > > *Type* > > *Virtual* > > *OPs* > > *Base* > > How affects the use of serveral users at the same time to the Time > response and the TPS avg. > Total Threads = XML threads + JSON threads > > Orion > > BIG (XXL) > > (NO) CPU 16 Cores MEM 16 GB > > Append + Update + Query > > Comment: > The Average Throughput is similar to lastest version (0.10.1). > In this case, we add a append request and we add validations by status > code and the response body in all requests (append, update and query) > > *Test exec* > > ~/test/apache-jmeter-2.11/bin/jmeter.sh -n -t > ~/JMXs/orionPerfTest_v1.2.jmx -p ~/test/jmeter.prop > -JPROJECT="Scenarios_0.11.0" -JTEST_NAME="HILOS" -JHOST=10.95.20.2 > -JPORT=1026 -JHILOS=???? -JITERATIONS=1 -JRAMPUP=50 -JRUNTIME=180 > > *Threads* > > *Metrics* > > *Results without verbose logs* > > *Latest Version* > > *Comments* > > *Results with verbose logs* > > *Lastest Version * > > *1* > > Average Response Time, ms: > > 1 > > 1 > > Maximum Response Time, ms: > > 104 > > 96 > > Average Throughput (TPS): > > *1323.17* > > *1329.87* > > Average Virtual Users: > > 1.98895 > > 1.98895 > > Max Virtual Users: > > 2 > > 2 > > Url: > > *https://loadosophia.org/gui/125418 * > > *5* > > Average Response Time, ms: > > 5 > > 5 > > Maximum Response Time, ms: > > 105 > > 105 > > Average Throughput (TPS): > > *1452.97* > > *1477.12* > > Average Virtual Users: > > 8.19545 > > 8.1448 > > Max Virtual Users: > > 10 > > 10 > > Url: > > *https://loadosophia.org/gui/125420 * > > *50* > > Average Response Time, ms: > > 54 > > 52 > > Maximum Response Time, ms: > > 286 > > 318 > > Average Throughput (TPS): > > *1452.47* > > *1506.84* > > Average Virtual Users: > > 78.2609 > > 78.655 > > Max Virtual Users: > > 100 > > 100 > > Url: > > *https://loadosophia.org/gui/125426 * > > *250* > > Average Response Time, ms: > > 256 > > 244 > > Maximum Response Time, ms: > > 1706 > > 1308 > > Average Throughput (TPS): > > *1452.37* > > *1514.26* > > Average Virtual Users: > > 389.931 > > 389.81 > > Max Virtual Users: > > 500 > > 500 > > Url: > > *https://loadosophia.org/gui/125428 * > > *500* > > Average Response Time, ms: > > 547 > > 519 > > *500 - Recheck with verbose logs* > > 1416 > > Maximum Response Time, ms: > > 2816 > > 2643 > > 6169 > > Average Throughput (TPS): > > *1402.55* > > *1511.81* > > *635.641* > > Average Virtual Users: > > 777.474 > > 776.612 > > 779.444 > > Max Virtual Users: > > 1000 > > 1000 > > 1006 > > Url: > > *https://loadosophia.org/gui/125460 * > > *https://loadosophia.org/gui/125773 * > > *750* > > Average Response Time, ms: > > 830 > > > > *Error rate: 0.38% Caused by: java.net.ConnectException: Connection timed > out See in Extra 1 page "Aggregate Report for 750 Threads"* > > *750 - Recheck with verbose logs* > > 1718 > > Maximum Response Time, ms: > > 146957 > > 148008 > > Average Throughput (TPS): > > *1458.46* > > *664.524* > > Average Virtual Users: > > 1234.48 > > 1230.91 > > Max Virtual Users: > > 1734 > > 1721 > > Url: > > *https://loadosophia.org/gui/125768 * > > *https://loadosophia.org/gui/125777 * > > *1000* > > Average Response Time, ms: > > 1040 > > 1042 > > > > *Error rate: 0.73% Caused by: java.net.ConnectException: Connection timed > out See in Extra 1 page "Aggregate Report for 1000 Threads"* > > *1000 - Recheck with verbose logs* > > 2463 > > Maximum Response Time, ms: > > 155109 > > 155261 > > 156280 > > Average Throughput (TPS): > > *1551.09* > > *1678.95* > > *649.606* > > Average Virtual Users: > > 1586.16 > > 1794.97 > > 1691.05 > > Max Virtual Users: > > 2467 > > 2475 > > 2465 > > Url: > > *https://loadosophia.org/gui/125467 * > > *https://loadosophia.org/gui/125778 * > > *1500* > > Average Response Time, ms: > > 1633 > > 1574 > > > > *Error rate: 1.63% Caused by: java.net.ConnectException: Connection timed > out See in Extra 1 page "Aggregate Report for 1500 Threads"* > > *1500 - Recheck with verbose logs* > > 3142 > > 3177 > > Maximum Response Time, ms: > > 163372 > > 162967 > > 164486 > > 164091 > > Average Throughput (TPS): > > *1504.44* > > *1710.55* > > *736.204* > > 812.517 > > Average Virtual Users: > > 2529.98 > > 2792.82 > > 2516.73 > > 2781.36 > > Max Virtual Users: > > 3926 > > 3940 > > 3928 > > 3941 > > Url: > > *https://loadosophia.org/gui/125729 * > > *https://loadosophia.org/gui/125744 * > > *2000* > > Average Response Time, ms: > > > > > *Error rate: 42.33% Caused by: java.net.ConnectException: Connection timed > out See in Extra 1 page "Aggregate Report for 2000 Threads" Max Used: CPU > 21% and MEM 8Gb* > > *2000 - Recheck with verbose logs* > > Maximum Response Time, ms: > > Average Throughput (TPS): > > Average Virtual Users: > > Max Virtual Users: > > Url: > > *https://loadosophia.org/gui/125753 * > > *https://loadosophia.org/gui/125784 * > > *3000* > > Average Response Time, ms: > > Maximum Response Time, ms: > > Average Throughput (TPS): > > 0 > > Average Virtual Users: > > Max Virtual Users: > > Url: > > *5000* > > Average Response Time, ms: > > Maximum Response Time, ms: > > Average Throughput (TPS): > > Average Virtual Users: > > Max Virtual Users: > > Url: > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: