[Fiware-qualityassurance] Change of strategy for non-functional testing

Riccardo Zanetti riccardo.zanetti at eng.it
Fri Mar 10 16:07:09 CET 2017


Dear Clara, Peter, Stefano and all,
let me add some details to the issues we all are experiencing from 
different sides of testing with the FIWARE Catalog and more in general 
with the GEs we are testing.

1) The GE(s) listed by Peter below that may be thought (wrongly) as 
"updated" (in a distant past, moreover, as he has already pointed) don't 
have anyway in some cases, in the catalog, the version number set. In 
fact the date of when a catalog web page has been modified doesn't match 
necessarily with a change done actually on the release date "field".
@Stefano: let me point out more in general that this unreliable catalog 
is obviously preventing us to follow the "catalog driven" approach for 
functional (but not only) testing that was required by you in our last 
QA conf call.

2)Last month I shared a spreadsheet (in the attached email you can find 
the email I sent with its link as well as further details) in order *to 
focus in a single place (table)* the list of GE(s) that it makes sense 
to be tested from a functional and a non functional point of view, and 
those not, with related motivations.
Moreover, relating to the previous issue, GE(s) with no set or 
misleading version were already highlighted in red color in that table.
I think it would be useful also to highlight in the same shared 
spreadsheet which GE(s) are currently not being supported by their owner 
and thus put in quarantine, once confirmed by the TSC.
@Clara: do you think it would be possible for you to highlight there 
which are such GE(s) and apply the necessary updates that reflects your 
changed plan?
 From what it can be tested from every side (Catalog/Documentation/API 
functional/API non-functional) depends in fact the feasibility of the 
labelling process and thus the data that must be produced by each side 
of testing; feel free to add fields to it if needed.
@Stefano: could you provide the necessary feedback on this table ?

Thanks in advance for your attention and collaboration.
Best regards,
Riccardo



On 09/03/2017 14:29, Muryshkin, Peter wrote:
>
> ​Hi, all,
>
>
> here attached  recent statistics of Enabler releases as reported in 
> the Catalogue as I can scrape this data with the automated checking 
> tool; (maybe there is an easier shortcut through the Catalogue' server 
> SQL database).
>
>
> Anyway, may be it can be helpful in this context to check against the 
> supported/unsupported Enabers in FI-NEXT.
>
> However, maybe some components have recent developments visible only 
> on GitHub but not update to the Catalogue.
>
> Also, there might be some Enablers which were finally released and 
> there is no reasonable demand/plans for new versions (otherwise with 
> FI-NEXT supported Enablers they have at least budget).
>
>
> Top 10 recent updates (none from this year so far):
>
>>
> ---
>
> *date**enabler*
> 2016-12-12BigData Analysis - Cosmos
> 2016-12-09Publish/Subscribe Context Broker - Orion Context Broker
> 2016-11-16Protocol Adapter - MR CoAP
> 2016-11-04PaaS Manager - Pegasus
> 2016-11-04Policy Manager - Bosun
> 2016-11-03Application Management - Murano
> 2016-10-31Synchronization - FiVES
> 2016-10-26IoT Discovery
> 2016-10-21Authorization PDP - AuthZForce
> 2016-10-21Backend Device Management - IDAS
>
>
> ---
>
>>
> kind regards
>
> Peter
>
> ------------------------------------------------------------------------
> *Von:* fiware-qualityassurance-bounces at lists.fiware.org 
> <fiware-qualityassurance-bounces at lists.fiware.org> im Auftrag von 
> Stefano De Panfilis <stefano.depanfilis at fiware.org>
> *Gesendet:* Donnerstag, 9. März 2017 00:07
> *An:* Pezuela Robles, Clara M
> *Cc:* fiware-qualityassurance at lists.fiware.org
> *Betreff:* Re: [Fiware-qualityassurance] Change of strategy for 
> non-functional testing
> Dear Clara,
>
> it is quite sad, but obviously it is the only path that make sense.
>
> However, i do suggest to write a formal email to the tsc which shall 
> take the proper quarantine action with respect to those ges.
>
> Ciao
> Stefano
>
> Il 08 Mar 2017 23:16, "Pezuela Robles, Clara M" 
> <clara.pezuela at atos.net <mailto:clara.pezuela at atos.net>> ha scritto:
>
>     Dear Stefano et all,
>     I am thinking to change the initial plan we had in non-functional
>     testing due to the lack of support from all GE owners that have
>     been contacted so far.
>     We proposed to test the GEs that are still funded by FI-NEXT
>     project, otherwise we are experiencing that GE owners have stopped
>     the development or at least the maintenance as they do not provide
>     any support.
>     Can we have this list of GEs that are somehow under the funding of
>     FI-NEXT? Can we go through the catalogue and see which ones are
>     truly alive and supported?
>     What do you think?
>     Best regards
>     Clara Pezuela
>     Head of IT Market
>     Research and Innovation Group
>     _ARI booklet_
>     <https://atos.net/wp-content/uploads/2017/01/atos-ari-2016.pdf>
>     Atos Spain SA
>     _Clara.pezuela at atos.net_ <mailto:Clara.pezuela at atos.net>
>     +34 675 62 9974 <tel:+34%20675%2062%2099%2074>
>     This e-mail and the documents attached are confidential and
>     intended solely for the addressee; it may also be privileged. If
>     you receive this e-mail in error, please notify the sender
>     immediately and destroy it.
>     As its integrity cannot be secured on the Internet, the Atos group
>     liability cannot be triggered for the message content. Although
>     the sender endeavors to maintain a computer virus-free network,
>     the sender does not warrant that this transmission is virus-free
>     and will not be liable for any damages resulting from any virus
>     transmitted.
>
>     Este mensaje y los ficheros adjuntos pueden contener información
>     confidencial destinada solamente a la(s) persona(s) mencionadas
>     anteriormente y pueden estar protegidos por secreto profesional.
>     Si usted recibe este correo electrónico por error, gracias por
>     informar inmediatamente al remitente y destruir el mensaje.
>     Al no estar asegurada la integridad de este mensaje sobre la red,
>     Atos no se hace responsable por su contenido. Su contenido no
>     constituye ningún compromiso para el grupo Atos, salvo
>     ratificación escrita por ambas partes.
>     Aunque se esfuerza al máximo por mantener su red libre de virus,
>     el emisor no puede garantizar nada al respecto y no será
>     responsable de cualesquiera daños que puedan resultar de una
>     transmisión de virus.
>
>     __________________________________________________________________________________________
>
>     You can get more information about our cookies and privacy
>     policies on the following links:
>     -
>     http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy
>     <http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy>
>     -
>     http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE
>     <http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE>
>
>     Fiware-qualityassurance mailing list
>     Fiware-qualityassurance at lists.fiware.org
>     <mailto:Fiware-qualityassurance at lists.fiware.org>
>     https://lists.fiware.org/listinfo/fiware-qualityassurance
>     <https://lists.fiware.org/listinfo/fiware-qualityassurance>
>
>
>
>
> __________________________________________________________________________________________
>
> You can get more information about our cookies and privacy policies on the following links:
> - http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy
> - http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE
>
> Fiware-qualityassurance mailing list
> Fiware-qualityassurance at lists.fiware.org
> https://lists.fiware.org/listinfo/fiware-qualityassurance
>


-- 

*Riccardo Zanetti, PMP*
Direzione Ricerca e Innovazione
riccardo.zanetti at eng.it <mailto:riccardo.zanetti at eng.it>

*Engineering Ingegneria Informatica S.p.A.*
Laboratorio ESTRO
Via Sommarive, 18 - 38123 Trento
Tel +39 0461 312305
Mob +39 320 8283676
www.eng.it <http://www.eng.it>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fiware.org/private/fiware-qualityassurance/attachments/20170310/b69b35ed/attachment-0001.html>
-------------- next part --------------
An embedded message was scrubbed...
From: Riccardo Zanetti <riccardo.zanetti at eng.it>
Subject: Re: [Fiware-qualityassurance] My TODOS after today's call
Date: Mon, 6 Feb 2017 12:46:55 +0100
Size: 30236
URL: <https://lists.fiware.org/private/fiware-qualityassurance/attachments/20170310/b69b35ed/attachment-0001.mht>


More information about the Fiware-qualityassurance mailing list

You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy   Cookies policy