[Fiware-tech-help] R: CEF funded project compliance tests

Iulian Gabriel Coltea i.coltea at key2.it
Fri Nov 18 18:58:24 CET 2022


Hi,

For our platform DYDAS, developed with a CEF co-founded project, we would need some support as indicated in my colleague mail below, regarding the compliance of our integration of the Context Broker, which is required by CINEA.

We had some difficulties in succeeding in passing all tests, whereas we followed the instructions by the letter, we couldn’t pass all compliance.  Can you support us with the tests or help us achieve compliance? We used the Context Broker for some time without problem, but for the completion of the project we need the compliance report.

Detailed information is indicated in the mail below.

Thank you

Regards



Iulian Gabriel Coltea
R&D Manager

KEY TO BUSINESS S.R.L.
[cid:image009.png at 01D7C061.3BA7C390]
+393480936357 | +390698358320
[cid:image010.png at 01D7C061.3BA7C390]
i.coltea at key2.it<mailto:i.coltea at key2.it>
[cid:image011.png at 01D7C061.3BA7C390]
https://www.key2.it/<https://www.key2.it/it/>
[cid:image012.png at 01D7C061.3BA7C390]
Viale dell'Esperanto, 71, 00144 Roma (RM)
Via Lunigiana 40, 20125 Milano (MI)
SS 17 BIS SNC, 67100 L'Aquila (AQ)
[cid:image013.png at 01D7C061.3BA7C390]
[cid:image014.png at 01D7C061.3BA7C390]<https://www.instagram.com/k2business/?hl=it> [cid:image015.png at 01D7C061.3BA7C390] <https://www.facebook.com/key2.it>  [cid:image016.png at 01D7C061.3BA7C390] <https://www.linkedin.com/company/key-2/>


Da: Elena Fulvio<mailto:e.fulvio at key2.it>
Inviato: giovedì 10 novembre 2022 11:15
A: fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>
Cc: Iulian Gabriel Coltea<mailto:i.coltea at key2.it>
Oggetto: CEF funded project compliance tests

Good evening,

we are trying to run the conformance test for the Orion Context Broker that is included in a project funded by CEF, but we are facing some difficulties.

We are running the Orion Context Broker via Kubernetes. The context broker was installed by helm (following the instruction at https://github.com/FIWARE/helm-charts<https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FFIWARE%2Fhelm-charts&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083018882%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=917TiVHmjkpNEaOeKj3OYv4mZm%2BJAudIHPq2J6dDpc0%3D&reserved=0> ), resulting in a container based on the image quay.io/fiware/orion-ld:1.1.0 (for reference the mongodb image, installed along via the helm chart is quay.io/opencloudio/ibm-mongodb:4.0.24). The containers are up and running and we are able to successfully execute the REST apis described in https://fiware-orion.readthedocs.io/en/master/<https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffiware-orion.readthedocs.io%2Fen%2Fmaster%2F&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083018882%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=w6Vjjb2RB%2B2OlrYyl%2FBGEcu0Wq%2FWiv2dGG7vNHHaXgE%3D&reserved=0> , however the test suites we are running seem to fail.


We found two different test suites, the first one (NGSI-LD Test Suite) which is linked in CEF digital page https://ec.europa.eu/cefdigital/wiki/display/CEFDIGITAL/Conformance+testing<https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fec.europa.eu%2Fcefdigital%2Fwiki%2Fdisplay%2FCEFDIGITAL%2FConformance%2Btesting&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083018882%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yMUQyroRE6RVLmNyZHuuygLakP1B56G1%2B7JF27bgZ6Q%3D&reserved=0> and the second one (ETSI NGSI-LD API Conformance Test Suite) on the FIWARE github page.
[https://ec.europa.eu/cefdigital/wiki/cefdigital/wiki/rest/documentConversion/latest/conversion/thumbnail/356876566/1]<https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fec.europa.eu%2Fcefdigital%2Fwiki%2Fdisplay%2FCEFDIGITAL%2FConformance%2Btesting&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083018882%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yMUQyroRE6RVLmNyZHuuygLakP1B56G1%2B7JF27bgZ6Q%3D&reserved=0>
Conformance testing - ec.europa.eu<https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fec.europa.eu%2Fcefdigital%2Fwiki%2Fdisplay%2FCEFDIGITAL%2FConformance%2Btesting&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083018882%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yMUQyroRE6RVLmNyZHuuygLakP1B56G1%2B7JF27bgZ6Q%3D&reserved=0>
CEF Context Broker offers two different types of testing services:
ec.europa.eu


In spite of the fact that the first one seems to be deprecated and the second one is still under development we tried both of them:

[cid:image001.png at 01D8FB7F.AF7701A0]
      
      NGSI-LD Test Suite:

            We downloaded the test suite from : https://github.com/FIWARE/NGSI-LD_TestSuite<https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FFIWARE%2FNGSI-LD_TestSuite&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083175990%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=bgN%2BIdYuKU92YV5ppBnQ9kOEGiO3qtloUsS%2B5UiVtVU%3D&reserved=0>


            The first test was directed to the helm instance I mentioned before and resulted in :

            Test Suites: 15 failed, 22 passed, 37 total
            Tests:       49 failed, 120 passed, 169 total
            Snapshots:   0 total
            Time:        117.426s, estimated 118s
      
            which is odd, considering the fact that the Orion Context Broker instance we are testing is the default image provided by the official helm chart (the complete logs are available in the attachment OUTPUT_NGIS-LD_helm.txt).

            We also tried to run the same test suite using the docker containers that are provided in the suite itself (under /docker-compose/orion.yml) and it resulted in:

            Test Suites: 11 failed, 26 passed, 37 total
            Tests:       39 failed, 130 passed, 169 total
            Snapshots:   0 total
            Time:        102.645s

            which is extremely odd since in this case Orion-LD, mongodb, accumulator server & notification server are all provided by the suite itself .

      ETSI Test Suite:

            We downloaded the test suite from:  https://forge.etsi.org/rep/cim/ngsi-ld-test-suite/-/tree/develop  since the master branch is still empty, and we tried to test the helm instance again.
            We were actually able to launch part of the tests but the testing process seems to freeze at some point during the execution.




Considering all of the above, how we can achieve the CEF compliance for the FIWARE Orion Context broker implementation? Are those tests sufficient to be compliant?


Thank you for your time and sorry for the long email.


Best regards,



Elena Fulvio
Solution Architect

KEY TO BUSINESS S.R.L.
[https://www.key2.it/img/loghi_mail/Email.png]
e.fulvio at key2.it<mailto:e.fulvio at key2.it>
[https://www.key2.it/img/loghi_mail/Sito%20web.png]
https://www.key2.it/<https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.key2.it%2Fit%2F&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083175990%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=W3E2FM6%2Ff6tAoONNKGjno0el54Q%2FeUx9DPggWtvfhn0%3D&reserved=0>
[https://www.key2.it/img/loghi_mail/Indirizzo.png]
Viale dell'Esperanto, 71, 00144 Roma (RM)
Via Lunigiana 40, 20125 Milano (MI)
SS 17 BIS SNC, 67100 L'Aquila (AQ)
[https://www.key2.it/img/loghi_mail/logo_k2_blue_xxs.png]
[https://www.key2.it/img/loghi_mail/Instagram.png]<https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.instagram.com%2Fk2business%2F%3Fhl%3Dit&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083175990%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=59XnL5%2FMgwRJNqYhV%2BdSs4%2B4wqxeqhWRWTVodnV%2F6pg%3D&reserved=0> [https://www.key2.it/img/loghi_mail/Facebook.png] <https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.facebook.com%2Fkey2.it&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083175990%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=oFeRQmGMC%2FXn49uL5iHeQu00%2BTDHSI4yvG%2FE56F%2BZnc%3D&reserved=0>  [https://www.key2.it/img/loghi_mail/Linkedin.png] <https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fkey-2%2F&data=05%7C01%7Ci.coltea%40key2.it%7Ce4eacb40f6b047f5f48108dac30470d6%7C8c586c92cabd4ce5983abe9869cdc625%7C0%7C0%7C638036721083175990%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=waQFQ0xYhs2XwMcUlYnfQpozRmPSMScFIY1AWhkJdnk%3D&reserved=0>


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 92499417ECEB415097B6BFE4D8AF93CF[59902346].png
Type: image/png
Size: 986 bytes
Desc: 92499417ECEB415097B6BFE4D8AF93CF[59902346].png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0009.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: A7F9CF05520A49719A91318DF755E5A7[59902347].png
Type: image/png
Size: 1251 bytes
Desc: A7F9CF05520A49719A91318DF755E5A7[59902347].png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0010.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 5A4729E1C293425DB6FA7497B7DC07E1[59902348].png
Type: image/png
Size: 1350 bytes
Desc: 5A4729E1C293425DB6FA7497B7DC07E1[59902348].png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0011.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 345DE666B82A47839C2F6FFF19D80FA2[59902349].png
Type: image/png
Size: 1011 bytes
Desc: 345DE666B82A47839C2F6FFF19D80FA2[59902349].png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0012.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 33B33BE7D7324491B0CC4156EDD1426D[59902350].png
Type: image/png
Size: 5232 bytes
Desc: 33B33BE7D7324491B0CC4156EDD1426D[59902350].png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0013.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 596B389986CE44A9828163D176242D49[59902351].png
Type: image/png
Size: 1867 bytes
Desc: 596B389986CE44A9828163D176242D49[59902351].png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0014.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ACD96A9D1F4443D9B0DA08D29DC81CAB[59902352].png
Type: image/png
Size: 1389 bytes
Desc: ACD96A9D1F4443D9B0DA08D29DC81CAB[59902352].png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0015.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: A48B74D3120342B78AA893DD66FB1D23[59902353].png
Type: image/png
Size: 1472 bytes
Desc: A48B74D3120342B78AA893DD66FB1D23[59902353].png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0016.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: D5B047911EEC457CB24E1AAE87DB6ADD.png
Type: image/png
Size: 157871 bytes
Desc: D5B047911EEC457CB24E1AAE87DB6ADD.png
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20221118/4ecc0257/attachment-0017.png>


More information about the Fiware-tech-help mailing list

You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy   Cookies policy