Meeting Logistics: 

Attendee List:

  1. Qiao Fu (china Mobile)
  2. Michael Fix (AT&T)
  3. Scott Steinbrueck (AT&T)
  4. Parth Yadav (University of Delhi)
  5. Vipin Rathi (University of Delhi)
  6. Liang Chen (China Mobile)
  7. Luc Provoost (Intel)
  8. Daniel Balsiger (Swisscom)
  9. Jiaqiang Zhang (China Mobile)
  10. Cedric Ollivier (Orange)
  11. Mehmet Toy (Verizon)
  12.  cheng tong(China Mobile)
  13. Liang Chen
  14. Saad Ullah Sheikh (STC)
  15. Sridhar Rao (Spirent)

Goals of Meeting

  1. Status (5 min)
  2. Delivery Status (30 min)
    1. PR review
    2. Gaps, Issues, & Weekly Summary
  3. Results Presentation / Options (10 min)
    1. Functest/Xtesting CI
    2. TestAPI
    3. DoveTail
    4. Jenkins View
  4. Demo - VSPerf (10 min) – table to next week


Next Meeting

  1. OPNFV Project Gaps
  2. Baldy Deliverables

________________________________________________________________________________________________

Agenda:

  1. Status
    1. Labs (POD10/15)
      1. Test Runs enabled on POD15.  See results & issues log.
    2. HDV & SDV 
      1. Submitted project proposals for 2020 Intern
      2. SDV demo provided 3/2 of pre-deployment validation; post-deployment under constructions; working on Repo issues w/ LF to create Gerrit remote (git remote add)
      3. HDV additional conversation with community - soliciting feedback and support - CMCC has code to share, waiting for Repo issues to be fixed, 
  2. Delivery Results
    1. PR Review
      1. [RI-1 Ch09] General Baldy cleanup for RI doc #1225 
      2. [RC1 - Ch03] Documentation Updates - Clarify Statements for Excluded Test Cases #1163
    2. Gaps, Issues, & Weekly Summary (CIRV project)
      1. Issues - align, fill in gaps
      2. Test Summary - confirm issue #s and status
      3. Req Gaps - volunteers to close gaps
  3. Results Presentation / Options (Did Not Cover)
    1. What are the tests, and results, for the various deployment and validation gates for Functest/Xtesting being run on the intel PODs for CNTT?
    2. Dashboard - what is available (question)
      1. Functest/Xtesting CI 
      2. TestAPI
      3. DoveTail
      4. Jenkins View (tables)
  4. DemoVSPerf - PTL to present next meeting
  5. Next Meeting
    1. OPNFV Project Gaps
      1. (Cedric) will add traceability (TCs to requirements) in RC Ch 5; to close gaps
      2. Yardstick - discussing, nothing definitive, CNTT/Xtesting integration is part of the project's recurring call
      3. VSPerf - (Sridhar R.) ready to demo, wants to onboard - when (question)
      4. Barometer (Emma Foley, 2/19) - 
        1. Discussing, need clarification what is/isn’t already onboarded into Functest
        2.  ...initial feedback, Barometer TCs are not being run with functest.
        3. ...Determine what TCs we have and whether they are still valid/functional

        4. PTL provided wiki 2/26 of how to use; ack. no discussion on integrating Xtesting; they will research and follow-up with Cedric
      5. NFVBench - Alex H.
        1. Discussion 2/25 → can cover two Performance Requirements at a minimum
        2. Provided requirements, test cases, and overview
        3. Value-add in Latency, Throughput, and Capacity benchmarking
        4. Requires external TRex traffic generator (use on jump host), specific NICs (710s already in lab), and access to TOR switch w/ software config
        5. Intel to provide 'best effort' support if we decide to pursue
        6. On hold right now pending review / integration of Prox, and demo of VSPerf week of 3/2
      6. Storperf (Mark B) - discussing, ready to onboard, dialogue open about storage KPIs, but promoting need to baseline first before having established KPIs
      7. SampleVNF – discussing, with renewed interested and potential validations of perf profiling capabilities (as discussed in Prague
        1. Prox is code residing in SampleVNF project, which can be used for performance profiling
        2. Follow-up needed with Luc to determine feasibility and traceability to requirements for what Prox can cover
    2. Baldy Deliverables:  CNTT Baldy  
      1. RI Goals: https://github.com/cntt-n/CNTT/projects/7


        Reference #FeatureNotesVolunteerRelated Issues
        baldy.ri1.1General CleanupsAll ChaptersQiao Fuhttps://github.com/cntt-n/CNTT/issues/1041
        baldy.ri1.2Complete Overall RequirementsCh02Currently do not see any need for update. Will create issue if certain requirement been pointed out
        baldy.ri1.3Complete Lab Requirements → Need an issue?Ch04
        Currently do not see any need for update. Will create issue if certain requirement been pointed out
        baldy.ri1.4Complete Target State & MetadataCh03

        need careful review to see if we capture all the requirement from RM and RA.  

        https://github.com/cntt-n/CNTT/issues/1042

        baldy.ri1.5Complete Installer Requirements and hardware delivery requirement

        Ch05


        Liang Chen

        https://github.com/cntt-n/CNTT/issues/1021

        https://github.com/cntt-n/CNTT/pull/944

        baldy.ri1.6Complete Lab Cookbook (Ops)Ch06[RI] baldy.ri1.6 - Complete Lab Cookbook (Ops) #1165
        baldy.ri1.6Restructure & Complete Integration Cookbook → Need an issue?Ch07

        baldy.ri1.7*Implement Profiles within OPNFV Installers and consume CNTT metadataDEV

        Lincoln Lavoie

        Sridhar Rao

        This work depends on the on-going activity and discussion of information model in OPNFV.  create one issue to follow this work

        https://github.com/cntt-n/CNTT/issues/1043


      2. RC Goals: https://github.com/cntt-n/CNTT/projects/4


        Reference #FeatureNotesVolunteer (question)Related Issue(s)
        baldy.rc1.1General CleanupAll Chapters
        [RC-1] baldy.rc1.1: General cleanup for RC doc #1164
        baldy.rc1.2Clarify Conformance Categories (NFVI & VNFs)Ch01Rajesh, Kanagaraj,Manik[RC1 - Ch01] Clarify Conformance Categories (NFVI & VNFs) #1056
        baldy.rc1.3Complete NFVI Framework RequirementsCh02Cedric,Manik 

        [RC-1] Reflect Backward compatibility support in RI #1036

        [RC1 Dev] Clean interfaces between RC and OVP #829

        [RC1 Ch01] Provide Verification Process, including Life Cycle Management #159

        [RC-1 Ch02] VNF Profile(s) #1029

        baldy.rc1.4Categorise NFVI TC Req and Write API Testing TCCh03
        [RC1 Ch04] Define the test cases for exposed infrastructure capabilities #774
        baldy.rc1.5Create NFVI Mapping & Traceability Matrix and populate itCh05Rajesh, Dan, Ashok,Deepanshu[RC1 Ch11] Gap analysis for NFVI Testing #419
        baldy.rc1.6Restructure NFVI Cookbook and CleanupCh04Cedric

        [RC1 Ch9 - Snezka F2F] RC Cookbook Enhancements #945

        [RI1 Dev][RC1 Dev] new RI deployment container #828

        baldy.rc1.7*NFVI Framework & Test Cases DevelopmentDEVCedric,Manik 

        [RI 1 Dev] Port NFVbench testcases to Xtesting #865

        [RI1 RC1] Add tempest-stress in Functest #916

        [RC-1] Port VTP test cases to Xtesting #917

        [RI 1 Dev] Port VSPERF testcases to Xtesting #511

        [RI 1 Dev] Port Bottlenecks to Xtesting #510

        [RI 1 Dev] Port YardStick testcases to Xtesting #509

        [RI 1 Dev] Port StorPerf testcases to Xtesting #673

        [RI1 RC1] Integrate Spirent NFVI/VIM TCs to Functest/Xtesting