Meeting Logistics: 

Attendee List:

  1. Michael Fix (AT&T)
  2. Al Morton  (AT&T)
  3. Jim Baker (LF)
  4. Scott Steinbrueck (AT&T)
  5. Parth Yadav (University of Delhi)
  6. Toshiyasu Wakayama (KDDI)
  7. Trevor Cooper (Intel)
  8. Lincoln Lavoie

Goals of Meeting

  1. Admin (5 min)
    1. 2020 Summer Interns
      1. TSC approved 2 CNTT resources for SDV and HDV work
      2. Holding pattern until candidate list is provided from LF
      3. Resources start early June
      4. ink to Mentor Program details
    2. CIRV Repo
      1. Locations:
        1. https://gerrit.opnfv.org/gerrit/admin/repos/cirv
        2. https://github.com/opnfv/cirv/
      2. CLA & Gerrit remote add issues resolved
      3. SDV prototype uploaded
      4. HDV prototype to be uploaded soon (reviews being conducted - https://gerrit.opnfv.org/gerrit/c/cirv/+/69772
      5. Reviews and Approvals pending to add a jenkins-ci job run python quality / sanity checks (e.g. pylint) against builds (under discussion in Gerrit)
    3. Demo - VSPerf will be demo'ed in OPNFV Community calls
  2. RI (25 min)
    1. Requirements Gaps (see wiki - working session)
      1. Jason Li - to review/edit "Test Req Interpretation" and "Testable" columns.  
      2. Request for reviews/edits will be sent once Jason is complete.
    2. Cookbook status - confirmed a priority for Baldy → Mike to confirm with Fu Ciao that Baldy items, Cookbook and Requirements Mapping are receiving sufficient attention
  3. RC (25 min)
    1. PR Review
      1. [RC1 - Ch03] Documentation Updates - Clarify Statements for Excluded Test Cases #1163 → comment & follow requesting approvals done today
      2. [RC1 - Ch01] Clarify Conformance Categories #1283 → approved, pending merge → additional changes / clarification recommended; Mike to make the necessary changes and re-request (re)review & (re)approval
    2. Following were reviewed with confirmation the are Baldy delivery items
      1. Cookbook status
      2. Baldy Issues Review *
      3. Test Progress Weekly Summary (wiki)
      4. SDV
    3. OPNFV Project Gaps * → Not reviewed during call
    4. RC WS Volunteer table → Not reviewed during call

Next Meeting

  1. Issue Resolution Flow - a Process flow for issue handling will be reviewed with the RI-1 WS team for clarification and handling of environment/implementation gaps needing resolution for RI-1/RC-1 validations

________________________________________________________________________________________________

Supporting Material:

  1. RC WS Volunteers (table, email)

    #

    Volunteer Name

    Area

    Description

    1


    Issue Tracking

    Daily (2x) review of open issues to ensure we have current status, request status from reviewers in GitHub, re-assign to others as needed

    2


    PR Tracking

    Same

    3


    Baldy Items

    Monitor the list of Baldy deliverables, measure progress, request status, and help write content

    4


    Chapter Updates

    Review list of required content updates; write(co-write) content and/make updates to a chapter, or chapters

    5


    Weekly Meeting Prep

    Host a weekly meeting (rotate the responsibility – 1 person / meeting per week)

    6


    Weekly Results Tracking

    Update weekly wiki with status; measure success of closing gaps; raise concern when no progress being made

    7


    Onboard OPNFV test projects

    There are 6 potential projects which need onboarding to Xtesting.  Setup meetings, integrate, onboard, and validate.

    8


    Results Dashboard

    Integrate Results Dashboard for testing results

    9


    Close RIRC Req Gaps

    Manage the closure of gaps in the RIRC Requirements-to-Test-Coverage gaps

    10


    HDV and SDV Completion

    Track / Manager delivery of these two tools.

    11

    (FUTURE)

    Baldy Presentations

    Prepare Materials, and co-present for Baldy Release


  2. OPNFV Project Gaps
    1. Yardstick - discussing, nothing definitive, CNTT/Xtesting integration is part of the project's recurring call
    2. VSPerf - (Sridhar R.) ready to demo, wants to onboard - when (question)
    3. Barometer (Emma Foley, 2/19) - 
      1. Discussing, need clarification what is/isn’t already onboarded into Functest
      2.  ...initial feedback, Barometer TCs are not being run with functest.
      3. ...Determine what TCs we have and whether they are still valid/functional

      4. PTL provided wiki 2/26 of how to use; ack. no discussion on integrating Xtesting; they will research and follow-up with Cedric
    4. NFVBench - Alex H.
      1. Discussion 2/25 → can cover two Performance Requirements at a minimum
      2. Provided requirements, test cases, and overview
      3. Value-add in Latency, Throughput, and Capacity benchmarking
      4. Requires external TRex traffic generator (use on jump host), specific NICs (710s already in lab), and access to TOR switch w/ software config
      5. Intel to provide 'best effort' support if we decide to pursue
      6. On hold right now pending review / integration of Prox, and demo of VSPerf week of 3/2
    5. Storperf (Mark B) - discussing, ready to onboard, dialogue open about storage KPIs, but promoting need to baseline first before having established KPIs
    6. SampleVNF – discussing, with renewed interested and potential validations of perf profiling capabilities (as discussed in Prague
      1. Prox is code residing in SampleVNF project, which can be used for performance profiling
      2. Follow-up needed with Luc to determine feasibility and traceability to requirements for what Prox can cover
  3. Baldy Deliverables:  CNTT Baldy  
    1. RI Goals: https://github.com/cntt-n/CNTT/projects/7


      Reference #FeatureNotesVolunteerRelated Issues
      baldy.ri1.1General CleanupsAll ChaptersQiao Fuhttps://github.com/cntt-n/CNTT/issues/1041
      baldy.ri1.2Complete Overall RequirementsCh02Currently do not see any need for update. Will create issue if certain requirement been pointed out
      baldy.ri1.3Complete Lab Requirements → Need an issue?Ch04
      Currently do not see any need for update. Will create issue if certain requirement been pointed out
      baldy.ri1.4Complete Target State & MetadataCh03

      need careful review to see if we capture all the requirement from RM and RA.  

      https://github.com/cntt-n/CNTT/issues/1042

      baldy.ri1.5Complete Installer Requirements and hardware delivery requirement

      Ch05


      Liang Chen

      https://github.com/cntt-n/CNTT/issues/1021

      https://github.com/cntt-n/CNTT/pull/944

      baldy.ri1.6Complete Lab Cookbook (Ops)Ch06[RI] baldy.ri1.6 - Complete Lab Cookbook (Ops) #1165
      baldy.ri1.6Restructure & Complete Integration Cookbook → Need an issue?Ch07

      baldy.ri1.7*Implement Profiles within OPNFV Installers and consume CNTT metadataDEV

      Lincoln Lavoie

      Sridhar Rao

      This work depends on the on-going activity and discussion of information model in OPNFV.  create one issue to follow this work

      https://github.com/cntt-n/CNTT/issues/1043


    2. RC Goals: https://github.com/cntt-n/CNTT/projects/4


      Reference #FeatureNotesVolunteer (question)Related Issue(s)
      baldy.rc1.1General CleanupAll Chapters
      [RC-1] baldy.rc1.1: General cleanup for RC doc #1164
      baldy.rc1.2Clarify Conformance Categories (NFVI & VNFs)Ch01Rajesh, Kanagaraj,Manik[RC1 - Ch01] Clarify Conformance Categories (NFVI & VNFs) #1056
      baldy.rc1.3Complete NFVI Framework RequirementsCh02Cedric,Manik 

      [RC-1] Reflect Backward compatibility support in RI #1036

      [RC1 Dev] Clean interfaces between RC and OVP #829

      [RC1 Ch01] Provide Verification Process, including Life Cycle Management #159

      [RC-1 Ch02] VNF Profile(s) #1029

      baldy.rc1.4Categorise NFVI TC Req and Write API Testing TCCh03
      [RC1 Ch04] Define the test cases for exposed infrastructure capabilities #774
      baldy.rc1.5Create NFVI Mapping & Traceability Matrix and populate itCh05Rajesh, Dan, Ashok,Deepanshu[RC1 Ch11] Gap analysis for NFVI Testing #419
      baldy.rc1.6Restructure NFVI Cookbook and CleanupCh04Cedric

      [RC1 Ch9 - Snezka F2F] RC Cookbook Enhancements #945

      [RI1 Dev][RC1 Dev] new RI deployment container #828

      baldy.rc1.7*NFVI Framework & Test Cases DevelopmentDEVCedric,Manik 

      [RI 1 Dev] Port NFVbench testcases to Xtesting #865

      [RI1 RC1] Add tempest-stress in Functest #916

      [RC-1] Port VTP test cases to Xtesting #917

      [RI 1 Dev] Port VSPERF testcases to Xtesting #511

      [RI 1 Dev] Port Bottlenecks to Xtesting #510

      [RI 1 Dev] Port YardStick testcases to Xtesting #509

      [RI 1 Dev] Port StorPerf testcases to Xtesting #673

      [RI1 RC1] Integrate Spirent NFVI/VIM TCs to Functest/Xtesting