...

Note, the following is a work in progress.

VNF Testing

...

Compliance (to a specification or standard):

VNF Compliance

• Conformance to HEAT or TOSCA Templates, as defined by ONAP Requirements.

• Conformance to ONAP VNFRqmts documentation which will integrate other SDO requirements (ie, 5G, BBF, ETSI,...)

• Documentation of VNF is available.

NFVI (Doesn't this include VIM?) Compliance:

•  ETSI ISG NFV interface standards
• should this be expanded to whitebox servers, DPDK,  FDIO,...
• what does it mean for NFVI to be compliant?
any standard exit?

Validation:

• VNF Validation:

  • On-boarding: Validate the VNF Artifact(s) is able to be "consumed" by an ONAP instance.

    • Open questions: 1) What are the requirements defined for "On-boarding?" What is the requirement for the "ONAP instance?" 3) Is there a requirement for backwards compatibility? 4) Besides ONAP are there other organizations defining this?

  • Instantiation: Validate the VNF can be "launched" by an ONAP instance on top of an NFVI.

    • Open questions: 1) What is the requirements for ONAP Instance? 2) What is the requirements for the NFVI? 3) What are the requirements for the "VNF launch?"

  • Validate various life-cycle operations are possible with the VNF running on the ONAP Instance.

    • Open questions: 1) What the required "life-cycle operations?" 2) What the requirements for each "operation?" 3) What are the requirements for the "ONAP instance?"

    • Life Cycle Operations  of VNF (long term vision) - my version of FCAPS:
    • Fault Management
    • Capacity Management
    • Billing/Accounting Management
    • Performance Management
    • Security Management 
• NFVI Validation:
  • Healthcheck?

Performance:

• NFVI Performance

  • Capacity:

  • Stability:

    • Chaos monkey tests?
  • What is my reference implementation of NFVI? GSMA Profiles (B, N, and C).
  • What are the metrics we need to measure? (align with ETSI, GSMA defined metrics).
    • 1 test per metric?
• VNF Performance.
  • huge dependency on NFVI. need reference NFVI to compare against. (GSMA Profiles).
  • what are the metrics we need to measure? (align with ETSI, GSMA defined metrics).
    • 1 test per metric?

Security:

• Compliance:

• Validation:

• Open question: Where do these requirements come from? Who is responsible for the test cases?

NFVI Testing

• Performance:

Attachments

Slide presented/created in Paris 2019 F2f

...