Note:
Gradually refine testing processes in different test scenarios, evaluate the feasibility and difficulty of automated testing in each processes and scenarios. According to the feasibility analysis, summarize the changes before and after the automated testing, and then put forward relevant recommendations.
At the same time, after the introduction of the NFV automated testing, testing cycle, personnel reduction and other aspects will be theoretically evaluated to estimate efficiency improvement.
- Contributions:
- Lei Huang - use automated testing evaluation index model to investigate NFV automated testing feasibility
- Beth Cohen - optimize white paper
- Others?
According to the analysis of automated testing evaluation index model, NFV automated testing includes test environment deployment, configuration, test cases and execution, process observation, test reports output, etc. Specific test frameworks/tools can provide automation of related test phases, making automated testing feasible:
- The application of software and hardware products with interfaces defined by open standards makes it possible to automate the control of these products, and to complete the control of different devices through a unified interface, making automation test cases have a good replication usability.
- The existence of various open source or professional testing instruments and tools makes automated testing possible, such as SpecCpu-CPU performance testing tool, Stream-memory performance testing tool, FIO-storage performance testing tool, IxNetwork-professional network performance testing tool, Cloudpeak-expanded automated test suite based on Yardstick NFV test standard.
- Various CI/CD automation solutions and platforms make automated testing as well as continuous development and integration possible.
- Jenkins/pytest can drive the execution of test cases, Gitlab can realize project management and code hosting.
- The universal automated test framework integrates the capabilities of various third-party and open source test tools/instruments, which can realize automated test topology design, automated deployment of test environments, automated execution of test tasks, automated analysis and certification of test results.