A. Concepts and Definitions
Software Quality Assurance (SQA) is defined as a planned and systematic approach to the evaluation of the quality of and adherence to software product standards, processes, and procedures. SQA includes the process of assuring that standards and procedures are established and are followed throughout the software acquisition life cycle. Compliance with agreed-upon standards and procedures is evaluated through process monitoring, product evaluation, and audits. Software development and control processes should include quality assurance approval points, where an SQA evaluation of the product may be done in relation to the applicable standards.
B. Standards and Procedures
Establishing standards and procedures for software development is critical, since these provide the framework from which the software evolves. Standards are the established criteria to which the software products are compared.
Procedures are the established criteria to which the development and control processes are compared. Standards and procedures establish the prescribed methods for developing software; the SQA role is to ensure their existence and adequacy. Proper documentation of standards and procedures is necessary since the SQA activities of process monitoring, product evaluation, and auditing rely upon unequivocal definitions to measure project compliance.
Types of standards include:
-Documentation Standards specify form and content for planning, control, and product documentation and provide consistency throughout a project.
-Design Standards specify the form and content of the design product. They provide rules and methods for translating the software requirements into the software design and for representing it in the design documentation.
-Code Standards specify the language in which the code is to be written and define any restrictions on use of language features. They define legal language structures, style conventions, rules for data structures
and interfaces, and internal code documentation.
C. Software Quality Assurance Activities
Product evaluation and process monitoring are the SQA activities that assure the software development and control processes described in the project's Management Plan are correctly carried out and that the project's procedures and standards are followed. Products are monitored for conformance to standards and processes are monitored for conformance to procedures. Audits are a key technique used to perform product evaluation and process monitoring. Review of the Management Plan should ensure that appropriate SQA approval points are built into these processes.
D. SQA Relationships to Other Assurance Activities
The more important relationships of SQA to other management and assurance activities are described below.
- Configuration Management Monitoring
SQA assures software Configuration Management (CM) activities are performed in accordance with the CM plans, standards, and procedures. SQA reviews the CM plans for compliance with software CM policies and requirements and provides follow-up for nonconformances. SQA audits the CM functions for adherence to standards and procedures and prepares reports of its findings. The CM activities monitored and audited by SQA include baseline control, configuration identification, configuration control, configuration status accounting, and configuration authentication.
- Verification and Validation Monitoring
SQA assures Verification and Validation (V&V) activities by monitoring technical reviews, inspections, and walkthroughs. The SQA role in formal testing is described in the next section. The SQA role in reviews, inspections, and walkthroughs is to observe, participate as needed, and verify that they were properly conducted and documented. SQA also ensures that any actions required are assigned, documented, scheduled, and updated. Formal software reviews should be conducted at the end of each phase of the life cycle to identify problems and determine whether the interim product meets all applicable requirements. Examples of formal reviews are the Preliminary Design Review (PDR), Critical Design Review (CDR), and Test Readiness Review (TRR).
- Formal Test Monitoring
SQA assures that formal software testing, such as acceptance testing, is done in accordance with plans and procedures. SQA reviews testing documentation for completeness and adherence to standards. The documentation review includes test plans, test specifications, test procedures, and test reports. SQA monitors testing and provides follow-up on non-conformances. By test monitoring, SQA assures software completeness and readiness for delivery.
E. Software Quality Assurance During the Software Acquisition Life Cycle
In addition to the general activities described in subsections C and D, there are phase-specific SQA activities that should be conducted during the Software Acquisition Life Cycle. At the conclusion of each phase, SQA concurrence is a key element in the management decision to initiate the following life cycle phase. Suggested activities for each phase are described below.
- Software Concept and Initiation Phase
SQA should be involved in both writing and reviewing the Management Plan in order to assure that the processes, procedures, and standards identified in the plan are appropriate, clear, specific, and auditable. During this phase, SQA also provides the QA section of the Management
Plan.
- Software Requirements Phase
During the software requirements phase, SQA assures that software requirements are complete, testable, and properly expressed as functional, performance, and interface requirements.
- Software Architectural (Preliminary) Design Phase
SQA activities during the architectural (preliminary) design phase include:
Assuring adherence to approved design standards as designated in the Management Plan.
Assuring all software requirements are allocated to software components.
Assuring that a testing verification matrix exists and is kept up to date.
Assuring the Interface Control Documents are in agreement with the standard in form and content.
Reviewing PDR documentation and assuring that all action items are resolved.
Assuring the approved design is placed under configuration management.
- Software Detailed Design Phase
SQA activities during the detailed design phase include:
Assuring that approved design standards are followed.
Assuring that allocated modules are included in the detailed design.
Assuring that results of design inspections are included in the design.
Reviewing CDR documentation and assuring that all action items are resolved.
- Software Implementation Phase
SQA activities during the implementation phase include the audit of:
Results of coding and design activities including, the schedule contained in the Software Development Plan.
Status of all deliverable items.
Configuration management activities and the software development library.
Non-conformance reporting and corrective action system.
- Software Integration and Test Phase
SQA activities during the integration and test phase include:
Assuring readiness for testing of all deliverable items.
Assuring that all tests are run according to test plans and procedures and that any non-conformances are reported and resolved.
Assuring that test reports are complete and correct.
Certifying that testing is complete and software and documentation are ready for delivery.
Participating in the Test Readiness Review and assuring all action items are completed.
- Software Acceptance and Delivery Phase
As a minimum, SQA activities during the software acceptance and delivery phase include assuring the performance of a final configuration audit to demonstrate that all deliverable items are ready for delivery.
- Software Sustaining Engineering and Operations Phase
During this phase, there will be mini-development cycles to enhance or correct the software. During these development cycles, SQA conducts the appropriate phase-specific activities described above.
F. Techniques and Tools
SQA should evaluate its needs for assurance tools versus those available off-the-shelf for applicability to the specific project, and must develop the others it requires. Useful tools might include audit and inspection checklists and automatic code standards analyzers.
Delta consultants stand ready to deploy all types of testing activities, including:
- Functional Testing
- Regression Testing
- Performance Testing
- Compatibility Testing
- Security Testing
- Automated Testing
Delta's Solution |
|