Engineering software testing
Overview
This standard identifies the competences you need to test software as part of the product definition activity, in accordance with approved procedures. You will be given a detailed brief and will be required to assess these requirements and to extract all necessary information in order to carry out the software test activity. You will need to select the appropriate software test method to use, based on the type and complexity of the software functions/software design/requirements to be tested. You will be expected to use current British, European, international and company standards to test the software. Peer review feedback will also need to be evaluated and undertaken, and any lessons learned from the activity will need to be shared within the business.
Your responsibilities will require you to comply with organisational policy and procedures for working in the software development team. You will be required to report any problems with the computer hardware, software or procedures that you cannot personally resolve, or that are outside your permitted authority, to the relevant people. You will be expected to work to verbal/written instructions and draft specifications, with a minimum of supervision, taking personal responsibility for your own actions and for the quality and accuracy of the work that you carry out.
Your underpinning knowledge will provide a good understanding of your work, and will provide an informed approach to applying software test procedures. You will understand the computer system and software used, and its application, and will know about the various tools and techniques used to test the software, in adequate depth to provide a sound basis for carrying out the activities to the required specification.
You will understand the safety precautions required when working in the software development team. You will be required to demonstrate safe working practices throughout, and will understand the responsibility you owe to yourself and others in the workplace.
Performance criteria
You must be able to:
- work safely at all times, complying with health and safety legislation, regulations, directives and other relevant guidelines
- plan the software testing activities before you start them
- use appropriate sources to obtain the required information for the software testing activity
- access and use the correct software test tools
- use appropriate techniques to create the software tests
- use references that follow the required conventions
- produce the finished test script/case, with sufficient detail to allow execution
- make sure that the test script/case is checked and approved by the appropriate person
- save and store the test script/case as the appropriate file type and in the correct location
- execute a test script/case and record the results
- undertake and evaluate peer review feedback, and identify what lessons can be learned from the feedback
- provide technical feedback on the engineering software testing activity undertaken including lessons learnt and those lessons which can be shared within the business
- review the results of the test script/case
- deal promptly and effectively with problems within your control, and seek help and guidance from the relevant people if you have problems that you cannot resolve
Knowledge and Understanding
You need to know and understand:
- the specific safety precautions to be taken when working with software development environment hardware (to include such items as safety guidance relating to the use of visual display unit (VDU) equipment and work station environment such as lighting, seating, positioning of equipment; repetitive strain injury (RSI); the dangers of trailing leads and cables; how to spot faulty or dangerous electrical leads, plugs and connections)
- the importance of good housekeeping arrangements (such as cleaning down work surfaces; putting media, manuals and unwanted items of equipment into safe storage; leaving the work area in a safe and tidy condition)
- the relevant sources and methods for obtaining any required technical information relevant to the test script/case being produced (such as new model brief/request, drawing briefs, specification sheets, request for changes or modifications to code; technical publications, calculations, software requirements)
- test methodologies and national, international and relevant company software test procedures (such as black box, white box testing)
- identification of the correct version of software tool, and the various testing techniques that are supported by the tool
- how to use and configure the testing environment (such as target, host and target simulator)
- the basic principles of software testing, and how to create suitable tests for the particular application
- how to access the specific software requirements, design model and code to be tested
- the national, international and organisational standards and conventions that are used for the test script/case and results
- the application and use of software testing tools
- how to access, recognise and use a wide range of standard components and symbol libraries from the testing tools
- the need for configuration control on all test artefacts (such as ensuring that completed test script/case and results are approved, labelled and stored on a suitable storage device)
- how to evaluate and undertake any peer review feedback and how any lessons learned from the engineering testing activity can be shared within the business
- why it is necessary to be able to recall previous issues of test script/case and results
- when to act on your own initiative and when to seek help and advice from others
Scope/range
Scope Performance
Prepare for the software testing activities, by carrying out all of the following:
- check that the working environment is in a safe and appropriate condition and that all working equipment is in a safe, tested and usable condition (such as cables undamaged, correctly connected, safely routed)
- start the appropriate software test tool
- set up the testing environment and select a suitable template/folder
- identify relevant software requirements/design to be tested against
- identify the required standards and all relevant sources (such as software requirements, design and software test methods)
Use four of the following to obtain the necessary data to produce the required test script/case:
- change order/modification request
- standards reference documents
- technical publications
- specifications
- calculations
- regulations
- software requirements
- software design
- technical notes (such as meetings/discussions, e-mail)
- other specific available data
Demonstrate how the software testing takes account of seven of the following:
- function
- cost
- operating environment
- quality
- lifetime of the product
- interfaces
- testing method
- accuracy
- safety
- resources (such as memory, performance and bandwidth)
- design structure
- software requirements
- run time sequencing
- system/software safety requirements
Carry out all of the following before producing the software test script/case:
- ensure that the data and information you have is complete and accurate
- analyse the data and information to identify the test script/case requirements
- recognise and deal with problems (such as technical issues and lack of information, or incorrect information)
Use both of the following modelling methodologies to produce the software test script/case:
- black box
- white box
Create/modify the software test script/case using five of the following:
- objects
- classes
- types
- functions
- procedures
- data
- change requests
- test rigs specifications
Run the test script using one of the following:
- target simulator environment
- host environment
- target environment
Check the test script/case for all of the following:
- completeness
- traceability
- accuracy
- sequencing
- coverage
Save and store the test script/case and results in appropriate locations, to include carrying out all of the following:
- check that the test script/case and results are correctly titled, referenced and annotated
- ensure that your test script/case and results have been checked and comply with company procedures
- save the test script/case and results to an appropriate location (such as storage device, configuration database)
- register and store the test script/case and results in the company information system (where appropriate)
- record and store any changes to the test script/case and results in the appropriate company information system
- ensure that a separate backup copy is created and placed in safe storage
Produce a test script/case which complies with one of the following:
- company standards and procedures
- customer standards and requirements
- statutory regulations and codes of practice
- software standards
- BS, ISO or BSEN standards and procedures
- other international standards
Scope Knowledge
Values
Behaviours
Additional Information
You will be able to apply the appropriate behaviours required in the workplace to meet the job profile and overall company objectives, such as:
- strong work ethic
- positive attitude
- team player
- dependability
- responsibility
- honesty
- integrity
- motivation
- commitment