According to the ISO 19011:2018 document, the audit plan should provide the basis for agreement regarding the conduct and scheduling of the audit activities. The amount of detail provided in the audit plan should reflect the scope and complexity of the audit, as well as the risk of not achieving the audit objectives1. The scope of the audit refers to the extent and boundaries of the audit, such as the audit criteria, the audit objectives, the organizational and functional units, and the processes to be audited1. The complexity of the audit refers to the degree of difficulty or intricacy of the audit, such as the number and diversity of the auditees, the audit criteria, the audit methods, and the audit team composition2. The risk of not achieving the audit objectives refers to the possibility that the audit may fail to provide reliable and sufficient audit evidence to support the audit conclusions and report1.

Therefore, the complete sentence is:

In the context of a third-party audit, the amount of detail provided in the audit plan should reflect the scope and complexity of the audit, as well as the risk of not achieving the audit objectives.

References: 1: ISO 19011:2018 - Guidelines for auditing management systems 2: Audit Complexity - an overview | ScienceDirect Topics

According to ISO 19011:2018, clause 6.3.2, an audit plan should include the following information:

• The audit objectives, scope, and criteria
• The audit team members and their roles and responsibilities
• The audit schedule, including the sequence and timings of audit activities, such as opening meeting, document review, interviews, observations, closing meeting, etc.
• The expected time and duration of each audit activity and location
• The name and contact details of the auditee’s representative and other relevant parties
• The allocation of appropriate resources to support the audit activities
• The audit methods and techniques to be used, such as interviews, observations, sampling, etc.
• The audit documents and records to be prepared and retained
• The audit language and communication methods
• The audit risks and opportunities and how to address them
• The audit follow-up arrangements, if applicable

Therefore, the correct answer is D and F, as they are essential elements of an audit plan. The other options are either irrelevant or optional for an audit plan. References:

• ISO 19011:2018(en), Guidelines for auditing management systems, clause 6.3.2
• ISO 19011: Guidelines for Auditing Management Systems | ASQ, section “Making audit arrangements”
• ISO 19011 Management Systems Audit Checklist | Process Street, task 6.3.2

A screenshot of a chat Description automatically generated

According to the ISO 9000:2015 document, the seven quality management principles are:

• Customer focus
• Leadership
• Engagement of people
• Process approach
• Improvement
• Evidence-based decision making
• Relationship management

For each principle, the document provides a statement, a rationale, key benefits, and actions you can take to apply the principle in your organization.

Based on the document, here is a possible way to match a potential benefit to each of the four quality management principles you mentioned:

Table

Quality management principle

Potential benefit

Customer focus

Increased revenue and market share

Engagement of people

Enhanced trust and collaboration throughout the organization

Improvement

Enhanced drive for innovation

Evidence-based decision making

Increased ability to demonstrate effectiveness of past actions

According to the ISO - Management system standards page, the key benefits of an effective management system include improved operational effectiveness and efficiency, improved risk management and protection of people and the environment, and enhanced drive for innovation. The Integrated Use of Management System Standards (IUMSS) handbook also states that the purpose and objectives of management system standards are to help organizations improve their performance by specifying repeatable steps that organizations consciously implement to achieve their goals and objectives.

Therefore, the complete sentence is:

“The purpose of a management system standard is to improve the performance of an organisation.”

A screenshot of a computer Description automatically generated

The activities that are specifically required by ISO 17021-1 as part of third-party (Certification Body) surveillance audit processes are:

•Option A: Audit use of certification marks on marketing materials. This option is correct because ISO 17021-1:2015 clause 9.6.2.2 requires the certification body to audit the client’s use of marks and/or any other reference to certification, as applicable, to ensure conformity with the certification requirements.

•Option B: Review changes to the QMS since last visit. This option is correct because ISO 17021-1:2015 clause 9.6.2.2 requires the certification body to review any changes affecting the client’s quality management system and its ability to continue to fulfil the requirements of the standard used for certification.

•Option C: Confirm effectiveness of internal audit and management review. This option is correct because ISO 17021-1:2015 clause 9.6.2.2 requires the certification body to confirm the continuing effectiveness of the client’s quality management system, including the effectiveness of the internal audit and management review processes.

•Option F: Review the status of previously raised findings and audit effectiveness of any outstanding findings. This option is correct because ISO 17021-1:2015 clause 9.6.2.2 requires the certification body to review the status of findings and any corrective actions taken by the client in response to previous audits, and to verify the effectiveness of the implemented corrective actions.

•Option H: Verify legal compliance. This option is correct because ISO 17021-1:2015 clause 9.6.2.2 requires the certification body to verify the client’s compliance with applicable statutory and regulatory requirements related to the scope of certification.

•Option I: Handling of customer complaints since last visit. This option is correct because ISO 17021-1:2015 clause 9.6.2.2 requires the certification body to review the client’s handling of customer complaints related to the certified activities since the last audit.

The following options are not correct:

•Option D: Complete a full document review of the quality management system. This option is not correct because ISO 17021-1:2015 clause 9.6.2.2 does not require the certification body to complete a full document review of the quality management system during surveillance audits. A full document review is only required during the initial certification audit or when there are significant changes to the quality management system or the certification requirements.

•Option E: Failing to meet financial responsibilities. This option is not correct because ISO 17021-1:2015 clause 9.6.2.2 does not require the certification body to audit the client’s financial responsibilities during surveillance audits. The certification body may have contractual arrangements with the client regarding the payment of fees, but this is not part of the surveillance audit process.

•Option G: Review the calibration status of the instrumentation. This option is not correct because ISO 17021-1:2015 clause 9.6.2.2 does not require the certification body to review the calibration status of the instrumentation during surveillance audits. The certification body may audit the client’s monitoring and measuring resources as part of the quality management system requirements, but this is not a specific activity required by ISO 17021-1.

•Option J: Conduct a minimum number of annual surveillance audits during the certification period. This option is not correct because ISO 17021-1:2015 clause 9.6.2.2 does not require the certification body to conduct a minimum number of annual surveillance audits during the certification period. The certification body may determine the frequency and duration of surveillance audits based on the risk and performance of the client, but this is not a specific activity required by ISO 17021-1.

References:

•ISO 17021-1:2015 Conformity assessment - Requirements for bodies providing audit and certification of management systems - Part 1: Requirements

•ISO 9001 Lead Auditor Course Material, Module 7: Audit Follow-up and Surveillance, Slide 8: Surveillance Audit

•ISO 9001 Lead Auditor Training Course - IRCA Certified, Section 7.2: Audit Follow-up and Surveillance

•Lead Auditor Exam Preparation Guide (EPG) Template - PECB, Section 3.2: Exam Content Outline, Subsection 3.2.1: Section 1 - Audit Fundamentals, Subsection 3.2.2: Section 2 - Audit Principles, Subsection 3.2.3: Section 3 - Audit Process, Subsection 3.2.4: Section 4 - Audit Competencies

According to the ISO 9001 Auditing Practices Group Guidance on Improvement Opportunities1, an improvement opportunity is a suggestion made by the auditor for the auditee to consider that, if implemented, may enhance the performance of the QMS. Improvement opportunities are not mandatory, but they should be based on objective evidence and aligned with the audit criteria and objectives. Improvement opportunities should also be realistic, feasible, and beneficial for the auditee. In this case, the evidence statements that represent acceptable improvement opportunities in the report are A, C, and E, because they address the potential causes and effects of the spelling errors in the print run, and propose possible actions that may improve the quality of the products and services, and the effectiveness of the QMS. These options are consistent with the requirements and principles of ISO 9001, such as clause 6.1 on actions to address risks and opportunities, clause 8.1 on operational planning and control, clause 8.5.1 on control of production and service provision, and clause 10.2 on nonconformity and corrective action. The other options are not appropriate improvement opportunities, because they are either irrelevant, unrealistic, or unhelpful for the auditee. For example, option B may contradict the audit objective and scope, option D may imply a lack of auditor competence or impartiality, option F may not address the root cause of the problem, option G may not be applicable or effective, and option H may not be feasible or justified. References: ISO 9001 Auditing Practices Group Guidance on Improvement Opportunities, ISO 9001:2015, ISO 9001 Auditing Practices Group Guidance on Audit Evidence

Match the process descriptions below to the process names:

The process by which the accuracy of test equipment is checked against a known standard. = Calibration

The process by which a product or service is visually examined to determine conformity to requirements. = Evaluation

The process by which data is examined in detail to reach a specific answer or answers. = Analysis

The process by which a parameter of a product or service is examined to determine a specific value. = Measurement

According to the ISO 9000:2015 - Quality management systems — Fundamentals and vocabulary, the definitions of the process names are as follows:

• Calibration: operation that, under specified conditions, in a first step, establishes a relation between the quantity values with measurement uncertainties provided by measurement standards and corresponding indications with associated measurement uncertainties and, in a second step, uses this information to establish a relation for obtaining a measurement result from an indication.
• Evaluation: determination of the suitability, adequacy or effectiveness of an object to achieve established objectives.
• Analysis: detailed examination of the elements or structure of something.
• Measurement: process to experimentally obtain one or more quantity values that can reasonably be attributed to a quantity.

Therefore, the process descriptions can be matched to the process names based on these definitions.

References:

ISO 9000:2015 - Quality management systems — Fundamentals and vocabulary

Sequence:

• Stage 1 Audit
• Stage 2 Opening Meeting
• Interviews
• Stage 2 Closing Meeting
• Close-out of Stage 2 Audit Findings
• Issue Certificate
• Surveillance Audit
• Follow-up Audit

To complete the sequence, you can drag and drop the options to the appropriate blank section.

Here is a brief explanation of each step:

• Stage 1 Audit: This is the initial audit that aims to assess the readiness of the organization for the stage 2 audit. It involves reviewing the documentation of the quality management system, evaluating the scope and objectives of the audit, and identifying any major gaps or nonconformities34.
• Stage 2 Opening Meeting: This is the meeting that marks the start of the stage 2 audit. It involves confirming the audit plan, the audit criteria, the audit scope, and the audit team. It also provides an opportunity for the auditee to ask any questions or raise any concerns34.
• Interviews: This is the main activity of the stage 2 audit, where the audit team collects evidence by interviewing the personnel involved in the quality management system, observing the processes and activities, and examining the records and documents. The audit team uses various techniques, such as sampling, measurement, analysis, and evaluation, to verify the conformity and effectiveness of the quality management system345.
• Stage 2 Closing Meeting: This is the meeting that marks the end of the stage 2 audit. It involves presenting the audit findings, the audit conclusions, and the audit report to the auditee. It also provides an opportunity for the auditee to provide feedback, ask questions, or dispute any findings34.
• Close-out of Stage 2 Audit Findings: This is the process of verifying that the auditee has taken appropriate corrective actions to address any nonconformities or opportunities for improvement identified during the stage 2 audit. The audit team may request evidence or conduct a follow-up visit to confirm the effectiveness of the corrective actions34.
• Issue Certificate: This is the process of issuing a certificate of conformity to the auditee, if the audit team is satisfied that the quality management system meets the requirements of the standard and that there are no major nonconformities or unresolved issues. The certificate is valid for a specified period, usually three years, and is subject to periodic surveillance audits34.
• Surveillance Audit: This is the process of conducting periodic audits, usually once a year, to monitor the continued conformity and effectiveness of the quality management system. It involves reviewing the changes, improvements, and performance of the quality management system, and identifying any new nonconformities or opportunities for improvement34.
• Follow-up Audit: This is the process of conducting an additional audit, usually in response to a significant change, a complaint, or a major nonconformity, to verify the impact and the corrective actions taken by the auditee. It may result in the suspension, withdrawal, or renewal of the certificate, depending on the outcome of the audit34.

The actions that should be taken in the context of the audit are:

•Option B: Call the individual(s) managing the audit programme to explain the situation and recommend immediate suspension of certification to protect the integrity of the Certification Body. This option is correct because the auditor has found serious and significant gaps in the QMS processes that affect the health and safety of the patients, which is a major nonconformity that may warrant suspension of certification. The auditor should inform the individual(s) managing the audit programme of the situation and the audit findings, and recommend immediate suspension of certification to protect the integrity of the Certification Body and the credibility of the certification scheme. The auditor should also follow the Certification Body’s procedures and rules for suspension of certification and communicate the decision and the consequences to the auditee.

•Option C: Continue with the meeting, present the audit conclusions and inform the DCM that the organisation will receive the audit report in due course. This option is correct because the auditor should not terminate or postpone the closing meeting due to the absence of the Catering Manager, as the DCM is the auditee’s nominated representative for the audit. The auditor should continue with the meeting, present the audit conclusions and the audit findings, and inform the DCM that the organisation will receive the audit report in due course. The auditor should also explain the audit outcome recommendation and the suspension of certification, and request the DCM to acknowledge the receipt and understanding of the audit results.

The following options are not correct:

•Option A: Close the meeting immediately after the DCM’s response and advise that the issues will be addressed at the next surveillance visit. This option is not correct because the auditor should not close the meeting without presenting the audit conclusions and the audit findings, as this would violate the audit principles of fairness and transparency. The auditor should also not advise that the issues will be addressed at the next surveillance visit, as this would imply that the auditor is accepting the auditee’s delay and inaction, and that the auditor is not taking the major nonconformity seriously.

•Option D: Conclude the meeting early and advise that it will be rescheduled once the Catering Manager has returned to work. This option is not correct because the auditor should not conclude the meeting early or reschedule it due to the absence of the Catering Manager, as this would disrupt the audit process and the audit schedule. The auditor should also not wait for the Catering Manager to return to work, as this would delay the communication and resolution of the major nonconformity, and potentially compromise the health and safety of the patients.

•Option E: Recommend that all personnel should be given urgent in-depth training in the QMS. This option is not correct because the auditor should not recommend or prescribe specific corrective actions to the auditee, as this would violate the audit principles of independence and objectivity. The auditor should only report the audit findings and the audit outcome recommendation, and leave the responsibility and authority for determining and implementing the corrective actions to the auditee.

•Option F: Thank the DCM for his time and express an expectation that improvements will be made in the QMS. This option is not correct because the auditor should not thank the DCM for his time and express an expectation that improvements will be made in the QMS, as this would imply that the auditor is satisfied and optimistic with the auditee’s performance and response, and that the auditor is not taking the major nonconformity seriously. The auditor should instead express the concern and dissatisfaction with the auditee’s QMS processes and the impact on the health and safety of the patients, and communicate the suspension of certification and the need for urgent and effective corrective actions.

References:

•ISO 19011:2018 Guidelines for auditing management systems, Clause 6.4.2: Conducting audit activities, Subclause k) and l)

•ISO 9001 Lead Auditor Course Material, Module 5: Conducting an Audit, Slide 20: Closing Meeting

•ISO 9001 Lead Auditor Training Course - IRCA Certified, Section 5.5: Closing Meeting

•Lead Auditor Exam Preparation Guide (EPG) Template - PECB, Section 3.2: Exam Content Outline, Subsection 3.2.1: Section 1 - Audit Fundamentals, Subsection 3.2.2: Section 2 - Audit Principles, Subsection 3.2.3: Section 3 - Audit Process, Subsection 3.2.4: Section 4 - Audit Competencies

• Establishing the audit programme objectives
• Determining and evaluating the audit programme risks and opportunities
• Establishing the audit programme
• Initiating the audit
• Preparing all audit activity
• Conducting the audit activities

According to ISO 19011:2018, clause 5, the audit programme is a set of one or more audits planned for a specific time frame and directed towards a specific purpose. The audit programme includes all activities necessary to plan, organize, and conduct the audits. The audit programme management involves the following steps1:

• Establishing the audit programme objectives: The audit programme objectives define the intended outcomes of the audit programme, such as verifying conformity, evaluating performance, identifying improvement opportunities, etc. The audit programme objectives should be aligned with the strategic direction and policies of the organization and the needs and expectations of the interested parties.
• Determining and evaluating the audit programme risks and opportunities: The audit programme risks and opportunities are the factors that can affect the achievement of the audit programme objectives, such as changes in the internal or external context, availability of resources, competence of auditors, etc. The audit programme risks and opportunities should be identified, analyzed, and evaluated to determine the appropriate actions to address them.
• Establishing the audit programme: The audit programme is established by defining the audit programme scope, criteria, methods, and resources. The audit programme scope defines the extent and boundaries of the audit programme, such as the processes, functions, sites, activities, etc. that will be audited. The audit programme criteria are the set of policies, procedures, or requirements used as a reference for the audits. The audit programme methods are the techniques used to conduct the audits, such as interviews, observations, document review, sampling, etc. The audit programme resources are the human, technical, and financial resources needed to implement the audit programme.
• Initiating the audit: The audit initiation is the process of formally establishing the arrangements for an individual audit within the audit programme. The audit initiation involves contacting the auditee and the audit client, confirming the audit objectives, scope, and criteria, and obtaining the necessary information and access for the audit.
• Preparing all audit activity: The audit preparation is the process of developing the audit plan and the audit work documents for an individual audit. The audit plan is a document that provides the basis for agreement regarding the conduct of the audit, such as the audit schedule, the audit team, the audit methods, the audit language, the audit report, etc. The audit work documents are the records that provide evidence of the audit activities, such as the audit checklist, the audit notes, the audit findings, etc.
• Conducting the audit activities: The audit activities are the processes of collecting and verifying audit evidence and evaluating it against the audit criteria to make the audit conclusions. The audit activities include the opening meeting, the communication during the audit, the roles and responsibilities of the audit team and the auditee, the audit evidence collection and verification, the audit findings generation and recording, the closing meeting, and the audit report preparation and distribution.

References: ISO 19011:2018(en), Guidelines for auditing management systems

Table

Statement

First-party audits

Second-party audits

Third-party audits

The audit scope is typically determined by the organisation being audited.

Yes

No

No

The outcome of the audit is typically certification to a recognised standard.

No

No

Yes

The audit scope is typically confined to service/product provision capability.

No

Yes

No

Here is a brief explanation of each statement:

• The audit scope is typically determined by the organisation being audited: This statement applies to first-party audits, also known as internal audits, where the organisation audits its own processes and activities to ensure conformity and improvement1. The organisation can decide the scope of the audit based on its own needs and objectives2. This statement does not apply to second-party audits, where the customer audits the supplier, or third-party audits, where an independent body audits the organisation. In these cases, the audit scope is determined by the customer or the certification body, respectively34.
• The outcome of the audit is typically certification to a recognised standard: This statement applies to third-party audits, where an independent body audits the organisation to verify that it meets the requirements of a specific standard, such as ISO 9001, and issues a certificate of conformity if the audit is successful34. This statement does not apply to first-party audits or second-party audits, where the outcome of the audit is not certification, but rather self-improvement or supplier qualification13.
• The audit scope is typically confined to service/product provision capability: This statement applies to second-party audits, where the customer audits the supplier to ensure that they are meeting the requirements specified in the contract, such as service or product quality, delivery, or performance34. The audit scope is usually focused on the specific aspects of the service or product that are of interest to the customer3. This statement does not apply to first-party audits or third-party audits, where the audit scope is broader and covers the entire quality management system or the relevant clauses of the standard14.