Building services engineering senior technician

This document explains the requirements for end-point assessment (EPA) for the building services engineering senior technician apprentices. End-point assessment organisations (EPAOs) must follow this when designing and delivering their EPA.

Building services engineering senior technician apprentices, their employers and training providers should read this document.

An approved EPAO must conduct the EPA for this apprenticeship. Employers must select an approved EPAO from the Education and Skills Funding Agency’s Register of end-point assessment organisations (RoEPAO).

A full-time apprentice typically spends 36 months on-programme (this means in training before the gateway) working towards competence as a building services engineering senior technician. All apprentices must spend at least 12 months on-programme. All apprentices must spend at least 20% of their on-programme time completing off-the-job training.

This EPA has 2 EPA methods.

The grades available for each EPA method are:

EPA method 1 - technical project report and presentation with questioning:

• fail

• pass

• distinction

EPA method 2 - professional discussion underpinned by a portfolio:

• fail

• pass

• distinction

The result from each EPA method is combined to decide the overall apprenticeship grade. The following grades are available for the apprenticeship:

• fail

• pass

• distinction

The EPA will be taken within the EPA period. The EPA period begins when the EPAO confirms the gateway requirements are met and is typically 4 months.

The expectation is that the EPAO will confirm the gateway requirements are met and the EPA begins as quickly as possible.

The apprentice’s employer must confirm that they think the apprentice is working at or above the occupational standard as a building services engineering senior technician. They will then enter the gateway. The employer may take advice from the apprentice's training provider(s), but the employer must make the decision.

Apprentices must meet the following gateway requirements before starting their EPA.

These are:

• achieved English and mathematics at Level 2.

• achieved A Level 4 qualification in Construction and Built Environment that meets the knowledge requirements of the standard and is approved by the Engineering Council as meeting the learning outcomes specified for EngTech at level 4

• for the professional discussion underpinned by a portfolio apprentices must submit: portfolio of evidence

Portfolio of evidence requirements:

Apprentices must compile a portfolio of evidence during the on-programme period of the apprenticeship. It should contain evidence related to the KSBs that will be assessed by this assessment method. The portfolio of evidence will typically contain 12 discrete pieces of evidence. Evidence should be mapped against the KSBs.

Evidence may be used to demonstrate more than one KSB; a qualitative as opposed to quantitative approach is suggested.

Evidence must cover the following areas:

• design, technology and modelling in building services engineering
• project management and safe systems of working
• roles, responsibilities and engagement with others
• personal and professional practice

Evidence sources may include evidence of work undertaken which may be supported by:

• building services engineering designs
• technical drawings
• CAD/BIM/Revit models
• technical briefs
• industry specifications
• industry standards
• techncial reports
• project plans
• client or customer feedback
• witness statements
• employer/trainer feedback
• initial and continuous professional development and training records
• appraisal records
• training course completion

This is not a definitive list; other evidence sources can be included.

The portfolio should not include reflective accounts or any methods of self-assessment. Any employer contributions should focus on direct observation of performance (for example witness statements) rather than opinions. The evidence provided should be valid and attributable to the apprentice; the portfolio of evidence should contain a statement from the employer and apprentice confirming this.

The EPAO should not assess the portfolio of evidence directly as it underpins the discussion. Independent assessors should review the portfolio of evidence to prepare questions for the discussion assessment method. They are not required to provide feedback after this review.

Apprentices must submit any policies and procedures as requested by the EPAO.

The EPA period starts when the EPAO confirms all gateway requirements have been met. The expectation is they will do this as quickly as possible.

The assessment methods can be delivered in any order.

The result of one assessment method does not need to be known before starting the next.

Overview

A project involves the apprentice completing a significant and defined piece of work that has a real business application and benefit. The project must start after the apprentice has gone through the gateway.

The technical project report and presentation with questioning must be structured to give the apprentice the opportunity to demonstrate the KSBs mapped to this EPA method to the highest available grade.

The project must meet the needs of the employer’s business and be relevant to the apprentice’s occupation and apprenticeship. The EPAO must confirm that it provides the apprentice with the opportunity to demonstrate the KSBs mapped to this EPA method to the highest available grade. The EPAO must refer to the grading descriptors to ensure that projects are pitched appropriately.

This EPA method includes 2 components:

• project with a project output
• presentation with questions and answers.

The project and any components must be assessed holistically by the independent assessor when they are deciding the grade for this EPA method.

Rationale

This EPA method is being used because the technical project reflects an employer’s building services engineering challenges and is typical of the apprentice’s everyday work, ensuring that they can demonstrate KSBs in practice. As part of a building services engineering senior technician's role, they will be expected to plan and carry out technical projects, using appropriate engineering principles, theories, processes, and advanced mathematical and data analysis skills, before evaluating and proposing appropriate building engineering solutions, with consideration for a range of factors, back to various audiences through reports, presentations and discussions. Therefore, this method of assessment is deemed as the most appropriate for this occupation as it accurately reflects the environments and current workplace tasks of the apprentice. The technical project report, presentation and questioning allow for effective assessment of the KSBs assigned to this assessment method.

Component 1: Project with a project output

Delivery

Apprentices must complete a project which may be based on any of the following:

• a specific problem
• a recurring issue
• an idea or opportunity.

The EPAO must provide detailed specifications with what must be included in the project to allow an apprentice to evidence the KSBs mapped to the EPA method to the highest available grade.

The project output must be in the form of a report.

The apprentice must start the project after the gateway. They must complete and submit the report to the EPAO after a maximum of 6 weeks. The employer should ensure the apprentice has the time and resources within this period, to plan and complete their project. The apprentice must complete their project and the production of all its components unaided.

The apprentice may work as part of a team which could include technical internal or external support. However, the project output must be the apprentice’s own work and will be reflective of their own role and contribution. The apprentice and their employer must confirm that the project output(s) is the apprentice’s own work when it is submitted.

The report must include at least:

Apprentices will undertake a technical project after they have passed the gateway and produce a report that appropriately covers all of the KSBs assigned to this method of assessment.

The EPAO will issue the technical project brief to the apprentice at gateway aligned to their engineering specialism.

The technical project brief will reflect a real work-based building services engineering challenge in a subject area, providing a focus on an area such as:

• mechanical engineering
• electrical engineering
• mechanical and electrical engineering (M&E)
• public health engineering
• energy and building management systems
• environment and sustainability in building services engineering
• facilities management
• building services engineering contracting
• building services engineering manufacturing

The technical project brief, designed and issued by the EPAO, will typically be 500 words in length. The EPAO will design and issue guidance with the technical brief.

Technical project reports must include:

• an introduction
• the scope of the project
• key performance indicators
• a project plan, methodology and timeline for key tasks
• research and findings:
  • data collection, analysis and evaluation appropriate to the technical project and level of apprenticeship
• reference to:
  • relevant scientific and engineering principles and theories
  • relevant techniques, procedures and methods used
  • relevant drawings and mathematical calculations at level 4
  • the use of appropriate and approved materials, components or parts
  • relevant industry policies, standards, regulations and legislations
  • environmental and sustainability concerns
  • cost, quality, safety, security, environmental impact and lifecycle of building services engineering solutions
• project outcomes and the rationale for the chosen project solution presented
• conclusions

The apprentice must prepare a technical project report with appendices of supporting evidence relating to the technical project. The technical project report and all appendices of supporting evidence directly demonstrating performance of KSBs must be attributable in full. Evidence must be accompanied by a witness statement outlining the apprentice's contribution, signed by the apprentice and their employer authenticating it.

Examples of appendices of supporting evidence may include:

• plans
• diagrams
• calculations
• designs
• feedback
• video clips

This is not a definitive list and other evidence sources apart from self-reflection are permissible..

To allow the apprentice to apply for professional registration on completion of the apprenticeship, two independent assessors must holistically assess all assessment methods, in line with the independent assessor requirements set out in this plan. They will have equal responsibility in grading the assessment. The use of two independent assessors will enable the provision of balance to assessment, to bring in greater breadth and depth of technical expertise to questioning and discussion with the apprentice, elucidating more accurate grading decisions.

In the event that the two independent assessors cannot agree on whether to grade the technical project and presentation with a pass, fail or distinction, the EPAO is required to moderate in accordance with their moderation procedures. The EPAO will then make the final decision on the grade to award based on the assessment evidence presented.

The project report has a maximum word count of 3500 words. A tolerance of 10% above or below the word count is allowed at the apprentice’s discretion. Appendices, references and diagrams are not included in this total. The project report must map, in an appendix, how it evidences the relevant KSBs mapped to this EPA method.

Component 2: Presentation with questioning

Delivery

This is a formal presentation where an apprentice will present to an independent assessor on a set subject. The independent assessor must ask questions. Apprentices must prepare, submit and deliver a presentation. The presentation is restricted to the KSBs allocated to this EPA method as shown in the mapping section of this document.

The presentation and questioning must last 30 minutes This will typically include a presentation of 10 minutes and questioning lasting 20 minutes.

The independent assessor must ask at least 5 questions. They must use the questions from the EPAO’s question bank or create their own questions in-line with the EPAO’s training. Follow up questions are allowed where clarification is required.

The presentation will provide an overview of the apprentice’s project and the presentation with questions and answers. Independent assessors will ask questions after the presentation. All presentations must include at least:

• an overview of the project
• the project scope (including key performance indicators)
• summary of actions undertaken by the apprentice
• project outcomes and how these were achieved.

The apprentice must prepare and submit their presentation to the EPAO at the same time as the report which is a maximum of 6 weeks after the gateway.

The apprentice must notify the EPAO, at the submission of the presentation, of any technical requirements for the presentation.

The independent assessor must have at least 3 weeks to review the project output(s) and presentation before the presentation to allow them to prepare appropriate questions.

Apprentices must be given at least 1 week(s) notice of the date and time of the presentation or question and answer session.

Assessment location

The presentation with questioning must take place in a suitable venue selected by the EPAO for example the EPAO’s or employer’s premises.

The presentation with questioning should take place in a quiet room, free from distractions and influence.

Question and resource development

EPAOs must write an assessment specification and question bank. The specification must be relevant to the occupation and demonstrate how to assess the KSBs shown in the mapping. It is recommended this is done in consultation with employers of this occupation. EPAOs should maintain the security and confidentiality of EPA materials when consulting employers. The questions must be unpredictable. A question bank of sufficient size will support this. The assessment specification and questions must be reviewed at least once a year to ensure they remain fit-for-purpose.

EPAOs will develop purpose-built question banks and ensure that appropriate quality assurance procedures are in place, for example, considering standardisation, training and moderation. EPAOs will ensure that questions are refined and developed to a high standard.

EPAOs must ensure that apprentices have a different set of questions in the case of re-sits or re-takes.

• independent assessor EPA materials which include:
  • training materials
  • administration materials
  • moderation and standardisation materials
  • guidance materials
  • grading guidance
  • question bank
• EPA guidance for the apprentice and employer

Overview

In the professional discussion, an independent assessor and apprentice have a formal two-way conversation. It gives the apprentice the opportunity to demonstrate their competency across the KSBs as shown in the mapping.

Rationale

This EPA method is being used to assess those KSBs that are not likely to occur in the technical project report. Building services engineering senior technicians will be expected to be able to discuss their portfolio, where evidence and results of work-based tasks or projects carried out as part of their apprenticeship, can be used to underpin assessment in a formal setting and where apprentices’ will be able to explain their work in detail.

Delivery

The professional discussion must be structured to give the apprentice the opportunity to demonstrate the KSBs mapped to this EPA method to the highest available grade.

The purpose of the independent assessor's questions will be to:

• clarify any questions the independent assessors have from their review of the portfolio
• explore aspects of the work, including how it was carried out, in more detail
• require the apprentice to draw on their portfolio evidence to demonstrate the KSBs

The EPAO must give an apprentice 3 weeks notice of the professional discussion.

The independent assessor must have at least 3 week(s) to review the supporting documentation.

Apprentices must have access to their portfolio of evidence during the professional discussion.

Apprentices can refer to and illustrate their answers with evidence from their portfolio of evidence, however the portfolio of evidence is not directly assessed.

The professional discussion must last for 40 minutes. The independent assessor can increase the time of the professional discussion by up to 10%. This time is to allow the apprentice to respond to a question if necessary.

For the professional discussion, the independent assessor must ask at least 6 questions. Follow-up questions are allowed. The independent assessor must use the questions from the EPAO’s question bank or create their own questions in-line with the EPAO’s training. The professional discussion must allow the apprentice the opportunity to demonstrate the KSBs mapped to this EPA method at the highest possible grade.

The independent assessor conducts and assesses the professional discussion.

The independent assessor must keep accurate records of the assessment. The records must include the KSBs met, the grade achieved and answers to questions.

To allow the apprentice to apply for professional registration on completion of the apprenticeship, two independent assessors must holistically assess all assessment methods, in line with the independent assessor requirements set out in this plan. They will have equal responsibility in grading the assessment. The use of two independent assessors will enable the provision of balance to assessment, to bring in greater breadth and depth of technical expertise to questioning and discussion with the apprentice, elucidating more accurate grading decisions.

In the event that the two independent assessors cannot agree on whether to grade the technical project and presentation with a pass, fail or distinction, the EPAO is required to moderate in accordance with their moderation procedures. The EPAO will then make the final decision on the grade to award based on the assessment evidence presented.

Assessment location

The professional discussion must take place in a suitable venue selected by the EPAO (for example the EPAO’s or employer’s premises).

The professional discussion can be conducted by video conferencing. The EPAO must have processes in place to verify the identity of the apprentice and ensure the apprentice is not being aided.

The professional discussion should take place in a quiet room, free from distractions and influence.

Question and resource development

EPAOs must write an assessment specification and question bank. The specification must be relevant to the occupation and demonstrate how to assess the KSBs shown in the mapping. It is recommended this is done in consultation with employers of this occupation. EPAOs should maintain the security and confidentiality of EPA materials when consulting employers. The questions must be unpredictable. A question bank of sufficient size will support this. The assessment specification and questions must be reviewed at least once a year to ensure they remain fit-for-purpose.

EPAOs will develop purpose-built question banks and ensure that appropriate quality assurance procedures are in place, for example, considering standardisation, training and moderation. EPAOs will ensure that questions are refined and developed to a high standard.

EPAOs must ensure that apprentices have a different set of questions in the case of re-sits or re-takes.

EPAOs must produce the following materials to support the professional discussion underpinned by a portfolio:

• independent assessor assessment materials which include:
  • training materials
  • administration materials
  • moderation and standardisation materials
  • guidance materials
  • grading guidance
  • question bank
• EPA guidance for the apprentice and employer

The EPA methods contribute equally to the overall EPA grade.

Performance in the EPA will determine the apprenticeship grade of:

• fail

• pass

• distinction

Independent assessors must individually grade the: technical project report and presentation with questioning and professional discussion underpinned by a portfolio according to the requirements set out in this EPA plan.

EPAOs must combine the individual assessment method grades to determine the overall EPA grade.

Apprentices who fail one or more assessment method will be awarded an overall EPA fail.

Apprentices must achieve at least a pass in all the EPA methods to get an overall pass. In order to achieve an overall EPA ‘distinction’, apprentices must achieve a distinction in both assessment methods.

Grades from individual assessment methods should be combined in the following way to determine the grade of the EPA as a whole.

Apprentices who fail one or more EPA method(s) can take a re-sit or a re-take at the employer’s discretion. The apprentice’s employer needs to agree that a re-sit or re-take is appropriate. A re-sit does not need further learning, whereas a re-take does.

Apprentices should have a supportive action plan to prepare for a re-sit or a re-take.

The employer and EPAO agree the timescale for a re-sit or re-take. A re-sit is typically taken within 4 months of the EPA outcome notification. The timescale for a re-take is dependent on how much re-training is required and is typically taken within 6 months of the EPA outcome notification.

Failed EPA methods must be re-sat or re-taken within a 6-month period from the EPA outcome notification, otherwise the entire EPA will need to be re-sat or re-taken in full.

Re-sits and re-takes are not offered to apprentices wishing to move from pass to a higher grade.

An apprentice will get a maximum EPA grade of pass for a re-sit or re-take, unless the EPAO determines there are exceptional circumstances.

The EPAO must have reasonable adjustments arrangements for the EPA.

This should include:

• how an apprentice qualifies for reasonable adjustment
• what reasonable adjustments may be made

Adjustments must maintain the validity, reliability and integrity of the EPA as outlined in this EPA plan.

Internal quality assurance refers to how EPAOs ensure valid, consistent and reliable EPA decisions. EPAOs must adhere to the requirements within the roles and responsibilities section and:

• have effective and rigorous quality assurance systems and procedures that ensure fair, reliable and consistent EPA regardless of employer, place, time or independent assessor
• appoint independent assessors who are competent to deliver the EPA and who:
  • have recent relevant experience of the occupation or sector to at least occupational level 4 gained in the last 2 years or significant experience of the occupation or sector
  • hold, or are working towards, an assessor qualification
  • have professional body membership with:

    The Engineering Council, and registered with a relevant professional engineering institution (PEI)

  • meet the following minimum requirements:
    • be professionally active and maintain their cpd record annually
    • complete an epao induction to demonstrate working knowledge of the apprenticeship standard and assessment methodology
  • operate induction training for anyone involved in the delivery and/or assessment of the EPA
  • provide training for independent assessors in good assessment practice, operating the assessment tools and making grading decisions
  • provide ongoing training for markers and invigilators
  • provide standardisation activity for this apprenticeship standard for all independent assessors:
    • before they conduct an EPA for the first time
    • if the EPA is updated
    • periodically as appropriate (a minimum of annually)
  • conduct effective moderation of EPA decisions and grades
  • conduct appeals where required, according to the EPAO’s appeals procedure, reviewing and making final decisions on EPA decisions and grades
  • have no direct connection with the apprentice, their employer or training provider. In all instances, including when the EPAO is the training provider (for example a higher education institution)

Affordability of the EPA will be aided by using at least some of the following:

• utilising digital remote platforms to conduct applicable assessment methods

• using the employer’s premises

• conducting assessment methods on the same day

This apprenticeship standard is designed to prepare successful apprentices to meet the requirements for registration as a:

Engineering Council (EngTech) for level 4