Science manufacturing process operative

This document explains the requirements for end-point assessment (EPA) for the science manufacturing process operative apprenticeship. End-point assessment organisations (EPAOs) must follow this when designing and delivering the EPA.

Science manufacturing process operative apprentices, their employers and training providers should read this document.

An approved EPAO must conduct the EPA for this apprenticeship. Employers must select an approved EPAO from the register of end-point assessment organisations (RoEPAO).

A full-time apprentice typically spends 18 months on-programme (this means in training before the gateway) working towards competence as a science manufacturing process operative. The apprentice must spend at least 12 months on-programme. The apprentice must complete the required amount of off-the-job training specified by the apprenticeship funding rules.

This EPA has 3 assessment methods.

The grades available for each assessment method are:

Assessment method 1 - observation with questions:

• fail

• pass

• distinction

Assessment method 2 - interview underpinned by a portfolio of evidence:

• fail

• pass

• distinction

Assessment method 3 - multiple-choice test:

• fail

• pass

The result from each assessment method is combined to decide the overall apprenticeship grade. The following grades are available for the apprenticeship:

• fail

• pass

• merit

• distinction

The EPA is taken in the EPA period. The EPA period starts when the EPAO confirms the gateway requirements have been met and is typically 3 months.

The expectation is that the EPAO will confirm the gateway requirements have been met and the EPA starts as quickly as possible.

The apprentice’s employer must confirm that they think their apprentice is working at or above the occupational standard. The apprentice will then enter the gateway. The employer may take advice from the apprentice's training provider(s), but the employer must make the decision.

The apprentice must meet the gateway requirements before starting their EPA.

These are:

• achieved English and maths qualifications in line with the apprenticeship funding rules

• for the interview underpinned by a portfolio of evidence the apprentice must submit a portfolio of evidence

Portfolio of evidence requirements:

The apprentice must compile a portfolio of evidence during the on-programme period of the apprenticeship. It should only contain evidence related to the KSBs that will be assessed by this assessment method. It will typically contain 10 discrete pieces of evidence. Evidence must be mapped against the KSBs. Evidence may be used to demonstrate more than one KSB; a qualitative as opposed to quantitative approach is suggested.

Evidence sources may include:

• workplace records
• workplace policies and procedures
• witness statements
• annotated photographs
• video clips (maximum total duration 10 minutes); the apprentice must be in view and identifiable
• learning records and development plans

This is not a definitive list; other evidence sources can be included.

The portfolio of evidence should not include reflective accounts or any methods of self-assessment. Any employer contributions should focus on direct observation of performance (for example, witness statements) rather than opinions. The evidence provided should be valid and attributable to the apprentice; the portfolio of evidence should contain a statement from the employer and apprentice confirming this.

The EPAO should not assess the portfolio of evidence directly as it underpins the interview. The independent assessor should review the portfolio of evidence to prepare questions for the interview. They are not required to provide feedback after this review.

The apprentice must submit any policies and procedures as requested by the EPAO.

The assessment methods can be delivered in any order.

The result of one assessment method does not need to be known before starting the next.

Overview

In the observation with questions, an independent assessor observes the apprentice in their workplace and asks questions. The apprentice completes their day-to-day duties under normal working conditions. Simulation is not permitted. It gives the apprentice the opportunity to demonstrate the KSBs mapped to this assessment method.

Rationale

This assessment method is being used because:

• this is a practical role, best demonstrated through completing tasks in a real work setting
• observation makes use of employer resources and equipment which will be familiar to the apprentice and thus allow them to perform at their best
• questioning allows for the assessment of the breadth and depth of underpinning knowledge against the grading descriptors
• tasks completed during the observation should contribute to workplace productivity and are valid
• it is a holistic assessment method

Delivery

The observation with questions must be structured to give the apprentice the opportunity to demonstrate the KSBs mapped to this assessment method to the highest available grade.

An independent assessor must conduct and assess the observation with questions.

The independent assessor must only observe one apprentice at a time to ensure quality and rigour. They must be as unobtrusive as possible.

The EPAO must give an apprentice 2 weeks notice of the observation with questions.

The observation must take 2 hours.

The independent assessor can increase the time of the observation with questions by up to 10%. This time is to allow the apprentice to complete a task or respond to a question if necessary.

The observation may be split into discrete sections held on the same working day.

The EPAO must manage invigilation of the apprentice during the assessment, to maintain security of the EPA, in line with their malpractice policy. This includes breaks and moving between locations during the working day.

The independent assessor must explain to the apprentice the format and timescales of the observation with questions before it starts. This does not count towards the assessment time.

The independent assessor should observe the following during the observation:

• carry out process manufacturing operations
• arrange and prepare materials for process activity
• contribute to quality control
• complete process work records
• contribute to maintaining own work area (housekeeping)

Activities may be completed in relation to the same process or different processes.

These activities provide the apprentice with the opportunity to demonstrate the KSBs mapped to this assessment method.

The independent assessor must ask questions. The purpose of the independent assessor's questions is to test the apprentice’s breadth and depth of underpinning knowledge against the grading descriptors.

Questioning can occur both during and after the observation. The time for questioning is included in the overall assessment time. The independent assessor must ask at least 5 questions. To remain as unobtrusive as possible, the independent assessor should ask questions during natural stops between tasks and after completion of work rather than disrupting the apprentice’s flow. Follow-up questions are allowed where clarification is required. The independent assessor must use the questions from the EPAO’s question bank or create their own questions in-line with the EPAO’s training.

The independent assessor must ask questions about KSBs that were not observed to gather assessment evidence. These questions are in addition to the above set number of questions for the observation with questions and should be kept to a minimum.

The independent assessor must make the grading decision. The observation and responses to questions must be assessed holistically by the independent assessor when they are deciding the grade.

The independent assessor must keep accurate records of the assessment. They must record:

• the KSBs observed
• the apprentice’s answers to questions
• the KSBs demonstrated in answers to questions
• the grade achieved 

Assessment location

The observation with questions must take place in the apprentice’s normal place of work (for example their employer’s premises or a customer’s premises). Equipment and resources needed for the observation must be provided by the employer and be in good and safe working condition.   

Questioning that occurs after the observation should take place in a quiet room, free from distractions and influence.

Question and resource development

The EPAO must develop a purpose-built assessment specification and question bank. It is recommended this is done in consultation with employers of this occupation. The EPAO should maintain the security and confidentiality of EPA materials when consulting employers. The assessment specification and question bank must be reviewed at least once a year to ensure they remain fit-for-purpose.  

The assessment specification must be relevant to the occupation and demonstrate how to assess the KSBs mapped to this assessment method. The EPAO must ensure that questions are refined and developed to a high standard. The questions must be unpredictable. A question bank of sufficient size will support this.

The EPAO must produce the following materials to support the observation with questions:

• independent assessor assessment materials which include:
  • training materials
  • administration materials
  • moderation and standardisation materials
  • guidance materials
  • grading guidance
  • question bank
• EPA guidance for the apprentice and the employer

The EPAO must ensure that the EPA materials are subject to quality assurance procedures including standardisation, training, and moderation.

Overview

In the interview, an independent assessor asks the apprentice questions. The apprentice can refer to and illustrate their answers with evidence from their portfolio of evidence. It gives the apprentice the opportunity to demonstrate the KSBs mapped to this assessment method.

Rationale

This assessment method is being used because:

• it allows for assessment of KSBs that do not occur on a predictable or regular basis
• it allows for testing of responses where there are a range of potential answers that cannot be tested through the multiple-choice test
• it can be conducted remotely, potentially reducing cost

Delivery

The interview must be structured to give the apprentice the opportunity to demonstrate the KSBs mapped to this assessment method to the highest available grade.

An independent assessor must conduct and assess the interview.

The purpose of the independent assessor's questions will be to cover the following themes:

• science manufacturing process operative’s role
• stock control
• end of process procedures
• environment and sustainability
• continuous improvement
• information technology
• team working

The EPAO must give an apprentice 2 weeks notice of the interview.

The independent assessor must have at least 2 weeks to review the supporting documentation.

The apprentice must have access to their during the interview.

The apprentice can refer to and illustrate their answers with evidence from their portfolio of evidence however, it is not directly assessed.

The interview must last for 60 minutes. The independent assessor can increase the time of the interview by up to 10%. This time is to allow the apprentice to respond to a question if necessary.

The independent assessor must ask at least 7 questions. Follow-up questions are allowed where clarification is required. The independent assessor must use the questions from their EPAO’s question bank or create their own questions in-line with the EPAO’s training.

The independent assessor must make the grading decision. The independent assessor must keep accurate records of the assessment. They must record:

• the apprentice’s answers to questions
• the KSBs demonstrated in answers to questions
• the grade achieved 

Assessment location

The interview must take place in a suitable venue selected by the EPAO (for example the EPAO’s or employer’s premises).

The interview can be conducted by video conferencing. The EPAO must have processes in place to verify the identity of the apprentice and ensure the apprentice is not being aided.

The interview should take place in a quiet room, free from distractions and influence.

Question and resource development

The EPAO must develop a purpose-built assessment specification and question bank. It is recommended this is done in consultation with employers of this occupation. The EPAO should maintain the security and confidentiality of EPA materials when consulting employers. The assessment specification and question bank must be reviewed at least once a year to ensure they remain fit-for-purpose.  

The assessment specification must be relevant to the occupation and demonstrate how to assess the KSBs mapped to this assessment method. The EPAO must ensure that questions are refined and developed to a high standard. The questions must be unpredictable. A question bank of sufficient size will support this.

The EPAO must ensure that apprentice has a different set of questions in the case of re-sits or re-takes.

The EPAO must produce the following materials to support the interview underpinned by a portfolio of evidence:

• independent assessor assessment materials which include:
  • training materials
  • administration materials
  • moderation and standardisation materials
  • guidance materials
  • grading guidance
  • question bank
• EPA guidance for the apprentice and the employer

The EPAO must ensure that the EPA materials are subject to quality assurance procedures including standardisation, training, and moderation.

Overview

A multiple-choice test is an assessment for asking questions in a controlled and invigilated environment. It gives the apprentice the opportunity to demonstrate the knowledge mapped to this assessment method.

Rationale

This assessment method is being used because:

• it allows for the efficient testing of knowledge where there is a right or wrong answer
• it allows for flexibility in terms of when, where and how it is taken
• it allows larger volumes of apprentices to be assessed at one time

Delivery

This multiple-choice test must be appropriately structured to give the apprentice the opportunity to demonstrate the knowledge mapped to this assessment method to the highest available grade.

The multiple-choice test can be computer or paper based.

The multiple-choice test must consist of 40 multiple-choice questions.

Multiple-choice questions must have four options, with one correct answer.

The apprentice must be given at least 2 weeks notice of the date and time of the multiple-choice test.

Test administration

The apprentice must have 60 minutes to complete the multiple-choice test.

The multiple-choice test is closed book which means that the apprentice cannot refer to reference books or materials whilst taking the test.

The multiple-choice test must be taken in the presence of an invigilator who is the responsibility of the EPAO. If the test can be taken on-line, specialised (proctor) software can be used to ensure the security of the test.

The EPAO must have an invigilation policy setting out how the multiple-choice test must be conducted. It must state the ratio of apprentices to invigilators for the setting and allow the test to take place in a secure way.

The EPAO must verify the identity of the apprentice.

The EPAO is responsible for the security of the multiple-choice test including the arrangements for on-line testing. The EPAO must ensure that their security arrangements maintain the validity and reliability of the multiple-choice test.

Marking

The multiple-choice test must be marked by an independent assessor or marker employed by the EPAO. They must follow a marking scheme produced by the EPAO. Marking by computer is allowed.

A correct answer gets 1 mark.

Any incorrect or missing answers get zero marks.

The EPAO is responsible for overseeing the marking of the multiple-choice test. The EPAO must ensure standardisation and moderation of written response test.

Assessment location

The apprentice must take the multiple-choice test in a suitably controlled and invigilated environment that is a quiet room, free from distractions and influence. The EPAO must check the venue is suitable.

The multiple-choice test could take place remotely if the appropriate technology and systems are in place to prevent malpractice. The EPAO must verify the apprentice’s identity and ensure invigilation of the apprentice for example with, and not limited to, 360-degree cameras and screen sharing facilities.

Question and resource development

The EPAO must write an assessment specification and question bank. It is recommended this is done in consultation with the employers of this occupation. The EPAO should maintain the security and confidentiality of EPA materials when consulting employers.

The specification must be relevant to the occupation and demonstrate how to assess the KSBs mapped to this assessment method. The EPAO must develop a purpose-built question bank and ensure that appropriate quality assurance procedures are in place for example, considering standardisation, training and moderation. The EPAO must ensure that questions are refined and developed to a high standard. The questions must be unpredictable. A question bank of sufficient size will support this. The assessment specification and questions must be reviewed at least once a year to ensure they remain fit-for-purpose.

The EPAO must ensure that an apprentice has a different set of questions in the case of re-sits or re-takes.

The EPAO must produce the following material to support this assessment method:

• independent assessor assessment materials which include:
  • training materials
  • administration materials
  • moderation and standardisation materials
  • guidance materials
  • grading guidance
  • test specification
  • sample test and mark schemes
  • live tests and mark schemes
  • question bank
• EPA guidance for the apprentice and the employer

The assessment methods contribute equally to the overall EPA pass grade.

Performance in the EPA determines the apprenticeship grade of:

• fail

• pass

• merit

• distinction

An independent assessor must individually grade the observation with questions and interview underpinned by a portfolio of evidence according to the requirements set out in this EPA plan.

The EPAO must combine the individual assessment method grades to determine the overall EPA grade.

If the apprentice fails one or more assessment methods, they will be awarded an overall EPA fail.

The apprentice must achieve at least a pass in all the assessment methods to get an overall pass. To achieve an overall EPA merit, the apprentice must achieve a distinction in one assessment method (the observation with questions or interview underpinned by a portfolio of evidence), and a pass in the other assessment methods. To achieve an overall EPA distinction, the apprentice must achieve a distinction in the observation with questions and interview underpinned by a portfolio of evidence, and a pass in the multiple-choice test.

Grades from individual assessment methods must be combined in the following way to determine the grade of the EPA overall.

If the apprentice fails one or more assessment methods they can take a re-sit or a re-take at their employer’s discretion. The apprentice’s employer needs to agree that a re-sit or re-take is appropriate. A re-sit does not need further learning, whereas a re-take does.The apprentice should have a supportive action plan to prepare for a re-sit or a re-take.

The employer and EPAO agree the timescale for a re-sit or re-take. A re-sit is typically taken within 2 months of the EPA outcome notification. The timescale for a re-take is dependent on how much re-training is required and is typically taken within 4 months of the EPA outcome notification.

Failed assessment methods must be re-sat or re-taken within a 6-month period from the EPA outcome notification, otherwise the entire EPA will need to be re-sat or re-taken in full.

Re-sits and re-takes are not offered to an apprentice wishing to move from pass to a higher grade.

The apprentice will get a maximum EPA grade of pass for a re-sit or re-take, unless the EPAO determines there are exceptional circumstances.

The EPAO must have reasonable adjustments arrangements for the EPA.

This should include:

• how an apprentice qualifies for reasonable adjustment
• what reasonable adjustments may be made

Adjustments must maintain the validity, reliability and integrity of the EPA as outlined in this EPA plan.

Internal quality assurance refers to how the EPAO ensures valid, consistent and reliable EPA decisions. The EPAO must adhere to the requirements within the roles and responsibilities section.

They must also:

• have effective and rigorous quality assurance systems and procedures that ensure fair, reliable and consistent EPA regardless of employer, place, time or independent assessor
• appoint independent assessors who are competent to deliver the EPA and who:
  • have recent relevant experience of the occupation or sector to at least occupational level 3 gained in the last 2 years or significant experience of the occupation or sector
• operate induction training for anyone involved in the delivery or assessment of the EPA
• provide training for independent assessors in good assessment practice, operating the assessment tools and making grading decisions
• provide ongoing training for markers and invigilators
• provide standardisation activity for this apprenticeship for independent assessors:
  • before they conduct an EPA for the first time
  • if the EPA is updated
  • periodically as appropriate (a minimum of annually)
• conduct effective moderation of EPA decisions and grades
• conduct appeals where required, according to the EPAO’s appeals procedure, reviewing and making final decisions on EPA decisions and grades
• have no direct connection with the apprentice, their employer or training provider

Affordability of the EPA will be aided by using at least some of the following:

• completing applicable assessment methods online (for example computer-based assessment)

• utilising digital remote platforms to conduct applicable assessment methods

• assessing multiple apprentices simultaneously where the method of assessment permits this

• using the employer’s premises

• conducting assessment methods on the same day

Professional body recognition is not relevant to this occupational apprenticeship.