Take-home exams
The digital alternative to in-person examinations
The current situation:
Due to the development of the pandemic, the University leadership has decided that written and oral examinations should be carried out digitally. This should give you the greatest possible certainty when you plan and ensure that, with few exceptions, you can take your examinations in February and March even if there is a stricter lockdown.
Conducting supervised electronic written examinations as a substitute for in-presence written examinations is not possible in Hamburg for legal reasons. However, as the University is obligated to conduct examinations (as far is possible in pandemic conditions) in a skills-based manner, alternative digital forms of examination have been introduced as a replacement for written examinations.
Therefore, certain faculties have integrated take-home examinations into their examination regulations as a replacement for written examinations, which can currently not be conducted. Because of the many ways they can be conducted, take-home examinations lend themselves particularly well to study and examination conditions during a pandemic.
The Faculty of Business, Economics and Social Sciences/Business Administration (WiSo/BWL) and the Faculty of Law have already incorporated this examination method as an alternative to in-person examinations into their examination regulations and/or subject-specific provisions (FSBs). The Faculty of Psychology and Human Movement Science and the MIN Faculty have already passed corresponding resolutions, which will soon be approved by the Executive University Board. [Last updated: 18 January 2021]
Content:
Planning
Planning
What is a take-home exam?
During a take-home exam (THE), students work on one or multiple assignments
- handwritten or electronically,
- on their own,
- without supervision,
- while using permitted tools and resources (if applicable),
- within a set time and
- within a set period (by a deadline), which may be longer than the actual completion time.
The examination regulations give examiners certain freedoms regarding the specific design of take-home exams. This applies, among other factors, to the completion time (within the scope of the applicable examination regulations) and the completion period.
Each set of examination regulations specifies its own completion time. The guidelines are:
- 120–180 minutes for the Faculty of Law,
- 60–240 minutes for the Faculty of Business, Economics and Social Sciences, the Faculty of Mathematics and Natural Sciences, and the Faculty of Psychology and Human Movement Science.
- 60–180 minutes for the Faculty of Business Administration (Hamburg Business School).
Examiners specify the specific completion time within the timeframe issued by the guideline that applies to their subject.
The period between the distribution of the assignment and the submission deadline may exceed the specified completion time. The examination regulations do not provide any guidelines for that period.
As a general rule of thumb: the longer the period between the distribution of the examination questions and the submission of the answers, the better the chance students have of carrying out their own research and consulting sources that will help them answer the question. Examiners are asked to bear this in mind when phrasing the assignment question and set the completion period accordingly (also see the note on didactic aspects on this page).
Take-home exams can be carried out in two ways:
Version 1: completion period plus technical buffer = examination duration
The completion time is similar to that of a written examination. When determining what completion period to set, bear in mind that students may struggle with a brief loss of internet connectivity, small time-lags or technical issues. There may also be minimal differences in the time displayed on their devices. Ensure that your schedule gives students appropriate flexilibility to prevent conflicts under the examination regulations. Experience has shown that a 15-minute buffer period is fair and feasible. In this version, the completion period corresponds to the completion time plus a 15-minute buffer to ensure that students can manage the technical aspects of the examination, such as downloading the assignment, uploading their answers, and completing the declaration of originality.
Students simultaneously complete the assignment at a computer (in any location). They may use permitted tools, such as lecture notes or textbooks (open-book exam). The tight completion period limits their ability to conduct in-depth research, so examiners can set similar questions as those used for in-person examinations. If the take-home exam consists of multiple-choice exercises, the answers and/or questions can be assigned randomly. The completion order of individual questions can be fixed to prevent jumping between questions. If necessary, examiners can require their students to complete the take-home exam in handwriting, photograph and scan their work, and then upload it.
Version 2: significantly extended completion period
In this version, examiners set a binding completion period (for example, 24 hours, 3 days, 1 week etc.) Students need to complete their take-home exam within that period and within the time specified by the examiners in accordance with the respective examination regulations (see above). This means that the students do complete the examination in the same amount of time, but they can decide for themselves when exactly to do so. Again, students complete the examination using a computer in any location. They may access permitted tools and resources, such as lecture notes, textbooks, online resources etc. (= open-book exam). The extended completion period allows them to undertake more in-depth research, which should be taken into consideration when phrasing the questions.
In both versions, examiners can set the required volume (e.g., number of pages etc.) of the answers.
It is recommended that students are given a practice take-home exam process in advance as part of a mock exam, either remotely or in class. You can thus ensure that all students are familiar with the new examination format. Regardless of the version you choose, it is important that students are aware of the new process and rules in advance.
<div id="aufgabe-ergaenzen">What information do students need in addition to the assignment?</div>
Apart from the assignment itself, the exam needs to include sufficiently large text fields for the students to provide their personal data (name, surname, student ID number).
Tell your students which tools and resources they are allowed to consult to complete the assignment. Any tools or resources that are not mentioned explicitly are prohibited. This is essential in assessing cheating allegations (more on this in the section on examination laws).
The cover of the assignment should explain the format (file format, font, font size, number of pages, line spacing etc.) in which the work must be submitted, how it must be submitted, and by when it must be submitted. Consider providing file templates.
As per the examination regulations, students must confirm that they have completed the assignment on their own and without using any tools or resources beyond those explicitly permitted. It is helpful to include a template text, which the students can copy into their exam before submitting. It also makes sense to point out that only students who have registered for the examination in STiNE are allowed to take the examination. This is relevant in case unauthorized third parties gain access to the login details.
The section on technology and the course template for take-home exams contain further useful information about examinations in OpenOlat. The course template also contains PDF forms for the declaration of authorship.
Didactic aspects
Choose an examination format (open questions, multiple-choice test, written examination, term paper structure etc.) based on the qualification objectives of the course or module (for details, see Gabi Reinmann’s text on didactic design; in German only). Multiple-choice exercises are suitable for a simple evaluation of acquired knowledge (learning objectives phrased “Students will become familiar with...” or “... can recall basic knowledge about...”).
Formats resembling term papers are better suited where your students are expected to demonstrate more advanced learning objectives (e.g., “Students can apply the fundamental knowledge acquired to new questions/texts/models” or “... can critically reflect even on complex matters”, see the examination regulations and/or subject-specific provisions). The less restrictive question format gives students greater freedom to demonstrate their expertise.
Such formats are explicitly intended to be open-book exams, meaning that students are allowed (and expected) to consult specialist literature, seminar notes etc. Ensure that the assignment is complex enough to prevent examinees from simply recalling their knowledge rather than applying it, which may lead them to copy from their notes or the literature.
Pure free-text formats may not be suitable for large courses due to insufficient resources. You can use the following strategies to assess higher skill levels with multiple-choice exercises and require students to apply their knowledge in order to answer the questions correctly:
- Ask students to choose the best suited answer instead of asking true or false questions.
- Use short case vignettes or similar formats as a means of asking a question.
If you wish to work with multiple-choice exercises, the Anleitung zur Herstellung von MC-Fragen und MC-Prüfungen (guidelines on producing MC questions and examinations) published by the University of Bern are a useful resource.
In general, it is recommended to prepare the students for the format and process of the take-home exam in class.
- This may include well-designed examples,
- such as a realistic mock THE. Upload the anonymized results to OpenOlat and, for example, ask students to provide feedback as an assessment component of active participation in a seminar. In summary: announce the text type and structure, citation and bibliography requirements,
- general requirements and assessment criteria in advance and provide an opportunity to practice.
What technical equipment are students expected to possess?
When designing an examination, ensure that it can be completed without special hardware (e.g., printers) or specialized, platform-dependent software that is not offered by Universität Hamburg. Assume that the student body works with a variety of operating systems, office suites, and devices from various manufacturers and of various versions. Students must be able to complete the assignment in an accessible format and regardless of their technical equipment.
Experience from the Faculty of Law have shown that the requirement of uploading the examination in PDF format frequently causes problems. If you are planning to work with PDFs in order to prevent readability problems involving unknown file formats, notify your students of this well in advance so that they have ample time to prepare.
If your planned take-home exam requires your students to remain online continuously while completing the exam (e.g., a multiple-choice test), notify them of this in advance so that they can arrange for a workspace with a stable internet connection. The University expects to be able to provide on-site workspaces for a limited number of examinees sitting take-home exams. Please determine during your class whether your students require any such workplaces and consult the academic office to plan further steps. The problem can be reduced considerably by designing take-home exams in a way that allows students to download the assignment, complete it offline, and upload the completed version afterwards.
For take-home exam formats with an extended completion period, students without a sufficient internet connection can use a University workspace, bookable through the library.
Members of the WiSo Faculty: Members of the WiSo Faculty who do not have the required technical equipment may borrow a laptop from the WISO Research Lab.
Members of the Faculty of Education: Faculty of Education students who do not have a suitable workspace or lack the required technical equipment may use a device from the faculty’s Education Media Center to sit their exam on University premises. Students who require a workspace or device should contact Ms. Birgit Veelders. Please pass this information on to your students.
Organization
When and how do examinees receive their assignments?
The assignments are given out at the time specified in the examination plan. If you are using OpenOlat, examinations can be distributed to the students automatically.
For technical reasons, examinations cannot be made available through STiNE at the moment.
Where will the completion time and period and the distribution method of the exam assignment be announced? Can they be changed?
Please check to what extent the faculty-specific notes in this section correspond to the requirements of your own faculty.
The academic office publishes the completion time and period in the course description under “Additional Examination Information”. As the description is publicly accessible, it cannot contain the login details for the exam. Login details must be distributed in another way (see the following section: “How do examinees receive their assignments?”)
The completion time is also announced during the relevant round of examinations. For degree programs in the Department of Socioeconomics, the completion time and period of take-home exams is announced as an examination date in STiNE. Also note the course description. It states the completion period and the final submission deadline for each exam.
Please note that the completion time must be coordinated with the dates of other THEs and in-person examinations. Once decided, details can only be changed in consultation with the academic office, especially if the change involves an extension of the completion time. Any changes must be approved before the course registration period starts.
Members of the Faculty of Education: You, the lecturer, are responsible for informing you students about the completion period and examination terms. Use the communication function in STiNE and the appropriate channels for your course.
How do examinees receive their assignments?
Only students who have registered for the examination (not just the course) in STiNE may take it. Bear this in mind when distributing the assignments. Registered students may withdraw from an examination up to three days before the date on which assignments are distributed. They remain registered for the course. The University is currently reviewing whether the withdrawal period is suitable or whether it may have to be shortened briefly to facilitate exam organization.
There are multiple ways to distribute assignments. Universität Hamburg offers a variety of eLearning platforms. OpenOlat has been used successfully for THEs. If you decide to use OpenOlat, set up a separate course for the examination. This ensures that only students who have registered for the examination in advance may sit it (rather than all students who have registered for the course only).
While assignment distribution per email is a conceivable option, the University believes it to be less transparent, which may cause legal uncertainty in the event of conflict.
Due to the current hygiene regulations (as of 8 January 2021), assignments cannot be distributed as physical copies.
How do students submit their completed exams?
Examiners set the submission method. (Also see the section “What information do students need in addition to the assignment?”). If you are using an eLearning platform, such as OpenOlat, students upload their exams themselves or complete the assignment in their browser. This option provides a technical solution to prevent submission (upload) or editing past the submission deadline.
If you ask your students to submit their completed exams by email, clearly explain the required format and layout: Ask your students to include their student ID number to ensure that each submitted examination document can be unambiguously assigned to the correct student.
For email submission, the completion period should be about 15 minutes longer than for other submission methods. This ensures that students have ample time for the technical steps involved: downloading, PDF conversion (if required), uploading and any other measures resulting from the chosen method. Please contact the academic office if you wish to extend the completion period correspondingly and announce the extension in STiNE.
How are the dates of take-home examinations coordinated with those of in-person examinations?
Please check to what extent the faculty-specific notes in this section correspond to the requirements of your own faculty.
The academic office schedules both THEs and in-person examinations in the examination plan. The dates provided in it are also binding for take-home exams.
Members of the Faculty of Education: As always, dates are coordinated with the academic office.
When and how do examiners announce examination details?
Use the course information function in STiNE.
If the corresponding course uses an eLearning system, such as OpenOlat, it makes sense to also publish the details of the examination there.
Examination laws
What tools and resources may students use when sitting a take-home exam?
Permitted tools and resources are up to the examiners.
How is plagiarism detected?
Please check to what extent the faculty-specific notes in this section correspond to the requirements of your own faculty.
In examinations taking place on site, learning literature by heart and reproducing it word for word does not constitute plagiarism. Examiners determine how their students should mark the source of any rephrased or copied passages in a take-home exam. Take your students’ familiarity with good scientific practice and subject-specific citation rules into account, especially if they are still at the beginning of their program. Ideally, set assignments that cannot be completed by mere reproduction of literature. Students sitting a take-home exam with an extended completion period which asks for an independently produced text should be reminded to comply with good scientific practice and cite all their sources.
Plagiarism in take-home examinations can only be detected during the grading process, so examiners are responsible for detecting and proving intentional plagiarism. The academic office provides advice and announces the issue (in STiNE and, in English, if necessary, by letter of notification). Within the scope of evaluating take-home exams, an external institution may be employed to check for plagiarism using a computer-assisted plagiarism detection system.
Handwritten answers can make it more difficult to plagiarise, as they prevent copying and pasting. Do not forget to let your students know far enough in advance of the need to photograph or scan their handwritten assignment, so that they can organize a smartphone or scanner. Students who do not have the necessary hardware and cannot obtain it by themselves must be able to borrow a suitable device from the University. Be aware however, if you require your students to submit handwritten assignments, you sacrifice the advantage of better legibility inherent to typed answers, which can reduce grading time by about 20%.
What happens when a student claims that they were unable to submit or access the examination assignment for technical reasons?
Students have a duty to actively get involved if they experience problems during an exam. They need to inform their examiners immediately about any technical issues, for example, inability to download the assignment questions or upload their completed exam. This constitutes a complaint under examination laws.
You must ensure that students can submit a complaint during the examination, for instance, by email. If you receive a complaint, first check whether the problem can be fixed immediately. If so, the examinee may be granted a brief extension of their completion time, and they continue to sit the examination. If the problem cannot be fixed, their exam attempt is invalidated, and the student is given another chance to sit the exam as soon as possible. The latter is always the case if the technical problems were the University’s fault.
If the technical problems occurred on the students’ side, they will need to provide evidence of the problem after the examination. It is difficult to differentiate actual technical problems from self-serving claims of technical problems, but it is not impossible. Students can provide evidence of such problems (internet connection protocol and used IP addresses in their router, evidence of unexpected construction work, evidence of a loss of electricity from their provider etc.). If the student does not provide evidence, they will fail the examination.
Examiners should consult the competent members of their faculty regarding the procedure for supporting students during their exam.
Members of the Faculty of Education: Students must convince you, their lecturer, that they were unable to sit the exam for technical reasons. If they make a convincing case, the academic office will grant them a resit. Contact the academic office in this case.
What happens when a student fails to submit their completed THE by the deadline?
If a student fails to submit their exam on time through no fault of their own, please refer to the previous question. If the student’s failure to submit on time is their own responsibility, they will fail the exam.
As with regular examinations, examiners announce this failure due to absence in STiNE. The onus is on the examiner to prove that the exam was not submitted on time. They must retain all evidence for at least one year after announcing a student’s failure due to absence in case that appeal procedures are initiated.
OpenOlat provides a technical option that prevents students from submitting their completed assignments after the deadline. This automates deadline administration.
What are the legal consequences of exceeding the specified completion time?
If the completion period (between the distribution of the assignment and the submission deadline) is longer than the completion time, strict administration of the latter will not be possible. OpenOlat does not offer any technical options to interrupt an examination to determine a student’s actual completion time. In such cases, the assignment should be designed in a way that exceeding the specified completion time by working through the entire completion period does not benefit students.
Additional notes on examinations and unambiguous assignment questions
For take-home exams as well as regular examinations, the answers to individual students’ questions about the assignment must be visible to all students. Much like with multiple-choice examinations, it may not be possible to amend problems with the assignment—especially if the completion period is tight. If necessary, you can send an explanatory message to all examinees through OpenOlat or whichever system you are using.
To prevent students from claiming that they did not notice the message, make sure to inform them in advance that they need to keep an eye on their OpenOlat inbox during the exam. Their duty to actively contribute to making the system work precludes citing failure to notice a message as an excuse. If a student does argue that they did not receive a message, they must submit a complaint immediately after noticing the fact (which may only be the case after their exam has been assessed). Examiners may need to verify whether or not the student received the message in question. If they did, their complaint will be discarded, and the examination will be graded. If the student did not receive the message, the message is sent again, and the student continues their examination. They may be granted an extension to their completion time. If the student only notices that they have missed a message after the examination, their attempt will be annulled.
It is prudent, then, to put the system to the test during a mock exam before the start of the actual exam.
What to do about examinations submitted by students who were not registered for the examination?
In some circumstances, it may be impossible to prevent students from sitting an examination without having registered for it. Assume that such exams cannot be graded. Only grade them upon consultation with the academic office, which will determine whether the student in question sat the exam legitimately. If their participation was not legitimate, the academic office will advise you on all further steps.
How can examiners account and compensate for disadvantages?
The measures implemented to compensate for disadvantages (extended exam completion times, break rules) also apply to THEs. In technical systems such as OpenOlat, you can set individual submission deadlines for the affected students. Only the exam completion time may be extended, not the completion period. If all other students are given a completion period that exceeds their completion time, as recommended, students requiring compensation for disadvantages should also be granted a buffer period. While this buffer period does not need to be identical to that of the other students, it should be no shorter than 15 minutes. No individual measures may be required for examinations with a long completion period.
Students with physical disadvantages are most likely able to establish suitable examination conditions at home. If any students require changes to the presentation of the assignment, e.g. in case of visual impairments, consider using a different technical method for their examination (but schedule it at the same time).
What do I need to bear in mind for multiple-choice tests?
Most exams that can be evaluated automatically by the learning platform are multiple-choice tests. Bear in mind that the limited scope of the available answers comes with certain legal requirements:
“Examinees and examiners are not able to exchange views about controversial questions in the event of a difference in opinion. Multiple-choice examinations must therefore be graded in a different manner. The bulk of the examiner’s work is carried out in advance and involves selecting the examination material, preparing the questions, and setting the answer options. Multiple-choice examinations are generally permitted at Universität Hamburg. However, they must be explicitly addressed in the relevant examination regulations or subject-specific provisions. Given the special features listed above, the design of the examination is of particular importance. It is also important that the grading guidelines applied are clearly defined” (Cited from Universität Hamburg, Section 31, Handout No. 11: Legal Framework for Multiple-Choice Examinations).
Setting up the technology
OpenOlat
Universität Hamburg has been using OpenOlat (OO) for most THEs and similar exam formats. The system offers a vast variety of assignment formats (as does Moodle). Microsoft Teams and CommSy are best suited for essay-based assignments.
OpenOlat offers a range of functions that help with the organization, methodical design, and documentation of THEs.
OpenOlat has the following advantages:
- Your students are familiar with the examination environment.
- You can either integrate the examination into the existing learning environment or set up a separate THE course, allowing you to archive the examination without archiving the entire course later.
- You and your students have access to help files.
- Your students can upload documents and other files as part of their assignment (or create them directly on the platform, but this may be risky).
- You can choose from a wide range of question types when setting up an automatically evaluated online test (multiple-choice exam).
- Randomization functions allow you to individualize exams, making it more difficult for your students to cheat collectively.
- Completion and submission deadlines are enforced automatically.
- You can offer a realistic mock THE.
- Students will be able to view their results digitally.
Introduction
You and your students can log into the central OpenOlat learning platform with their uni username and password. As an employee of University of Hamburg, you automatically have write access, meaning that you can set up a course and your take-home exam environment. (Alternatively, you can copy the take-home exam template—see below.)
Another advantage of the system: most of your students (and you, perhaps) already know how to use OpenOlat.
Note: Make sure to set up a separate course for your take-home exam rather than adding them to a course which you are also using during class.
Please name your take-home exam course according to the following naming protocol: “[Course name] Take-Home Exam”. Uniform names make it easier for your students to navigate confidently.
- Video tutorials: Introductory tutorials for teaching staff : Setting up a course | A brief introduction for students | Take Home Exams (THE) in OpenOlat—web session
- Overview of helpful resources from Universität Hamburg: https://www.uni-hamburg.de/elearning/werkzeuge/openolat.html
- HelpCards: The main functions at a glance
Access for examinees registered in STiNE
Only students who have registered for the examination, rather than all course participants, should get access to the OpenOlat course containing the take-home exams.
At the moment, examinees must be granted access to OpenOlat courses manually. The following section describes 2 ways of doing so. One is for employees of academic offices who support lecturers in this step. The other is for the lecturers. Both ways require you to copy the student ID numbers of your registered examinees to add them as course participants using the OpenOlat import function.
NB: Only take these steps after the registration and registration-cancellation period have ended!
How to copy student ID numbers (for staff at the academic offices):
1. Open the round of examinations (or one of the rounds in the bundle, if applicable) and select all members who have registered.
2. Use the “print” button to export the data.
3. Select the options “Assessments”, “Passed exams” and “Failed exams”.
4. Select a destination and name for your export file. Manually set the file type to “.csv” so that you can open the exported file as a table, for example, in Excel. Click the “Export” button to create the file and open it.
5. Copy the student ID numbers and use them to import your examinees into the course (as described below).
How to copy student ID numbers (for examiners):
1. Open your examination in STiNE and access the details page:
2. On the details page, click “Participants” and “Extend list”:
3. Highlight all table content and copy the personal data:
4. Extract the student ID numbers and discard all other data. You can do this by pasting the data into an Excel file, for instance.
5. Copy the student ID numbers and use them to import your examinees into the course (as described below).
Import your examinees into the OpenOlat course as members and assign them participant status
1. Once you have copied the student ID numbers, open the OpenOlat course containing your THE and navigate to “Administration” > “Members management”. Click “Import members”:
2. Paste the student ID numbers and ensure that each row contains exactly one student ID number.
3. Assign the course role “participant” to your examinees.
OpenOlat will offer you to send your examinees an email informing them that they have been added to the course. It also includes a link to the course.
Note that the status of the course should be set to “preparation” until you have completed all preliminary work. Do not distribute the address of the course. Once the course status has been set to “finished”, your examinees will be able to see the course and access all visible and available course content—if content has not yet been finalized, confusion ensues. By setting the course to “preparation” and keeping the address to yourself until your planning and preparation are complete, you can prevent premature questions about accessing the THE.
Note: OpenOlat can only give participant rights to users who have already signed up to the system before. When a user signs up for the first time, OpenOlat compares the new data with the general user database and essentially saves a copy. The platform now ‘knows’ the user. You may receive the following error message: “The following users have not been found: [student ID numbers]”. In this case, ask the students in question to sign up to OpenOlat and let you know once they have done so. You will then be able to add them individually.
Course element “Task”: Distribute assignments and enable document upload
You can use the course element “Task” to organize actions and submission tasks. Students can upload their submissions to the course and you, as their teacher, can provide feedback and grade their work. You can also request revisions and provide sample solutions. If your students’ internet bandwidth allows, this function also supports sizable submissions for large courses. The OpenOlat “Task” element does not set an upload or storage limit. It also accepts any file type.
The “Task” element also has the advantage that examinees only need to be online to receive and submit their examination, while the “Test” element requires a virtually constant internet connection.
The course element logs all events, which increases legal certainty.
Thanks to a relatively new function, students can also work on their submission directly in the OpenOlat course, editing a Word, Excel, or PowerPoint file in their browser with the integrated OnlyOffice application. OnlyOffice even allows users to work on equations in Word files.
Note: Bear in mind that your students may experience internet connectivity problems while editing documents in their browser through OnlyOffice. While OnlyOffice does save progress regularly, it is much safer not to use this option in a THE and ask your students to work in their own Office applications.
Please point this out to your students!
HTML documents can also be created and submitted directly in the browser, and the editor supports LaTeX, too (“Insert > Insert math formula”).
The following settings in the “Task” element can be useful for a THE:
“Visibility” tab
- Do not set any restrictions here.
- To prevent confusion, add a note in the field “information if visible and no access” advising your students that while the THE is already visible in the course menu, it may only be accessible once the exam completion period starts.
“Access” tab
In agreement with Section 31: Quality Management and Legal Affairs, we recommend that you grant your examinees read-only access to the element for one year past the completion period.
This reassures them after a stressful examination that their assignment was uploaded and registered correctly.
- Choose “Depending on date”.
- Enter the beginning of the THE completion period into the “from” field.
- Enter the end of the completion period PLUS ONE YEAR into the “to” field.
You can restrict editing of the take-home exam to the permitted period under the “Workflow” tab.
“Workflow“ tab
- Select “Obligation: mandatory” and “Provide and assign tasks for participants”.
- Revision should remain active until the end of the completion period!
- Activate the submission of solutions and set the end date to the end of the completion period.
Note: Bear in mind that exam results must first be announced in STiNE first, before OpenOlat. Use the functions “Return and feedback” and “Revision” carefully.
“Assignment” tab
- Select “Type of assignment > Automatic task assignment” and “Type of sampling > Your task will be assigned to more than one user / group”.
Assigning different versions of a task: If you want to assign your examinees different versions of the task (for example, involving different numbers), upload the documents containing the versions, set “Automatic allocation of a task” and select “Task is allocated to several users/a group”.
Please note that the allocation is not fully randomized: OpenOlat allocates tasks in the order in which they were originally uploaded and starts from the beginning once it reaches the end of the list. Example: The first examinee receives task number one. The second examinee receives task number two, and so on. If there are five versions, the sixth examinee receives task number one again.
To prevent misunderstandings, emphasize to your students that they need to open the “Task” element and download their tasks there. In the past, the phrasing of the OpenOlat interface, such as “Allocation of tasks” or “Automatic allocation” has led users to believe that examinees can passively wait for their task or a message that their task is available. However, examinees must actively access and download their task, or they will not receive it.
“Submission” task
- Select “Upload documents (e.g. PDF) > activated”.
Note: If you enter a number in the field “maximum number of documents”, each upload from a participant will be counted. This includes cases in which students wish to overwrite an earlier upload within the completion period. Example: Your students have to submit two documents, a written report and a personal statement. If you set the maximal number of documents to “2”, your students will not be able to replace their uploads with amended or improved versions, even if they try to do so within the completion period. It is better to enter a high number or even leave the field empty. Ultimately, the only relevant consideration is that students cannot upload documents after the end of the completion period.
It may be advisable to let your students know that they can upload an incomplete version of their work long before the deadline and overwrite it by uploading their final version later.
Have OpenOlat send your students the submission confirmation by email in addition to the automatic system message.
Note: Students receive email notifications depending on their personal settings under “User profile and visiting card” (top right) > “Settings” > “System” (see image). This means that they only receive their submission confirmation by email (to the email address they have provided) if they have activated the corresponding settings. Otherwise, the notification will be sent to their OpenOlat inbox.
Further details and instructions are available from Helpcard 30-080 and the OpenOlat user manual.
“Test” element: Various types of multiple-choice test with automatic evaluation
Note: Bear in mind that your examinees will have to remain online continuously while completing an exam created with the “Test” element. The “Task” element, on the other hand, allows them to download their assignment, work offline, and then upload their completed assignment when they are done.
If a student loses their internet connection during a test, their answers will be saved, but they will only be able to continue once their internet connection has been restored. If the connection drops, they will no longer be able to use the interface. When the connection is restored, they will continue where they left off. The remaining time is displayed and continues to count down. This was determined during function tests of the new OpenOlat version in January 2021. Previously, OpenOlat only stored answers in the browser, meaning that students needed to keep their browser open at all times.
Examinees need to know that they should keep their browser window with OpenOlat open during a loss of internet connectivity while they are working on a test. (They will no longer be able to use the interface, such as the buttons “Save answer“, “Next answer“, “Complete test“ etc.) This allows them to start on the next question as soon as their internet connection has been restored.
The “Test” element is an alternative to the “Task” element. OpenOlat offers a variety of question types that can be graded automatically, i.e., multiple-choice exercises (make sure to read the very important notes above). QTI tests (a standard format) can be integrated into the course using a self-test element or a test element). Self-tests are a tool for ungraded practice and self-assessment. Results are anonymized before they are stored. You can use self-tests to run mock THEs for your students. Test results, on the other hand, are stored with personal information. They are used for graded tests.
You can choose from the following question types when setting up a QTI test:
- Single-Choice: A question with a choice of at least 2 answers, only one of which can be selected.
- Multiple-Choice: A question with a choice of at least 2 answers, multiple of which can be selected and defined as correct.
- Kprim: A question with 4 statements, each of which is defined as either true or false.
- Matrix: A question matrix with several columns and rows. One of more answers can be selected in each row.
- Drag&Drop: Terms are matched with categories.
- True/False: Similar to the Kprim type. Statements are evaluated as true or false in each row.
- Gap Text: Gaps in a text have to be completed with the right terms.
- Numerical Input: Gaps have to be completed with the right numbers.
- Hottext: In a block of text, gaps have to be filled with one or more pre-defined terms.
- Hotspot: Multiple areas in an uploaded image can be defined as true or false.
- Order: Texts or images are arranged in a specific order.
- Essay: A question with free-text answers in a predefined text field of any size. Not evaluated automatically.
- File Upload: Upload a file created during a test or self-test.
- Drawing: An image is provided for editing. Not evaluated automatically.
Randomization options in tests
To prevent your students from attempting to cheat by working together, OpenOlat can output the sections of a test, the questions of a section, and the possible answers to a question in a random order.
- Randomizing answers to a question
Edit your questions and answers and save your changes. If possible, select “Yes” next to “Random order”. - Randomizing questions within a section
In the course menu, select the course editor and navigate to the section whose questions are to be output in a random order. In the tab “Section”, tick “Yes” next to “Random order of questions or sections?”. - Randomizing sections
Edit the test element and select the “Test configuration” tab. You can create or edit the test under “Selected file”. Edit the test. In each superordinate sections, you can tick ““Random order of questions or sections?” under “Section”.
Note: At the moment, it is not possible to create mathematical exercises and have random numerical answers generated. As a workaround, you could create a section for each question. Create each exercise multiple times with different numerical values but limit the number of output answers to 1 in the section. Einen Kniff müssen Sie dabei noch beachten: Note that the number of questions per section needs to vary at least a little. If each section has the same number of questions (or variants, exactly one of which is to be output randomly), OpenOlat would offer each examinee either question 1 or question 2 or question 3 etc. in each section.
One more tip: You can import questions from Excel to simplify setting up all the question types. At the moment, OpenOlat supports the following question types for import: Single-Choice, Multiple-Choice, Kprim, Gap Text, Essay, Matrix, Drag&Drop, TrueFalse
All details and configuration options are described in the user manual.
The eLearning portal offers a range of Helpcards on the topic.
OpenOlat also offers a sample text involving all question types.
Completion periods and compensation for disadvantages
OpenOlat allows you to configure the visibility and access of each course element separately using the corresponding tabs. The following settings are recommended for a take-home exam:
Visibility of the element containing the exam: continuous and unrestricted
The element containing the THE should be continuously visible, independent of the completion period.
This allows examinees to easily find the THE in the course menu when the completion period begins.
Access to the element containing the exam: From the start of the completion period and beyond its end.
Access to the THE element should be set to “depending on date”, and the date range should be
- from the beginning of the completion period
- to one year after the end of the completion period.
Note: this recommendation is based on examination law and has been agreed with Section 31: Quality Management and Legal Affairs. This also allows students to return to the element after a stressful examination and check that their assignment was uploaded and registered correctly.
Restrict editing of the take-home exam to the permitted period
Depending on the element you are using for your THE, you can restrict editing of the THE to the completion period as follows:
- Course element Task:
- In the course editor, select the “task” element and navigate to the “Workflow“ tab.
- Activate submission for participants and enter the end date of the completion period under “Submission deadline”.
- Also activate assignment allocation until the end of the completion period.
For more on the “Workflow“ tab, see the section on the course element “Task”.
- Course element Test:
- In the course editor, select the “Test” element and navigate to the “Test configuration“ tab.
- Tick “Specify test period” and enter the completion period.
OpenOlat indirectly points out that you can set a test timeframe in addition to the test period.
The test can be started within the text period (specify a start and end time at the element level, optional). But it can only be edited for a set amount of time specified as the Test timeframe (specify a duration in minutes within the test file).
Note: While this setting allows you to differentiate the completion period from the completion time, our support experience has shown that it is better not to set a test timeframe. The risk of incorrect configuration and misunderstandings among the examinees is very high.
Extending the completion period to compensate for disadvantages
If any examinees with disabilities require an extension of the completion period to compensate for their disadvantages, use the following options in OpenOlat:
- If you are using the Task element for your take-home exam,
- select it as the “Owner” or “Coach” of the course.
- In the list of participants, select “Extend”.
- Enter the extended completion period into the date fields.
- If you are using the Test element for your take-home exam,
- navigate to “Assessment tool” in the administration and select the link to the course elements under “List of assessable items”.
- Use the menu on the left to navigate to the test.
- In the list of examinees, click the cogwheel symbol in the row with the person requiring the extension.
- Select “Add disadvantage compensation” and enter the additional time in the dialog window.
The link “Add disadvantage compensation” will only appear after you specify a test period in the “Test configuration” tab under the “Test” element.
- Regardless of the selected element, you can proceed as follows: Copy the course element containing the THE and create a group in the user management. Add all examinees who require compensation for disadvantages to the group. Make access to the copied element dependent on group membership. Also make access dependent on a date and set the dates to the extended test period.
Assessment tool
Note: Bear in mind that exam results must be announced in STiNE first, not in OpenOlat.
The assessment tool under “Administration” helps you manage assessments. Course owners and their appointed coaches (more on coaches in the next section) can view and assess their examinees’ performance in all assessable elements.
The assessment tool gives teachers immediate access to an overview of upcoming assessments, a list of assessable elements, and statistical data on the participants’ activities. There is also a notification service for new submissions and test results.
Assessments can be made for individuals (as shown in the middle of the following image) or for individual elements (left), which allows you to assess the achievements of multiple persons.
Multiple assessments types are available: a points scheme, a pass/fail scheme, and individual feedback. Users can only access their own results.
With the “bulk assessment” function, you can assess the performance of multiple course participants at once. To do so, create an external list containing the user identification, points score, status and any comments and upload that list later. Individual fields must be separated by a comma or by pressing the tab key.
- How to assess all assessable course elements for a participant: Open the documentation
- Assessing tasks: Open the documentation
- Creating a bulk assessment for submitted work: Open the documentation
- Helpcard 20-080 on the assessment tool
If you want someone else involved in the assessment of a take-home exam, assign them the course-based role of “coach”. Coaches can access the assessment tools of the course, but they cannot edit the course in the course editor nor delete it.
Proceed as follows to assign the “coach” role to a colleague or assistant: Navigate to “Administration > User management > Create user” and enter the full name of the person in the user attribute search field. Click “Search.”
Note: OpenOlat only recognizes users who have signed up to the platform before.
Select the user, confirm, and tick the box labeled “Coach” next to the name of your course under “Group memberships”.
Please note: To ensure that tests and student submissions are not modified or lost during the assessment process, create backups before adding your correction assistants as coaches. For more details, see the sections “Result export“ (tests) and “Download all submitted files“ (submissions within the task element).
The “Coach” role: Open documentation
Course templates and sample THEs
You can find an OpenOlat course template for your own course in the course templates directory of the platform’s catalog or at https://www.openolat.uni-hamburg.de/auth/RepositoryEntry/130188257.
To create your own course based on the template, select “Administration” and “Copy” (not “Convert into learning path course”).
NB: Remember that these tips are only technical. The responsibilities of the role of examiner lie entirely with you.
Please test your own THE course and its implementation in detail. The role change functions of OpenOlat make this easy; see HelpCard 20-031.
Importantly, allow your students to sit a mock THE well in advance of the real exam.
We wish you all the best and welcome all useful feedback.H.W.