Improving Response Rates
- Pick a day during the last three weeks of class with peak attendance. For example, schedule it for a day when attendance is mandatory for an important instructional activity. Also, don't pick a day when an optional review is planned. The OIA tries to ensure your online course evaluations are open for 3 full weeks during which you can administer your TCE during any class session. (In summer and intersessions, there is considerably less time, of course.)
Note: Occasionally we hear from faculty who assume that TCEs are meant to be administered at the last possible minute in a course. Although conceptually, it is logical to want to wait until the last minute so the whole course is taken into account, getting a good response rate is more important than collecting data on the last day of the course. There will be essentially no difference in ratings obtained a couple of weeks before the class ends versus the last day of class, without any major changes to the course structure.
- Administer at the start of class instead of the end. Set aside 20 minutes at the START of class. Announce the TCE and explain that you've allowed 15-20 minutes to complete the TCE because it is important that you hear from everyone. (Arrange with the student monitor to signal you when to step back into the room.)
Note: Again, this may seem counter-intuitive at first glance, but consider that it will take the same amount of time for the class as a whole to respond either way, Why not get your students to give the task their undivided attention? You will get more thoughtful and extended feedback if you do AND your overall response rate likely will be higher since students will be less likely to leave without completing it at the start of class.
Online TCEs have different challenges when it comes to getting a reasonably representative sample of the class as a whole. Voluntary responses are not randomly sampled, which a higher response rate than a scientifically sampled survey for validity. It is critical in small classes to obtain maximum response. Getting the 'silent majority' of a class to weigh in is an important counter balance to the tendency of students with the most extreme positive or negative responses which will be more likely to respond.
Research on this particular problem shows that getting good response rates is possible, but takes a combination of tactics to pull off. The more tactics in play, the higher the response rates. "Nagging" by email is one of the most powerful tactics and is already being done on your behalf. The OIA tracks who has responded and periodically sends email reminders to students who have not.
Here is a list of additional actions you can take to improve rates beyond the predicted 65%.
Tell students their opinions are valued & expected. In-class, reminder on the board, email, D2L News Tool (or other announcements) to invite participation. In each case, post the link tceonline.oia.arizona.edu and include TCE Evaluation Period Dates. In summer and inter-sessions it is critical to let the students know the window for participation is very short.
In-Person-Online TCE Hybrid- Set aside 15 min at the beginning of class during the TCE Evaluation period.
Requirements: All students bring one of the following; smartphone, laptop or tablet. Wi-Fi Internet connection all students can utilize.
- Explain to the class:
- Their responses are important to you and after you leave the room, they can start the TCE.
- Recommend to students who have completed, to review their responses, since you value their detailed feedback.
- Appoint a student to notify you when to return.
- Leave the room. (It is critical you & any TA are out of the room.)
- Return to class. (Students who had not submitted evaluations will receive email reminders.)
- Explain to the class:
Monitor your response rates periodically and take active steps to improve low response before the TCE ends.
- Log in to http://tceonline.oia.arizona.edu/
- Use to drop-down menu to select 'View Currently or Recently Open TCEs'. A list of your courses with the current response rate will appear.
- Always remind students their responses are anonymous. The TCE System does track who has responded for email reminders. (We will remind non responders by email of the closing time.)
- Halfway through with less than 75% response rate? Email your students, tell them how important it is for the credibility of the results that every student participate.
- 3/4ths through with low response rates? Email them again with the response rate, tell them how much you hope they will complete the TCE since the credibility of the results ultimately depends on how many students respond.
- Incentives: (Check with your department first.)
It is perfectly appropriate in large classes where the grading scheme permits, to offer bonus points for participation. It is important to remind them that what they say is anonymous, but the TCE system software does let them document their own participation to claim the bonus points. Here are some instructions about documenting TCE participation for you with an example of instructions for students.