Helpful guides and examples to make life easier.

View the Project on GitHub GoldenbergLab/lab-helper-codes


Handle issues with Prolific approvals and Qualtrics surveys faster.

Prolific is chaos

A guide to approving submissions when you can barely keep track of them (see accompanying doc for images)


General Tips

Walkthrough Steps

  1. Download Qualtrics data and task data and compile a new, cleaned dataset consisting only of the submissions that you want to keep
  2. Write these ids to a text file, separated by commas. Click on “Approve by upload” and paste these ids into the text box.
  3. This will auto-approve all people who have completed the study.
  4. Reject any participants with NOCODE in the STUDY CODE column.


If they raise a technical issue:

Hello, Thank you for bringing this to our attention! We will try to fix this. Please return the study to prolific. Best wishes and we thank you again for participating.

If they accidentally insert the wrong ID:

Dear participant,

Some individuals accidentally wrote their Mechanical Turk ID instead of their Prolific ID, and we cannot credit them for their work as a result. If you have an Mehanical Turk ID, please reply with the last two characters of it in order for us to confirm your identity and credit you for your study.


If they contest a rejection (unreasonably):

Dear participant, Your study was rejected for [X] reasons. [Insert stuff here]. Thanks for reaching out. Please let us know if you have any more questions.

Extended example for responding to a contested rejection:

Dear participant,

Your study was rejected for three reasons:

  1. You failed to provide the correct completion code,
  2. There is no data associated with your Prolific ID,
  3. The average amount of time spent on this study is 10-12 minutes, whereas Prolific indicates that you spent less than 2 minutes.

Thanks for reaching out. Please let us know if you have any more questions.