Skip to content

Help for researchers

How to run a paid online study with open recruitment, keep bots out, and give your ethics board a clear record.

From setup to payment

  1. 1

    Create the study

    Title, PI, budget and the amount per participant. Honorarium reserves money for every response that may be paid, so the budget can never be overspent.

    New study
  2. 2

    Write and lock the rules

    Write exclusion rules the way you would in your protocol. Gemini turns them into exact checks; you read each one back, adjust thresholds and lock them before importing any data.

  3. 3

    Import responses

    Upload the CSV export from Qualtrics, Google Forms or REDCap and tell Honorarium what each column is. Nothing is checked until the rules are locked.

  4. 4

    Verify and review

    Every response becomes Pay, Hold for review or Don't pay, with the evidence. You decide every hold yourself, with a reason.

  5. 5

    Approve the payout

    Check the pre-flight list, type the study code and send one PayPal batch. Statuses come back from PayPal by verified webhook.

  6. 6

    Export the ethics report

    Rules, hash, exclusions by rule, overrides and the money trail, ready to print or save as PDF for your IRB.

Wording you can copy

State the verification step up front: it is what makes withholding payment from fraudulent responses defensible.

Consent form

Payment of $[amount] will be made through PayPal after your responses have been checked. If responses cannot be verified, compensation may not be issued. Responses are checked against criteria decided before data collection, and every decision not to pay is reviewed by a member of the research team.

Protocol / IRB application

Responses will be screened with Honorarium against exclusion criteria fixed and time-stamped (SHA-256) before data collection. An AI model (Gemini) flags open-text answers for human review only; it cannot exclude participants. Shared IP addresses alone are never grounds for exclusion. Every exclusion, override and payment is recorded in an append-only audit log and summarised in an ethics report.

Questions researchers ask

Can the AI stop someone from being paid?

No. Only the deterministic rules you locked can produce Don't pay. Gemini can only flag an answer, which sends the respondent to a person. If Gemini is unavailable or the daily cap is reached, unreviewed answers are held, never paid automatically.

What does the AI see?

The question wording, the open-text answer with emails, phone numbers and IP addresses removed, up to four closed answers you mapped, and a pseudonymous ref such as R-0147. It never sees payout emails, names or IP addresses. A last check refuses to send anything that still contains an identifier.

Several students share one campus IP address. Will they be excluded?

No. A shared IP address can at most send responses to review, because campus Wi-Fi and mobile networks put many real people behind one address.

Two people used the same payout email. What happens?

Without a rule, both go to review and are linked to each other, because siblings and shared family accounts happen. With a locked “one payment per email” rule, the earliest submission is kept and later ones are excluded. Gmail dot and +tag variants count as the same inbox.

A payout shows UNCLAIMED. Is the money lost?

No. The recipient has no PayPal account yet and PayPal emailed them a link. If nobody claims it within 30 days, PayPal returns it. You can also cancel it from the Payouts page; the money goes back to the budget once PayPal confirms.

A payout failed because of a typo in the email.

Open the respondent, correct the payout email with a reason (it is kept in the audit log), decide Pay again, and prepare a new payout. Only corrected, failed items are sent again; successful ones never are.

I need to change the rules after seeing the data.

Create a new rules version with a written reason. The old version stays locked with its hash, and the change and its reason appear in the ethics report, so reviewers can see exactly what changed and when.

Is any of this real money?

Not in this deployment. Honorarium refuses to start unless PayPal is in sandbox mode, so every payment is PayPal test money.