On this page
Published
What share of reference checks reach a person who supervised the candidate?
A measurement protocol that separates a supervised reference from a personal or indirect one.

Key stats
Key takeaways
- Record the reference relationship before the call.
- Count personal references separately.
- Report missing relationship data as missing.
- Compare results only within the same question set.
Question and scope
Scope the review to reference checks completed during the observation window. Exclude cases that lack a usable timestamp and report them separately. The recruiting coordinator records the start date, stop date, and exclusion rule. A count without a denominator cannot support a staffing or quality decision. In the Hire Assistant Near Me hiring file, the note names the interviewer and the date. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
The decision this review supports is whether the reference process needs a stricter source rule. The hiring manager should be able to use the result to change one rule, template, or review point. If the finding cannot lead to a decision, narrow the question. Write that boundary before selecting any case. The hiring manager should be able to repeat this check from the candidate record. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Scope the review to reference checks completed during the observation window. Exclude cases that lack a usable timestamp and report them separately. The recruiting coordinator records the start date, stop date, and exclusion rule. A count without a denominator cannot support a staffing or quality decision. Keep the evidence with the candidate file rather than in a private message. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Population and unit
The unit of analysis is one case, not one message or one task. A case can contain several messages and still count once. The recruiting coordinator removes duplicates with the case key before sampling. Document any merge so the count can be rebuilt. The hiring manager should be able to repeat this check from the candidate record. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
The unit of analysis is one case, not one message or one task. A case can contain several messages and still count once. The recruiting coordinator removes duplicates with the case key before sampling. Document any merge so the count can be rebuilt. Keep the evidence with the candidate file rather than in a private message. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Report the population size, the number excluded, and the number available for review. If the available set is too small, say so rather than widening the definition mid-review. The same rule should apply to every case in the window. Keep the frozen list with the final report. A second reviewer should see the same prompt, rubric, and evidence. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Definitions and measures
Define share of checks where the reference directly supervised the candidate before collecting data. State the start event, the stop event, and any pause rule in plain language. The recruiting coordinator writes one example and one counterexample so reviewers apply the same test. Ambiguous definitions produce confident but useless numbers. Keep the evidence with the candidate file rather than in a private message. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Define share of checks where the reference directly supervised the candidate before collecting data. State the start event, the stop event, and any pause rule in plain language. The recruiting coordinator writes one example and one counterexample so reviewers apply the same test. Ambiguous definitions produce confident but useless numbers. A second reviewer should see the same prompt, rubric, and evidence. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Measure each case against the reference questions, the reference relationship, and the completed notes where those artifacts are available. Record missing evidence as missing, not as a negative outcome. Use the same observation date for every case in the sample. Keep the raw value beside any percentage. Record the decision and the next action before the case leaves the queue. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Evidence dictionary
Every dictionary entry should name the record's location, the person who can retrieve it, and the retention period. A required artifact that exists only in a personal inbox makes the measure impossible to reproduce. Replace it with a shared record or disclose the limitation. The dictionary belongs in the finding package. A second reviewer should see the same prompt, rubric, and evidence. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Version the dictionary with the date it changed. A later reviewer should know which definition produced which result. The recruiting coordinator stores the dictionary beside the extract and the sample list. That package is what makes the review repeatable. Record the decision and the next action before the case leaves the queue. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Every dictionary entry should name the record's location, the person who can retrieve it, and the retention period. A required artifact that exists only in a personal inbox makes the measure impossible to reproduce. Replace it with a shared record or disclose the limitation. The dictionary belongs in the finding package. The recruiting coordinator dates the entry and links the source document. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Sampling and collection
A full census is preferable when the population is small enough to review in the time available. For larger queues, state the sample size and the confidence the team can reasonably claim. Do not imply precision the sample cannot support. The recruiting coordinator keeps the sample list with the original case keys. Record the decision and the next action before the case leaves the queue. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
A full census is preferable when the population is small enough to review in the time available. For larger queues, state the sample size and the confidence the team can reasonably claim. Do not imply precision the sample cannot support. The recruiting coordinator keeps the sample list with the original case keys. The recruiting coordinator dates the entry and links the source document. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Collect the evidence in one pass and record retrieval failures. If the relationship is unknown or the check used a personal contact, mark the case and continue rather than stopping the review. The exception count belongs in the result. A review that silently drops hard cases will overstate performance. Where the evidence conflicts, the file keeps both values and the reviewer's note. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Analysis and reporting
Write one paragraph a busy manager can repeat: what was checked, what was found, and what remains uncertain. Attach the extract and the dictionary reference. If the result contradicts an earlier review, explain the difference in method. Do not smooth over the change. The recruiting coordinator dates the entry and links the source document. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Write one paragraph a busy manager can repeat: what was checked, what was found, and what remains uncertain. Attach the extract and the dictionary reference. If the result contradicts an earlier review, explain the difference in method. Do not smooth over the change. Where the evidence conflicts, the file keeps both values and the reviewer's note. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Break the result down by role, reference type, and source only when each group has enough cases to be meaningful. Avoid ranking people on a small sample. The hiring manager reviews the finding before it is shared outside the team. Add the limitation beside the number, not in a footnote. In the Hire Assistant Near Me hiring file, the note names the interviewer and the date. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Limitations
Do not turn a local count into an industry claim. The value of the review is that the team can repeat it and compare its own periods. If the method changes, the comparison breaks. Preserve the old definition so the history remains readable. Where the evidence conflicts, the file keeps both values and the reviewer's note. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
A small sample limits precision, and a short window may miss seasonal variation. The recruiting coordinator notes any process change that occurred during collection. Cases handled outside the reference check record may be absent from the population. Those limits should travel with the result. In the Hire Assistant Near Me hiring file, the note names the interviewer and the date. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
A small sample limits precision, and a short window may miss seasonal variation. The recruiting coordinator notes any process change that occurred during collection. Cases handled outside the reference check record may be absent from the population. Those limits should travel with the result. The hiring manager should be able to repeat this check from the candidate record. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Review and next action
Close the review by writing what the team will stop doing as well as what it will start. A control that only adds work will be abandoned. Set the next review date before the meeting ends. That date is the difference between a study and a habit. In the Hire Assistant Near Me hiring file, the note names the interviewer and the date. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
Re-run the same measure after the change and compare like with like. If the result improves, keep the change and document why. If it does not, inspect the sample before assuming the change failed. The next review should test the rule, not the person. The hiring manager should be able to repeat this check from the candidate record. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
The monthly review should end with one owner, one change, and one review date. The recruiting coordinator picks the smallest change that addresses the most common gap. Update the template or evidence list instead of adding another report. Record the decision in the same file as the finding. Keep the evidence with the candidate file rather than in a private message. For this hiring review, keep the extract, the role brief version, and the reviewer list together.
