Questionnaire answer reuse and field drift

Question and scope

This review asks whether a family's reusable questionnaire answers stay consistent when the same fields are submitted to different college programs. The unit is a single field within a single submission, not a whole form and not an athlete. The review does not test whether a coach read the form or whether a submission influenced interest. It tests only whether the value sent matched the family's current written source, and it complements the questionnaire response rate research.

The scope is fixed before collection so the reviewer cannot choose only the easy fields. A field is eligible when it appears on at least two forms in the window and has a source outside the form itself. Name, graduation year, school, position, GPA, and test status are typical candidates. Open-ended prompts and coach-specific questions are excluded because they do not have one canonical value.

The review also separates a value that changed from a value that was always recorded differently. A family may have used an older GPA scale for one form and a newer scale for another, which is a source problem rather than a typing problem. Naming that cause helps the family fix the source instead of repeatedly correcting the same field. The review records the cause when the evidence shows it.

Population and unit

The population is the set of questionnaire submissions completed by one family or support assistant during the declared window. Each submission must be dated and tied to a program. Submissions with no saved copy are excluded because there is no evidence to compare. The same program may appear more than once if the family submitted an updated form after a material change.

The field is the unit because a form can be mostly correct and still contain one damaging mismatch. Keeping the field separate also makes it possible to compare a GPA across three forms without treating the entire submission as a single pass or fail. A field that appears only once is kept in the file but excluded from the drift measure, even if the answer bank guide would normally include it. Every exclusion is listed with its reason.

Definitions and measures

A drift event occurs when the value sent differs from the family's written source in a way that could change a coach's interpretation. A typo that does not change meaning is recorded separately from a substantive difference. A rounded GPA is substantive when the source reports a different precision or scale. A shortened position label is substantive only when it names a different role.

The primary measure is the number of eligible fields with at least one drift event across the window. A second measure records whether the drift was corrected in a later submission. Both measures are reported with the number of eligible fields and the number of submissions inspected. A percentage without those counts would obscure how small the sample may be.

Evidence standard

Each field is tagged matched, drifted, or unverifiable using the source that was current on the submission date. A transcript or school profile supports academic fields, while a coach's written note or a program page supports context fields. The tag describes the comparison, not the family's intent. A field that cannot be checked stays visible as unverifiable rather than being counted as a match.

When the family used two sources that disagree, both values are recorded and the reviewer names which one controlled the submission. A later correction does not erase the earlier value from the file. The reviewer also notes whether the form itself forced a format, such as a drop-down list that could not represent the source exactly. Format pressure is a cause of drift, not an excuse for hiding it.

A source is current when it was issued before the submission and not replaced by a later document. A transcript from the prior term is current for that term but may not represent the latest grades. The reviewer records the term or issue date beside the value instead of assuming that any transcript is current. That note prevents a technically real document from being used outside its period.

Sampling and collection

The sample is drawn from submissions that entered the recruiting queue during the declared window. Collection uses a fixed interval and a written stopping point, and it includes forms from a mix of division levels when available. A sample made only of forms that the family considered important would overstate care and understate drift. The note records how many submissions were eligible, how many were read, and where reading stopped.

Late submissions are not added after the first results are visible. If a submission arrives during the review but after the stop, it is logged for the next window and kept out of the current count. The reviewer also records any form that could not be saved or printed, because a missing copy is a process gap even when the answer was correct on screen. A late form that looks more complete than the rest is still excluded, because the rule applies to every submission in the window.

Forms that could not be saved are listed as missing records and counted separately from drifted fields. A missing record can hide a correct answer or a wrong one, so it cannot be treated as either. The collection note also records the device used to complete each form, because mobile forms sometimes truncate long values. Those details make the sample reproducible without exposing the athlete's identity.

Independent replay

A second reviewer compares the same fields against the same written sources without seeing the first reviewer's tags. The comparison checks the drift tag and the source used for each field. Where the reviewers disagree about whether a difference is substantive, the recruiting coordinator applies the written rule and records the reasoning. The replay tests the rule, not the reviewer's memory of the form.

Disagreement is expected around rounded numbers, abbreviations, and fields with more than one accepted label. The review treats those cases as candidates for a clearer definition rather than as personal errors. A short calibration note is added before the next window so the same argument does not repeat. The note stays with the case file and is dated.

Privacy and access

The working set replaces athlete names with study identifiers, and the crosswalk stays inside the approved recruiting system. Only the fields needed for the comparison are opened, and access is removed when the review ends. Coach messages are summarized rather than quoted at length. The report lists what was withheld or unavailable instead of leaving a silent gap.

Privacy rules protect the family and the student, but they do not make a reused answer accurate. A private form can still contain an outdated GPA or a position label that no longer applies. The review keeps the access question separate from the accuracy question so one cannot stand in for the other. That separation matters when a new assistant inherits the file.

Limits and next step

The conclusion is tied to the window, the mix of forms, the available sources, and the reviewers' judgment. A different sport or division may present different format pressures and different fields. Re-running the review on a smaller set of high-consequence fields shows whether the pattern holds. Where the second run differs, both results are reported and the operational choice is named.

The output supports one process fix and a scheduled retest, not a judgment about a coach or a program. A useful fix is to attach the source, reviewer, and review date to every reusable field before the next submission. A second fix is to check the five highest-consequence fields after any material change. Both fixes are small enough to survive a busy recruiting month.

A different set of forms could produce a lower drift count if the programs used similar required fields. A set drawn from one division could also share format conventions that reduce variation. The review does not pool those possibilities into a single explanation. It names them so the next window can test one at a time.

Sources

• NCAA Recruiting Rules
• NCAA Eligibility Center
• NCAA Division I and II Recruiting Calendars
• U.S. Department of Education Federal Student Aid