
On this page
Key Takeaways
- The protocol distinguishes public-page observations from institutional decisions and athlete-specific conclusions.
- Every observation retains its source URL, retrieval time, scope, and exception status.
- The method supports better follow-up questions but cannot predict recruiting outcomes.
Research question
This study protocol examines agreement among official school, conference, and governing-body result records for the same competition. It is designed for a recruiting-support team that needs to know how much confidence a public record deserves before using it in a family briefing. It does not rank colleges, evaluate coaches, or estimate an athlete's chance of admission, aid, roster placement, or playing time. For Public Competition Result Source Concordance Study, checkpoint 1 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
The primary question is whether a repeat observer can collect the same evidence, apply the same status definitions, and reach the same narrow classification. The unit of analysis is single-event result records. The principal measure is exact-match, explainable-mismatch, and unresolved-mismatch rates. Results should be reported as observations within a stated window, not as permanent characteristics of an institution. For Public Competition Result Source Concordance Study, checkpoint 2 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Scope and preregistered boundaries
Define the sport, division or association, institution set, observation dates, and inclusion rules before collecting data. Freeze the sample list and preserve the reason each unit qualifies. Exclude private messages, authenticated portals, personal accounts, search snippets, and third-party profile claims from the primary dataset. These sources may identify a question but should not be treated as equivalent to a controlling public page. For Public Competition Result Source Concordance Study, checkpoint 3 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Use public pages that are reachable without credentials and belong to the institution, conference, governing body, or responsible public office. Preserve the page title, canonical URL, retrieval timestamp, season or effective-date label, and a cryptographic or archive reference where lawful. If robots controls, access terms, or technical barriers prohibit automated capture, switch to documented manual review rather than evading the restriction. For Public Competition Result Source Concordance Study, checkpoint 4 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Apparent score conflicts may reflect corrections, forfeits, timing conventions, or event identifiers rather than careless publication. This inference boundary belongs in the codebook and every result summary. Observers record what a source displays; responsible campus staff decide what a policy or record means for an individual. For Public Competition Result Source Concordance Study, checkpoint 5 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Sampling design
Use a stratified sample so the study is not dominated by one sport, region, institution type, or competition season. Assign each unit a random selection number inside its stratum. Publish the intended sample size, replacement rule, and reasons for exclusions. If a page disappears after selection, retain the unit as an availability outcome instead of silently replacing it with an easier case. For Public Competition Result Source Concordance Study, checkpoint 6 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Observe each unit on a fixed cadence. A practical design uses a baseline capture, two scheduled follow-ups, and one adjudication pass after the observation window. Vary the time of day across a small subset to detect scheduled publishing behavior. Do not increase visits to a page simply because it produces an interesting result; that would make exposure unequal across the sample. For Public Competition Result Source Concordance Study, checkpoint 7 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Record planned observations separately from incident-driven checks. If a family reports a possible change between scheduled observations, label that review as supplemental and keep it out of the primary rate calculation unless the protocol specified such triggers in advance. This separation protects the denominator from hindsight. For Public Competition Result Source Concordance Study, checkpoint 8 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Data dictionary
Each row includes study ID, institution ID, sport or service category, source class, source URL, page title, retrieval timestamp with time zone, observation status, comparison target, discrepancy class, evidence note, reviewer, and adjudication status. Avoid personal identifiers unless they are already integral to the public record and necessary for the stated measure. Even then, publish aggregate results rather than a searchable list of individuals. For Public Competition Result Source Concordance Study, checkpoint 9 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Use bounded status values: available and aligned, available with explainable difference, available with unresolved difference, temporarily unavailable, permanently redirected, or out of scope. A free-text note explains evidence but does not replace the code. Create explicit missing values so an unavailable page is never interpreted as a zero or a negative finding. For Public Competition Result Source Concordance Study, checkpoint 10 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
For the principal measure, calculate the numerator and denominator from locked fields. Report counts next to percentages. Where a time interval is used, publish the median and range and show censored observations that had not reached alignment by the end of the window. Averages alone can hide a small number of very long delays. For Public Competition Result Source Concordance Study, checkpoint 11 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Collection and quality control
Train two observers on records outside the main sample. They independently classify the same practice set, compare disagreements, and revise ambiguous definitions before the study begins. During collection, double-code at least a defined quality sample. Report raw agreement and the kinds of disputes; a single agreement percentage without the confusion pattern is difficult to interpret. For Public Competition Result Source Concordance Study, checkpoint 12 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
A discrepancy must survive a fresh-page check, identity check, season check, and source-authority check before being classified as unresolved. Preserve both source records and do not contact staff under a false identity. If clarification is necessary, send a short transparent question through the office's published channel and record that the response was solicited. Nonresponse is not confirmation of the researcher's interpretation. For Public Competition Result Source Concordance Study, checkpoint 13 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Validate timestamps, URL normalization, and duplicate detection with automated checks, then review exceptions manually. Automation can find identical URLs and impossible dates, but it should not decide whether two differently worded roles or results are substantively equivalent. Keep the adjudicator blind to institution labels where practical to reduce expectation bias. For Public Competition Result Source Concordance Study, checkpoint 14 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Analysis plan
First publish the flow of units from selection through final classification. Then summarize availability and the principal measure by preregistered strata only when cell counts are large enough to avoid identifying individuals or producing unstable rates. Label every exploratory comparison. Do not claim one group performs better when the protocol was not designed or powered for that inference. For Public Competition Result Source Concordance Study, checkpoint 15 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Run sensitivity checks using a stricter and a more permissive matching rule. Show how many classifications change. Repeat the analysis excluding incident-driven reviews and again treating unresolved end-of-window observations as censored rather than failures. If the practical conclusion depends on one arbitrary rule, state that fragility prominently. For Public Competition Result Source Concordance Study, checkpoint 16 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
The result most useful to a family is operational: how recently to recheck a source, what evidence to preserve, and which office should resolve a mismatch. It is not a score for coach interest or program quality. A responsible summary uses neutral language and provides the observation window beside every statistic. For Public Competition Result Source Concordance Study, checkpoint 17 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Limitations
Public web pages are snapshots of publishing systems, not complete institutional records. The study may miss same-day corrections, personalized portal information, phone explanations, and context that was never intended for public display. Technical caching can make two observers see different versions. School calendars, weekends, competition seasons, and staff workload can affect update timing. For Public Competition Result Source Concordance Study, checkpoint 18 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
The sample cannot represent every college sport or recruiting pathway without appropriate weighting. Selection from easily discoverable pages may overrepresent institutions with stronger web infrastructure. A later redesign can change contact paths or page structure, so findings should not be projected beyond the observation window without replication. For Public Competition Result Source Concordance Study, checkpoint 19 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Most importantly, association is not causation. A measured delay or mismatch does not reveal intent, competence, athlete status, or recruiting interest. The protocol supports source hygiene and better questions; it does not authorize reputational claims about a person or institution. For Public Competition Result Source Concordance Study, checkpoint 20 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Operational implications
For support work, label each copied fact with its retrieval time and source class. Recheck consequential items before an athlete sends a message, makes travel plans, submits a form, or compares options. When sources disagree, show the discrepancy to the athlete and route a concise question to the responsible office rather than selecting the preferred answer. For Public Competition Result Source Concordance Study, checkpoint 21 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Keep research evidence separate from the athlete's working profile. Limit access, remove personal details from analysis exports, and set a review or disposal date. If a finding touches eligibility, admissions, aid, disability access, health, safety, or a binding decision, treat the public evidence as a prompt for official clarification, not as advice. For Public Competition Result Source Concordance Study, checkpoint 22 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
Sources
- NCAA recruiting resources
- NCAA Eligibility Center
- NCAA scholarships guidance
- NCAA research
- NCAA student-athlete resources
- NAIA eligibility center
- U.S. Department of Education FERPA
- U.S. Department of Education College Scorecard
- ADA prospective students guidance
- IPEDS data center For Public Competition Result Source Concordance Study, checkpoint 23 is evaluated through the agreement among official school, conference, and governing-body result records for the same competition lens before the record advances.
All sources were reviewed October 12, 2026. Page content and institutional processes can change; readers should recheck the controlling source before acting.
Related Research
recruiting evidence quality
Analyze Source Decay in Athlete Profiles
A source-linked research protocol for analyze source decay in athlete profiles, with explicit measures, quality controls, limitations, and operational boundaries.
recruiting evidence quality
Study Aging in Recruiting Camp Exception Queues
A source-linked research protocol for study aging in recruiting camp exception queues, with explicit measures, quality controls, limitations, and operational boundaries.
recruiting evidence quality
Measure Reviewer Agreement on Coach Directory Changes
A source-linked research protocol for measure reviewer agreement on coach directory changes, with explicit measures, quality controls, limitations, and operational boundaries.