Reproducibility checklist
Use this checklist when an NL Analytics output will support a paper, policy note, appendix, replication file, monitoring output, report, or dashboard. This page is the canonical list; other pages link here instead of repeating it.
Query and dataset definition
Record:
- Exact query string.
- Date range, filters, and adjacent-sentence behavior. These complete the query and change what the measures count.
- Selected measures, display settings, and export options. These are dataset settings, not part of the query.
- Combination or comparison logic if datasets were combined or compared.
- Keyword Tool settings and the saved search protocol, if the query came out of a keyword-set review.
Review evidence
Keep notes from matched-sentence review:
- Examples of true positives.
- False positives and exclusions added.
- Missing terms added during refinement.
- Ambiguous terms and how they were handled.
Matched-sentence review supports auditability. It does not, by itself, prove construct validity.
Export context
Record:
- Export date.
- Corpus statement used for the analysis, and the sample availability check for the target sample.
- Files downloaded (see the file reference).
- Dataset metadata where available.
- Dataset share link where used.
Generated dataset results are retained for 90 days. Refresh an older dataset before inspecting its matched sentences again. A saved dataset or share link is not a replication package: keep the exported files, query and dataset metadata, matched-sentence notes, and downstream code or notes together outside the product.
Downstream analysis
Record:
- Join key and identifier checks.
- Sample restrictions.
- Whether raw counts were normalized and which denominator was used,
nr_of_sentencesornr_of_sentences_filtered(see the normalization caveat). - Any filtering of zero rows.
- Version of the downstream dataset.
Zero Exposure means the selected query did not match sentences in that transcript. It does not mean the company had no real-world exposure to the topic.