Combine and compare datasets

Combine datasets to join their matched sentences, or compare them to measure differences.

To revise the terms in one query, follow Inspect matches.

Check compatibility: both datasets must use the same search engine. Weighted datasets cannot be combined or compared. Each operation also has the requirements below.

Combine datasets

Combine two existing datasets with AND, OR, or AND NOT from the dataset page. See My Library for where the actions live.

Both datasets must use Whether any appear scoring and compatible matching and scoring contexts. Words around each match scoring and existing comparison results cannot be used. Older datasets may need to be rerun, but rerunning does not make unsupported scoring compatible.

Choose the operation based on which sentences should count:

• AND keeps sentences matched by both datasets.
• OR keeps sentences matched by either dataset, including sentences that only the second dataset matched.
• AND NOT keeps sentences from the first dataset that the second dataset did not match.

The combination creates a new dataset and counts as one search. It recomputes the call-level measures from the combined sentence set, so exposure, risk, and sentiment follow the same measure definitions as other datasets. The new dataset keeps zero rows for the calls covered by the combination: with OR, calls from either dataset; with AND, calls present in both; with AND NOT, calls from the first dataset.

Compare datasets

A comparison takes a left and right dataset and creates a new dataset. Choose how to express the difference: net difference, absolute difference, ratio, or percent difference. Creating the comparison counts as one search.

Use datasets with Whether any appear scoring. An existing comparison result cannot be used as an input. Compare uses each dataset's saved results; check that differences in their settings suit your research question.

Use a comparison to check how a query refinement changed a measure, for example how many matches an added exclusion removed and for which firms. Matched sentences are labeled by source, so you can inspect which sentences belong to only one dataset.

Refreshing or editing combined and comparison datasets

Refreshing a combined or comparison dataset rebuilds it from the current saved parent datasets; refresh the parent datasets first if you want new earnings calls included. Edit & rerun is available only on ordinary query datasets—to change a query used in a combination or comparison, edit and rerun the parent dataset first and then create a new combination or comparison.