Toolbox — Cards Test

4 items

Category: Data analysis Subcategory: Prepare data

TEST Data quality control

Suited to both small teams and larger consortia, this intervention scales by keeping its core requirements minimal and its documentation self-explanatory.

Implementer:
Institution, PhD students, Post docs
Classification:
Open data and materials, Open educational resources
Research field:
Natural sciences, Not reported, Social sciences

Quality assessments

Consistency:
Some inconsistency observed between disciplines; further harmonisation recommended.
Heterogeneity:
Moderate heterogeneity, mostly due to differing institutional contexts.

Resources needed to run the Interventions

Financial costs:
Effort and time:
Infrastructure:

Insight

A checklist-driven procedure ensures every step of the workflow is documented and reproducible by an independent team.

Interventions

  • Example related reference 1 for item 250

Category: Data analysis Subcategory: Validate analyses

TEST Multiverse analysis

Adopting this practice early in a project tends to reduce rework later, since it surfaces ambiguities in scope and method before data collection begins.

Implementer:
Not applicable, PhD students, Publisher
Classification:
Other
Research field:
Humanities and the arts

Quality assessments

Consistency:
High consistency; the intervention is described in near-identical terms across sources.
Heterogeneity:
High heterogeneity; adoption varies substantially by field.

Resources needed to run the Interventions

Financial costs:
Effort and time:
Infrastructure:

Insight

A checklist-driven procedure ensures every step of the workflow is documented and reproducible by an independent team.

Interventions

  • Example related reference 1 for item 255
  • Example related reference 2 for item 255

Category: Data analysis Subcategory: Document (DA) procedures

TEST Open workflow platform

A lightweight addition to existing workflows: most teams report it slots in without requiring a change to their existing tools or reporting templates.

Implementer:
Government, Other
Classification:
Open data and materials, Open educational resources, Open science tools
Research field:
Agricultural & veterinary sciences, Medical & health sciences

Quality assessments

Consistency:
High consistency; the intervention is described in near-identical terms across sources.
Heterogeneity:
High heterogeneity; adoption varies substantially by field.

Resources needed to run the Interventions

Financial costs:
Effort and time:
Infrastructure:

Insight

A shared template standardises reporting across teams, reducing ambiguity when the intervention is reused.

Interventions

  • Example related reference 1 for item 258
  • Example related reference 2 for item 258

Category: Data analysis Subcategory: Conduct analyses

TEST Statistical tool to estimate power

A lightweight addition to existing workflows: most teams report it slots in without requiring a change to their existing tools or reporting templates.

Implementer:
Not applicable
Classification:
Open educational resources, Open methodology
Research field:
Medical & health sciences, Not applicable

Quality assessments

Consistency:
High consistency; the intervention is described in near-identical terms across sources.
Heterogeneity:
High heterogeneity; adoption varies substantially by field.

Resources needed to run the Interventions

Financial costs:
Effort and time:
Infrastructure:

Insight

Peer feedback is collected at an early stage, before resources are committed to the full rollout.

Interventions

  • Example related reference 1 for item 252
  • Example related reference 2 for item 252
  • Example related reference 3 for item 252
  • Example related reference 4 for item 252
  • Example related reference 5 for item 252
  • Example related reference 6 for item 252
  • Example related reference 7 for item 252

Learn more about our Cookie Policy.