Hypothesis Testing (Parametric) · TOOL GUIDE

Two-Sample T-Test

Open Quantly ↗

Understand the method. Use it with confidence.

Compare means of two independent groups. Quantly runs the method against your active analysis context and returns structured results for review and interpretation.

01

When to use it

Use this tool to test a prespecified mean-based hypothesis when observations are appropriately sampled and the model assumptions are reasonable.
Use it only when the selected variables and study design match the method's requirements.

02

How to use it

  1. Open the tool from the Quantly Tools panel.
  2. Confirm the active dataset and analysis session.
  3. Set Numeric Variable (Required): Select the numeric variable to compare.
  4. Set Grouping Variable (Required): Select the categorical variable with exactly two groups.
  5. Set Alternative Hypothesis (Required): Specifies the alternative hypothesis.
  6. Set Significance Level (α) (Required): The threshold for statistical significance.
  7. Set Generate Side-by-side Box Plots (Optional): Set generate side-by-side box plots.
  8. Set Generate Violin Plots with Swarm Plots (Optional): Set generate violin plots with swarm plots.
  9. Set Generate Group Means with CI Plot (Optional): Set generate group means with ci plot.
  10. Set Generate Back-to-back Histograms (Optional): Set generate back-to-back histograms.
  11. Set Generate Beeswarm Plots (Optional): Set generate beeswarm plots.
  12. Review optional or advanced settings and keep defaults unless your design requires a change.
  13. Run the tool, inspect warnings and diagnostics, then save or export the result with its assumptions.
03

How to interpret results

Interpret the p-value against the chosen alpha level, then examine the effect estimate and confidence interval. Statistical significance is not the same as practical importance; verify assumptions and multiplicity.