Skip to main content
`Ctrl`+`K`
scipy.stats.

# mannwhitneyu

scipy.stats.mannwhitneyu(x, y, use_continuity=True, alternative='two-sided', axis=0, method='auto', *, nan_policy='propagate', keepdims=False)

  Perform the Mann-Whitney U rank test on two independent samples.

  The Mann-Whitney U test is a nonparametric test of the null hypothesis that the distribution underlying sample x is the same as the distribution underlying sample y. It is often used as a test of difference in location between distributions.

  Parameters:
    x, y array-like

      N-d arrays of samples. The arrays must be broadcastable except along the dimension given by axis.

    use_continuity bool, optional

      Whether a continuity correction (1/2) should be applied. Default is True when method is `'asymptotic'`; has no effect otherwise.

    alternative{‘two-sided’, ‘less’, ‘greater’}, optional

      Defines the alternative hypothesis. Default is ‘two-sided’. Let SX(u) and SY(u) be the survival functions of the distributions underlying x and y, respectively. Then the following alternative hypotheses are available:

      - ‘two-sided’: the distributions are not equal, i.e. SX(u) ≠ SY(u) for at least one u.

      - ‘less’: the distribution underlying x is stochastically less than the distribution underlying y, i.e. SX(u) < SY(u) for all u.

      - ‘greater’: the distribution underlying x is stochastically greater than the distribution underlying y, i.e. SX(u) > SY(u) for all u.

      Under a more restrictive set of assumptions, the alternative hypotheses can be expressed in terms of the locations of the distributions; see [5] section 5.1.

    axis int or None, default: 0

      If an int, the axis of the input along which to compute the statistic. The statistic of each axis-slice (e.g. row) of the input will appear in a corresponding element of the output. If `None`, the input will be raveled before computing the statistic.

    method{‘auto’, ‘asymptotic’, ‘exact’} or `PermutationMethod` instance, optional

      Selects the method used to calculate the p-value. Default is ‘auto’. The following options are available.

      - `'asymptotic'`: compares the standardized test statistic against the normal distribution, correcting for ties.

      - `'exact'`: computes the exact p-value by comparing the observed \(U\) statistic against the exact distribution of the \(U\) statistic under the null hypothesis. No correction is made for ties.

      - `'auto'`: chooses `'exact'` when the size of one of the samples is less than or equal to 8 and there are no ties; chooses `'asymptotic'` otherwise.

      - `PermutationMethod` instance. In this case, the p-value is computed using `permutation_test` with the provided configuration options and other appropriate settings.

    nan_policy{‘propagate’, ‘omit’, ‘raise’}

      Defines how to handle input NaNs.

      - `propagate`: if a NaN is present in the axis slice (e.g. row) along which the statistic is computed, the corresponding entry of the output will be NaN.

      - `omit`: NaNs will be omitted when performing the calculation. If insufficient data remains in the axis slice along which the statistic is computed, the corresponding entry of the output will be NaN.

      - `raise`: if a NaN is present, a `ValueError` will be raised.

    keepdims bool, default: False

      If this is set to True, the axes which are reduced are left in the result as dimensions with size one. With this option, the result will broadcast correctly against the input array.

  Returns:
    res MannwhitneyuResult

      An object containing attributes:

      statisticfloat

        The Mann-Whitney U statistic corresponding with sample x. See Notes for the test statistic corresponding with sample y.

      pvaluefloat

        The associated p-value for the chosen alternative.

      zstatisticarray_like

        When `method = 'approx'`, this is the normalized z-statistic:

            z = (U - mn - d) / se

        where `U` is statistic as defined above, `mn` is the mean of the distribution under the null hypothesis, `d` is a continuity correction, and `se` is the standard error. When `method != 'asymptotic'`, this attribute is not available.

  See also

  `scipy.stats.wilcoxon`, `scipy.stats.ttest_ind`

  Notes

  If `U1` is the statistic corresponding with sample x, then the statistic corresponding with sample y is `U2 = x.shape[axis] * y.shape[axis] - U1`.

  The p-value and standardized z-statistic produced by the Mann-Whitney U test is identical to that produced by a Wilcoxon rank sum test, but different raw statistics are associated with the tests. Specifically, the rank sum statistic corresponding with the first sample is `R1 = U1 + x.shape[axis] * (x.shape[axis] + 1) / 2`.

  `mannwhitneyu` is for independent samples. For related / paired samples, consider `scipy.stats.wilcoxon`.

  method `'exact'` is recommended when there are no ties and when either sample size is less than 8 [1]. The implementation follows the algorithm reported in [3]. Note that the exact method is not corrected for ties, but `mannwhitneyu` will not raise errors or warnings if there are ties in the data. If there are ties and either samples is small (fewer than ~10 observations), consider passing an instance of `PermutationMethod` as the method to perform a permutation test.

  The Mann-Whitney U test is a non-parametric version of the t-test for independent samples. When the means of samples from the populations are normally distributed, consider `scipy.stats.ttest_ind`.

  Beginning in SciPy 1.9, `np.matrix` inputs (not recommended for new code) are converted to `np.ndarray` before the calculation is performed. In this case, the output will be a scalar or `np.ndarray` of appropriate shape rather than a 2D `np.matrix`. Similarly, while masked elements of masked arrays are ignored, the output will be a scalar or `np.ndarray` rather than a masked array with `mask=False`.

  Array API Standard Support

  `mannwhitneyu` has experimental support for Python Array API Standard compatible backends in addition to NumPy. Please consider testing these features by setting an environment variable `SCIPY_ARRAY_API=1` and providing CuPy, PyTorch, JAX, or Dask arrays as array arguments. The following combinations of backend and device (or other capability) are supported.

  Library | CPU | GPU
  --- | --- | ---
  NumPy | ✅ | n/a
  CuPy | n/a | ⛔
  PyTorch | ✅ | ⛔
  JAX | ⚠️ no JIT | ⛔
  Dask | ⛔ | n/a

  `mannwhitneyu` also accepts MArrays backed by the backends indicated above; masked values will be treated as though they were not present. Only `method='asymptotic'` is compatible with MArray input.``method=’auto’`` is incompatible with JAX arrays. See Support for the array API standard for more information.

  References

  [1]

  H.B. Mann and D.R. Whitney, “On a test of whether one of two random variables is stochastically larger than the other”, The Annals of Mathematical Statistics, Vol. 18, pp. 50-60, 1947.

  [2]

  Mann-Whitney U Test, Wikipedia, http://en.wikipedia.org/wiki/Mann-Whitney_U_test

  [3]

  Andreas Löffler, “Über eine Partition der nat. Zahlen und ihr Anwendung beim U-Test”, Wiss. Z. Univ. Halle, XXXII’83 pp. 87-89.

  [4] (1,2,3,4,5,6,7)

  Rosie Shier, “Statistics: 2.3 The Mann-Whitney U Test”, Mathematics Learning Support Centre, 2004.

  [5]

  Michael P. Fay and Michael A. Proschan. “Wilcoxon-Mann-Whitney or t-test? On assumptions for hypothesis tests and multiple interpretations of decision rules.” Statistics surveys, Vol. 4, pp. 1-39, 2010. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2857732/

  [6]

  MathWorks. “ranksum - Wilcoxon rank sum test - MATLAB”. https://www.mathworks.com/help/stats/ranksum.html.

  Examples

  We follow the example from [4]: nine randomly sampled young adults were diagnosed with type II diabetes at the ages below.

      >>> males = [19, 22, 16, 29, 24]
      >>> females = [20, 11, 17, 12]

  We use the Mann-Whitney U test to assess whether there is a statistically significant difference in the diagnosis age of males and females. The null hypothesis is that the distribution of male diagnosis ages is the same as the distribution of female diagnosis ages. We decide that a confidence level of 95% is required to reject the null hypothesis in favor of the alternative that the distributions are different. Since the number of samples is very small and there are no ties in the data, we can compare the observed test statistic against the exact distribution of the test statistic under the null hypothesis.

      >>> from scipy.stats import mannwhitneyu
      >>> U1, p = mannwhitneyu(males, females, method="exact")
      >>> print(U1)
      17.0

  `mannwhitneyu` always reports the statistic associated with the first sample, which, in this case, is males. This agrees with \(U_M = 17\) reported in [4]. The statistic associated with the second statistic can be calculated:

      >>> nx, ny = len(males), len(females)
      >>> U2 = nx*ny - U1
      >>> print(U2)
      3.0

  This agrees with \(U_F = 3\) reported in [4]. The two-sided p-value can be calculated from either statistic, and the value produced by `mannwhitneyu` agrees with \(p = 0.11\) reported in [4].

      >>> print(p)
      0.1111111111111111

  The exact distribution of the test statistic is asymptotically normal, so the example continues by comparing the exact p-value against the p-value produced using the normal approximation.

      >>> _, pnorm = mannwhitneyu(males, females, method="asymptotic")
      >>> print(pnorm)
      0.11134688653314041

  Here `mannwhitneyu`’s reported p-value appears to conflict with the value \(p = 0.09\) given in [4]. The reason is that [4] does not apply the continuity correction performed by `mannwhitneyu`; `mannwhitneyu` reduces the distance between the test statistic and the mean \(\mu = n_x n_y / 2\) by 0.5 to correct for the fact that the discrete statistic is being compared against a continuous distribution. Here, the \(U\) statistic used is less than the mean, so we reduce the distance by adding 0.5 in the numerator.

      >>> import numpy as np
      >>> from scipy.stats import norm
      >>> U = min(U1, U2)
      >>> N = nx + ny
      >>> z = (U - nx*ny/2 + 0.5) / np.sqrt(nx*ny * (N + 1)/ 12)
      >>> p = 2 * norm.cdf(z)  # use CDF to get p-value from smaller statistic
      >>> print(p)
      0.11134688653314041

  If desired, we can disable the continuity correction to get a result that agrees with that reported in [4].

      >>> _, pnorm = mannwhitneyu(males, females, use_continuity=False,
      ...                         method="asymptotic")
      >>> print(pnorm)
      0.0864107329737

  Regardless of whether we perform an exact or asymptotic test, the probability of the test statistic being as extreme or more extreme by chance exceeds 5%, so we do not consider the results statistically significant.

  Suppose that, before seeing the data, we had hypothesized that females would tend to be diagnosed at a younger age than males. In that case, it would be natural to provide the female ages as the first input, and we would have performed a one-sided test using `alternative = 'less'`: females are diagnosed at an age that is stochastically less than that of males.

      >>> res = mannwhitneyu(females, males, alternative="less", method="exact")
      >>> print(res)
      MannwhitneyuResult(statistic=3.0, pvalue=0.05555555555555555)

  Again, the probability of getting a sufficiently low value of the test statistic by chance under the null hypothesis is greater than 5%, so we do not reject the null hypothesis in favor of our alternative.

  If it is reasonable to assume that the means of samples from the populations are normally distributed, we could have used a t-test to perform the analysis.

      >>> from scipy.stats import ttest_ind
      >>> res = ttest_ind(females, males, alternative="less")
      >>> print(res)
      TtestResult(statistic=-2.239334696520584,
                  pvalue=0.030068441095757924,
                  df=7.0)

  Under this assumption, the p-value would be low enough to reject the null hypothesis in favor of the alternative.