text:
Loss function
From Wikipedia, the free encyclopedia
Jump to: navigation, search
In mathematical optimization, statistics, econometrics, decision theory, machine learning and computational neuroscience, a loss function or cost function is a function that maps an event or values of one or more variables onto a real number intuitively representing some "cost" associated with the event. An optimization problem seeks to minimize a loss function. An objective function is either a loss function or its negative (in specific domains, variously called a reward function, a profit function, a utility function, a fitness function, etc.), in which case it is to be maximized.
In statistics, typically a loss function is used for parameter estimation, and the event in question is some function of the difference between estimated and true values for an instance of data. The concept, as old as Laplace, was reintroduced in statistics by Abraham Wald in the middle of the 20th century.[1] In the context of economics, for example, this is usually economic cost or regret. In classification, it is the penalty for an incorrect classification of an example. In actuarial science, it is used in an insurance context to model benefits paid over premiums, particularly since the works of Harald Cramér in the 1920s.[2] In optimal control the loss is the penalty for failing to achieve a desired value. In financial risk management the function is mapped to a monetary loss.
Contents
[hide]
1 Use in statistics
1.1 Definition
2 Expected loss
2.1 Frequentist expected loss
2.2 Bayesian expected loss
2.3 Economic choice under uncertainty
2.4 Examples
3 Decision rules
4 Selecting a loss function
5 Loss functions in Bayesian statistics
6 Regret
7 Quadratic loss function
8 0-1 loss function
9 See also
10 References
11 Further reading
Use in statistics[edit]
Parameter estimation for supervised learning tasks such as regression or classification can be formulated as the minimization of a loss function over a training set. The goal of estimation is to find a function that models its input well: if it were applied to the training set, it should predict the values (or class labels) associated with the samples in that set. The loss function quantifies the amount by which the prediction deviates from the actual values.
Definition[edit]
Formally, we begin by considering some family of distributions for a random variable X, that is indexed by some θ.
More intuitively, we can think of X as our "data", perhaps X = ( X 1 , … , X n ) {\displaystyle X=(X_{1},\ldots ,X_{n})} , where X i ∼ F θ {\displaystyle X_{i}\sim F_{\theta }} i.i.d. The X is the set of things the decision rule will be making decisions on. There exists some number of possible ways F θ {\displaystyle F_{\theta }} to model our data X, which our decision function can use to make decisions. For a finite number of models, we can thus think of θ as the index to this family of probability models. For an infinite family of models, it is a set of parameters to the family of distributions.
On a more practical note, it is important to understand that, while it is tempting to think of loss functions as necessarily parametric (since they seem to take θ as a "parameter"), the fact that θ is infinite-dimensional is completely incompatible with this notion; for example, if the family of probability functions is uncountably infinite, θ indexes an uncountably infinite space.
From here, given a set A of possible actions, a decision rule is a function δ : X {\displaystyle \scriptstyle {\mathcal {X}}} → A.
A loss function is a real lower-bounded function L on Θ × A for some θ ∈ Θ. The value L(θ, δ(X)) is the cost of action δ(X) under parameter θ.[3]
Expected loss[edit]
The value of the loss function itself is a random quantity because it depends on the outcome of a random variable X. Both frequentist and Bayesian statistical theory involve making a decision based on the expected value of the loss function: however this quantity is defined differently under the two paradigms.
Frequentist expected loss[edit]
We first define the expected loss in the frequentist context. It is obtained by taking the expected value with respect to the probability distribution, Pθ, of the observed data, X. This is also referred to as the risk function[4][5][6][7] of the decision rule δ and the parameter θ. Here the decision rule depends on the outcome of X. The risk function is given by:
R ( θ , δ ) = E θ  L ( θ , δ ( X ) ) = ∫ X L ( θ , δ ( x ) ) d P θ ( x ) . {\displaystyle R(\theta ,\delta )=\operatorname {E} _{\theta }L{\big (}\theta ,\delta (X){\big )}=\int _{X}L{\big (}\theta ,\delta (x){\big )}\,\mathrm {d} P_{\theta }(x).}
Here, θ is a fixed but possibly unknown state of nature, X is a vector of observations stochastically drawn from a population, E θ {\displaystyle \operatorname {E} _{\theta }} is the expectation over all population values of X, dPθ is a probability measure over the event space of X (parametrized by θ) and the integral is evaluated over the entire support of X.
Bayesian expected loss[edit]
In a Bayesian approach, the expectation is calculated using the posterior distribution π* of the parameter θ:
ρ ( π ∗ , a ) = ∫ Θ L ( θ , a ) d π ∗ ( θ ) . {\displaystyle \rho (\pi ^{*},a)=\int _{\Theta }L(\theta ,a)\,\mathrm {d} \pi ^{*}(\theta ).}
One then should choose the action a* which minimises the expected loss. Although this will result in choosing the same action as would be chosen using the frequentist risk, the emphasis of the Bayesian approach is that one is only interested in choosing the optimal action under the actual observed data, whereas choosing the actual frequentist optimal decision rule, which is a function of all possible observations, is a much more difficult problem.
Economic choice under uncertainty[edit]
In economics, decision-making under uncertainty is often modelled using the von Neumann-Morgenstern utility function of the uncertain variable of interest, such as end-of-period wealth. Since the value of this variable is uncertain, so is the value of the utility function; it is the expected value of utility that is maximized.
Examples[edit]
For a scalar parameter θ, a decision function whose output θ ^ {\displaystyle {\hat {\theta }}} is an estimate of θ, and a quadratic loss function
L ( θ , θ ^ ) = ( θ − θ ^ ) 2 , {\displaystyle L(\theta ,{\hat {\theta }})=(\theta -{\hat {\theta }})^{2},}
the risk function becomes the mean squared error of the estimate,
R ( θ , θ ^ ) = E θ  ( θ − θ ^ ) 2 . {\displaystyle R(\theta ,{\hat {\theta }})=\operatorname {E} _{\theta }(\theta -{\hat {\theta }})^{2}.}
In density estimation, the unknown parameter is probability density itself. The loss function is typically chosen to be a norm in an appropriate function space. For example, for L2 norm,
L ( f , f ^ ) = ∥ f − f ^ ∥ 2 2 , {\displaystyle L(f,{\hat {f}})=\|f-{\hat {f}}\|_{2}^{2}\,,}
the risk function becomes the mean integrated squared error
R ( f , f ^ ) = E  ∥ f − f ^ ∥ 2 . {\displaystyle R(f,{\hat {f}})=\operatorname {E} \|f-{\hat {f}}\|^{2}.\,}
Decision rules[edit]
A decision rule makes a choice using an optimality criterion. Some commonly used criteria are:
Minimax: Choose the decision rule with the lowest worst loss — that is, minimize the worst-case (maximum possible) loss:
a r g m i n δ max θ ∈ Θ R ( θ , δ ) . {\displaystyle {\underset {\delta }{\operatorname {arg\,min} }}\ \max _{\theta \in \Theta }\ R(\theta ,\delta ).}
Invariance: Choose the optimal decision rule which satisfies an invariance requirement.
Choose the decision rule with the lowest average loss (i.e. minimize the expected value of the loss function):
a r g m i n δ E θ ∈ Θ  [ R ( θ , δ ) ] = a r g m i n δ ∫ θ ∈ Θ R ( θ , δ ) p ( θ ) d θ . {\displaystyle {\underset {\delta }{\operatorname {arg\,min} }}\operatorname {E} _{\theta \in \Theta }[R(\theta ,\delta )]={\underset {\delta }{\operatorname {arg\,min} }}\ \int _{\theta \in \Theta }R(\theta ,\delta )\,p(\theta )\,d\theta .}
Selecting a loss function[edit]
Sound statistical practice requires selecting an estimator consistent with the actual acceptable variation experienced in the context of a particular applied problem. Thus, in the applied use of loss functions, selecting which statistical method to use to model an applied problem depends on knowing the losses that will be experienced from being wrong under the problem's particular circumstances.[8]
A common example involves estimating "location." Under typical statistical assumptions, the mean or average is the statistic for estimating location that minimizes the expected loss experienced under the squared-error loss function, while the median is the estimator that minimizes expected loss experienced under the absolute-difference loss function. Still different estimators would be optimal under other, less common circumstances.
In economics, when an agent is risk neutral, the objective function is simply expressed in monetary terms, such as profit, income, or end-of-period wealth.
But for risk-averse (or risk-loving) agents, loss is measured as the negative of a utility function, which represents satisfaction and is usually interpreted in ordinal terms rather than in cardinal (absolute) terms.
Other measures of cost are possible, for example mortality or morbidity in the field of public health or safety engineering.
For most optimization algorithms, it is desirable to have a loss function that is globally continuous and differentiable.
Two very commonly used loss functions are the squared loss, L ( a ) = a 2 {\displaystyle L(a)=a^{2}} , and the absolute loss, L ( a ) = | a | {\displaystyle L(a)=|a|} . However the absolute loss has the disadvantage that it is not differentiable at a = 0 {\displaystyle a=0} . The squared loss has the disadvantage that it has the tendency to be dominated by outliers—when summing over a set of a {\displaystyle a} 's (as in ∑ i = 1 n L ( a i ) {\displaystyle \sum _{i=1}^{n}L(a_{i})} ), the final sum tends to be the result of a few particularly large a-values, rather than an expression of the average a-value.
The choice of a loss function is not arbitrary. It is very restrictive and sometimes the loss function may be characterized by its desirable properties.[9] Among the choice principles are, for example, the requirement of completeness of the class of symmetric statistics in the case of i.i.d. observations, the principle of complete information, and some others.
Loss functions in Bayesian statistics[edit]
One of the consequences of Bayesian inference is that in addition to experimental data, the loss function does not in itself wholly determine a decision. What is important is the relationship between the loss function and the posterior probability. So it is possible to have two different loss functions which lead to the same decision when the prior probability distributions associated with each compensate for the details of each loss function.[citation needed]
Combining the three elements of the prior probability, the data, and the loss function then allows decisions to be based on maximizing the subjective expected utility, a concept introduced by Leonard J. Savage.[citation needed]
Regret[edit]
Main article: Regret (decision theory)
Savage also argued that using non-Bayesian methods such as minimax, the loss function should be based on the idea of regret, i.e., the loss associated with a decision should be the difference between the consequences of the best decision that could have been taken had the underlying circumstances been known and the decision that was in fact taken before they were known.
Quadratic loss function[edit]
The use of a quadratic loss function is common, for example when using least squares techniques. It is often more mathematically tractable than other loss functions because of the properties of variances, as well as being symmetric: an error above the target causes the same loss as the same magnitude of error below the target. If the target is t, then a quadratic loss function is
λ ( x ) = C ( t − x ) 2 {\displaystyle \lambda (x)=C(t-x)^{2}\;}
for some constant C; the value of the constant makes no difference to a decision, and can be ignored by setting it equal to 1.
Many common statistics, including t-tests, regression models, design of experiments, and much else, use least squares methods applied using linear regression theory, which is based on the quadratric loss function.
The quadratic loss function is also used in linear-quadratic optimal control problems. In these problems, even in the absence of uncertainty, it may not be possible to achieve the desired values of all target variables. Often loss is expressed as a quadratic form in the deviations of the variables of interest from their desired values; this approach is tractable because it results in linear first-order conditions. In the context of stochastic control, the expected value of the quadratic form is used.
0-1 loss function[edit]
In statistics and decision theory, a frequently used loss function is the 0-1 loss function
L ( y ^ , y ) = I ( y ^ ≠ y ) , {\displaystyle L({\hat {y}},y)=I({\hat {y}}\neq y),\,}
where I {\displaystyle I} is the indicator notation.
See also[edit]
Loss functions for classification
Discounted maximum loss
Hinge loss
Scoring rule
References[edit]
Jump up ^ Wald, A. (1950). Statistical Decision Functions. Wiley.
Jump up ^ Cramér, H. (1930). On the mathematical theory of risk. Centraltryckeriet.
Jump up ^ Nikulin, M.S. (2001) [1994], "Loss function", in Hazewinkel, Michiel, Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 978-1-55608-010-4
Jump up ^ Nikulin, M.S. (2001) [1994], "Risk of a statistical procedure", in Hazewinkel, Michiel, Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 978-1-55608-010-4
Jump up ^ Berger, James O. (1985). Statistical decision theory and Bayesian Analysis (2nd ed.). New York: Springer-Verlag. ISBN 0-387-96098-8. MR 0804611.
Jump up ^ DeGroot, Morris (2004) [1970]. Optimal Statistical Decisions. Wiley Classics Library. ISBN 0-471-68029-X. MR 2288194.
Jump up ^ Robert, Christian P. (2007). The Bayesian Choice (2nd ed.). New York: Springer. ISBN 0-387-95231-4. MR 1835885. doi:10.1007/0-387-71599-1.
Jump up ^ Pfanzagl, J. (1994). Parametric Statistical Theory. Berlin: Walter de Gruyter. ISBN 3-11-013863-8.
Jump up ^ Detailed information on mathematical principles of the loss function choice is given in Chapter 2 of the book Klebanov, B.; Rachev, Svetlozat T.; Fabozzi, Frank J. (2009). Robust and Non-Robust Models in Statistics. New York: Nova Scientific Publishers, Inc. (and references there).
Further reading[edit]
Aretz, Kevin; Bartram, Söhnke M.; Pope, Peter F. (April–June 2011). "Asymmetric Loss Functions and the Rationality of Expected Stock Returns". International Journal of Forecasting. 27 (2): 413–437. SSRN 889323  . doi:10.1016/j.ijforecast.2009.10.008.
Berger, James O. (1985). Statistical decision theory and Bayesian Analysis (2nd ed.). New York: Springer-Verlag. ISBN 0-387-96098-8. MR 0804611.
[hide]
v
t
e
Statistics
Outline
Index
[show]
Descriptive statistics
Continuous data
Center
Mean
arithmetic
geometric
harmonic
Median
Mode
Dispersion
Variance
Standard deviation
Coefficient of variation
Percentile
Range
Interquartile range
Shape
Central limit theorem
Moments
Skewness
Kurtosis
L-moments
Count data
Index of dispersion
Summary tables
Grouped data
Frequency distribution
Contingency table
Dependence
Pearson product-moment correlation
Rank correlation
Spearman's rho
Kendall's tau
Partial correlation
Scatter plot
Graphics
Bar chart
Biplot
Box plot
Control chart
Correlogram
Fan chart
Forest plot
Histogram
Pie chart
Q–Q plot
Run chart
Scatter plot
Stem-and-leaf display
Radar chart
[show]
Data collection
Study design
Population
Statistic
Effect size
Statistical power
Sample size determination
Missing data
Survey methodology
Sampling
stratified
cluster
Standard error
Opinion poll
Questionnaire
Controlled experiments
Design
control
optimal
Controlled trial
Randomized
Random assignment
Replication
Blocking
Interaction
Factorial experiment
Uncontrolled studies
Observational study
Natural experiment
Quasi-experiment
[hide]
Statistical inference
Statistical theory
Population
Statistic
Probability distribution
Sampling distribution
Order statistic
Empirical distribution
Density estimation
Statistical model
Lp space
Parameter
location
scale
shape
Parametric family
Likelihood (monotone)
Location–scale family
Exponential family
Completeness
Sufficiency
Statistical functional
Bootstrap
U
V
Optimal decision
loss function
Efficiency
Statistical distance
divergence
Asymptotics
Robustness
Frequentist inference
Point estimation
Estimating equations
Maximum likelihood
Method of moments
M-estimator
Minimum distance
Unbiased estimators
Mean-unbiased minimum-variance
Rao–Blackwellization
Lehmann–Scheffé theorem
Median unbiased
Plug-in
Interval estimation
Confidence interval
Pivot
Likelihood interval
Prediction interval
Tolerance interval
Resampling
Bootstrap
Jackknife
Testing hypotheses
1- & 2-tails
Power
Uniformly most powerful test
Permutation test
Randomization test
Multiple comparisons
Parametric tests
Likelihood-ratio
Wald
Score
Specific tests
Z (normal)
Student's t-test
F
Goodness of fit
Chi-squared
Kolmogorov–Smirnov
Anderson–Darling
Lilliefors
Jarque–Bera
Normality (Shapiro–Wilk)
Likelihood-ratio test
Model selection
Cross validation
AIC
BIC
Rank statistics
Sign
Sample median
Signed rank (Wilcoxon)
Hodges–Lehmann estimator
Rank sum (Mann–Whitney)
Nonparametric anova
1-way (Kruskal–Wallis)
2-way (Friedman)
Ordered alternative (Jonckheere–Terpstra)
Bayesian inference
Bayesian probability
prior
posterior
Credible interval
Bayes factor
Bayesian estimator
Maximum posterior estimator
[show]
Correlation
Regression analysis
Correlation
Pearson product-moment
Partial correlation
Confounding variable
Coefficient of determination
Regression analysis
Errors and residuals
Regression model validation
Mixed effects models
Simultaneous equations models
Multivariate adaptive regression splines (MARS)
Linear regression
Simple linear regression
Ordinary least squares
General linear model
Bayesian regression
Non-standard predictors
Nonlinear regression
Nonparametric
Semiparametric
Isotonic
Robust
Heteroscedasticity
Homoscedasticity
Generalized linear model
Exponential families
Logistic (Bernoulli) / Binomial / Poisson regressions
Partition of variance
Analysis of variance (ANOVA, anova)
Analysis of covariance
Multivariate ANOVA
Degrees of freedom
[show]
Categorical / Multivariate / Time-series / Survival analysis
Categorical
Cohen's kappa
Contingency table
Graphical model
Log-linear model
McNemar's test
Multivariate
Regression
Manova
Principal components
Canonical correlation
Discriminant analysis
Cluster analysis
Classification
Structural equation model
Factor analysis
Multivariate distributions
Elliptical distributions
Normal
Time-series
General
Decomposition
Trend
Stationarity
Seasonal adjustment
Exponential smoothing
Cointegration
Structural break
Granger causality
Specific tests
Dickey–Fuller
Johansen
Q-statistic (Ljung–Box)
Durbin–Watson
Breusch–Godfrey
Time domain
Autocorrelation (ACF)
partial (PACF)
Cross-correlation (XCF)
ARMA model
ARIMA model (Box–Jenkins)
Autoregressive conditional heteroskedasticity (ARCH)
Vector autoregression (VAR)
Frequency domain
Spectral density estimation
Fourier analysis
Wavelet
Survival
Survival function
Kaplan–Meier estimator (product limit)
Proportional hazards models
Accelerated failure time (AFT) model
First hitting time
Hazard function
Nelson–Aalen estimator
Test
Log-rank test
[show]
Applications
Biostatistics
Bioinformatics
Clinical trials / studies
Epidemiology
Medical statistics
Engineering statistics
Chemometrics
Methods engineering
Probabilistic design
Process / quality control
Reliability
System identification
Social statistics
Actuarial science
Census
Crime statistics
Demography
Econometrics
National accounts
Official statistics
Population statistics
Psychometrics
Spatial statistics
Cartography
Environmental statistics
Geographic information system
Geostatistics
Kriging
Category
Portal
Commons
WikiProject
Retrieved from "https://en.wikipedia.org/w/index.php?title=Loss_function&oldid=808442142"
Categories:
Optimal decisions
Loss functions
Hidden categories:
All articles with unsourced statements
Articles with unsourced statements from February 2012
Navigation menu
Personal tools
Not logged in
Talk
Contributions
Create account
Log in
Namespaces
Article
Talk
Variants
Views
Read
Edit
View history
More
Search
Navigation
Main page
Contents
Featured content
Current events
Random article
Donate to Wikipedia
Wikipedia store
Interaction
Help
About Wikipedia
Community portal
Recent changes
Contact page
Tools
What links here
Related changes
Upload file
Special pages
Permanent link
Page information
Wikidata item
Cite this page
Print/export
Create a book
Download as PDF
Printable version
Languages
Asturianu
Español
فارسی
Français
한국어
Português
Русский
Simple English
Basa Sunda
Українська
Edit links
This page was last edited on 2 November 2017, at 21:54.
Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization.
Privacy policy
About Wikipedia
Disclaimers
Contact Wikipedia
Developers
Cookie statement
Mobile view
Enable previews

key: html

type: local

value: div

attrs: id class

values: mw-page-base noprint

values: mw-head-base noprint

value: a

attrs: id class lang

values: firstHeading firstHeading en

values: siteSub noprint

values: jump-to-nav mw-jump

attrs: href title

value: b

attrs: href class title

values:
/wiki/Reward_function
mw-redirect
Reward function

values:
/wiki/Profit_function
mw-redirect
Profit function

values:
/wiki/Utility_function
mw-redirect
Utility function

values:
/wiki/Parameter_estimation
mw-redirect
Parameter estimation

values:
/wiki/Numerical_optimization
mw-redirect
Numerical optimization

values:
/wiki/Training_set
mw-redirect
Training set

values: vertical-align: -0.838ex; width:18.296ex; height:2.843ex;

values: vertical-align: -0.671ex; width:8.366ex; height:2.509ex;

values: vertical-align: -0.671ex; width:2.516ex; height:2.509ex;

values: vertical-align: -0.338ex; width:1.334ex; height:1.676ex;

values: vertical-align: -2.338ex; width:48.267ex; height:5.843ex;

values: vertical-align: -0.671ex; width:2.604ex; height:2.509ex;

values:
/wiki/Posterior_distribution
mw-redirect
Posterior distribution

values: vertical-align: -2.338ex; width:28.545ex; height:5.843ex;

values: Edit section: Economic choice under uncertainty

values: Von Neumann-Morgenstern utility function

values: vertical-align: -0.338ex; width:1.366ex; height:3.009ex;

values: vertical-align: -0.838ex; width:18.911ex; height:3.509ex;

values: vertical-align: -0.838ex; width:21.697ex; height:3.509ex;

values: vertical-align: -1.005ex; width:20.877ex; height:3.676ex;

values: vertical-align: -0.838ex; width:23.038ex; height:3.509ex;

values: vertical-align: -2.671ex; width:21.321ex; height:4.676ex;

values: \underset{\delta} {\operatorname{arg\,min}} \ \max_{\theta \in \Theta} \ R(\theta,\delta).

values: vertical-align: -2.671ex; width:52.473ex; height:6.176ex;

values: vertical-align: -0.838ex; width:10.075ex; height:3.176ex;

values:
/wiki/Absolute_deviation
mw-redirect
Absolute deviation

values: vertical-align: -0.838ex; width:10.328ex; height:2.843ex;

values: vertical-align: -0.338ex; width:5.522ex; height:2.176ex;

values: vertical-align: -0.338ex; width:1.24ex; height:1.676ex;

values: vertical-align: -3.005ex; width:9.223ex; height:7.009ex;

values: Edit section: Loss functions in Bayesian statistics

values:
/wiki/Prior_probability_distribution
mw-redirect
Prior probability distribution

values: This claim needs references to reliable sources. (February 2012)

values:
noprint Inline-Template Template-Fact
white-space:nowrap;

values:
/wiki/Leonard_J._Savage
mw-redirect
Leonard J. Savage

values: vertical-align: -0.838ex; width:18ex; height:3.176ex;

values:
/wiki/Linear-quadratic_regulator
mw-redirect
Linear-quadratic regulator

values:
/wiki/First-order_condition
mw-redirect
First-order condition

values: vertical-align: -0.838ex; width:19.7ex; height:2.843ex;

values: vertical-align: -0.338ex; width:1.182ex; height:2.176ex;

values:
/wiki/Indicator_notation
mw-redirect
Indicator notation

values:
/wiki/James_Berger_(statistician)
mw-redirect
James Berger (statistician)

values:
nofollow
external text
//doi.org/10.1007%2F0-387-71599-1

values: -moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;

values:
nofollow
external text
//ssrn.com/abstract=889323

attrs: alt src title width height srcset data-file-width data-file-height

values:
/wiki/Shape_of_the_distribution
mw-redirect
Shape of the distribution

values: Pearson product-moment correlation coefficient

values: Kendall tau rank correlation coefficient

values: nowraplinks collapsible collapsed navbox-subgroup

values:
/wiki/Population_(statistics)
mw-redirect
Population (statistics)

values:
/wiki/Maximum_likelihood
mw-redirect
Maximum likelihood

values:
/wiki/Median-unbiased_estimator
mw-redirect
Median-unbiased estimator

values:
/wiki/Likelihood_interval
mw-redirect
Likelihood interval

values:
/wiki/Power_(statistics)
mw-redirect
Power (statistics)

values:
/wiki/Permutation_test
mw-redirect
Permutation test

values:
/wiki/Randomization_test
mw-redirect
Randomization test

values:
/wiki/Multiple_comparisons
mw-redirect
Multiple comparisons

values:
/wiki/Rank_statistics
mw-redirect
Rank statistics

values:
/wiki/Sample_median
mw-redirect
Sample median

values: Kruskal–Wallis one-way analysis of variance

values: nowraplinks collapsible uncollapsed navbox-subgroup

values:
CorrelationRegression_analysis
font-size:114%;margin:0 4em
hlist hlist-separated

values:
/wiki/Regression_model_validation
mw-redirect
Regression model validation

values: Multivariate adaptive regression splines

values:
/wiki/Multivariate_distribution
mw-redirect
Multivariate distribution

values:
/wiki/Trend_estimation
mw-redirect
Trend estimation

values: List of fields of application of statistics

values: nowraplinks hlist collapsible uncollapsed navbox-inner

values: navigation navbox Statistics padding:3px

values: Category:All articles with unsourced statements

values: Category:Articles with unsourced statements from February 2012

values: Discussion about edits from this IP address [ctrl-alt-n]

values: A list of edits made from this IP address [ctrl-alt-y]

values: You are encouraged to create an account and log in; however, it is not mandatory

values: You're encouraged to log in; however, it's not mandatory. [ctrl-alt-o]

values:
/wiki/Loss_function
View the content page [ctrl-alt-c]
c

values: Discussion about the content page [ctrl-alt-t]

values: p-namespaces navigation vectorTabs p-namespaces-label

values:
p-variants
navigation
vectorMenu emptyPortlet
p-variants-label

values: Past revisions of this page [ctrl-alt-h]

values: p-views navigation vectorTabs p-views-label

values:
p-cactions
navigation
vectorMenu emptyPortlet
p-cactions-label

values:
mw-wiki-logo
/wiki/Main_Page
Visit the main page

values:
/wiki/Main_Page
Visit the main page [ctrl-alt-z]
z

values: Featured content – the best of Wikipedia

values: Find background information on current events

values:
/wiki/Special:Random
Load a random article [ctrl-alt-x]
x

values: portal navigation p-navigation p-navigation-label

values: Guidance on how to use and edit Wikipedia

values: About the project, what you can do, where to find things

values: A list of recent changes in the wiki [ctrl-alt-r]

values: portal navigation p-interaction p-interaction-label

values: List of all English Wikipedia pages containing links to this page [ctrl-alt-j]

values: Recent changes in pages linked from this page [ctrl-alt-k]

values:
/wiki/Wikipedia:File_Upload_Wizard
Upload files [ctrl-alt-u]
u

values: A list of all special pages [ctrl-alt-q]

values: Permanent link to this revision of the page

values: Link to connected data repository item [ctrl-alt-g]

values: Printable version of this page [ctrl-alt-p]

values:
uls-settings-trigger
Language settings
0
button
true

values: تابع هزینه – Persian

values: Функция потерь – Russian

values: Функція втрат – Ukrainian

values: mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-0 ns-subject page-Loss_function rootpage-Loss_function vector-experimental-print-styles vector-nav-directionality skin-vector action-view