Probability

Probability is the branch of mathematics that studies the possible outcomes of given events together with the outcomes' relative likelihoods and distributions. In common usage, the word "probability" is used to mean the chance that a particular event (or set of events) will occur expressed on a linear scale from 0 (impossibility) to 1 (certainty), also expressed as a percentage between 0 and 100%. The analysis of events governed by probability is called statistics.

There are several competing interpretations of the actual "meaning" of probabilities. Frequentists view probability simply as a measure of the frequency of outcomes (the more conventional interpretation), while Bayesians treat probability more subjectively as a statistical procedure that endeavors to estimate parameters of an underlying distribution based on the observed distribution.

A properly normalized function that assigns a probability "density" to each possible outcome within some interval is called a probability function (or probability distribution function), and its cumulative value (integral for a continuous distribution or sum for a discrete distribution) is called a distribution function (or cumulative distribution function).

A variate is defined as the set of all random variables that obey a given probabilistic law. It is common practice to denote a variate with a capital letter (most commonly ). The set of all values that can take is then called the range, denoted (Evans et al. 2000, p. 5). Specific elements in the range of are called quantiles and denoted , and the probability that a variate assumes the element is denoted .

Probabilities are defined to obey certain assumptions, called the probability axioms. Let a sample space contain the union () of all possible events , so

(1)

and let and denote subsets of . Further, let be the complement of , so that

(2)

Then the set can be written as

(3)

where denotes the intersection. Then

			(4)
			(5)
			(6)
			(7)
			(8)
			(9)
			(10)

where is the empty set.

Let denote the conditional probability of given that has already occurred, then

			(11)
			(12)
			(13)
			(14)
			(15)
			(16)
			(17)

The relationship

(18)

holds if and are independent events. A very important result states that

(19)

which can be generalized to

(20)

Source: http://mathworld.wolfram.com/Probability.html