Chapter 14 Probability

Where a mathematical reasoning can be had, it is as great a folly to make use of any other, as to grope for a thing in the dark, when you have a candle in your hand. - JOHN ARBUTHNOT

14.1 Event

We have studied about random experiment and sample space associated with an experiment. The sample space serves as an universal set for all questions concerned with the experiment.

Consider the experiment of tossing a coin two times. An associated sample space is S={HH,HT,TH,TT}.

Now suppose that we are interested in those outcomes which correspond to the occurrence of exactly one head. We find that HT and TH are the only elements of S corresponding to the occurrence of this happening (event). These two elements form the set E={HT,TH}

We know that the set E is a subset of the sample space S. Similarly, we find the following correspondence between events and subsets of S.

Description of eventsCorresponding subset of ’ S ‘Number of tails is exactly 2A={TT}Number of tails is atleast oneB={HT, TH, TT}Number of heads is atmost oneC={HT, TH, TT}Second toss is not headD={HT, TT}Number of tails is atmost twoS={HH, HT, TH, TT}Number of tails is more than twoϕ

The above discussion suggests that a subset of sample space is associated with an event and an event is associated with a subset of sample space. In the light of this we define an event as follows.

Definition Any subset E of a sample space S is called an event.

14.1.1 Occurrence of an event

Consider the experiment of throwing a die. Let E denotes the event " a number less than 4 appears". If actually ’ 1 ’ had appeared on the die then we say that event E has occurred. As a matter of fact if outcomes are 2 or 3 , we say that event E has occurred

Thus, the event E of a sample space S is said to have occurred if the outcome ω of the experiment is such that ωE. If the outcome ω is such that ωE, we say that the event E has not occurred.

14.1.2 Types of events

Events can be classified into various types on the basis of the elements they have.

1. Impossible and Sure Events The empty set ϕ and the sample space S describe events. In fact ϕ is called an impossible event and S, i.e., the whole sample space is called the sure event.

To understand these let us consider the experiment of rolling a die. The associated sample space is

S={1,2,3,4,5,6}

Let E be the event " the number appears on the die is a multiple of 7". Can you write the subset associated with the event E ?

Clearly no outcome satisfies the condition given in the event, i.e., no element of the sample space ensures the occurrence of the event E. Thus, we say that the empty set only correspond to the event E. In other words we can say that it is impossible to have a multiple of 7 on the upper face of the die. Thus, the event E=ϕ is an impossible event.

Now let us take up another event F “the number turns up is odd or even”. Clearly F={1,2,3,4,5,6}=,S, i.e., all outcomes of the experiment ensure the occurrence of the event F. Thus, the event F=S is a sure event.

2. Simple Event If an event E has only one sample point of a sample space, it is called a simple (or elementary) event.

In a sample space containing n distinct elements, there are exactly n simple events.

For example in the experiment of tossing two coins, a sample space is

S={HH,HT,TH,TT}

There are four simple events corresponding to this sample space. These are

E1={HH},E2={HT},E3={TH} and E4={TT}

3. Compound Event If an event has more than one sample point, it is called a Compound event

For example, in the experiment of “tossing a coin thrice” the events

E: ‘Exactly one head appeared’

F: ‘Atleast one head appeared’

G: ‘Atmost one head appeared’ etc.

are all compound events. The subsets of S associated with these events are

E={HTT,THT,TTH}F={HTT,THT,TTH,HHT,HTH,THH,HHH}G={TTT, THT, HTT, TTH }

Each of the above subsets contain more than one sample point, hence they are all compound events.

14.1.3 Algebra of events

In the Chapter on Sets, we have studied about different ways of combining two or more sets, viz, union, intersection, difference, complement of a set etc. Like-wise we can combine two or more events by using the analogous set notations.

Let A, B, C be events associated with an experiment whose sample space is S.

1. Complementary Event For every event A, there corresponds another event A called the complementary event to A. It is also called the event ’not A ‘.

For example, take the experiment ‘of tossing three coins’. An associated sample space is

S={HHH,HHT,HTH,THH,HTT,THT,TTH,TTT}

Let A={HTH,HHT,THH} be the event ‘only one tail appears’

Clearly for the outcome HTT, the event A has not occurred. But we may say that the event ’not A’ has occurred. Thus, with every outcome which is not in A, we say that ’not A’ occurs.

Thus the complementary event ’not A’ to the event A is

A={HHH,HTT,THT,TTH,TTT}

or A={ω:ωS and ωA}=SA.

2. The Event ‘A or B’ Recall that union of two sets A and B denoted by A B contains all those elements which are either in A or in B or in both.

When the sets A and B are two events associated with a sample space, then ‘A B ’ is the event ’either A or B or both’. This event ‘A B ’ is also called ‘A or B’. Therefore

 Event A or B=AB={ω:ωA or ωB}

3. The Event ‘A and B’ We know that intersection of two sets AB is the set of those elements which are common to both A and B. i.e., which belong to both ‘A and B’.

If A and B are two events, then the set AB denotes the event ’ A and B ‘.

Thus, AB={ω:ωAandωB}

For example, in the experiment of ’throwing a die twice’ Let A be the event ‘score on the first throw is six’ and B is the event ‘sum of two scores is atleast 11’ then

A={(6,1),(6,2),(6,3),(6,4),(6,5),(6,6)}, and B={(5,6),(6,5),(6,6)}

so AB={(6,5),(6,6)}

Note that the set AB={(6,5),(6,6)} may represent the event ’the score on the first throw is six and the sum of the scores is atleast 11 ‘.

4. The Event ‘A but not B’ We know that A-B is the set of all those elements which are in A but not in B. Therefore, the set A-B may denote the event ‘A but not B’. We know that

AB=AB

14.1.4 Mutually exclusive events

In the experiment of rolling a die, a sample space is S={1,2,3,4,5,6}. Consider events, A ‘an odd number appears’ and B ‘an even number appears’

Clearly the event A excludes the event B and vice versa. In other words, there is no outcome which ensures the occurrence of events A and B simultaneously. Here

A={1,3,5} and B={2,4,6}

Clearly AB=ϕ, i.e., A and B are disjoint sets.

In general, two events A and B are called mutually exclusive events if the occurrence of any one of them excludes the occurrence of the other event, i.e., if they can not occur simultaneously. In this case the sets A and B are disjoint.

Again in the experiment of rolling a die, consider the events A ‘an odd number appears’ and event B ‘a number less than 4 appears’

Obviously A={1,3,5} and B={1,2,3}

Now 3A as well as 3B

Therefore, A and B are not mutually exclusive events.

Remark Simple events of a sample space are always mutually exclusive.

14.1.5 Exhaustive events

Consider the experiment of throwing a die. We have S={1,2,3,4,5,6}. Let us define the following events

A: ‘a number less than 4 appears’,

B: ‘a number greater than 2 but less than 5 appears’

and C: ‘a number greater than 4 appears’.

Then A={1,2,3},B={3,4} and C={5,6}. We observe that

ABC={1,2,3}{3,4}{5,6}=S.

Such events A,B and C are called exhaustive events. In general, if E1,E2,,En are n events of a sample space S and if

E1E2E3En=i=1nEi=S

then E1,E2,,En are called exhaustive events.In other words, events E1,E2,,En are said to be exhaustive if atleast one of them necessarily occurs whenever the experiment is performed.

Further, if EiEj=ϕ for ij i.e., events Ei and Ej are pairwise disjoint and i=1nEi=S, then events E1,E2,,En are called mutually exclusive and exhaustive events.

We now consider some examples.

14.2 Axiomatic Approach to Probability

In earlier sections, we have considered random experiments, sample space and events associated with these experiments. In our day to day life we use many words about the chances of occurrence of events. Probability theory attempts to quantify these chances of occurrence or non occurrence of events.

In earlier classes, we have studied some methods of assigning probability to an event associated with an experiment having known the number of total outcomes.

Axiomatic approach is another way of describing probability of an event. In this approach some axioms or rules are depicted to assign probabilities.

Let S be the sample space of a random experiment. The probability P is a real valued function whose domain is the power set of S and range is the interval [0,1] satisfying the following axioms

 (i) For any event E,P(E)0 (ii) P(S)=1

(iii) If E and F are mutually exclusive events, then P(EF)=P(E)+P(F).

It follows from (iii) that P(ϕ)=0. To prove this, we take F=ϕ and note that E and ϕ are disjoint events. Therefore, from axiom (iii), we get

P(Eϕ)=P(E)+P(ϕ) or P(E)=P(E)+P(ϕ) i.e. P(ϕ)=0

Let S be a sample space containing outcomes ω1,ω2,,ωn, i.e.,

S={ω1,ω2,,ωn}

It follows from the axiomatic definition of probability that

(i) 0P(ωi)1 for each ωiS

(ii) P(ω1)+P(ω2)++P(ωn)=1

(iii) For any event A,P(A)=P(ωi),ωiA.

Note - It may be noted that the singleton {ωi} is called elementary event and for notational convenience, we write P(ωi) for P({ωi}).

For example, in ‘a coin tossing’ experiment we can assign the number 12 to each of the outcomes H and T.

i.e. P(H)=12 and P(T)=12

Clearly this assignment satisfies both the conditions i.e., each number is neither less than zero nor greater than 1 and

P(H)+P(T)=12+12=1

Therefore, in this case we can say that probability of H=12, and probability of T=12

If we take P(H)=14 and P(T)=34(2)

Does this assignment satisfy the conditions of axiomatic approach?

Yes, in this case, probability of H=14 and probability of T=34.

We find that both the assignments (1) and (2) are valid for probability of H and T.

In fact, we can assign the numbers p and (1p) to both the outcomes such that 0p1 and P(H)+P(T)=p+(1p)=1

This assignment, too, satisfies both conditions of the axiomatic approach of probability. Hence, we can say that there are many ways (rather infinite) to assign probabilities to outcomes of an experiment. We now consider some examples.

14.2.1 Probability of an event

Let S be a sample space associated with the experiment ’examining three consecutive pens produced by a machine and classified as Good (non-defective) and bad (defective)’. We may get 0,1,2 or 3 defective pens as result of this examination.

A sample space associated with this experiment is

S={BBB,BBG,BGB,GBB,BGG,GBG,GGB,GGG}

where B stands for a defective or bad pen and G for a non - defective or good pen.

Let the probabilities assigned to the outcomes be as follows

Sample point:BBBBBGBGBGBBBGGGBGGGBGGGProbability: 1818181818181818

Let event A: there is exactly one defective pen and event B: there are atleast two defective pens.

Hence A={BGG,GBG,GGB} and B={BBG,BGB,GBB,BBB}

Now P(A)=P(ωi),ωiA

=P(BGG)+P(GBG)+P(GGB)=18+18+18=38

and

P(B)=P(ωi),ωiB=P(BBG)+P(BGB)+P(GBB)+P(BBB)=18+18+18+18=48=12

Let us consider another experiment of “tossing a coin “twice”

The sample space of this experiment is S={HH,HT,TH,TT}

Let the following probabilities be assigned to the outcomes

P(HH)=14,P(HT)=17,P(TH)=27,P(TT)=928

Clearly this assignment satisfies the conditions of axiomatic approach. Now, let us find the probability of the event E : ‘Both the tosses yield the same result’.

Here E={HH,TT}

Now P(E)=ΣP(wi), for all wiE

=P(HH)+P(TT)=14+928=47

For the event F : ’exactly two heads’, we have F={HH}

and P(F)=P(HH)=14

14.2.2 Probabilities of equally likely outcomes

Let a sample space of an experiment be

S={ω1,ω2,,ωn}.

Let all the outcomes are equally likely to occur, i.e., the chance of occurrence of each simple event must be same.

i.e. P(ωi)=p, for all ωiS where 0p1

Since i=1nP(ωi)=1 i.e., p+p++p(n times )=1ornp=1 i.e., p=1n

Let S be a sample space and E be an event, such that n(S)=n and n(E)=m. If each out come is equally likely, then it follows that

P(E)=mn= Number of outcomes favourable to E Total possible outcomes 

14.2.3 Probability of the event ’ A or B '

Let us now find the probability of event ‘A or B’, i.e., P(AB)

Let A={HHT,HTH,THH} and B={HTH,THH,HHH} be two events associated with ’tossing of a coin thrice’

Clearly AB={HHT,HTH,THH,HHH}

Now P(AB)=P(HHT)+P(HTH)+P(THH)+P(HHH)

If all the outcomes are equally likely, then

P(AB)=18+18+18+18=48=12

Also P(A)=P(HHT)+P(HTH)+P(THH)=38

and P(B)=P(HTH)+P(THH)+P(HHH)=38

Therefore P(A)+P(B)=38+38=68

It is clear that P(AB)P(A)+P(B)

The points HTH and THH are common to both A and B. In the computation of P(A)+P(B) the probabilities of points HTH and THH, i.e., the elements of AB are included twice. Thus to get the probability P(AB) we have to subtract the probabilities of the sample points in AB from P(A)+P(B)

i.e.

P(AB)=P(A)+P(B)P(ωi),ωiAB=P(A)+P(B)P(AB)

Thus we observe that, P(AB)=P(A)+P(B)P(AB)

In general, if A and B are any two events associated with a random experiment, then by the definition of probability of an event, we have

P(AB)=p(ωi),ωiAB

Since AB=(AB)(AB)(BA)

we have

P(AB)=[P(ωi)ωi(AB)]+[P(ωi)ωiAB]+[P(ωi)ωiBA]

(because AB,AB and BA are mutually exclusive)

Also P(A)+P(B)=[p(ωi)ωiA]+[p(ωi)ωiB]

=[P(ωi)ωi(AB)(AB)]+[P(ωi)ωi(BA)(AB)]=[P(ωi)ωi(AB)]+[P(ωi)ωi(AB)]+[P(ωi)ωi(BA)]+[P(ωi)ωi(AB)]=P(AB)+[P(ωi)ωiAB][using(1)]=P(AB)+P(AB).

Hence P(AB)=P(A)+P(B)P(AB).

Alternatively, it can also be proved as follows:

AB=A(BA), where A and BA are mutually exclusive, and B=(AB)(BA), where AB and BA are mutually exclusive. Using Axiom (iii) of probability, we get

P(AB)=P(A)+P(BA)(2)

and P(B)=P(AB)+P(BA)(3)

Subtracting (3) from (2) gives

P(AB)P(B)=P(A)P(AB)

P(AB)=P(A)+P(B)P(AB)

The above result can further be verified by observing the Venn Diagram (Fig 14.1)

image

If A and B are disjoint sets, i.e., they are mutually exclusive events, then AB=ϕ Therefore

P(AB)=P(ϕ)=0

Thus, for mutually exclusive events A and B, we have

P(AB)=P(A)+P(B)

which is Axiom (iii) of probability.

14.2.4 Probability of event ’not A

Consider the event A={2,4,6,8} associated with the experiment of drawing a card from a deck of ten cards numbered from 1 to 10 . Clearly the sample space is S={1,2,3,,10}

If all the outcomes 1,2,,10 are considered to be equally likely, then the probability of each outcome is 110

Now

P(A)=P(2)+P(4)+P(6)+P(8)=110+110+110+110=410=25

Also event ’ not A=A={1,3,5,7,9,10}

Now P(A)=P(1)+P(3)+P(5)+P(7)+P(9)+P(10)

=610=35

Thus, P(A)=35=125=1P(A)

Also, we know that A and A are mutually exclusive and exhaustive events i.e.,

AA=ϕ and AA=S

or P(AA)=P(S)

Now P(A)+P(A)=1, by using axioms (ii) and (iii).

or P(A)=P(notA)=1P(A)

We now consider some examples and exercises having equally likely outcomes unless stated otherwise.

Summary

In this Chapter, we studied about the axiomatic approach of probability. The main features of this Chapter are as follows:

Event: A subset of the sample space

Impossible event : The empty set

Sure event: The whole sample space

Complementary event or ’not event’ : The set A ’ or SA

Event A or B: The set A B

Event A and B : The set AB

Event A and not B : The set AB

Mutually exclusive event: A and B are mutually exclusive if AB=ϕ

Exhaustive and mutually exclusive events: Events E1,E2,,En are mutually exclusive and exhaustive if E1E2En=S and EiEj=ϕij Probability: Number P(ωi) associated with sample point ωi such that

(i) 0P(ωi)1

(ii) P(ωi) for all ωiS=1

(iii) P(A)=P(ωi) for all ωiA. The number P(ωi) is called probability of the outcome ωi

Equally likely outcomes: All outcomes with equal probability

Probability of an event: For a finite sample space with equally likely outcomes Probability of an event P(A)=n(A)n(S), where n(A)= number of elements in the set A,n(S)= number of elements in the set S.

If A and B are any two events, then

P(A or B)=P(A)+P(B)P(A and B) equivalently, P(AB)=P(A)+P(B)P(AB)

If A and B are mutually exclusive, then P(A or B)=P(A)+P(B)

If A is any event, then

P(notA)=1P(A)

Historical Note

Probability theory like many other branches of mathematics, evolved out of practical consideration. It had its origin in the 16th century when an Italian physician and mathematician Jerome Cardan (1501-1576) wrote the first book on the subject “Book on Games of Chance” (Biber de Ludo Aleae). It was published in 1663 after his death.

In 1654, a gambler Chevalier de Metre approached the well known French Philosopher and Mathematician Blaise Pascal (1623-1662) for certain dice problem. Pascal became interested in these problems and discussed with famous French Mathematician Pierre de Fermat (1601-1665). Both Pascal and Fermat solved the problem independently. Besides, Pascal and Fermat, outstanding contributions to probability theory were also made by Christian Huygenes (16291665), a Dutchman, J. Bernoulli (1654-1705), De Moivre (1667-1754), a Frenchman Pierre Laplace (1749-1827), the Russian P.L Chebyshev (18211897), A. A Markov (1856-1922) and A. N Kolmogorove (1903-1987). Kolmogorov is credited with the axiomatic theory of probability. His book ‘Foundations of Probability’ published in 1933, introduces probability as a set function and is considered a classic.