Specifying the Probability Function of a Numerical-Valued Random Phenomenon

Consider the probability function of a numerical-valued random phenomenon. The question arises concerning the convenient ways of stating the function without having actually to state the value of for every set of real numbers . In general, to state the function , as with any function, one has to enumerate all the members of the domain of the function , and for each of these members of the domain one states the value of the function. In special circumstances (which fortunately cover most of the cases encountered in practice) more convenient methods are available.

For many probability functions there exists a function , defined for all real numbers , from which can, for any event , be obtained by integration:  

Given a probability function , which may be represented in the form of (2.1) in terms of some function , we call the function the probability density function of the probability function , and we say that the probability function is specified by the probability density function .

A function must have certain properties in order to be a probability density function. To begin with, it must be sufficiently well behaved as a function so that the integral 1 in (2.1) is well defined. Next, letting in (2.1) ,  

It is necessary that satisfy (2.2) ; in words, the integral of from to must be equal to 1.

A function is said to be a probability density function if it satisfies (2.2) and, in addition, 2 satisfies the condition since a function satisfying (2.2) and (2.3) is the probability density function of a unique probability function , namely the probability function with value at any event given by (2.1)

Some typical probability density functions are illustrated in Fig.2A .

Figure 2.4.1
Fig. 2A . Graphs of the probability density functions given in the exercises indicated.

Example 2A . Verifying that a function is a probability density function . Suppose one is told that the time one has to wait for a bus on a certain street corner is a numerical-valued random phenomenon, with a probability function, specified by the probability density function , given by

The function is negative for various values of ; in particular, it is negative for (prove this statement). Consequently, it is not possible for to be a probability density function. Next, suppose that the probability density function is given by \begin{align} f(x) & = \begin{cases} 4x - 2x^{2}, & \text{if } 0 \leq x \leq 2 \tag{2.5} \\ 0, & \text{otherwise}. \end{cases} \end{align} 

The function , given by (2.5) , is nonnegative (prove this statement). However, its integral from to , is not equal to 1. Consequently the function , given by (2.5) is not a probability density function. However, the function , given by is a probability density function.

Example 2B . Computing probabilities from a probability density function . Let us consider again the numerical-valued random phenomenon, discussed in example 1A , that consists in observing the time one has to wait for a bus at a certain bus stop. Let us assume that the probability function of this phenomenon may be expressed by (2.1) in terms of the function , whose graph is sketched in Fig. 2B . An algebraic formula for can be written as follows:

Figure 2.4.1
Fig. 2B . Graph of the probability density function defined by (2.6) .

From (2.1) it follows that if and then which agree with the values assumed in example 1A .

Example 2C . The lifetime of a vacuum tube. Consider the numerical valued random phenomenon that consists in observing the total time a vacuum tube will burn from the moment it is first put into service. Suppose that the probability function of this phenomenon is expressed by (2.1) in terms of the function given by

Let be the event that the tube burns between 100 and 1000 hours, inclusive, and let be the event that the tube burns more than 1000 hours. The events and may be represented as subsets of the real line: and . The probabilities of and are given by

For many probability functions there exists a function , defined for all real numbers , but with value equal to 0 for all except for a finite or countably infinite set of values of at which is positive, such that from the value of can be obtained for any event by summation: In order that the sum in (2.7) may be meaningful, it suffices to impose the condition [letting in (2.7) ] that  

Given a probability function , which may be represented in the form (2.7) , we call the function the probability mass function of the probability function , and we say that the probability function is specified by the probability mass function .

A function , defined for all real numbers, is said to be a probability mass function if (i) equals zero for all , except for a finite or countably infinite set of values of for which , and (ii) the infinite series in (2.8) converges and sums to 1. Such a function is the probability mass function of a unique probability function defined on the subsets of the real line, namely the probability function with value at any set given by (2.7)

Example 2D . Computing probabilities from a probability mass function . Let us consider again the numerical-valued random phenomenon considered in examples 1A and 2B. Let us assume that the probability function of this phenomenon may be expressed by (2.7) in terms of the function , whose graph is sketched in Fig. 2C .

Figure 2.4.1

Fig. 2C . Graph of the probability mass function defined by (2.9) .

An algebraic formula for can be written as follows:

It then follows that which agree with the values assumed in example 1A .

The terminology of “density function” and “mass function” comes from the following physical representation of the probability function of a numerical-valued random phenomenon. We imagine that a unit mass of some substance is distributed over the real line in such a way that the amount of mass over any set of real numbers is equal to . The distribution of substance possesses a density, to be denoted by , at the point , if for any interval containing the point of length (where is a sufficiently small number) the mass of substance attached to the interval is equal to . The distribution of substance possesses a mass, to be denoted by , at the point , if there is a positive amount of substance concentrated at the point.

We shall see in section 3 that a probability function always possesses a probability density function and a probability mass function. Consequently, in order for a probability function to be specified by either its probability density function or its probability mass function, it is necessary (and, from a practical point of view, sufficient) that one of these functions vanish identically.

Exercises

Verify that each of the functions , given in exercises , is a probability density function (by showing that it satisfies (2.1) and (2.3) ) and sketch its graph. 3 Hint : use freely the facts developed in the appendix to this section.

2.1.

2.2.

2.3.

2.4.

2.5.

Show that each of the functions given in exercises 2.6 and 2.7 is a probability mass function [by showing that it satisfies (2.8) ], and sketch its graph. 
Hint : use freely the facts developed in the appendix to this section.

2.6.

2.7.

2.8. The amount of bread (in hundreds of pounds) that a certain bakery is able to sell in a day is found to be a numerical-valued random phenomenon, with a probability function specified by the probability density function , given by

  1. Find the value of which makes a probability density function.
  2. Graph the probability density function.
  3. What is the probability that the number of pounds of bread that will be sold tomorrow is (a) more than 500 pounds, less than 500 pounds, (c) between 250 and 750 pounds?
  4. Denote, respectively, by , and , the events that the number of pounds of bread sold in a day is ( ) greater than 500 pounds, less than 500 pounds, between 250 and 750 pounds. Find . Are and independent events? Are and independent events?

2.9. The length of time (in minutes) that a certain young lady speaks on the telephone is found to be a random phenomenon, with a probability function specified by the probability density function , given by

(i) Find the value of that makes a probability density function.

(ii) Graph the probability density function.

(iii) What is the probability that the number of minutes that the young lady will talk on the telephone is more than 10 minutes, less than 5 minutes, between 5 and 10 minutes?

(iv) For any real number , let denote the event that the young lady talks longer than minutes. Find . Show that, for and . In words, the conditional probability that a telephone conversation will last more than minutes, given that it has lasted at least minutes, is equal to the unconditional probability that it will last more than minutes.

 

Answer

(i) ; (iii) (a) 0.1353, (b) 0.6321, (c) 0.2326; (iv) .

 

2.10. The number of newspapers that a certain newsboy is able to sell in a day is found to be a numerical-valued random phenomenon, with a probability function specified by the probability mass function , given by

(i) Find the value of that makes a probability mass function.

(ii) Sketch the probability mass function.

(iii) What is the probability that the number of newspapers that will be sold tomorrow is (a) more than 50, (b) less than 50, (c) equal to 50, (d) between 25 and 75, inclusive, (e) an odd number?

(iv) Denote, respectively, by , and , the events that the number of newspapers sold in a day is (a) greater than less than equal to 50, (d) between 25 and 75, inclusive. Find , . Are and independent events? Are and independent events? Are and independent events?

2.11. The number of times that a certain piece of equipment (say, a light switch) operates before having to be discarded is found to be a random phenomenon, with a probability function specified by the probability mass function , given by

(i) Find the value of which makes a probability mass function.

(ii) Sketch the probability mass function.

(iii) What is the probability that the number of times the equipment will operate before having to be discarded is (a) greater than an even number (regard 0 as even), (c) an odd number?

(iv) For any real number , let denote the event that the number of times the equipment operates is strictly greater than or equal to . Find . Show that, for any integers and . Express in words the meaning of this formula.

 

Answer

(i) ; (iii) (a) , (b) , (c) ; (iv) .

 

Appendix: The Evaluation of Integrals and Sums

If (2.1) and (2.7) are to be useful expressions for evaluating the probability of an event, then techniques must be available for evaluating sums and integrals. The purpose of this appendix is to state some of the notions and formulas with which the student should become familiar and to collect some important formulas that the reader should learn to use, even if he lacks the mathematical background to justify them.

To begin with, let us note the following principle. If a function is defined by different analytic expressions over various regions, then to evaluate an integral whose integrand is this function one must express the integral as a sum of integrals corresponding to the different regions of definition of the function . For example, consider the probability density function defined by \begin{align} f(x) = \begin{cases} x, & \text{for } 0 < x < 1 \Misplaced &2mm] 2 - x, & \text{for } 1 < x < 2 \\[2mm] 0, & \text{elsewhere.} \end{cases} \end{align} </span>To prove that <mjx-container aria-label="f(\cdot)" class="MathJax" jax="SVG"><svg style="vertical-align: -0.566ex;" xmlns="http://www.w3.org/2000/svg" width="3.633ex" height="2.262ex" role="img" focusable="false" viewBox="0 -750 1606 1000" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mi"><use data-c="1D453" xlink:href="#MJX-TEX-I-1D453"></use></g><g data-mml-node="mo" transform="translate(550,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mo" transform="translate(939,0)"><use data-c="22C5" xlink:href="#MJX-TEX-N-22C5"></use></g><g data-mml-node="mo" transform="translate(1217,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g></g></g></svg></mjx-container>is a probability density function, we need to verify that <a href="https://adaptivebooks.org/probability-theory-and-its-applications/numerical-valued-random-phenomena/specifying-the-probability-function-of-a-numerical-valued-random-phenomenon#Eq:4.2.2">(2.2) </a>and <a href="https://adaptivebooks.org/probability-theory-and-its-applications/numerical-valued-random-phenomena/specifying-the-probability-function-of-a-numerical-valued-random-phenomenon#Eq:4.2.3">(2.3) </a>are satisfied. Clearly, <a href="https://adaptivebooks.org/probability-theory-and-its-applications/numerical-valued-random-phenomena/specifying-the-probability-function-of-a-numerical-valued-random-phenomenon#Eq:4.2.3">(2.3) </a>holds. Next, <mjx-container aria-label="\begin{align} \int_{-\infty}^{\infty} f(x) d x & =\int_{0}^{2} f(x) d x+\int_{-\infty}^{0} f(x) d x+\int_{2}^{\infty} f(x) d x \\ & =\int_{0}^{1} f(x) d x+\int_{1}^{2} f(x) d x+0 \\ & =\left.\frac{x^{2}}{2}\right|_{0} ^{1}+\left.\left(2 x-\frac{x^{2}}{2}\right)\right|_{1} ^{2}=\frac{1}{2}+\left(2-\frac{3}{2}\right)=1, \end{align}" class="MathJax" jax="SVG" display="true"><svg style="vertical-align: -8.883ex;" xmlns="http://www.w3.org/2000/svg" width="57.818ex" height="18.898ex" role="img" focusable="false" viewBox="0 -4426.5 25555.6 8353" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mtable"><g data-mml-node="mtr" transform="translate(0,2867.5)"><g data-mml-node="mtd"><g data-mml-node="msubsup"><g data-mml-node="mo" transform="translate(0 1)"><use data-c="222B" xlink:href="#MJX-TEX-LO-222B"></use></g><g data-mml-node="TeXAtom" transform="translate(1046.4,1088.1) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mi"><use data-c="221E" xlink:href="#MJX-TEX-N-221E"></use></g></g><g data-mml-node="TeXAtom" transform="translate(589,-896.4) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mo"><use data-c="2212" xlink:href="#MJX-TEX-N-2212"></use></g><g data-mml-node="mi" transform="translate(778,0)"><use data-c="221E" xlink:href="#MJX-TEX-N-221E"></use></g></g></g><g data-mml-node="mi" transform="translate(2062.9,0)"><use data-c="1D453" xlink:href="#MJX-TEX-I-1D453"></use></g><g data-mml-node="mo" transform="translate(2612.9,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(3001.9,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(3573.9,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g><g data-mml-node="mi" transform="translate(3962.9,0)"><use data-c="1D451" xlink:href="#MJX-TEX-I-1D451"></use></g><g data-mml-node="mi" transform="translate(4482.9,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g><g data-mml-node="mtd" transform="translate(5054.9,0)"><g data-mml-node="mi"></g><g data-mml-node="mo" transform="translate(277.8,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="msubsup" transform="translate(1333.6,0)"><g data-mml-node="mo" transform="translate(0 1)"><use data-c="222B" xlink:href="#MJX-TEX-LO-222B"></use></g><g data-mml-node="TeXAtom" transform="translate(1046.4,1088.1) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g></g><g data-mml-node="TeXAtom" transform="translate(589,-896.4) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="30" xlink:href="#MJX-TEX-N-30"></use></g></g></g><g data-mml-node="mi" transform="translate(2950.2,0)"><use data-c="1D453" xlink:href="#MJX-TEX-I-1D453"></use></g><g data-mml-node="mo" transform="translate(3500.2,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(3889.2,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(4461.2,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g><g data-mml-node="mi" transform="translate(4850.2,0)"><use data-c="1D451" xlink:href="#MJX-TEX-I-1D451"></use></g><g data-mml-node="mi" transform="translate(5370.2,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(6164.4,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="msubsup" transform="translate(7164.6,0)"><g data-mml-node="mo" transform="translate(0 1)"><use data-c="222B" xlink:href="#MJX-TEX-LO-222B"></use></g><g data-mml-node="TeXAtom" transform="translate(1046.4,1088.1) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="30" xlink:href="#MJX-TEX-N-30"></use></g></g><g data-mml-node="TeXAtom" transform="translate(589,-896.4) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mo"><use data-c="2212" xlink:href="#MJX-TEX-N-2212"></use></g><g data-mml-node="mi" transform="translate(778,0)"><use data-c="221E" xlink:href="#MJX-TEX-N-221E"></use></g></g></g><g data-mml-node="mi" transform="translate(9227.5,0)"><use data-c="1D453" xlink:href="#MJX-TEX-I-1D453"></use></g><g data-mml-node="mo" transform="translate(9777.5,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(10166.5,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(10738.5,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g><g data-mml-node="mi" transform="translate(11127.5,0)"><use data-c="1D451" xlink:href="#MJX-TEX-I-1D451"></use></g><g data-mml-node="mi" transform="translate(11647.5,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(12441.7,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="msubsup" transform="translate(13442,0)"><g data-mml-node="mo" transform="translate(0 1)"><use data-c="222B" xlink:href="#MJX-TEX-LO-222B"></use></g><g data-mml-node="TeXAtom" transform="translate(1046.4,1088.1) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mi"><use data-c="221E" xlink:href="#MJX-TEX-N-221E"></use></g></g><g data-mml-node="TeXAtom" transform="translate(589,-896.4) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g></g></g><g data-mml-node="mi" transform="translate(15412.1,0)"><use data-c="1D453" xlink:href="#MJX-TEX-I-1D453"></use></g><g data-mml-node="mo" transform="translate(15962.1,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(16351.1,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(16923.1,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g><g data-mml-node="mi" transform="translate(17312.1,0)"><use data-c="1D451" xlink:href="#MJX-TEX-I-1D451"></use></g><g data-mml-node="mi" transform="translate(17832.1,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g></g><g data-mml-node="mtr" transform="translate(0,54.2)"><g data-mml-node="mtd" transform="translate(5054.9,0)"></g><g data-mml-node="mtd" transform="translate(5054.9,0)"><g data-mml-node="mi"></g><g data-mml-node="mo" transform="translate(277.8,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="msubsup" transform="translate(1333.6,0)"><g data-mml-node="mo" transform="translate(0 1)"><use data-c="222B" xlink:href="#MJX-TEX-LO-222B"></use></g><g data-mml-node="TeXAtom" transform="translate(1046.4,1088.1) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g></g><g data-mml-node="TeXAtom" transform="translate(589,-896.4) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="30" xlink:href="#MJX-TEX-N-30"></use></g></g></g><g data-mml-node="mi" transform="translate(2950.2,0)"><use data-c="1D453" xlink:href="#MJX-TEX-I-1D453"></use></g><g data-mml-node="mo" transform="translate(3500.2,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(3889.2,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(4461.2,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g><g data-mml-node="mi" transform="translate(4850.2,0)"><use data-c="1D451" xlink:href="#MJX-TEX-I-1D451"></use></g><g data-mml-node="mi" transform="translate(5370.2,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(6164.4,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="msubsup" transform="translate(7164.6,0)"><g data-mml-node="mo" transform="translate(0 1)"><use data-c="222B" xlink:href="#MJX-TEX-LO-222B"></use></g><g data-mml-node="TeXAtom" transform="translate(1046.4,1088.1) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g></g><g data-mml-node="TeXAtom" transform="translate(589,-896.4) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g></g></g><g data-mml-node="mi" transform="translate(8781.2,0)"><use data-c="1D453" xlink:href="#MJX-TEX-I-1D453"></use></g><g data-mml-node="mo" transform="translate(9331.2,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(9720.2,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(10292.2,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g><g data-mml-node="mi" transform="translate(10681.2,0)"><use data-c="1D451" xlink:href="#MJX-TEX-I-1D451"></use></g><g data-mml-node="mi" transform="translate(11201.2,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(11995.5,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="mn" transform="translate(12995.7,0)"><use data-c="30" xlink:href="#MJX-TEX-N-30"></use></g></g></g><g data-mml-node="mtr" transform="translate(0,-2865.7)"><g data-mml-node="mtd" transform="translate(5054.9,0)"></g><g data-mml-node="mtd" transform="translate(5054.9,0)"><g data-mml-node="mi"></g><g data-mml-node="mo" transform="translate(277.8,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="msubsup" transform="translate(1333.6,0)"><g data-mml-node="mrow"><g data-mml-node="mo" transform="translate(0 250)"></g><g data-mml-node="mfrac"><g data-mml-node="msup" transform="translate(220,676)"><g data-mml-node="mi"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="TeXAtom" transform="translate(605,363) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g></g></g><g data-mml-node="mn" transform="translate(474.3,-686)"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g><rect width="1208.6" height="60" x="120" y="220"></rect></g><g data-mml-node="mo" transform="translate(1448.6,0)"><svg width="278" height="2519.9" y="-1009.9" x="27.5" viewBox="0 -312.1 278 2519.9"><use data-c="2223" xlink:href="#MJX-TEX-S4-2223" transform="scale(1,3.784)"></use></svg></g></g><g data-mml-node="TeXAtom" transform="translate(1814.6,1237) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g></g><g data-mml-node="TeXAtom" transform="translate(1814.6,-1045.3) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="30" xlink:href="#MJX-TEX-N-30"></use></g></g></g><g data-mml-node="mo" transform="translate(3773.9,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="msubsup" transform="translate(4774.1,0)"><g data-mml-node="mrow"><g data-mml-node="mo" transform="translate(0 250)"></g><g data-mml-node="mrow"><g data-mml-node="mo" transform="translate(0 -0.5)"><use data-c="28" xlink:href="#MJX-TEX-S3-28"></use></g><g data-mml-node="mn" transform="translate(736,0)"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g><g data-mml-node="mi" transform="translate(1236,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(2030.2,0)"><use data-c="2212" xlink:href="#MJX-TEX-N-2212"></use></g><g data-mml-node="mfrac" transform="translate(3030.4,0)"><g data-mml-node="msup" transform="translate(220,676)"><g data-mml-node="mi"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="TeXAtom" transform="translate(605,363) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g></g></g><g data-mml-node="mn" transform="translate(474.3,-686)"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g><rect width="1208.6" height="60" x="120" y="220"></rect></g><g data-mml-node="mo" transform="translate(4479,0) translate(0 -0.5)"><use data-c="29" xlink:href="#MJX-TEX-S3-29"></use></g></g><g data-mml-node="mo" transform="translate(5215,0)"><svg width="278" height="2519.9" y="-1009.9" x="27.5" viewBox="0 -312.1 278 2519.9"><use data-c="2223" xlink:href="#MJX-TEX-S4-2223" transform="scale(1,3.784)"></use></svg></g></g><g data-mml-node="TeXAtom" transform="translate(5581,1237) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g></g><g data-mml-node="TeXAtom" transform="translate(5581,-1045.3) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g></g></g><g data-mml-node="mo" transform="translate(11036.4,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="mfrac" transform="translate(12092.2,0)"><g data-mml-node="mn" transform="translate(220,676)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mn" transform="translate(220,-686)"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g><rect width="700" height="60" x="120" y="220"></rect></g><g data-mml-node="mo" transform="translate(13254.4,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="mrow" transform="translate(14254.7,0)"><g data-mml-node="mo" transform="translate(0 -0.5)"><use data-c="28" xlink:href="#MJX-TEX-S3-28"></use></g><g data-mml-node="mn" transform="translate(736,0)"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g><g data-mml-node="mo" transform="translate(1458.2,0)"><use data-c="2212" xlink:href="#MJX-TEX-N-2212"></use></g><g data-mml-node="mfrac" transform="translate(2458.4,0)"><g data-mml-node="mn" transform="translate(220,676)"><use data-c="33" xlink:href="#MJX-TEX-N-33"></use></g><g data-mml-node="mn" transform="translate(220,-686)"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g><rect width="700" height="60" x="120" y="220"></rect></g><g data-mml-node="mo" transform="translate(3398.4,0) translate(0 -0.5)"><use data-c="29" xlink:href="#MJX-TEX-S3-29"></use></g></g><g data-mml-node="mo" transform="translate(18666.9,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="mn" transform="translate(19722.7,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mo" transform="translate(20222.7,0)"><use data-c="2C" xlink:href="#MJX-TEX-N-2C"></use></g></g></g></g></g></g></svg></mjx-container>and <a href="https://adaptivebooks.org/probability-theory-and-its-applications/numerical-valued-random-phenomena/specifying-the-probability-function-of-a-numerical-valued-random-phenomenon#Eq:4.2.2">(2.2) </a>has been shown to hold. It might be noted that the function <mjx-container aria-label="f(\cdot)" class="MathJax" jax="SVG"><svg style="vertical-align: -0.566ex;" xmlns="http://www.w3.org/2000/svg" width="3.633ex" height="2.262ex" role="img" focusable="false" viewBox="0 -750 1606 1000" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mi"><use data-c="1D453" xlink:href="#MJX-TEX-I-1D453"></use></g><g data-mml-node="mo" transform="translate(550,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mo" transform="translate(939,0)"><use data-c="22C5" xlink:href="#MJX-TEX-N-22C5"></use></g><g data-mml-node="mo" transform="translate(1217,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g></g></g></svg></mjx-container>in <a href="https://adaptivebooks.org/probability-theory-and-its-applications/numerical-valued-random-phenomena/specifying-the-probability-function-of-a-numerical-valued-random-phenomenon#Eq:4.2.10">(2.10) </a>can be written somewhat more concisely in terms of the absolute value notation: <span class="math display" id="Eq:4.2.11" label="Eq:4.2.11">\begin{align} f(x) = \begin{cases} 1 - |1 - x|, & \text{for } 0 \leq x \leq 2 \\[2mm] 0, & \text{otherwise} \end{cases} \end{align} </span>Next, in order to check his command of the basic techniques of integration, the reader should verify that the following formulas hold: <mjx-container aria-label="\int \frac{e^{x}}{\left(1+e^{x}\right)^{2}} d x=\frac{-1}{1+e^{x}}, \quad \int \frac{e^{x}}{1+e^{2 x}} d x=\tan ^{-1} e^{x}=\arctan e^{x}," class="MathJax" jax="SVG" display="true"><svg style="vertical-align: -2.62ex;" xmlns="http://www.w3.org/2000/svg" width="64.474ex" height="5.699ex" role="img" focusable="false" viewBox="0 -1361 28497.4 2519" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mo" transform="translate(0 1)"><use data-c="222B" xlink:href="#MJX-TEX-LO-222B"></use></g><g data-mml-node="mfrac" transform="translate(1110.7,0)"><g data-mml-node="msup" transform="translate(1688.5,676)"><g data-mml-node="mi"><use data-c="1D452" xlink:href="#MJX-TEX-I-1D452"></use></g><g data-mml-node="TeXAtom" transform="translate(499,363) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mi"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g></g><g data-mml-node="msup" transform="translate(220,-908)"><g data-mml-node="mrow"><g data-mml-node="mo"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mn" transform="translate(389,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mo" transform="translate(1111.2,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="msup" transform="translate(2111.4,0)"><g data-mml-node="mi"><use data-c="1D452" xlink:href="#MJX-TEX-I-1D452"></use></g><g data-mml-node="TeXAtom" transform="translate(499,289) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mi"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g></g><g data-mml-node="mo" transform="translate(3064.9,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g></g><g data-mml-node="TeXAtom" transform="translate(3486.9,477.1) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g></g></g><rect width="4090.5" height="60" x="120" y="220"></rect></g><g data-mml-node="mi" transform="translate(5441.1,0)"><use data-c="1D451" xlink:href="#MJX-TEX-I-1D451"></use></g><g data-mml-node="mi" transform="translate(5961.1,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(6810.9,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="mfrac" transform="translate(7866.7,0)"><g data-mml-node="mrow" transform="translate(919,676)"><g data-mml-node="mo"><use data-c="2212" xlink:href="#MJX-TEX-N-2212"></use></g><g data-mml-node="mn" transform="translate(778,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g></g><g data-mml-node="mrow" transform="translate(220,-686)"><g data-mml-node="mn"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mo" transform="translate(722.2,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="msup" transform="translate(1722.4,0)"><g data-mml-node="mi"><use data-c="1D452" xlink:href="#MJX-TEX-I-1D452"></use></g><g data-mml-node="TeXAtom" transform="translate(499,289) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mi"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g></g></g><rect width="2875.9" height="60" x="120" y="220"></rect></g><g data-mml-node="mo" transform="translate(10982.6,0)"><use data-c="2C" xlink:href="#MJX-TEX-N-2C"></use></g><g data-mml-node="mstyle" transform="translate(11260.6,0)"><g data-mml-node="mspace"></g></g><g data-mml-node="mo" transform="translate(12427.3,0) translate(0 1)"><use data-c="222B" xlink:href="#MJX-TEX-LO-222B"></use></g><g data-mml-node="mfrac" transform="translate(13537.9,0)"><g data-mml-node="msup" transform="translate(1258,676)"><g data-mml-node="mi"><use data-c="1D452" xlink:href="#MJX-TEX-I-1D452"></use></g><g data-mml-node="TeXAtom" transform="translate(499,363) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mi"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g></g><g data-mml-node="mrow" transform="translate(220,-719.9)"><g data-mml-node="mn"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mo" transform="translate(722.2,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="msup" transform="translate(1722.4,0)"><g data-mml-node="mi"><use data-c="1D452" xlink:href="#MJX-TEX-I-1D452"></use></g><g data-mml-node="TeXAtom" transform="translate(499,289) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mn"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g><g data-mml-node="mi" transform="translate(500,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g></g></g><rect width="3229.5" height="60" x="120" y="220"></rect></g><g data-mml-node="mi" transform="translate(17007.4,0)"><use data-c="1D451" xlink:href="#MJX-TEX-I-1D451"></use></g><g data-mml-node="mi" transform="translate(17527.4,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(18377.2,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="msup" transform="translate(19432.9,0)"><g data-mml-node="mi"><use data-c="74" xlink:href="#MJX-TEX-N-74"></use><use data-c="61" xlink:href="#MJX-TEX-N-61" transform="translate(389,0)"></use><use data-c="6E" xlink:href="#MJX-TEX-N-6E" transform="translate(889,0)"></use></g><g data-mml-node="TeXAtom" transform="translate(1478,413) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mo"><use data-c="2212" xlink:href="#MJX-TEX-N-2212"></use></g><g data-mml-node="mn" transform="translate(778,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g></g></g><g data-mml-node="mo" transform="translate(21864.6,0)"><use data-c="2061" xlink:href="#MJX-TEX-N-2061"></use></g><g data-mml-node="msup" transform="translate(22031.3,0)"><g data-mml-node="mi"><use data-c="1D452" xlink:href="#MJX-TEX-I-1D452"></use></g><g data-mml-node="TeXAtom" transform="translate(499,413) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mi"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g></g><g data-mml-node="mo" transform="translate(23262.5,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="mi" transform="translate(24318.3,0)"><use data-c="61" xlink:href="#MJX-TEX-N-61"></use><use data-c="72" xlink:href="#MJX-TEX-N-72" transform="translate(500,0)"></use><use data-c="63" xlink:href="#MJX-TEX-N-63" transform="translate(892,0)"></use><use data-c="74" xlink:href="#MJX-TEX-N-74" transform="translate(1336,0)"></use><use data-c="61" xlink:href="#MJX-TEX-N-61" transform="translate(1725,0)"></use><use data-c="6E" xlink:href="#MJX-TEX-N-6E" transform="translate(2225,0)"></use></g><g data-mml-node="mo" transform="translate(27099.3,0)"><use data-c="2061" xlink:href="#MJX-TEX-N-2061"></use></g><g data-mml-node="msup" transform="translate(27266,0)"><g data-mml-node="mi"><use data-c="1D452" xlink:href="#MJX-TEX-I-1D452"></use></g><g data-mml-node="TeXAtom" transform="translate(499,413) scale(0.707)" data-mjx-texclass="ORD"><g data-mml-node="mi"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g></g></g><g data-mml-node="mo" transform="translate(28219.4,0)"><use data-c="2C" xlink:href="#MJX-TEX-N-2C"></use></g></g></g></svg></mjx-container><span class="math display" id="Eq:4.2.12" label="Eq:4.2.12">\[\int e^{-x-e^{-x}} d x=\int e^{-e^{-x}} e^{-x} d x=e^{-e^{-x}}. \tag{2.12} 

An important integration formula, obtained by integration by parts, is the following, for any real number for which the integrals make sense: Thus, for we obtain  

We next consider the Gamma function , which plays an important role in probability theory. It is defined for every by  

The Gamma function is a generalization of the factorial function in the following sense. From (2.13) it follows that Therefore, for any integer , Since, clearly, , it follows that for any integer  

Next, it may be shown that for any integer which may be written for any even integer since  

We prove (2.21) by showing that is equal to another integral of whose value we have need. In (2.15) , make the change of variable , and let . Then, for any integer, , we have the formula  

In view of (2.22) , to establish (2.21) we need only show that  

We prove (2.23) by proving the following basic formula; for any  

Equation (2.24) may be derived as follows. Let be the value of the integral in (2.24) . Then is a product of two single integrals. By the theorem for the evaluation of double integrals, it then follows that  

We now evaluate the double integral in (2.25) by means of a change of variables to polar coordinates. Then so that , which proves (2.24) .

For large values of there is an important asymptotic formula for the Gamma function, which is known as Stirling’s formula . Taking , in which is a positive integer, this formula can be written \begin{align} \log n ! & =\left(n+\frac{1}{2}\right) \log n-n+\frac{1}{2} \log 2 \pi+\frac{r(n)}{12 n}, \Misplaced &2mm] n! & =\left(\frac{n}{e}\right)^{n} \sqrt{2 \pi n} e^{r(n) / 12 n}, \tag{2.26} \end{align} </span>in which <mjx-container aria-label="r(n)" class="MathJax" jax="SVG"><svg style="vertical-align: -0.566ex;" xmlns="http://www.w3.org/2000/svg" width="4.138ex" height="2.262ex" role="img" focusable="false" viewBox="0 -750 1829 1000" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mi"><use data-c="1D45F" xlink:href="#MJX-TEX-I-1D45F"></use></g><g data-mml-node="mo" transform="translate(451,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(840,0)"><use data-c="1D45B" xlink:href="#MJX-TEX-I-1D45B"></use></g><g data-mml-node="mo" transform="translate(1440,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g></g></g></svg></mjx-container>satisfies <mjx-container aria-label="1-1 /(12 n+1)<r(n)<1" class="MathJax" jax="SVG"><svg style="vertical-align: -0.566ex;" xmlns="http://www.w3.org/2000/svg" width="26.74ex" height="2.262ex" role="img" focusable="false" viewBox="0 -750 11819 1000" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mn"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mo" transform="translate(722.2,0)"><use data-c="2212" xlink:href="#MJX-TEX-N-2212"></use></g><g data-mml-node="mn" transform="translate(1722.4,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="TeXAtom" data-mjx-texclass="ORD" transform="translate(2222.4,0)"><g data-mml-node="mo"><use data-c="2F" xlink:href="#MJX-TEX-N-2F"></use></g></g><g data-mml-node="mo" transform="translate(2722.4,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mn" transform="translate(3111.4,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use><use data-c="32" xlink:href="#MJX-TEX-N-32" transform="translate(500,0)"></use></g><g data-mml-node="mi" transform="translate(4111.4,0)"><use data-c="1D45B" xlink:href="#MJX-TEX-I-1D45B"></use></g><g data-mml-node="mo" transform="translate(4933.7,0)"><use data-c="2B" xlink:href="#MJX-TEX-N-2B"></use></g><g data-mml-node="mn" transform="translate(5933.9,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mo" transform="translate(6433.9,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g><g data-mml-node="mo" transform="translate(7100.7,0)"><use data-c="3C" xlink:href="#MJX-TEX-N-3C"></use></g><g data-mml-node="mi" transform="translate(8156.4,0)"><use data-c="1D45F" xlink:href="#MJX-TEX-I-1D45F"></use></g><g data-mml-node="mo" transform="translate(8607.4,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(8996.4,0)"><use data-c="1D45B" xlink:href="#MJX-TEX-I-1D45B"></use></g><g data-mml-node="mo" transform="translate(9596.4,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g><g data-mml-node="mo" transform="translate(10263.2,0)"><use data-c="3C" xlink:href="#MJX-TEX-N-3C"></use></g><g data-mml-node="mn" transform="translate(11319,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g></g></g></svg></mjx-container>. The proof of Stirling’s formula may be found in many books. A particularly clear derivation is given by H. Robbins, “A Remark on Stirling’s Formula”, <i>American Mathematical Monthly </i>, Vol. 62 (1955), pp. 26–29.</p><p>We next turn to <i>the evaluation of sums and infinite sums </i>. The major tool in the evaluation of infinite sums is Taylor’s theorem, which states that under certain conditions a function <mjx-container aria-label="g(x)" class="MathJax" jax="SVG"><svg style="vertical-align: -0.566ex;" xmlns="http://www.w3.org/2000/svg" width="4.133ex" height="2.262ex" role="img" focusable="false" viewBox="0 -750 1827 1000" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mi"><use data-c="1D454" xlink:href="#MJX-TEX-I-1D454"></use></g><g data-mml-node="mo" transform="translate(477,0)"><use data-c="28" xlink:href="#MJX-TEX-N-28"></use></g><g data-mml-node="mi" transform="translate(866,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(1438,0)"><use data-c="29" xlink:href="#MJX-TEX-N-29"></use></g></g></g></svg></mjx-container>may be expanded in a power series: <span class="math display" id="Eq:4.2.27" label="Eq:4.2.27">\[g(x)=\sum_{k=0}^{\infty} \frac{x^{k}}{k !} g^{(k)}(0), \tag{2.27} in which denotes the value at of the th derivative of . Letting , we obtain  

Take next , in which Clearly \begin{align} g^{(k)}(x) = \begin{cases} (-1)^{k}(n)_{k}(1 - x)^{n - k}, & \text{for } k = 0, 1, \ldots, n \Misplaced &2mm] 0, & \text{for } k > n. \end{cases} \end{align} </span></p><p>Consequently, for <mjx-container aria-label="n=1,2, \ldots" class="MathJax" jax="SVG"><svg style="vertical-align: -0.439ex;" xmlns="http://www.w3.org/2000/svg" width="11.301ex" height="1.946ex" role="img" focusable="false" viewBox="0 -666 4994.9 860" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mi"><use data-c="1D45B" xlink:href="#MJX-TEX-I-1D45B"></use></g><g data-mml-node="mo" transform="translate(877.8,0)"><use data-c="3D" xlink:href="#MJX-TEX-N-3D"></use></g><g data-mml-node="mn" transform="translate(1933.6,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mo" transform="translate(2433.6,0)"><use data-c="2C" xlink:href="#MJX-TEX-N-2C"></use></g><g data-mml-node="mn" transform="translate(2878.2,0)"><use data-c="32" xlink:href="#MJX-TEX-N-32"></use></g><g data-mml-node="mo" transform="translate(3378.2,0)"><use data-c="2C" xlink:href="#MJX-TEX-N-2C"></use></g><g data-mml-node="mo" transform="translate(3822.9,0)"><use data-c="2026" xlink:href="#MJX-TEX-N-2026"></use></g></g></g></svg></mjx-container><span class="math display" id="Eq:4.2.30" label="Eq:4.2.30">\[(1-x)^{n}=\sum_{k=0}^{n}(-1)^{k}\left(\begin{array}{l} n \tag{2.30} \\ k \end{array}\right) x^{k}, \quad-\infty<x<\infty which is a special case of the binomial theorem. One may deduce the binomial theorem from (2.30) by setting .

We obtain an important generalization of the binomial theorem by taking , in which is any real number. For any real number and any integer define the binomial coefficient \begin{align} \binom{t}{k} = \begin{cases} \frac{t(t-1) \cdots (t-k+1)}{k!}, & \text{for } k = 1, 2, \ldots \tag{2.31} \Misplaced &2mm] 1, & \text{for } k = 0 \end{cases} \end{align} </span></p><p>Note that for any positive number <mjx-container aria-label="n" class="MathJax" jax="SVG"><svg style="vertical-align: -0.025ex;" xmlns="http://www.w3.org/2000/svg" width="1.357ex" height="1.025ex" role="img" focusable="false" viewBox="0 -442 600 453" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mi"><use data-c="1D45B" xlink:href="#MJX-TEX-I-1D45B"></use></g></g></g></svg></mjx-container><span class="math display" id="Eq:4.2.32" label="Eq:4.2.32">\begin{align} \left(\begin{array}{c}-n \\ k\end{array}\right) & =(-1)^{k} \frac{n(n+1) \cdots(n+k-1)}{k !} \\ & =(-1)^{k}\left(\begin{array}{c}n+k-1 \\ k\end{array}\right). \tag{2.32} \end{align} </span></p><p>By Taylor’s theorem, we obtain the important formula for all real numbers <mjx-container aria-label="t" class="MathJax" jax="SVG"><svg style="vertical-align: -0.025ex;" xmlns="http://www.w3.org/2000/svg" width="0.817ex" height="1.441ex" role="img" focusable="false" viewBox="0 -626 361 637" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mi"><use data-c="1D461" xlink:href="#MJX-TEX-I-1D461"></use></g></g></g></svg></mjx-container>and <mjx-container aria-label="-1<x<1" class="MathJax" jax="SVG"><svg style="vertical-align: -0.186ex;" xmlns="http://www.w3.org/2000/svg" width="11.351ex" height="1.692ex" role="img" focusable="false" viewBox="0 -666 5017.1 748" xmlns:xlink="http://www.w3.org/1999/xlink"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="scale(1,-1)"><g data-mml-node="math"><g data-mml-node="mo"><use data-c="2212" xlink:href="#MJX-TEX-N-2212"></use></g><g data-mml-node="mn" transform="translate(778,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g><g data-mml-node="mo" transform="translate(1555.8,0)"><use data-c="3C" xlink:href="#MJX-TEX-N-3C"></use></g><g data-mml-node="mi" transform="translate(2611.6,0)"><use data-c="1D465" xlink:href="#MJX-TEX-I-1D465"></use></g><g data-mml-node="mo" transform="translate(3461.3,0)"><use data-c="3C" xlink:href="#MJX-TEX-N-3C"></use></g><g data-mml-node="mn" transform="translate(4517.1,0)"><use data-c="31" xlink:href="#MJX-TEX-N-31"></use></g></g></g></svg></mjx-container>, <span class="math display" id="Eq:4.2.33" label="Eq:4.2.33">\[(1-x)^{t}=\sum_{k=0}^{\infty}\left(\begin{array}{l} t \tag{2.33} \\ k \end{array}\right)(-x)^{k}. 

For the case of positive we may write, in view of (2.32) ,  

Equation (2.34) , with , is the familiar formula for the sum of a geometric series:  

Equation (2.34) with and 3 yields the formulas \begin{align} & \sum_{k=0}^{\infty}(k+1) x^{k}=1+2 x+3 x^{2}+\cdots=\frac{1}{(1-x)^{2}}, \quad|x|<1, \tag{2.36} \\ & \sum_{k=0}^{\infty}(k+2)(k+1) x^{k}=\frac{2}{(1-x)^{3}}, \quad|x|<1 . \end{align} 

From (2.33) we may obtain another important formula. By a comparison of the coefficients of on both sides of the equation we obtain for any real numbers and and any positive integer  

If and are positive integers (2.37) could be verified by mathematical induction. A useful special case of (2.37) is when ; we then obtain (5.13) of Chapter 2 .

Theoretical Exercises

2.1 . Show that for any positive real numbers , and

2.2 . Show for any and

2.3 . The integral which converges if and are positive, defines a function of and , called the beta function . Show that the beta function is symmetrical in its arguments, , and may be expressed [letting and , respectively] by \begin{align} B(m, n) & =2 \int_{0}^{\pi / 2} \sin ^{2 m-1} \theta \cos ^{2 n-1} \theta d \theta \tag{2.41} \\ & =\int_{0}^{\infty} \frac{y^{n-1}}{(1+y)^{m+n}} dy. \end{align} 

Show finally that the beta and gamma functions are connected by the relation Hint: By changing to polar coordinates, we have

2.4 . Use (2.41) and (2.42) , with , to prove (2.23) .

2.5 . Prove that the integral defining the gamma function converges for any real number .

2.6 . Prove that the integral defining the beta function converges for any real numbers and , such that and .

2.7 . Taylor’s theorem with remainder . Show that if the function has a continuous th derivative in some interval containing the origin then for in this interval

Hint : Show, for , that

2.8 . Lagrange’s form of the remainder in Taylor’s theorem . Show that if has a continuous th derivative in the closed interval from 0 to , where may be positive or negative, then for some number in the interval .


  1. We usually assume that the integral in (2.1) is defined in the sense of Riemann; to ensure that this is the case, we require that the function be defined and continuous at all but a finite number of points. The integral in (2.1) is then defined only for events , which are either intervals or unions of a finite number of non-overlapping intervals. In advanced probability theory the integral in (2.1) is defined by means of a theory of integration developed in the early 1900’s by Henri Lebesgue. The function must then be a Borel function, by which is meant that for any real number the set is a Borel set. A function that is continuous at all but a finite number of points may be shown to be a Borel function. It may be shown that if a Borel function satisfies (2.1) and (2.3) then, for any Borel set , the integral of over exists as an integral defined in the sense of Lebesgue. If is an interval, or a union of a finite number of non-overlapping intervals, and if is continuous on , then the integral of over , defined in the sense of Lebesgue, has the same value as the integral of over , defined in the sense of Riemann. Henceforth, in this book the word function (unless otherwise qualified) will mean a Borel function and the word set (of real numbers) will mean a Borel set. ↩︎ 
  2. For the purposes of this book we also require that a probability density function be defined and continuous at all but a finite number of points. ↩︎ 
  3. The reader should note the convention used in the exercises of this book. When a function is defined by a single analytic expression for all in , the fact that varies between and is not explicitly indicated. ↩︎