Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size...

27
Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence AURORA GARCÍA-GALLEGO NIKOLAOS GEORGANTZÍS PEDRO PEREIRA § JOSÉ C. PERNÍAS-CERRILLO 1st November 2005 We analyze the impact on consumer prices of the size and bias of price comparison search engines. In the context of a model related to Burdett and Judd (1983) and Varian (1980), we develop and test experimentally several theoretical predictions. The experimental results confirm the model’s predictions regarding the impact of the number of firms, and the type of bias of the search engine, but reject the model’s predictions regarding changes in the size of the index. The explanatory power of an econometric model for the price distributions is significantly improved when variables accounting for risk attitudes are introduced. Keywords: Search engines, incomplete information, biased information, price levels, experiments. JEL Codes: C91, D43, D83, L13. Corresponding author: Prof. Nikolaos Georgantzís: Dep. Economia, Universitat Jaume I, Av. Vi- cent Sos Baynat, 12071 Castellón (Spain); e-mail: [email protected]; phone: 34-964728588. The authors gratefully acknowledge financial support by the NET Institute, the Spanish Ministry of Science and Technol- ogy (BEC2002-04380-CO2-02), and the Generalitat Valenciana (GREC-GRUPOS04/13). This paper benefited from helpful comments by S. Hoernig, and professors H. Raff and J. Bröcker during the Erich Schneider seminar at Kiel Universität, T. Ca- son and J. Brandts at the IMEBE meeting in Córdoba, seminar participants at the Universities of Salamanca, Murcia, Paris II, Siena, Complutense de Madrid, and other participants at the SPIE (Lisbon), The Economics of Two Sided Markets (Toulouse), EARIE (Berlin), ASSET (Barcelona), and XX Jornadas de Economía Industrial (Granada) meetings. LEE/LINEEX and Economics Department, Universitat Jaume I, Castellón (Spain); e-mail: [email protected]; phone: 34-964728604. LEE/LINEEX and Economics Department, Universitat Jaume I, Castellón (Spain); e-mail: [email protected]; phone: 34-964728588. § Autoridade da Concorrência, R. Laura Alves, n o 4, 7 o , 1050-138 Lisboa (Portugal); e-mail: [email protected]; phone: 21-7802498; fax: 21-7802471. LINEEX/LEE, Universitat de València (Spain); e-mail: [email protected]; phone: 34-963864100 ext. 21725.

Transcript of Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size...

Page 1: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

Bias and Size Effects of Price-Comparison SearchEngines: Theory and Experimental Evidence?

AURORA GARCÍA-GALLEGO†

NIKOLAOS GEORGANTZÍS‡

PEDRO PEREIRA§

JOSÉ C. PERNÍAS-CERRILLO¶

1st November 2005

We analyze the impact on consumer prices of the size and bias of price comparison search engines.In the context of a model related to Burdett and Judd (1983) and Varian (1980), we develop andtest experimentally several theoretical predictions. The experimental results confirm the model’spredictions regarding the impact of the number of firms, and the type of bias of the search engine, butreject the model’s predictions regarding changes in the size of the index. The explanatory power ofan econometric model for the price distributions is significantly improved when variables accountingfor risk attitudes are introduced.

Keywords: Search engines, incomplete information, biased information, price levels, experiments.

JEL Codes: C91, D43, D83, L13.

Corresponding author: Prof. Nikolaos Georgantzís: Dep. Economia, Universitat Jaume I, Av. Vi-cent Sos Baynat, 12071 Castellón (Spain); e-mail: [email protected]; phone: 34-964728588.

?The authors gratefully acknowledge financial support by the NET Institute, the Spanish Ministry of Science and Technol-

ogy (BEC2002-04380-CO2-02), and the Generalitat Valenciana (GREC-GRUPOS04/13). This paper benefited from helpfulcomments by S. Hoernig, and professors H. Raff and J. Bröcker during the Erich Schneider seminar at Kiel Universität, T. Ca-son and J. Brandts at the IMEBE meeting in Córdoba, seminar participants at the Universities of Salamanca, Murcia, Paris II,Siena, Complutense de Madrid, and other participants at the SPIE (Lisbon), The Economics of Two Sided Markets (Toulouse),EARIE (Berlin), ASSET (Barcelona), and XX Jornadas de Economía Industrial (Granada) meetings.

†LEE/LINEEX and Economics Department, Universitat Jaume I, Castellón (Spain); e-mail: [email protected]; phone:34-964728604.

‡LEE/LINEEX and Economics Department, Universitat Jaume I, Castellón (Spain); e-mail: [email protected]; phone:34-964728588.

§Autoridade da Concorrência, R. Laura Alves, no 4, 7o, 1050-138 Lisboa (Portugal); e-mail: [email protected];phone: 21-7802498; fax: 21-7802471.

¶LINEEX/LEE, Universitat de València (Spain); e-mail: [email protected]; phone: 34-963864100 ext. 21725.

Page 2: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

Bias and Size Effects of Price-Comparison SearchEngines: Theory and Experimental Evidence

We analyze the impact on consumer prices of the size and bias of price comparison search engines.In the context of a model related to Burdett and Judd (1983) and Varian (1980), we develop andtest experimentally several theoretical predictions. The experimental results confirm the model’spredictions regarding the impact of the number of firms, and the type of bias of the search engine, butreject the model’s predictions regarding changes in the size of the index. The explanatory power ofan econometric model for the price distributions is significantly improved when variables accountingfor risk attitudes are introduced.

Keywords: Search engines, incomplete information, biased information, price levels, experiments.

JEL Codes: C91, D43, D83, L13.

Page 3: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

1. INTRODUCTION

1.1. Preliminary Thoughts

From the consumers’ perspective, one of the most promising aspects of e-commerce was that it would reducesearch costs. With search engines, consumers could easily observe and compare the prices of a large number ofvendors, and identify bargains. The consumers’ enhanced ability of comparing prices would discipline vendors,and put downward pressure on prices.1

Price Comparison Search Engines, also known as shopping agents or shopping robots, are a class of searchengines, which access and read Internet pages, store the results, and return lists of pages, which match keywordsin a query. They consist of three parts: (i) a crawler, (ii) an index, and (iii) the relevance algorithm. The Crawler,or spider, is a program that automatically accesses Internet pages, reads them, stores the data, and then followslinks to other pages. The Index, or catalog, is a database that contains the information the crawler finds. TheRelevance Algorithm is a program that looks in the index for matches to keywords, and ranks them by relevance,which is determined through criteria such as link analysis, or, click-through measurements. This description refersto crawler-based systems, such as Google or AltaVista. There are also Directories, like Yahoo was initially, inwhich lists are compiled manually. Most systems are hybrid.

Presumably, the larger the number of vendors whose price a search engine lists on its site, and that therebyconsumers can easily compare, the more competitive the market becomes. However, there are several technicalreasons for search engines to cover only a small subset of the Internet, and to collect and report information biasedin favor of certain vendors. This perspective is discussed in Pereira (2004) and documented by several studies(Bradlow and Schmittlein, 1999; Lawrence and Giles, 1998, 1999).

The technology-induced tendency, for search engines to have incomplete and biased coverage, is reinforcedby economic reasons. Search engines are profit-seeking institutions, which draw their income from vendors, eitherin the form of placement fees, sales commissions, or advertising (Pereira, 2004).

In this paper we examine, theoretically and experimentally, the impact on consumer prices on electronic mar-kets, of price comparison search engines covering only a small subset of the Internet, and collecting and reportinginformation being biased in favor of certain vendors.

1.2. Overview of the Paper

We develop a partial equilibrium search model, related to Burdett and Judd (1983) and Varian (1980), to discussthe implications of price comparison search engines providing consumers with incomplete and biased information.There is: (i) one price comparison search engine, (ii) a finite number of identical vendors, and (iii) a large numberof consumers of two types. Shoppers use the price comparison search engine, and buy at the lowest price listedby the search engine. Non-shoppers buy from a vendor chosen at random. Vendors choose prices. In equilibrium,vendors randomize between charging a higher price and selling only to non-shoppers, and charging a lower priceto try to sell also to shoppers.

In the benchmark case, the search engine has complete coverage, i.e., lists the prices of all vendors presentin the market. We also analyze two other cases. First, the case in which the price comparison search enginehas incomplete coverage, and is unbiased with respect to vendors. This case can be thought of as portraying thesituation where the search engine is a crawler-based system, which has no placement deals with any particularvendor. Second, we analyze the case in which the price comparison search engine has incomplete coverage, andis biased in favor of certain vendors. This case can be thought of as portraying the situation where the searchengine is either a crawler-based system or a directory, which has placement deals with certain vendors. The searchengines’ decisions of how many vendors to index, or the vendors’ decisions of whether to become indexed, areobviously of interest. Pereira (2004) analyzes these questions. In this paper we take these decisions as given, andfocus on the implications for the pricing behavior of vendors.

The theoretical analysis makes several predictions regarding the impact of: (i) the number of vendors, (ii)the size of the search engine, and (iii) the type of bias of the search engine. In addition, the model also draws

1. The search literature has no simple prediction about the relation between search costs, price levels, or price dispersion(Pereira, 2005; Samuelson and Zhang, 1992).

2

Page 4: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

attention to four general counterintuitive effects. First, there is a conflict of interests between types of consumers,i.e., between shoppers and non-shoppers. This makes it hard to evaluate the welfare impact of these effects.Second, more information, measured by a wider Internet coverage by the price comparison search engine, is notnecessarily desirable. It benefits some consumers, but harms others. Third, unbiased information about vendors isnot necessarily desirable either, and for the same reason. Fourth, the effects of entry in these markets are complex,and depend on the way entry occurs.

We tested the predictions of the theoretical analysis, in a laboratory experiment designed to evaluate themodel’s testable hypotheses. This included a lottery-choice task, intended to capture two different aspects ofrisk attitudes: (i) the subjects’ degree of risk aversion, and (ii) whether subjects accepted more risk in exchange fora higher return to risk.

The experimental results confirm the model’s predictions regarding the impact of the number of firms, and thetype of bias of the search engine, but reject the model’s predictions regarding changes in the size of the index. Theanalysis of the data indicated several additional data patterns, such as, that prices are lower under biased incompletecoverage than under unbiased incomplete coverage.

We also developed an econometric model of the empirical price distributions. This lead us to a very interest-ing empirical finding concerning risk attitudes. Introducing variables that account for the subjects’ risk attitudesimproved significantly the explanatory power of the econometric model. The implication of this finding for futureresearch is clear. If behavioral factors are systematically important in these markets, then they should be incorpo-rated explicitly in the modeling assumptions. Otherwise models may generate predictions that contrast with theempirical evidence.

1.3. Literature Review

The basic search models relevant for our research were developed in the early 1980s by Varian (1980), Rosenthal(1980), and Burdett and Judd (1983). Varian (1980) developed a model where firms are identical and there aretwo types of consumers. Shoppers, can observe costlessly all prices, while non-shoppers, observe only one price,perhaps because they have a prohibitive search cost. Firms randomize between charging low prices to try to sellto shoppers, and charging high prices to sell only to their share of non-shoppers. Stahl (1989) endogeneized thenon-shoppers reservation price through sequential search, and performed several comparative statics exercises.He showed that for this class of models, the equilibrium price distribution ranges between the monopoly and thecompetitive levels, as the fraction of shoppers varies between 0 to 1.

Recently, the use of the Internet and the existence of price-comparison search engines, renewed the interestin the search literature. Baye and Morgan (2001) developed a model where firms can sell on their local market,or sell beyond their local market through the Internet. Similarly, non-shoppers are consumers buying locally,whereas shoppers are consumers buying over the Internet. The price equilibrium involves mixed strategies. Iyerand Pazgal (2000) developed another model of electronic commerce where firms play mixed strategies, and tested itempirically. Brynjolfsson and Smith (2000) also confirmed empirically the prediction of persistent price dispersionin Internet markets, even in the presence of homogeneous products.

Among the burgeoning experimental literature on search markets, two laboratory experiments are of particularinterest to our research. Cason and Friedman (2003) studied markets with costly consumer search. The issue ofthe size of the sample used in the search process was explicitly addressed allowing for both human and automatedprice search on the demand side. Theoretical predictions in their model were mostly supported by the evidence.In a different setup, more similar to ours but assuming complete coverage, Morgan et al. (2004) studied the caseof a consumer population consisting of Internet shoppers and non-shoppers. Some systematic deviations betweentheoretical and experimental results were attributed by the authors to uncontrolled idiosyncratic features of theirsubjects. However, biases of price-comparison search engines and the effect of incompleteness, were not explored.

The remainder of the paper is organized as follows. In Section 2 we present the benchmark model, and inSection 3 we characterize its equilibrium. In Section 4 we conduct the analysis of the model and its variations.Section 5 analyzes the results of the experiment. Section 6 concludes. Appendix A and B include, respectively, theproofs and the experimental instructions.

3

Page 5: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

2. THE MODEL

2.1. The Setting

Consider an electronic market for a homogeneous search good that opens for 1 period. There are: (i) 1 pricecomparison search engine, (ii) n ≥ 3 vendors, which we index through subscript j = 1, . . . ,n, and (iii) manyconsumers.

2.2. Price-Comparison Search Engine

The Price-Comparison Search Engine, in response to a query for the product, lists the addresses of the firmscontained in its database, i.e., in its Index, and the prices they charge. The search engine may be of one of thefollowing types:

(i). Complete Coverage: Denote by k, the number of vendors the price-comparison search engine indexes. Wewill refer to k as the Size of the Index. The search engine has Complete Coverage if it indexes all vendorspresent in the market: k = n.

(ii). Unbiased Incomplete Coverage: The search engine has Incomplete Coverage if it does not index all vendors:1 < k < n. In addition, the search engine has an Unbiased Sample if it indexes each of the n vendors withthe same probability:

(n−1k−1

)/(n

k

)= k/n. When the search engine has incomplete coverage and an unbiased

sample, we say that it has Unbiased Incomplete Coverage.

(iii). Biased Incomplete Coverage: A search engine with incomplete coverage has a Biased Sample if it indexesvendors j = 1, . . . ,k, and does not index vendors j = k + 1, . . . ,n. When the search engine has incompletecoverage and a biased sample, we say that it has Biased Incomplete Coverage. For this parametrization,knowing the probability with which vendors are indexed, implies knowing the identity of the indexed ven-dors.2

Denote by τ the type of the search engine, and let ‘c’, mean Complete Coverage, ‘u’ mean Unbiased Incom-plete Coverage, and ‘b’ mean Biased Incomplete Coverage, i.e., τ belongs to {c,u,b}. We will use superscripts‘c’, ‘u’, ‘b’, to denote variables or values associated with the cases where the search engine has that type.

2.3. Consumers

There is a unit measure continuum of risk neutral consumers. Each consumer has a unit demand, and a reservationprice of 1. There are 2 types of consumers, differing only with respect to whether they use the price-comparisonsearch engine. Non-Shoppers, a proportion λ in (0,1) of the consumer population, do not use the price-comparisonsearch engine, perhaps because they are unaware of its existence, or perhaps because of the high opportunity costof their time.3 The other consumers, Shoppers, use the price-comparison search engine.

Consumers do not know the prices charged by individual vendors. Shoppers use the price-comparison searchengine to learn the prices of vendors. If the lowest price sampled by the price-comparison search engine is nohigher than 1, shoppers accept the offer and buy; in case of a tie they distribute themselves randomly amongvendors; otherwise they reject the offer and exit the market. Non-shoppers distribute themselves evenly across

2. There are alternative ways of introducing sample biasedness, for which knowing the probability with which vendorsare indexed does not imply knowing the identity of the indexed vendors. For example, all vendors can be indexed with a non-degenerate probability, which is higher for some vendors than for others. The advantage of our parametrization is that it yieldsa closed form solution.

3. To use a search engine consumers might have to download software, learn how to use the search engine’s interface, con-figure the interface, wait for the data to be downloaded, etc. These reasons might dissuade some consumers from using searchengines. This perspective agrees with the available evidence, which suggests a very limited use of price-comparison searchengines, at least yet. A Media Metrix study found that during July 2000 less than 4% of Internet users used a price-comparisonsearch engine, while over 66% visited an online retailer (Montgomery et al., 2004). Furthermore, a Jupiter Communicationssurvey found that 28% of the respondents where unaware of the existence of price-comparison search engine (Iyer and Pazgal,2000).

4

Page 6: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

vendors, i.e., each vendor has a share of non-shoppers of 1/n. If offered a price no higher than 1, non-shoppersaccept the offer and buy; otherwise they reject the offer and exit the market.

2.4. Vendors

Vendors are identical and risk neutral. Marginal costs are constant and equal to zero. Vendors know the functioningrules of the search engine. In particular, under Unbiased Incomplete Coverage, vendors know the probability withwhich they are indexed, but do not observe the identity of the indexed vendors, before choosing prices. UnderBiased Incomplete Coverage, vendors know the identity of the indexed vendors before choosing prices. In thecases of Complete Coverage and Unbiased Incomplete Coverage, vendors are identical. In the case of BiasedIncomplete Coverage, vendors are asymmetric. Denote by Π j(p), the expected profit of vendor j when it chargesprice p on R+

0 . A vendor’s strategy is a cumulative distribution function over prices, Fj(·). Denote the lowest andhighest prices on its support by

¯p j and p̄ j.4 A vendor’s payoff is its expected profit.

2.5. Equilibrium

A Nash equilibrium is a n-tuple of cumulative distribution functions over prices, {F1(·), . . . ,Fn(·)}, such that forsome Π?

j on R+0 , and j = 1, . . . ,n: (i) Π j(p) = Π?

j , for all p on the support of Fj(·), and (ii) Π j(p)≤ Π?j , for all p.

When vendors are identical we focus on symmetric equilibria, in which case: Fj(·) = F(·),¯p j =

¯p, p̄ j = p̄ and

Π?j = Π?, for all j.

3. CHARACTERIZATION OF EQUILIBRIUM

Denote by φ τj the probability of firm j being indexed, given that the search engine is of type τ:

φτj =

k/n if τ = c,u

1 if τ = b and j = 1, . . . ,k

0 if τ = b and j = k +1, . . . ,n.

Denote by p̂− j the minimum price charged by any indexed vendor other than vendor j, and denote by m̂− j thenumber of indexed vendors that charge p̂− j. The profit function of vendor j when it charges price p j is:

π j(p j;τ) =

p j

n+(1−λ )φ τ

j

]if p j < p̂− j ≤ 1

p j

n+

1−λ

m̂− jφ

τj

]if p j = p̂− j ≤ 1

p jλ

nif p̂− j < p j ≤ 1

0 if 1 < p j.

Ignoring ties,5 the expected profit of a vendor that charges p ≤ 1 is:6

Π j(p) = pλ

n+ p(1−λ )φ τ

j [1−F(p)]k−1. (1)

Denote by lτj the lowest price vendor j is willing to charge to sell to both types of consumers when the search

engine has type τ , i.e., lτj [λ/n+(1−λ )φ τ

j ]−λ/n ≡ 0.The next Lemma states some auxiliary results.

4. As it is well known this game has no equilibrium in pure strategies (Varian, 1980).5. Lemma 1(ii) shows that Fτ

j (·) is continuous.6. A vendor j that charges a price p ≤ 1 sells to shoppers: (i) if it belongs to the set of vendors indexed by price-

comparison search engine, which occurs with probability φ τj , and (ii) if it has the lowest price among the indexed vendors,

which occurs with probability [1−F(p)]k−1. Thus, the expected share of shoppers of a vendor that charges price p ≤ 1 is:(1−λ )φ τ

j [1−F(p)]k−1.

5

Page 7: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

Lemma 1. For all j: (i) lτj ≤

¯p j ≤ p̄ j ≤ 1; (ii) Fτ

j is continuous on [lτj ,1]; (iii) p̄ j = 1; (iv) Π?

j = λ/n; (v)

¯p j = lτ

j ; (vi) Fτj has a connected support. �

From Lemma 1(iv), in equilibrium:

n+ p(1−λ )φ τ

j [1−Fτj (p)]k−1 =

λ

n. (2)

Denote by δ (p), the degenerate distribution with unit mass on p.7 The next proposition characterizes theequilibrium for the model.8

Proposition 1. (i) for τ = c,u and j = 1, . . . ,n, and for τ = b and j = 1, . . . ,k:

Fτj (p;n,k) =

0 ⇐ p < lτ

j

1−

[(1

nφ τj

)(λ

1−λ

)(1− p

p

)] 1k−1

⇐ lτj ≤ p < 1

1 ⇐ 1 ≤ p,

with

lτj (n) =

λ

λ +(1−λ )nφ τj

;

(ii) for τ = b and j = k +1, . . . ,n, Fbj (p;n,k) = δ (1). �

Under Biased Incomplete Coverage, vendors j = k + 1, . . . ,n, are not indexed for sure, and therefore haveno access to shoppers. Since these vendors can only sell to non-shoppers, which are captive consumers, theycharge the reservation price. Vendors j = 1, . . . ,k, under Biased Incomplete Coverage, and all vendors in the casesComplete Coverage and Unbiased Incomplete Coverage, are indexed with positive probability. Hence, they facethe trade-off of charging a high price and selling only to non-shoppers, or charging a low price to try to sell also toshoppers, which leads them to randomize over prices.

4. ANALYSIS

In this section, we analyze the model for the 3 types of search engine.

4.1. Complete Coverage

In the case of Complete Coverage the model is similar to Varian (1980).9

Rewrite (2) as:

p(1−λ )[1−Fc(p)]n−1︸ ︷︷ ︸Marginal Benefit

n(1− p).︸ ︷︷ ︸

Opportunity Cost

(3)

If a vendor charges a price p lower than the consumers’ reservation price, it has the lowest price in the marketwith probability [1−Fc(p)]n−1, sells to (1−λ ) shoppers, and earns an additional expected profit of p(1−λ )[1−Fc(p)]n−1: the Volume of Sales effect. However, it loses (1− p) per non-shopper, and a total of (1− p)λ/n: theper Consumer Profit effect. The volume of sales effect is the marginal benefit of charging a price lower than theconsumers’ reservation price, and the per consumer profit effect is the marginal cost.

Denote by ε , the expected price, i.e., the expected price paid by non-shoppers. And denote by µ , the expectedminimum price, i.e., the expected price paid by shoppers.

7. Function δ (·) is the Dirac delta function.8. The equilibrium described in Proposition 1 is the unique symmetric equilibrium. Baye et al. (1992, Theorem 1, p. 496)

showed that there is also a continuum of asymmetric equilibria, where at least 2 firms randomize over [l,1], with each otherfirm i randomizing over [l,xi), xi < 1, and having a mass point at 1 equal to [1−Fi(xi)].

9. See also Rosenthal (1980) and Stahl (1989).

6

Page 8: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

The next Remark collects two useful observations.

Remark 1. (i) λεc +(1−λ )µc = λ ; (ii) µc < εc. �

The first part of Remark 1 says that the average price paid in the market, λεc +(1−λ )µc, equals the proportionof non-shoppers, λ .10 This has two implications. First, only shifts in the proportion of non-shoppers change theaverage price paid in the market. Second, shifts in any other parameter, such as the number of vendors, n, inducethe expected prices paid by shoppers and non-shoppers to move in opposite directions. A conflict of interestsbetween types of consumers is a recurring theme of this paper.

The second part of Remark 1, says that the expected price paid by shoppers, µc = lc +∫ 1

lc(1−Fc)nd p, islower than the expected price paid by non-shoppers, εc = lc +

∫ 1lc(1−Fc)d p. The price-comparison search engine

allows shoppers to compare the prices of all vendors in its index, and choose the cheapest vendor. This inducescompetition among vendors and puts downward pressure on prices, which benefits consumers using search engines.

4.2. Unbiased Incomplete Coverage

In this subsection, we analyze the case of Unbiased Incomplete Coverage, and compare it with the case of Com-plete Coverage. We show that Unbiased Incomplete Coverage compared with Complete Coverage, increases theexpected price paid by shoppers, and decreases the expected price paid by non-shoppers.

The price distribution for the case in which the market consists of n vendors, and the price-comparison searchengine has an unbiased index of size k ≤ n, is identical to the price distribution for the case in which the price-comparison search engine has Complete Coverage, k = n, and the market consists of k vendors: Fu(·;n,k) =Fc(·;k). For further reference, we present this observation in the next corollary.

Corollary 1. Fu(·;n,k) = Fc(·;k). �

The next proposition analyzes the impact of changes in the size of the index, k, and the number of vendors, n.

Proposition 2. (i) lu(k) < lu(k−1); (ii) µu(n,k) < µu(n,k−1) and εu(n,k) > εu(n,k−1); (iii) Fu(·;n,k) =Fu(·;n+1,k). �

Rewrite (2) as:

p(1−λ )(

kn

)[1−Fu(p)]k−1 =

λ

n(1− p). (4)

From (4), an unbiased decrease in the size of the index has two impacts. First, for indexed vendors, the decreasein the size of the index reduces the number of rivals with which a vendor has to compete to sell to shoppers fromk−1 to k−2. This increases the probability that an indexed vendor will have the lowest price, (1−Fu)k−1, whichincreases the Volume of Sales effect. The first impact leads vendors to shift probability mass from higher to lowerprices. As a consequence, the price distribution shifts to the left (Figure 1). Second, the decrease in the size ofthe index reduces the probability that a given vendor is indexed from k/n to (k−1)/n, which reduces the Volumeof Sales effect. The second impact leads vendors to raise the lower bound of the support, and to shift probabilitymass from lower to higher prices. As a consequence, the price distribution rotates (Figure 1). The total impact ofan unbiased decrease in the size of the index is to cause the price distribution to rotate counter clock-wise.11

The increase in the lower bound of the support, lu(k) < lu(k−1), raises the expected price paid by shoppers,µu(n,k) < µu(n,k− 1). However, from Remark 1(i), the average price paid in the market remains constant andequal to λ . This implies that the expected price by non-shoppers decreases, εu(n,k) > εu(n,k−1).12 Recall thatvendors now charge lower prices with a higher probability. Shoppers and non-shoppers have conflicting interests

10. Actually, it equals the proportion of non-shoppers times the reservation price: λ ·1. Also, since marginal cost is 0, anddemand is inelastic and unitary, the average price paid in the market equals the average market profits.

11. See Guimarães (1996) for a related discussion.12. See Morgan et al. (2004) for a related discussion.

7

Page 9: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

0

1

Fu

1plu(k−1)lu(k)

A

Fu(·;n,k−1)

Fu(·;n,k)

FIGURE 1Unbiased Incomplete Coverage: A decrease in the size of the index: the first impact causes the distribution to shift from Fc(·;n)

to A, and the second impact causes the distribution to shift from A to Fu(·;n,k).

with respect to Unbiased Incomplete Coverage, as compared with Complete Coverage. Shoppers prefer a large toa small unbiased index, and non-shoppers prefer a small to a large unbiased index.

Under Unbiased Incomplete Coverage, the equilibrium price distribution does not depend on the number ofvendors in the market, Fu(·;n,k) = Fu(·;n+1,k). This result is unexpected. The probability with which a vendoris indexed, k/n, depends on the number of vendors. Besides, each vendor’s share of non-shoppers, λ/n, alsodepends on the number of vendors. But from (4), n cancels out, and only the number of vendors whose priceshoppers compare matters. Rosenthal (1980) assumed that the increase in the number of vendors is accompaniedby a proportional increase in the measure of non-shoppers. In his setting, an increase in the number of vendorsinduces first-order stochastically dominating shifts in the price distribution, and therefore higher prices for bothtypes of consumers. The contrast between his and this result illustrates another recurring theme of this paper. Inthis sort of markets, the impact of entry depends critically on the way entry occurs.

The next corollary compares the cases of Complete Coverage and Unbiased Incomplete Coverage.

Corollary 2. (i) lc(n) < lb(k); (ii) µc(n) < µu(n,k) and εc(n) > εu(n,k). �

Given that Fu(·;n,k) = Fc(·;k), comparing the price distributions under Unbiased Incomplete Coverage,Fu(·;n,k), and under Complete Coverage, Fc(·;n), is equivalent to comparing Fu(·;n,k) and Fu(·;n,n), i.e., isequivalent to analyzing the impact of an increase in the size of the index, under Unbiased Incomplete Cover-age. Thus, compared with Complete Coverage, Unbiased Incomplete Coverage causes the price-comparison torotate counter-clockwise, which increases the expected price paid by shoppers, µc(n) < µu(n,k), and decreasesthe expected price paid by non-shoppers, εc(n) > εu(n,k).

4.3. Biased Incomplete Coverage

In this subsection, we analyze the case of Biased Incomplete Coverage, and compare it with the other two cases. Weshow that Biased Incomplete Coverage, compared with both Unbiased Incomplete Coverage and with CompleteCoverage, decreases the expected price paid by shoppers and the non-shoppers that buy from indexed vendors, andincreases the expected price paid by non-shoppers that buy from non-indexed vendors.

The next proposition analyzes the impact of changes in the size of the index, k, and the number of vendors, n.

8

Page 10: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

0

1

Fbj

1plb(n)

Fbj (·;n,k−1)

Fbj (·;n,k)

(a) A Decrease in the Size of the Index

0

1

Fbj

1plb(n+1) lb(n)

Fbj (·;n+1,k)

Fbj (·;n,k)

(b) An Increase in the Number of Firms

FIGURE 2Biased Incomplete Coverage: (a) A decrease in the size of the index. For j = 1, . . . ,k distributions Fb

j (·;n,k−1) are first-orderstochastically dominated by distributions Fb

j (·;n,k). (b) An increase in the number of firms. For j = 1, . . . ,k distributionsFb

j (·;n+1,k) are first-order stochastically dominated by distributions Fbj (·;n,k).

Proposition 3. (i) For j = 1, . . . ,k, Fbj (·;n,k)≤Fb

j (·;n,k−1); (ii) µbj (n,k−1) < µb

j (n,k) and εbj (n,k−1)≤

εbj (n,k); (iii) For j = 1, . . . ,k,Fb

j (·;n +1,k)≥ Fbj (·;n,k); (iv) µb

j (n +1,k) < µbj (n,k) and εb

j (n +1,k)≤ εbj (n,k),

with strict inequality for j = 1, . . . ,k. �

Rewrite (2) as

p(1−λ )[1−Fbj (p)]k−1 =

λ

n(1− p). (5)

From (5), a decrease in the size of a biased index, k, increases the probability that an indexed vendor hasthe lowest price, (1−Fb

j )k−1, which increases the Volume of Sales effect. This leads indexed vendors to shiftprobability mass from higher to lower prices. As a consequence, the distribution shifts in the first-order stochas-tically dominated sense, Fb

j (p;n,k) ≤ Fbj (p;n,k− 1) (Figure 2a). This decreases the expected price paid by

shoppers, µbj (n,k− 1) < µb

j (n,k), and by non-shoppers that buy from an indexed vendor, εbj (n,k− 1) < εb

j (n,k),j = 1, . . . ,k, and leaves unchanged the expected price paid by non-shoppers that buy from a non-indexed vendor,εb

j (n,k−1) = εbj (n,k), j = k +1, . . . ,n.

From (5), an increase in the number of vendors in the market, n, leaving fixed the size of a biased index, k,reduces the per Consumer Profit effect. This leads indexed vendors to reduce the lower bound of the support, andto shift probability mass from higher to lower prices. As a consequence, the distribution shifts in the first-orderstochastically dominated sense, Fb

j (p;n+1,k)≥ Fbj (p;n,k) (Figure 2b). This decreases the expected price paid by

shoppers, µbj (n + 1,k) < µb

j (n,k), and by non-shoppers that buy from an indexed vendor, εbj (n + 1,k) < εb

j (n,k),j = 1, . . . ,k, and leaves unchanged the expected price paid by non-shoppers that buy from a non-indexed vendor,εb

j (n+1,k) = εbj (n,k), j = k +1, . . . ,n.13

The next corollary compares the case of Biased Incomplete Coverage, with the two previous cases.

Corollary 3. (i) lb(n) = lc(n); (ii) For j = 1, . . . ,k, Fbj (·;n,k) ≥ max{Fc(·;n),Fu(·;n,k)}, and for j =

k + 1, . . . ,n, Fbj (·;n,k) ≤ min{Fc(·;n),Fu(·;n,k)}; (iii) µb

j (n,k) < min{µc(n), µu(n,k)}; (iv) For j = 1, . . . ,k,εb

j (n,k) < min{εc(n),εu(n,k)}, and for j = k +1, . . . ,n, εbj (n,k) > max{εc(n), εu(n,k)}. �

13. As n → ∞, lb → 0, and Fbj converges weakly to δ (1), j = 1, . . . ,k.

9

Page 11: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

0

1

p 1lu(k)lb(n,k)≡ lc(n)

Fbj (·;n,k)

Fc(·;n)Fu(·;n,k)

FIGURE 3Comparison among the three types of coverage. For j = 1, . . . ,k distributions Fb

j (·;n,k) are first-order stochastically dominatedby distributions Fc(·;n) and Fu(·;n,k).

For indexed vendors, Biased Incomplete Coverage involves only the positive impact of the Volume of Saleseffect, which leads vendors to shift probability mass from higher to lower prices. Thus, the price distribution ofindexed vendors, Fb

j (·;n,k), is first-order stochastically dominated by price distribution under Complete Coverage,Fc(·;n), and by the price distribution under Unbiased Incomplete Coverage Fu(·;n,k) (Figure 3). Shoppers buyfrom the cheapest indexed vendor. Thus, the expected price paid by shoppers is smaller under Biased IncompleteCoverage, than under either Complete Coverage, or Unbiased Incomplete Coverage. For non-shoppers that buyfrom an indexed vendor, the expected price is also smaller. For non-shoppers that buy from a non-indexed vendor,the expected price paid is higher.

5. EXPERIMENTAL EVIDENCE

In this section, we describe the design and report the results of a laboratory experiment, developed to test thetheoretical model in the presence of human subjects.

5.1. Experimental Design

The experiment was conducted at the Laboratori d’Economia Experimental, LEE, of the Universitat Jaume I,Castellón, Spain. A population of 144 subjects was recruited in advance among the students of Business Adminis-tration, and other business-related courses taught at this university.

The experiment was conducted in two independent steps, designed to study two different aspects of our sub-jects’ behavior. First, their attitudes towards risk, and, second, their pricing strategies in a market environment likethe one presented in the preceding pages.

Our theoretical model assumed risk neutrality. However, risk attitudes are likely to matter in our framework,for two reasons. First, because, similar to Morgan et al. (2004), depending on rival indexed prices, subjects haverandom sales. Second, because in our unbiased incomplete coverage treatments, subjects are indexed randomly.In the first part of the experiment, we captured our subjects’ risk attitudes using the lottery panel test proposed bySabater and Georgantzís (2002). Our objective was to use the data obtained from the test as an explanatory factorof any systematic divergence between behavior in the market experiment and our theoretical predictions.

The test elicits two dimensions of a subject’s risk attitude: the subject’s degree of risk aversion, and whethershe accepted more risk in the presence of a higher expected return. Subjects were offered the 4 panels of lotteries

10

Page 12: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

TABLE 1Panels for the Lottery-Choice Task

Panel 1q 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1X e 1.00 1.12 1.27 1.47 1.73 2.10 2.65 3.56 5.40 10.90Choice

Panel 2q 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1X e 1.00 1.20 1.50 1.90 2.30 3.00 4.00 5.70 9.00 19.00Choice

Panel 3q 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1X e 1.00 1.66 2.50 3.57 5.00 7.00 10.00 15.00 25.00 55.00Choice

Panel 4q 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1X e 1.00 2.20 3.80 5.70 8.30 12.00 17.50 26.70 45.00 100Choice

Panels of lotteries involving a probability q of earning X e and a probability 1−q of earning 0 e. Subjects choose one lotteryin each panel.

in Table 1, involving a probability q of earning a monetary reward of X e, and a probability 1− q of earning 0e. Subjects were informed that after submitting their four choices, one per panel, a four-sided die would be usedto determine which panel was binding. Following this stage, a ten-sided die was used to determine whether thesubject would receive the corresponding payoff or not, depending on the odds corresponding to the subject’s choicein the panel drawn.

Each one of the 4 panels was constructed using a fixed certain payoff, c = 1e, above which expected earnings,qX , were increased by h times the probability of not winning, 1−q, as implied by the formula: qX = c+h(1−q).That is, an increase in the probability of the unfavorable outcome is linearly compensated by an increase in theexpected payoff. We used 4 different risk return parameters, h = 0.1,1,5,10, implying an increase in the returnof risky choices as we moved from one panel to the next. Simple inspection of the panels shows that risk lovingand risk neutral subjects would choose q = 0.1 in all panels.14 The more risk averse a subject is, the lower the riskhe will assume, i.e., the higher the q he would choose. For risk-averse subjects, their sensitivity to the attractionimplied by a higher h was approximated by the difference in their choices across subsequent panels.15 In dataanalysis, we use the sign of transitions across panels as a qualitative variable capturing whether a subject complieswith the pattern of assuming more risk in the presence of a higher risk return. For labeling purposes, we referto this pattern of behavior as Monotonicity. While measures of local risk aversion are commonly obtained frombinary lottery tests,16 this second aspect of behavior captured by our test concerns a subject’s response to changes

14. Risk neutrality and risk-loving behavior are observationally impossible to distinguish from our test.15. In fact, using the utility function U(x) = x1/t , it can be shown that the optimal probability corresponding to an Expected

Utility maximizing subject is given by q? = (1− 1/t)(1 + c/h). This implies that subjects should choose weakly (given thediscreteness of the design) lower probabilities as we move from one panel to the next one. However, using more general utilityfunctions or non Expected Utility theories, one can easily construct counterexamples of the aforementioned choice pattern.

16. For example, Holt and Laury (2002) use binary lottery choice tasks, in order to obtain the parameter r of the utility

11

Page 13: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

TABLE 2Treatment Design and Moments of the Theoretical Price Distributions

Treatment Design parameters Average prices Minimum pricesτ n k φ τ Mean Std. Dev. Mean Std. Dev.

1 c 3 3 1.00 0.605 0.143 0.395 0.1452 u 3 2 0.67 0.549 0.103 0.451 0.1133 b 3 2 1.00 0.462 0.135 0.359 0.1134 c 6 6 1.00 0.708 0.125 0.292 0.1675 u 6 4 0.67 0.648 0.115 0.352 0.1586 b 6 4 1.00 0.587 0.154 0.275 0.1527 u 6 2 0.33 0.549 0.073 0.451 0.1138 b 6 2 1.00 0.324 0.137 0.225 0.099

τ is the type of search engine: ‘c’ means Complete Coverage; ‘u’ means Unbiased Incomplete Coverage, and ‘b’ means BiasedIncomplete Coverage. n is the number of firms present in each market. k is the size of the search engine index. φ τ is theprobability with which a firm is indexed by the search engine. The last four columns report the mean and the standard deviationof the theoretical distributions of average prices and minimum prices. Note that in treatments with biased sampling, τ = b, onlyfirms with non-null probability of being indexed are considered.

in the expected profitability of riskier choices.The lottery-choice experiment was followed by a market experiment which was run under 8 treatments, each

one consisting of a single session with 18 subjects. Table 2 reports the design parameters of each treatment and themoments of the distributions of average price and minimum price holding under the assumptions of the theoreticalmodel presented in the previous sections. Each session consisted of the same setup repeated 50 periods. Eachperiod, depending on the treatment, markets of 3 or 6 subjects were randomly formed. This strangers matchingprotocol was adopted, in order to maintain the experimental environment as close as possible to the one-shotframework of the theoretical model. Subjects were perfectly informed of the underlying model, and their onlydecision variable in each period was price (see Appendix B).

Demand was simulated by the local network server.17 There were 1200 consumers. The consumers’ reserva-tion price was normalized to 1000 rather than to 1, for representation and interface reasons, and in order to offer afine grid for the strategy space. Half of the consumers were shoppers, and the other half were non-shoppers, i.e.,λ = 1/2.

Under Complete Coverage, the search engine’s index contained the prices of all subjects, i.e., k = n = 3 ork = n = 6, depending on the treatment. Under Incomplete Coverage, the index contained the prices of only asubset of all subjects, i.e., k = 2 for n = 3, and k = 2 or k = 4 for n = 6. Under Unbiased Incomplete Coverage,subjects were informed whether they where indexed after each period’s prices were set. Under Biased IncompleteCoverage, subjects were informed on the composition of the index before prices were set. Both in the case ofUnbiased or Biased Coverage, after each period’s prices were set, subjects were informed on own and rival prices,as well as own quantities sold and profits earned.18

In order to make the earnings of each period equally interesting, subjects’ monetary rewards were calculatedfrom the cumulative earnings over 10 randomly selected periods. Individual rewards ranged between 15 e and 50e. This made the experiment worth participating in, and made trying to have the highest payoff worthwhile.

function, U(x) = x1−r/(1− r).17. We programmed software using z-Tree (Fischbacher, 1999) in order to organize strategy submission, demand simula-

tion, feedback, and data collection.18. Subjects observe their rivals’ prices for two reasons. First, for realism. Second, because it helps subjects infer the types

of strategies that are adopted and abandoned by the rest of the market, which speeds convergence.

12

Page 14: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

5.2. Testable Hypothesis

Denote by εt , the expected price in treatment t; by ε int the expected price of indexed firms in treatment t; by εni

t theexpected price of non-indexed firms in treatment t; and by µt the expected minimum price in treatment t, wheret = 1, . . . ,8.

We perform the following Consistency Test:

HC: Under Complete Coverage, an increase in the number of vendors: (i) decreases the expected minimumprice: µ4 < µ1; (ii) increases the average price: ε4 > ε1.

Regarding Unbiased Incomplete Coverage we test:

HU1: Under Unbiased Incomplete Coverage, a decrease in the size of the index: (i) increases the expectedminimum price: µ4 < µ5 < µ7 and µ1 < µ2; (ii) decreases the expected price: ε4 > ε5 > ε7 and ε1 > ε2.

HU2: Under Unbiased Incomplete Coverage, the equilibrium price distribution is independent of the num-ber of vendors present in the market: µ2 = µ7 and ε2 = ε7.

Regarding Biased Incomplete Coverage we test:

HB1: Under Biased Incomplete Coverage, a decrease in the size of the index: (i) decreases the expectedminimum price: µ4 > µ6 > µ8 and µ1 > µ3; (ii) decreases the expected price of indexed vendors: ε4 > ε in

6 > ε in8

and ε1 > ε in3 ; (iii) leaves unchanged the expected price of non-indexed vendors: εni

6 = εni8 = 1 and εni

3 = 1.

HB2: Under Biased Incomplete Coverage, an increase in the number of vendors present in the market: (i)decreases the expected minimum price: µ3 > µ8; (ii) decreases the expected price of indexed vendors: ε in

3 > ε in8 .

We also test:

HG: (i) The expected minimum price is smaller under Biased Incomplete Coverage, than under UnbiasedIncomplete Coverage: µ5 > µ6 and µ7 > µ8 and µ2 > µ3; (ii) The expected price of indexed vendors is smallerunder Biased Incomplete Coverage, than under Unbiased Incomplete Coverage: ε5 > ε in

6 , and ε7 > ε in8 , and

ε2 > ε in3 .

And we also test two hypotheses related to our subjects’ risk attitudes:

HRN: Subjects are risk neutral, i.e., subjects choose q = 0.1 in the four panels of the lottery-choice task.

HM: Subjects choose a no less riskier option in the presence of higher returns to risk. That is, across panels,as the return to risk is increased, subjects choose a no higher q.

5.3. Market Experiment Results

Table 3 summarizes the information and descriptive statistics regarding all treatments. The 20 initial periodswere dropped from the data sets to eliminate learning dynamics and guarantee that observations had reached thenecessary stability. Seven conclusions emerge from the experimental observations.

Observation 1. There is a systematic deviation of the empirical results from the theoretical results. �

This conclusion can be reached through at least two alternative ways. First, the inspection of the t-tests inTable 3 shows that with the exception of the average price for treatments 4 and 6, all estimated means of averageand minimum prices are significantly different from their theoretical values.

13

Page 15: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

TABLE 3Descriptive Statistics

Average prices Minimum prices

Treatment Mean Std. Dev. t-test Mean Std. Dev. t-test Obs.

1 0.535 0.158 −5.90∗∗ 0.294 0.103 −13.14∗∗ 1802 0.760 0.109 25.84∗∗ 0.635 0.157 15.68∗∗ 1803 0.637 0.211 11.13∗∗ 0.475 0.247 6.35∗∗ 1804 0.700 0.136 −0.58 0.193 0.161 9.98∗∗ 905 0.592 0.149 −3.52∗∗ 0.204 0.197 −7.17∗∗ 906 0.591 0.177 0.19 0.208 0.176 −3.64∗∗ 907 0.758 0.088 22.52∗∗ 0.644 0.258 7.10∗∗ 908 0.416 0.214 4.06∗∗ 0.269 0.187 2.21∗ 90

Means and standard deviations of the empirical distributions of average and minimum prices and two-sided t-tests of equalityof price distribution means to their theoretical values. Test statistics rejecting the null hypothesis at the 5% and 1% significancelevels are marked with ∗ and ∗∗ respectively. The means of the theoretical distribution of average prices and minimum pricesare reported in Table 2. In the biased treatments, 3, 6 and 8, only indexed firms are considered.

Second, this conclusion can also be gleaned from the inspection of Figure 4, which compares the empiricaland theoretical distributions of prices fixed by subjects that had a non null probability of being indexed by thesearch engine. In Figure 4, each empirical price distribution is surrounded with a confidence region built fromthe 1% critical values of the Kolmogorov-Smirnov test. The Kolmogorov-Smirnov test statistic is the maximumof the absolute value of the difference between the two distributions under comparison. Therefore, as none of thetheoretical distributions completely lies in the confidence regions of Figure 4, the data clearly rejects the equalityof the theoretical and the empirical distributions in all treatments.

The empirical distributions rotate clock-wise compared to the theoretical ones. In the case of treatments 2 and3, the empirical distribution “almost” first-order stochastically dominates the theoretical distribution. This rotationindicates the presence of more density on both tails of distributions of observed prices, than the theoretical modelwould have predicted. On one hand, in some treatments a large number of observations lie below of the infimum ofthe support of the theoretical distributions, lτ , e.g., in treatments 1, 4, 5 and 6. On the other hand, a large numberof observations are at the maximum price, p j = 1. This behavior is specially pronounced in treatments 4, 5, 6, and7. In line with the way in which the empirical distributions rotate, most of the empirical price distributions havehigher standard deviations than the corresponding theoretical ones (see Tables 2 and 3).

We also found a difference between the expected and the observed behavior of subjects that knew beforehandthat they would not be indexed under Biased Incomplete Coverage. In treatments 6 and 8, 8% of the observedprices of these subjects were different from p j = 1. We suspect that many of these observations were mistakes, asmany of these subjects only deviated from the degenerate equilibrium strategy once or twice. But in treatment 3,nearly 30% of the prices of these subjects were different from p j = 1, and four of these individuals always chooseprices lower than p j = 1. Clearly, the experimental data does not support hypothesis HB1 (iii).

Observation 2. The data supports the model’s predictions regarding changes in the number of firms presentin the market. �

From Table 4, it follows that: (i) µ2 = µ7 and ε2 = ε7, (ii) µ3 > µ8 and ε in3 > ε in

8 , (iii) µ1 > µ4 and ε1 < ε4.This implies that the data supports hypotheses: HC, HU2, and HB2.

Consider in particular the consistency test, HC: under Complete Coverage, an increase in the number ofvendors increases the average price and decreases the expected minimum price. This conclusion can also begleaned from the inspection of Figure 5. This non-trivial result was also obtained by Morgan et al. (2004).

14

Page 16: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

(a) Treatment 1

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

(b) Treatment 2

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

(c) Treatment 3

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

(d) Treatment 4

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

(e) Treatment 5

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

(f) Treatment 6

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

(g) Treatment 7

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

(h) Treatment 8

FIGURE 4Theoretical (solid lines) and Empirical (dashed line) Price Distributions. Empirical distributions are sourrounded with a confi-

dence region buit from the 1% critical values of the Kolmogorov-Smirnov test.

Observation 3. The data supports the model’s predictions regarding the comparison between UnbiasedIncomplete Coverage and Biased Complete Coverage. �

From Table 4, it follows that: (i) µ3 < µ2 and ε in3 < ε2, (ii) µ6 = µ5 and ε in

6 = ε5, (iii) µ8 < µ7 and ε in8 < ε7.

The data support hypothesis HG: the average and the average minimum prices are weakly lower under BiasedIncomplete Coverage than under Unbiased Incomplete Coverage. Both types of consumers, shoppers and non-shoppers, are better off if the index is biased than if it is unbiased. The same conclusion can be gleaned from theinspection of Figure 6.

Observation 4. The data does not support the model’s predictions regarding changes in the size of theindex. �

From Table 4, it follows that: (i) µ1 < µ2 and ε1 < ε2, (ii) µ4 < µ7 and ε4 < ε7, (iii) µ5 < µ7 and ε5 < ε7, (iv)µ4 = µ5 and ε4 > ε5. This implies that the data does not support hypothesis HU1.

15

Page 17: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

TABLE 4t-tests of Equality of Means of Average Prices

Average prices Minimum prices

H0 H1 t-test H0 H1 t-test d. f.

HC ε1 = ε4 ε1 < ε4 −8.44∗∗ µ4 = µ1 µ4 < µ1 −6.23∗∗ 268

HU1 ε5 = ε4 ε5 < ε4 −5.06∗∗ µ4 = µ5 µ4 < µ5 −0.39 178ε7 = ε4 ε7 < ε4 3.42 µ4 = µ7 µ4 < µ7 −14.06∗∗ 178ε7 = ε5 ε7 < ε5 9.11 µ5 = µ7 µ5 < µ7 −12.87∗∗ 178ε2 = ε1 ε2 < ε1 15.68 µ1 = µ2 µ1 < µ2 −24.26∗∗ 358

HU2 ε2 = ε7 ε2 6= ε7 0.11 µ2 = µ7 µ2 6= µ7 −0.35 268

HB1 ε in6 = ε4 ε in

6 < ε4 −4.64∗∗ µ6 = µ4 µ6 < µ4 0.59 178ε in

8 = ε4 ε in8 < ε4 −10.60∗∗ µ8 = µ4 µ8 < µ4 2.91 178

ε in8 = ε in

6 ε in8 < ε in

6 −5.96∗∗ µ8 = µ6 µ8 < µ6 2.25 178ε in

3 = ε1 ε in3 < ε1 5.19 µ3 = µ1 µ3 < µ1 9.09 358

HB2 ε in8 = ε in

3 ε in8 < ε in

3 −8.07∗∗ µ8 = µ3 µ8 < µ3 −7.00∗∗ 268

HG ε in6 = ε5 ε in

6 < ε5 −0.07 µ6 = µ5 µ6 < µ5 0.15 178ε in

8 = ε7 ε in8 < ε7 −14.01∗∗ µ8 = µ7 µ8 < µ7 −11.17∗∗ 178

ε in3 = ε2 ε in

3 < ε2 −6.93∗∗ µ3 = µ2 µ3 < µ2 −7.30∗∗ 358

Except for HU2, one-sided t-tests with ‘d.f’ degrees of freedom. The testable implications of section 5.2 correspond to thealternative hypothesis of these tests. For HU2, two-sided t-test with ‘d.f’ degrees of freedom. HU2 correspond to the nullhypothesis of this test. Test statistics rejecting the null hypothesis at the 5% and 1% significance levels are marked with ∗ and∗∗ respectively.

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

Treat. 1Treat. 4

(a) Theoretical distributions

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

Treat. 1Treat. 4

(b) Empirical distributions

FIGURE 5Comparison of Price Distributions: Complete Coverage.

16

Page 18: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

Treat. 2Treat. 3

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

Treat. 5Treat. 6

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

Treat. 7Treat. 8

(a) Theoretical distributions

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

Treat. 2Treat. 3

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

Treat. 5Treat. 6

0.0

0.2

0.4

0.6

0.8

1.0

0.0 0.2 0.4 0.6 0.8 1.0

Treat. 7Treat. 8

(b) Empirical distributions

FIGURE 6Comparison of Price Distributions: Incomplete Coverage

Also from Table 4, it follows that: (i) µ1 < µ3 and ε1 < ε in3 , (ii) µ4 < µ8 and ε4 > ε in

8 , (iii) µ6 < µ8 andε in

6 > ε in8 , (iv) µ4 = µ6 and ε4 > ε in

6 . This implies that the data does not support hypothesis HB1, either.

Observation 5. The data does not support the model’s predictions regarding the comparison between Com-plete Coverage and Incomplete Coverage. �

With respect to the comparison between Complete Coverage and Unbiased Incomplete Coverage, from Ta-ble 4, it follows that: (i) µ4 = µ5 < µ7 and µ1 < µ2; (ii) ε5 < ε4 < ε7 and ε1 < ε2. Only the comparison ofminimum prices is weakly compatible with the model’s predictions. The data fails to support the predicted com-parison between Complete Coverage and Unbiased Incomplete Coverage, i.e., HU1.

With respect to the comparison between Complete Coverage and Biased Incomplete Coverage, from Table 4,it follows that: (i) µ4 = µ6 < µ8 and µ1 < µ3; (ii) ε in

8 = ε in6 < ε4 and ε1 < ε in

3 . The data fails to support the predictedcomparison between Complete Coverage and Biased Incomplete Coverage, i.e., HB1.

Observation 6. The average minimum price is weakly lower under Complete Coverage than under BiasedIncomplete Coverage. �

From Table 4 it follows that: (i) µ1 < µ3, (ii) µ4 = µ6, and (iii) µ4 < µ8. Jointly with Observation 3, this implythat shoppers are better off under Complete Coverage than under Incomplete Coverage.

Observation 7. Given the type of bias, ratio k/n, and Incomplete Coverage, an increase in the number offirms in the market leads to a lower average price, and a lower average minimum price. �

17

Page 19: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

TABLE 5Lottery-Choice Task Results

Treatment Risk Neutr. (%) Avr. Choice Monotonicity compliance measures (%)Strict Average Local

1 1.39 0.59 44.44 72.22 77.782 15.28 0.46 27.78 77.78 38.893 4.17 0.54 33.33 55.56 55.564 20.83 0.44 55.56 88.89 83.335 5.56 0.59 33.33 77.78 72.226 5.56 0.52 33.33 66.67 66.677 8.33 0.59 33.33 66.67 55.568 18.06 0.50 50.00 77.78 61.11Average 9.90 0.53 38.89 72.92 63.89

‘Risk Neutr.’ is the percentage of choices which are compatible with risk neutrality, i.e., q = 0.1. ‘Avr. Choice’ is the averagechoice made by all subjects in each treatment over all panels. The last three columns refer to percentages of subjects fulfilling themonotonicity property at three different levels: ‘Strict’ indicates the percentage of subjects whose choices were all compatiblewith the monotonicity property; ‘Average’ indicates the percentage of subjects whose choices were on average compatible withthe monotonicity property; and ‘Local’ indicates the percentage of subjects whose choice of q decreased from panel 1 to panel2.

From Table 4 it follows that: (i) µ5 < µ2 and ε5 < ε2, and (ii) µ6 < µ3 and ε6 < ε3. This observation agreeswith the empirical findings of Baye et al. (2003).

5.4. Accounting for Risk Attitudes

We summarize the preceding observations as follows. On the basis of descriptive analysis, the data supports someof the model’s predictions, and rejects others. Given that some of the predictions that the data supports are non-trivial, particularly the consistency test, HC, the underlying Burdett and Judd (1983) and Varian (1980) models aresound. However, there is some factor, the model does not account for, that impacts systematically the way subjectsplay the game. In the case of Complete Coverage this unaccounted factor is qualitatively unimportant. However,under Incomplete Coverage this unaccounted factor becomes determinant. The model assumes that subjects arerisk neutral, expected utility maximizers. The unaccounted factor could be the subjects’ risk attitudes.

We have captured two aspects of subjects’ risk attitudes: (i) the average choice over the four panels, and (ii)the “transition” across two subsequent panels. The former can be used as a proxy for a subject’s risk aversion, andthe latter as a qualitative variable reflecting a subject’s compliance with the monotonicity property.

Table 5 summarizes the information and descriptive statistics regarding the lottery-choice task for all treat-ments. The second and third columns refer to the percentages of risk neutral subjects: (i) the Risk Neutr. columnindicates the percentage of choices which are compatible with risk neutrality, and (ii) the Avr. Choice columnindicates the average choice by all subjects in the treatment over all panels. The three remaining columns referto percentages of subjects which comply with the monotonicity property at three different levels: (i) the Strictcolumn indicates the percentage of subjects whose choices were all compatible with the monotonicity property,(ii) the Average column indicates the percentage of subjects whose choices were on average compatible with themonotonicity property, and (iii) the Local column indicates the percentage of subjects whose choice of q decreasedfrom panel 1 to panel 2, i.e., of individuals that comply with the monotonicity property for the minimum increasein the risk. The purpose of the penultimate column is to allow for human errors which might induce inconsistenttransitions from a given panel to the next one. And the purpose of the last column is to help infer the local behaviorof the subjects’ utility functions.

The results of the lottery-choice task are summarized in the following two observations:

Observation 8. The data does not support the hypothesis that subjects are risk neutral. �

18

Page 20: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

From Table 5, one concludes the following. Our results confirm previous findings of choice agglomerationaround probabilities close to 0.5 (Georgantzís et al., 2003). The average choices exhibit no systematic patternsacross treatments. A Kruskal-Wallis test does not reject the homogeneity of the distribution of subjects’ averagechoices across treatments. Overall, slightly less than 10% of the decisions are compatible with risk neutrality inany of the panels. However, this percentage falls below any significance level if one requires that a subject behavedin a way compatible with risk neutrality in all four panels.

Observation 9. The data does not support the hypothesis that subjects accept more risk in exchange for ahigher expected return. �

In Table 5, column Strict indicates the percentage of the subjects that comply strictly with the monotonicityproperty varies across treatments, ranging from 27.7% in treatment 2 to 55.5% in treatment 4. Overall, only 38% ofthe subjects comply strictly with monotonicity. Column Average indicates the percentage of subjects that complyon average with the monotonicity property is 72.9%. Column Local indicates the percentage of the subjects whosechoice of q decreased from panel 1 to panel 2 is 63.9%.

5.5. Econometric Model

Having established the violation of hypotheses HRN and HM, we assess its impact on the experimental results.We estimate price distributions conditional on experimental design parameter-specific variates, on one hand, and,individual-specific characteristics related to risky choice, on the other hand. From the estimated price distributionwe can derive the distributions of both average and minimum prices and assess the impact of experimental designparameters and risk attitudes on these distributions.

We model the observed prices as being generated by beta distributions. The beta distribution is commonly usedin the statistical analysis of variables with a bounded support. It is a flexible distribution which can accommodateasymmetries and various distributional shapes: uniform, bell-shaped, U-shaped, J-shaped. As it is a distributionfor bounded variables, it naturally incorporates a relation between mean and variance, so that, for unimodal dis-tributions, the variance is lower for beta variables with a mean near the boundaries than for beta variables whosemean lies around the center of the support. Finally, the mathematical tractability of the beta distribution generallyputs no excessive burden on the estimation and interpretability of the results.

Our formulation is similar but slightly more general than the one used by Ferrari and Cribari-Neto (2004). Weallow some degree of heterogeneity by doing the estimation conditional on a set of K covariates, xi =(x1i,x2i, . . . ,xKi)′,where subscript i = 1, . . . ,N indexes the experimental observations. In our analysis, these covariates are relatedto the design of each treatment and to the risk attitudes of the subjects. We parametrize a price distribution interms of its conditional mean, E(p|xi) = Θi = Θ(xi), and a function ∆i = ∆(xi) related to dispersion.19 Given thesedefinitions, the probability density function of prices is

f (p|xi) =Γ(1/∆i)

Γ(Θi/∆i)Γ((1−Θi)/∆i)pΘi/∆i−1(1− p)(1−Θi)/∆i−1, (6)

where 0 ≤ p ≤ 1, and Γ(·) is the gamma function.We use the following functional forms for the mean and the dispersion:

Θi = Λ(x′iθ), (7)

∆i = exp(x′iδ ), (8)

where Λ(s) = 1/(1 + e−s) is the logit function, and θ and δ are K-dimensional vectors of unknown parameters.The functional forms (7) and (8) guarantee that Θi lies between 0 an 1 and ∆i is greater than 0, for all possible

19. Perhaps, it would seem more natural to parametrize the price distribution in terms of its conditional mean and itsvariance. But this would complicate both the estimation procedure and the interpretation of estimates. This is so, due tothe nonlinear relationship between the mean and the upper bound of the variance of a beta distributed variable. In any case,knowing Θi and ∆i we can compute the variance as σ2

i = Θi(1−Θi)/(∆−1i + 1). Thus, given Θi, higher values of ∆i imply

higher variances.

19

Page 21: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

values of the parameters, θ ,δ , and the covariates, xi. These parameters are positively related to the marginaleffects of a covariate on the mean and dispersion of prices. Consider a change of covariate xli. It is easy to see that∂Θi/∂xli = Θi(1−Θi)θl , i.e., the marginal effect of xli on the mean is not constant, but its sign is the same as thesign of θl . In the same way ∂∆i/∂xli = ∆iδl , so increments of covariate xli imply higher dispersion if δl > 0.

Equations (6)–(8) allow us to write the logarithm of the likelihood function as

lnL =N

∑i=1

ln f (p|xi). (9)

We estimate the unknown parameters θ and δ by the method of maximum-likelihood.The eight treatments of the market experiment are designed using different parameter values of the theoretical

model. Therefore, we estimate a model whose explanatory terms are specific to these design variables and subjects’attitudes towards risk. According to equations (7) and (8), we use the following specifications for the mean andthe dispersion of price distributions:

Θi = Λ(θ0 +θuk (1−bi) lnki +θ

un (1−bi) lnni +θ

bk bi lnki +θ

bn bi lnni +θr lnri), (10)

∆i = exp(δ0 +δuk (1−bi) lnki +δ

un (1−bi) lnni +δ

bk bi lnki +δ

bn bi lnni +δr lnri), (11)

where ki is the size of the index, ni is the number of firms, bi is a dummy variable taking a value of 1 for observationscorresponding to biased treatments and 0 otherwise, and ri is a measure of the degree of risk aversion of the setterof price i.20 We define ri as the average choice made in the lottery-choice task discussed above normalized so thatit takes a value of 1 for subjects that choose q = 0.1 in the four panels. For such subjects we use the term riskneutral throughout the text.21 As the Complete Coverage case can be thought as a limit case of both Biased andUnbiased Incomplete Coverage we impose the additional restrictions θ u

k + θ un = θ b

k + θ bn and δ u

k + δ un = δ b

k + δ bn .

This restriction guarantees that, when n = k, the price distributions for Unbiased and Biased Incomplete Coveragecollapse to a common distribution, corresponding to Complete Coverage, but still allows different patterns ofinfluence of n and k on the Incomplete Coverage cases.

Table 6 shows three sets of estimates of the parameters in equations (10)–(11). The main results of ourestimation procedure can be summarized in the following three observations:

Observation 10. Subjects’ risk attitudes significantly affect the observed pricing behavior. �

In Table 6, Model I includes only treatment design variables. Model II includes additionally the risk aversionvariable ri. The increase of the likelihood function indicates a significant improvement of the fit. The estimates ofparameters θr and δr also indicate that the impacts of ri on both, the mean and the dispersion of price distributions,are significant.

Model III extends Model II by allowing for differences in the parameters of price distributions for MON andnon-MON subjects, i.e., for subjects that comply and do not comply, respectively, with the monotonicity property,measured by the Local indicator of Table 5. We find significant differences between the two sets of parameterestimates, and that the split into two subsamples significantly improves the overall fit. The likelihood ratio testsstatistics strongly reject Model I and Model II in favor of Model III.

Observation 11. (i) Risk neutral non-MON subjects set higher prices, which exhibit a lower dispersion,than MON subjects. (ii) Non-MON subjects, set lower prices with a larger dispersion, the higher their degree ofrisk aversion. �

The first part of Observation 11 follows from the rejection of the equality of the parameters for MON andnon-MON subjects, and from the comparison of the θ and δ parameters for both types of subjects. The second

20. We have tried other specifications including squares and interactions of the regressors, but they do not lead to differentqualitative results.

21. Note that this is done for labeling purposes, given that choosing q = 0.1 is also compatible with risk-loving behavioras well as with some, arbitrarily low, degree of risk-aversion.

20

Page 22: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

TABLE 6Price Distribution Estimations

Model I Model II Model IIIAll subjects All subjects MON non-MON

θ0 0.972[0.080]

∗∗ 1.418[0.097]

∗∗ 0.773[0.140]

∗∗ 2.169[0.147]

∗∗

θ uk −0.479

[0.059]∗∗ −0.523

[0.059]∗∗ −0.438

[0.070]∗∗ −0.482

[0.110]∗∗

θ un 0.352

[0.069]∗∗ 0.383

[0.069]∗∗ 0.500

[0.085]∗∗ 0.434

[0.113]∗∗

θ bk 0.410

[0.077]∗∗ 0.408

[0.079]∗∗ 0.342

[0.093]∗∗ 0.697

[0.149]∗∗

θ bn −0.536

[0.084]∗∗ −0.547

[0.085]∗∗ −0.280

[0.102]∗∗ −0.744

[0.145]∗∗

θr −0.275[0.039]

∗∗ −0.050[0.048]

−0.804[0.088]

∗∗

δ0 −1.289[0.058]

∗∗ −1.431[0.069]

∗∗ −1.260[0.097]

∗∗ −1.890[0.118]

∗∗

δ uk 0.709

[0.043]∗∗ 0.725

[0.044]∗∗ 0.782

[0.046]∗∗ 0.547

[0.088]∗∗

δ un 0.247

[0.050]∗∗ 0.221

[0.051]∗∗ 0.138

[0.054]∗ 0.226

[0.104]∗

δ bk 0.452

[0.061]∗∗ 0.421

[0.061]∗∗ 0.476

[0.068]∗∗ 0.228

[0.136]

δ bn 0.504

[0.068]∗∗ 0.525

[0.068]∗∗ 0.443

[0.075]∗∗ 0.544

[0.130]∗∗

δr 0.093[0.024]

∗∗ 0.032[0.024]

0.444[0.079]

∗∗

RMSE 0.325 0.323 0.321lnL 3228.0 3242.8 3268.1LR 80.22∗∗ 50.74∗∗

K 8 10 20

Maximum-likelihood estimates of parameters in equations (10) and (11). White’s (1982) robust standard errors between brack-ets. Sample size is 3600 observations. RMSE is the root mean squared prediction error, lnL is the value of the likelihoodfunction, LR are the likelihood ratio statistic comparing Model I and Model II with Model III, K is the number of parametersestimated in each model. Coefficients marked with ∗∗ (∗) are significantly different from 0 at the 1% (5%) level.

part of Observation 11 follows from the sign and significance of the estimates of θr and δr parameters for non-MON subjects. Risk aversion only affects significantly both the mean and the dispersion of price distributions fornon-MON subjects.

The reported heterogeneity of the subjects with respect to risk attitudes can help explain the rotation of empiri-cal price distributions compared to theoretical distributions, discussed in Observation 1. The presence of non-MONsubjects increases probability mass on both high and low prices. On one hand, risk neutral non-MON subjects shiftprobability mass from lower to higher prices. On the other hand, risk averse non-MON subjects shift probabil-ity mass from higher to lower prices. The varying patterns of rotations found in Figure 4 could be explained bydifferences across treatments in the proportion of non-MON subjects, and their degrees of risk aversion.

Observation 12. The pricing behavior of both types of subjects, MON and non-MON, deviates from thetheoretical predictions. �

The estimates of the parameters in Table 6 imply that with respect to Biased Incomplete Coverage the expectedprice set by indexed firms: (i) decreases with the number of firms, n, and (ii) increases with the size of the index,k. These results are in line with theoretical predictions.

With respect to Unbiased Incomplete coverage, the estimates imply that the expected price: (i) increases with

21

Page 23: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

TABLE 7Means and Standard Deviations of Estimated Price Distributions

Average prices Minimum prices

Treatment MON non-MON MON non-MON

(a) Risk neutrality1 0.699 (0.304) 0.892 (0.158) 0.428 (0.283) 0.764 (0.196)2 0.735 (0.266) 0.910 (0.134) 0.591 (0.273) 0.848 (0.159)3 0.669 (0.294) 0.862 (0.170) 0.504 (0.285) 0.778 (0.191)4 0.708 (0.351) 0.889 (0.192) 0.205 (0.245) 0.603 (0.256)5 0.743 (0.314) 0.907 (0.166) 0.387 (0.301) 0.735 (0.227)6 0.678 (0.346) 0.858 (0.208) 0.291 (0.281) 0.630 (0.252)7 0.797 (0.250) 0.932 (0.126) 0.669 (0.274) 0.880 (0.156)8 0.625 (0.331) 0.789 (0.231) 0.438 (0.310) 0.668 (0.247)

(b) “Average risk aversion”1 0.682 (0.313) 0.695 (0.298) 0.402 (0.284) 0.429 (0.275)2 0.719 (0.275) 0.735 (0.267) 0.569 (0.279) 0.590 (0.274)3 0.651 (0.303) 0.632 (0.304) 0.481 (0.289) 0.460 (0.284)4 0.691 (0.360) 0.688 (0.344) 0.182 (0.235) 0.201 (0.225)5 0.728 (0.324) 0.728 (0.314) 0.361 (0.299) 0.373 (0.288)6 0.661 (0.355) 0.624 (0.352) 0.266 (0.275) 0.237 (0.249)7 0.783 (0.259) 0.789 (0.259) 0.649 (0.282) 0.656 (0.284)8 0.606 (0.338) 0.506 (0.350) 0.414 (0.312) 0.305 (0.289)

Means and standard deviations, in parentheses, of average and minimum price distributions calculated from the estimates ofModel III (see Table 6).

the number of firms, and (ii) decreases with the size of the index. These results are not in line with theoreticalpredictions.

According to our empirical specification, the effect of an increase of the number of firms in the case of Com-plete Coverage is given by the sum of parameters θ u

k +θ un = θ b

k +θ bn . Unlike the case of Incomplete Coverage, this

effect differs qualitatively between MON and non-MON subjects. For MON subjects, the expected price increaseswith the number of firms, n, but for non-MON subjects the opposite occurs. However, neither of these effects isstatistically significant.

We can use the estimated price distributions in order to predict behavior under different conditions. An exam-ple is presented in Table 7, where we provide predictions for two interesting scenarios: risk neutrality and “averagerisk aversion”, corresponding to the modal choice in the lottery task, i.e., q = 0.5. For risk neutrality, results con-firm the comments above: non-MON subjects set higher prices with a lower standard deviation. This is also validfor minimum prices. However, these results are often reversed when one calculates the moments for risk aversesubjects.

The results in Table 7 also allow us to check the testable hypotheses of section 5.2. A major finding is thatsome hypotheses are confirmed independently from the subjects’ risk attitudes. Specifically, hypotheses HU1 (i),HB2, HG, and HB1 (ii) are confirmed in all cases. A second set of hypotheses are those which are not confirmedby any type of subjects. These are HU2, HU1 (ii), and HB1 (i). Finally, HC hypothesis is weakly confirmed forMON subjects only.

Some general features of the theoretical model like, for example the comparison between Biased and UnbiasedIncomplete Coverage, HG, are supported in the majority of the cases. This implies that some of the predictions ofmodels like Varian (1980), derived under assumptions of risk neutrality are robust enough to survive in the presence

22

Page 24: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

of risk-averse subjects. Other results are more frail. One could summarize the preceding results, observing thatgenerally speaking, failures of the theoretical model to organize observed behavior relate to Unbiased IncompleteCoverage, because this setting implies an extra source of uncertainty for sellers.

6. CONCLUSIONS

In this paper we developed a theoretical model of the effects on prices of incompleteness and biasedness of pricecomparison search engines. We tested the model’s predictions in a laboratory experiment, whose design wasspecific to the testable hypotheses. Furthermore, we implemented a lottery-choice experiment, designed to capturetwo different aspects of our subjects’ risk attitude: (i) the degree of risk aversion, and (ii) whether subjects acceptmore risk in exchange of a higher expected return. The experimental data was used to estimate an econometricmodel accounting for treatment design variables and individual risk attitudes.

The theoretical model warns us on possible counterintuitive effects of unbiased coverage of the market on ob-served prices, e.g., an increase in the number of firms whose prices are included in the search engine may not implyglobally lower expected prices. However, the experimental results contradict some of the theoretical predictions,especially, predictions about incomplete coverage. An interesting empirical finding reported here, concerns an im-portant improvement in the explanatory power of the empirical model of individual prices, obtained by introducingvariables accounting for our subjects’ risk attitudes. In particular, splitting the sample of subjects into two groups,according to whether they comply or not with the monotonicity hypothesis, improves the explanatory power ofthe empirical model. Furthermore, for subjects which do not comply with the monotonicity property, the expectedprice decreases with the degree of risk aversion. These risk-related aspects of our subjects’ behavior help explainthe systematic clock-wise rotation of observed price distributions as compared to the theoretical distributions.

Our findings indicate that behavioral factors are important in markets like the ones studied here. Therefore,models assuming monotonicity or risk neutrality may produce predictions which deviate from the behavior ofhuman subjects.

APPENDIX A. PROOFS

Proof of Lemma 1. For τ = b and j = k + 1, . . . ,n the proofs are obvious, so consider: (a) τ = b and j =1, . . . ,k, and (b) τ = c,u.

(i). For any j, any price p j < lτj or p j > 1 is strictly dominated by p j = 1;

(ii). Suppose not, i.e., suppose that Fτj has a mass point at price p. Let ε > 0 be arbitrarily small and such that

no mass point exists at price p− ε . The expected profits of firm j are:

Π j(p− ε) =(p− ε)λ

n+(p− ε)(1−λ )φ τ

j Prob[p− ε < p̂− j]

+ (p− ε)(1−λ )φ τj Prob[p− ε ≤ p = p̂− j],

and

Π j(p) = pλ

n+ p(1−λ )φ τ

j Prob[p < p̂− j]+ p(1−λ )φ τ

j

m̂− jProb[p = p̂ j

−i].

Subtracting the second expression from the first and taking the limit as ε approached zero, one obtains

limε→0

[Π j(p− ε)−Π j(p)] = pα(1−λ )φ τj

(m̂− j −1

m̂− j

)Prob[p = p̂− j] > 0.

Hence, vendor j would increase profit by shifting mass from p to an ε neighborhood below p. But thisimplies that it cannot be an equilibrium strategy to maintain a mass point at p;

(iii). Suppose not, i.e, suppose p̄ j < 1. Then

Π j(p̄ j) = p̄ jλ

n+ p̄ j(1−λ )φ τ

j [1−F(p̄ j)]k−1 = p̄ jλ

n,

since fom (ii) there are no mass points at p̄ jλ/n. However, the payoff from setting a price equal to 1 isλ/n > p̄ jλ/n;

23

Page 25: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

(iv). Follows from (ii) and (iii);

(v). Parts (ii) and (iv) imply that¯p jλ/n+

¯p j(1−λ )φ τ

j = Π j(¯p j) = λ/n. Hence

¯p j = lτ

j ;

(vi). Suppose not, i.e., suppose there is an interval [pl , ph] satisfying lτj ≤ pl < ph ≤ 1 such that F(pl) = F(ph).

Suppose also that pl is the infimum of all prices p, lτj ≤ p ≤ 1. Then pl is in the support of F(·) and, from

(ii) Π?j = Π j(pl) = plλ/n + pl(1−λ )φ τ

j [1−F(pl)]k−1 < phλ/n + ph(1−λ )φ τj [1−F(ph)]k−1 = Π j(ph),

a contradiction. �

Proof of Proposition 1. We show constructively that equilibrium exists. Alternatively, existence followsfrom theorem 5 of Dasgupta and Maskin (1986). (i) Use Lemma 1(iv) to set Π j(p) = pλ/n + p(1− λ )φ τ

j [1−F(p)]k−1 = λ/n. Solving for F(p) the result follows; (ii) Obvious. �

Proof of Remark 1. (i) Follows from the fact that all firms are indifferent between any equilibrium price andthe monopoly price. (ii) Follows directly from the definition of µc = lc +

∫ 1lc(1−Fc)nd p and εc = lc +

∫ 1lc(1−

Fc)d p. �

Theorem 1. (i) εc(n) < εc(n+1); (ii) µc(n) > µc(n+1). �

Proof of Theorem 1. (i) See Morgan et al. (2004); (ii) Follows from (i) and Remark 1(i). �

Proof of Corollary 1. Obvious. �

Proof of Proposition 2. (i) Obvious; (ii) Follows from Corollary 1 and the Theorem 1; (iii) Obvious. �

Proof of Corollary 2. (i) Obvious; (ii) Follows from Corollary 1 and the Theorem 1. �

Proof of Proposition 3. (i) Obvious; (ii) Follows from (i); (iii) Obvious; (iv) Follows from (iii). �

Proof of Corollary 3. (i) Obvious; (ii) Obvious; (iii) Follows from (ii); (iv) Follows from (ii). �

APPENDIX B. INSTRUCTIONS OF THE EXPERIMENT (TRANSLATED FROM SPANISH)

• The purpose of this experiment is to study how subjects take decisions in specific economic contexts. Thisproject has received financial support by public funds. Your decision making in this session is going to be ofgreat importance for the success of this research. At the end of the session you will receive a quantity of moneyin cash which will depend on your performance during the session.

• The environment in which the experiment takes place is an industry. This industry has the following character-istics:

(a) a price comparison search engine like the ones on the Internet,

(b) 3 firms, (Treatments 4–8: 6 firms),

(c) 1,200 consumers.

Each firm in the industry produces a homogeneous product, and this product is the same for all firms.

• Transactions will take place in UMEX (our lab’s Experimental Monetary Units).

• This session will consist of 50 rounds.

• You are one of the 3 firms (Treatments 4–8: 6 firms) in the industry. Your production costs are zero. Therefore,your profits are equal to your revenue.

24

Page 26: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

• Each round, you and the rest of the firms in the industry have to decide the price at which you want to sell theproduct. Price is your only decision variable.

• (Treatments 1 and 4) Each period, a Price Search Engine lists the prices of all firms in the industry.

• (Treatments 2, 5 and 7) Each period, a Price Search Engine lists the prices of 2 firms (Treatment 5: 4 firms) in theindustry. More precisely, each round, the price comparison search engine randomly chooses 2 firms (Treatment5: 4 firms), whose price will be included in its price list. The identity of the firms whose price will be includedin the list of the price search engine, will be announced publicly to the members of the industry after the firms’prices are posted.

• (Treatments 3, 6 and 8) Each period, a Price Search Engine lists the prices of 2 firms (Treatment 6: 4 firms) in theindustry. More precisely, each round, the price comparison search engine randomly chooses 2 firms (Treatment6: 4 firms), whose price will be included in its price list. The identity of the firms whose price will be includedin the list of the price search engine, will be announced publicly to the members of the industry before the firms’prices are posted.

• Each consumer wants to buy one unit of the product per round. The maximum willingness to pay of eachconsumer for a unit of the product is 1,000 UMEX. That is, if the price you fix is higher than 1,000 UMEX,nobody will buy from you.

• There are two types of consumers. Half of them, i.e., 600 consumers, will read the list of price created by thesearch engine. The other half do not actually read the list of prices of the search engine (maybe because they arenot able to do so).

• The consumers who read the price list of the search engine will buy, each period, from the firm whose price forthat period is the lowest among all prices included in the price list, if such price does not exceed 1,000 UMEX.In case of a “tie” (i.e., several firms fix the same minimum price) the consumers are distributed evenly amongthe firms with the same minimum price.

• The consumers who do not read the search engine’s price list will buy “randomly” from any vendor, so that thisgroup of consumers will be distributed evenly among all firms in the industry.

• In each round, 3 firms (Treatments 4–8: 6 firms) forming (together with you) the same industry, will be randomlydrawn among the 18 participants of this session. Therefore, the probability of competing with the same 2 firms(Treatments 4–8: 5 firms) in 2 different periods is very low (less than 10%).

• Once the participants have been assigned to the industries, you must set your price. The master program in thecomputer will simulate the consumers’ reactions. At the end of each round, you will see on your screen theinformation about your own sales, your earnings and the prices fixed by your competitors in the market.

• At the end of the session you will be paid in cash. Your reward will be determined taking into account theearnings you accumulate over 10 (randomly selected) out of the total 50 periods. The exchange rate will be:1,000,000 UMEX = 10 e.

Thank you very much for your participation. Good luck!

REFERENCES

BAYE, M., GATTI, R., KATTUMAN, P. and MORGAN, J. (2003), “Did the Euro Foster Online Price Competition?Evidence from an International Price Comparison Site”, Mimeo, Indiana University.

BAYE, M., KOVENOCK, D. and DEVRIES, C. (1992), “It Takes Two to Tango: Equilibria in a Model of Sales”,Games and Economic Behavior, 4, 493–510.

BAYE, M. and MORGAN, J. (2001), “Information Gatekeepers on the Internet and the Competitiveness of Homo-geneous Product Markets”, American Economic Review, 91 (3), 454–474.

BRADLOW, E. and SCHMITTLEIN, D. (1999), “The Little Engine that Could: Modeling the Performance of WorldWide Web Search Engines”, Marketing Science, 19 (1), 43–62.

25

Page 27: Bias and Size Effects of Price-Comparison ... - FGV EPGEepge.fgv.br/files/2007.pdf · Bias and Size Effects of Price-Comparison Search Engines: Theory and Experimental Evidence We

BRYNJOLFSSON, E. and SMITH, M. (2000), “Frictionless Commerce? A Comparison of Internet and Conven-tional Retailers”, Management Science, 46 (4), 563–585.

BURDETT, K. and JUDD, K. (1983), “Equilibrium Price Dispersion”, Econometrica, 51, 955–969.

CASON, T. N. and FRIEDMAN, D. (2003), “Buyer Search and Price Dispersion: a Laboratory Study”, Journal ofEconomic Theory, 112, 232–260.

DASGUPTA, P. and MASKIN, E. (1986), “The Existence of Equilibrium in Discontinuous Economic Games, I:Theory”, Review of Economic Studies, 53, 1–26.

FERRARI, S. L. P. and CRIBARI-NETO, F. (2004), “Beta Regression for Modelling Rates and Proportions”,Journal of Applied Statistics, 31, 799–815.

FISCHBACHER, U. (1999), “z-Tree: Zurich Toolbox for Readymade Economic Experiments. Experimenter’s Man-ual”, Working Paper 21, Institute for Empirical Research in Economics, University of Zurich.

GEORGANTZÍS, N., GENIUS, M., GARCÍA-GALLEGO, A. and SABATER, G. (2003), “Testing for Risk-ReturnTradeoffs in Individual Decision Making”, Working Paper 43/03, LINEEX, Valencia.

GUIMARÃES, P. (1996), “Search Intensity in Oligopoly”, Journal of Industrial Economics, 44, 415–426.

HOLT, C. A. and LAURY, S. K. (2002), “Risk Aversion and Incentive Effects”, American Economic Review, 92,1644–1655.

IYER, G. and PAZGAL, A. (2000), “Internet Shopping Agents: Virtual Co-Location and Competition”, MarketingScience, 22, 85–106.

LAWRENCE, S. and GILES, C. (1998), “Searching the World Wide Web”, Science, 280 (3), 98–100.

LAWRENCE, S. and GILES, C. (1999), “Accessibility of Information on the Web”, Nature, 400, 107–109.

MONTGOMERY, A., HOSANAGAR, K., KRISHNAN, R. and CLAY, K. (2004), “Designing a Better Shopbot”,Management Science, 50 (2), 189–206.

MORGAN, J., ORZEN, H. and SEFTON, M. (2004), “An Experimental Study of Price Dispersion”, Games andEconomic Behavior, forthcoming.

PEREIRA, P. (2004), “Search and Destroy: Competition between Search Engines and Consumer Prices”, Mimeo,Portuguese Competition Authority, Lisboa.

PEREIRA, P. (2005), “Do Lower Search Costs Reduce Prices and Price Dispersion?”, Information Economics andPolicy, 17 (1), 61–72.

ROSENTHAL, R. (1980), “A Model in Which an Increase in the Number of Sellers Leads to a Higher Price”,Econometrica, 48, 1575–1579.

SABATER, G. and GEORGANTZÍS, N. (2002), “Accounting for Risk Aversion in Repeated Prisoners’ DilemmaGames”, Journal of Economic Behavior and Organization, 48, 37–50.

SAMUELSON, L. and ZHANG, J. (1992), “Search Costs and Prices”, Economics Letters, 38, 55–60.

STAHL, D. (1989), “Oligopolistic Pricing with Sequential Consumer Search”, American Economic Review, 79,700–712.

VARIAN, H. (1980), “A Model of Sales”, American Economic Review, 70, 651–659.

WHITE, H. (1982), “Maximum Likelihood Estimation of Misspecified Models”, Econometrica, 53, 1–16.

26