Core-Selecting Auction Design for Dynamically Allocating Heterogeneous VMs in Cloud Computing

Transcription

1 Core-Selecting Auction Design for Dynamically Allocating Heterogeneous VMs in Cloud Computing Haoming Fu, Zongpeng Li, Chuan Wu, Xiaowen Chu University of Calgary The University of Hong Kong Hong Kong Baptist University June 24, 2014 Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

2 Outline Outline 1 Introduction 2 Problem Model 3 Core-Selecting VM Auctions 4 Core-Selecting Payment Rules 5 Simulations 6 Conclusion Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

3 Introduction Introduction to Cloud Markets Cloud markets Heterogeneity nature of virtual machine (VM) instances; Resource provisioning (resources: CPU, RAM, storage, etc.); Auction for efficient VM allocation (e.g. Amazon Spot Instances). Figure: (a) VM configuration from Spot Instances. (b) Illustration of a cloud market. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

4 Introduction Motivation of Our Work *Shill bidding problem is applicable to combinatorial auctions only and not to simple auctions. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

5 Introduction Our VM Auction Design We apply the core-selecting auctions, which achieve a revenue at least on par with that of VCG mechanisms and are robust against shill bidding. The core-selecting auction is further tailored to minimize CUs incentives to deviate from truthful bidding. A three-dimension auction framework is proposed for dynamic resource provisioning. We propose a combinatorial auction that is expressive enough to sell bundles of heterogeneous VMs. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

6 Problem Model Problem Model XOR bidding language: a cloud user (CU) can submit multiple bids, but can win a single bid only. B i is the set of all VM bundles CU i bids for. Utility The quasi-linear utility of CU i is: { vi (S) p u i = i if CU i wins a bundle S B i 0 otherwise The utility of the cloud provider (CP) is: u o = i N u i. All CUs are individually rational; v i (S) is the maximum amount that CU i is willing to pay for S. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

7 Problem Model Problem Model winner determination problem (WDP) w(n ) = max b i (S)x i (S) i N S B i m subject to: n j α k j π k 1 k t; j=1 x i (S) 1 i N ; S B i x i (S)r j i N S B i n j 1 j m, S = (r 1, r 2,..., r m); n j N 1 j m; x i (S) {0, 1} i N, S B i. Theorem 1 Relaxing n to take fractional values in the WDP does not change the value of w(n ). Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

8 Core-Selecting VM Auctions The Core of Our VM Auction An auction outcome is blocked by coalition C N if there is an alternative outcome which generates strictly more revenue for the auctioneer and no less utility for each CU i C. Core: Set of outcomes that are not blocked. Core Core(N ) ={u 0 i N {o} u i = w(n ), i C {o} u i w(c), C N } Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

9 Core-Selecting VM Auctions The Core of Our VM Auction Example: The cloud provider (auctioneer) has 25 CPUs and 25 GB storage in its resource pool. 7 CUs each submits one bid: b 1 (6, 0, 1) 8 7 = 4, b 2(2, 3, 0) 5 11 = 5, b 3 (0, 0, 6) 12 6 = 4, b 4(7, 0, 0) 7 7 = 27, b 5 (0, 4, 0) 4 12 = 25, b 6(0, 0, 6) 12 6 = 24, b 7 (5, 3, 7) = 33. To keep CU 1 from blocking: p 4 4. Similarly: p 5 5, p 6 4. To keep CUs 1, 2, 3 from blocking: p 4 + p 5 + p Individual rationality. Table: VM configuration. VM 1 VM 2 VM 3 CPU storage 1GB 3GB 1GB Figure: Illustration of the core. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

10 Core-Selecting VM Auctions The Core of Our VM Auction Theorem 2 The payment vector of first price auction is always in the core of our VM auction. (proof by definition) Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

11 Core-Selecting VM Auctions The Economic problems from VCG Mechanisms The VCG mechanism p VCG i = b i (S i ) (w(n ) w(n \{i})) Low revenue: a revenue of 4+5+4=13 is gleaned in view of the fact that the winners are willing to pay a total up to =76. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

12 Core-Selecting VM Auctions The Economic problems from VCG Mechanisms b 1 (6, 0, 1) 8 7 = 4, b 2 (2, 3, 0) 5 11 = 5, b 3 (0, 0, 6) 12 6 = 4, b 4 (7, 0, 0) 7 7 = 27, b 5 (0, 4, 0) 4 12= 25, b 6 (0, 0, 6) 12 6 = 24, b 7 (5, 3, 7) = 33. available VM 1 VM 2 VM 3 25 CPU GB storage 1GB 3GB 1GB Vulnerability to shill bidding: CU 5 impersonates four different CUs, each submitting this bid: b(0, 1, 0) 1 3 = CU 5 still wins 4 instances of VM 2 but reduces its payment from 4 to 0! Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

13 Core-Selecting VM Auctions The Necessity of Core-Selecting Auctions Theorem 3 (shill bidding proof) In a VM auction formulated with WDP, no CU can earn more than its VCG utility by bidding with shills if and only if the auction is core-selecting. u o + i N u i is constant since WDP implies efficiency, then Corollary (competitive revenue) The total revenue in a core-selecting VM auction formulated with WDP is at least as high as that in a VCG auction. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

14 Core-Selecting VM Auctions The Necessity of Core-Selecting Auctions Theorem 3 (shill bidding proof) In a VM auction formulated with WDP, no CU can earn more than its VCG utility by bidding with shills if and only if the auction is core-selecting. Proof sketch of Theorem 3 C N, their total utility under the VCG mechanism is w(n ) w(n \C) Our restriction is: i C u i w(n ) w(n \C). Efficiency: w(n ) = i N {o} u i. Then i (N {o})\c u i w(n \C). Note that: Core(N ) = {u 0 i N {o} u i = w(n ), i C {o} u i w(c), C N } Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

15 Core-Selecting Payment Rules Revenue Minimization Rule Revenue minimization rule We pick the payment that minimizes the total revenue over the core. Theorem 4 A core-selecting VM auction formulated with WDP and employing a revenue-minimization payment rule minimizes CUs incentives to deviate from truthful bidding. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

16 Core-Selecting Payment Rules Revenue Minimization Rule The core constraint i C {o} u i w(c), C N is equivalent to: i W\ C p i w( C (N \W)) i C b i (S i ), C W Setting β C = w( C (N \W)) i C b i(s i ), the core constraint can be compactly written as Ap β. δ = min 1 T p (revenue minimization) subject to: Ap β (core constraint) p b (individual rationality) Drawback: revenue minimization rule lacks of precision, since the points minimizing revenue are not unique. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

17 Core-Selecting Payment Rules Point Reference Rules Point reference rules Among the in-core payment points minimizing the revenue, we pick the one that is closest to some pre-determined point p. min(p p ) T (p p ) (closest to p ) subject to: Ap β (core constraint) p b (individual rationality) 1 T p = δ (revenue minimization) VCG-nearest rule and constant p reference rule p can be set to be the VCG payment vector or some constant vector independent of CUs bids. Theorem 5 Under the VCG-nearest rule, the set of constraints p b is unnecessary. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

18 Core-Selecting Payment Rules Point Reference Rules Under the constant p reference rule, the winner with high valuation relative to the auctioneer s expectation shares less of the burden to conquer a coalitional blocking. Origin-nearest rule: p = 0. available VM 1 VM 2 VM 3 18 CPU GB storage 1GB 3GB 1GB b 1 (0, 0, 6) 12 6 = 100 b 2 (0, 4, 0) 4 12 = 20 b 3 (0, 4, 6) = 60 b 4 (0, 0, 6) 12 6 = 50 Winners are CUs 1 and 2. p VCG = (50, 0) p VCG nearest = (55, 5) p origin nearest = (60, 0) Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

19 Simulations Simulations Figure: Performance of the VM allocation result under core-selecting auctions. Dynamic resource provisioning achieves higher social welfare, stably higher resource utilization but lower user satisfaction. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

20 Simulations Simulations Figure: The monetary burden shouldered by the winner(s) under (a) the VCG-nearest rule, and (b) the origin-nearest rule. µ ī = p p VCG ī ī i N (p i p VCG i ). Under the origin-nearest rule, the winner with high valuation relative to the auctioneer s expectation shares less of the burden to conquer a coalitional blocking. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

21 Simulations Simulations Figure: The monetary burden shouldered by the winner(s) under (a) the VCG-nearest rule, and (b) the origin-nearest rule. Core-selecting auction achieves 8% higher revenue over the VCG mechanism. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

22 Simulations Simulations Figure: The monetary burden shouldered by the winner(s) under (a) the VCG-nearest rule, and (b) the origin-nearest rule. Our core-selecting VM auction has a stable performance; revenues do not deteriorate when bidding instances are from Google Cluster Data or are randomly generated in different ways. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

23 Conclusion Conclusion Core-selecting combinatorial VM auctions are novelly designed for the cloud computing market. They are proved to be proof to shill bidding and generate higher revenues than VCG auctions do. Payment rules that minimize CUs incentives to deviate from truthful bidding are extensively discussed. We advance the VM auction design by generalizing static resource provisioning to dynamic resource provisioning, and from homogeneous VM instances to heterogeneous VM instances. Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

24 Main References 1 R. Day and P. Milgrom, Core-selecting package auctions, International Journal of Game Theory, vol. 36, no. 3-4, pp. 393C407, March R. W. Day and S. Raghavan, Fair payments for efficient allocations in public sector combinatorial auctions, Management Science, vol. 53, no. 9, pp. 1389C1406, September R. W. Day and P. Cramton, Quadratic core-selecting payment rules for combinatorial auctions, Operations Research, vol. 60, no. 3, pp. 588C603, May A. Gulati, A. Holler, M. Ji, G. Shanmuganathan, C. Waldspurger, and X. Zhu, Vmware distributed resource management: Design, implementation, and lessons learned, VMware Technical Journal, vol. 1, no. 1, pp. 45C64, June H. Zhang, B. Li, H. Jiang, F. Liu, A. V. Vasilakos, and J. Liu, A framework for truthful online auctions in cloud computing with heterogeneous user demands, in Proc. of IEEE INFOCOM, April 2013, pp. 1558C Y. Zhu, B. Li, and Z. Li, Core-selecting combinatorial auction design for secondary spectrum markets, in Proc. of IEEE INFOCOM, April 2013, pp. 2034C Google Cluster Data, 8 M. Yokoo, Y. Sakurai, and S. Matsubara, The effect of false-name bids in combinatorial auctions: New fraud in internet auctions, Games and Economic Behavior, vol. 46, no. 1, pp. 174C188, January Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24

25 Q&A Thank You! Haoming Fu, Zongpeng Li and Chuan Wu (UofC, HKU) June 24, / 24