Last week, Professor Mor Harchol-Balter visited us at the University of Toronto to deliver a talk as part of the Department of Computer Science’s Distinguished Lecture Series. During her excellent talk, she showed how intuition often fails us when scaling systems to meet a given load, even with perfect information of load patterns, whereby the amount of computers is over-estimated (thereby increasing energy use due to over-provisioning) and presented some results that will be appearing in conferences soon with experimental results related to power saving policies in data centres. One of the examples she gave of intuition breaking down is, given n computers serving r requests per unit time, load l, and a response time of t per request, how many computers are required to maintain response time t and load l if r increases by, say, a factor of one hundred?
During her talk, Professor Harchol-Balter mentioned that banks refuse to share computing power with anyone else. This seemed like a missed opportunity for energy savings in the form of virtualization, although, in the short term economic analysis, millions of dollars of power saved is chump change for these institutions. I later asked her about this and she conceded that they’d be willing to share their servers with other instances of their own software, given certain constraints. Which brings us to a continuation of my previous depth paper excerpt blog post Energy-proportional computing.
Continue reading “Professor Mor Harchol-Balter talk & Consolidating load in data centres”