WEEK 8
Capacity
Management
Synopsis
We
consider issues of identifying demand, customer activities, analyzing process
designs for capacity implications, and capacity management in e-Services.
Readings
Nature of e-Services Capacity Management
This first
short article addresses the key question for us to consider, and covers the simplest
case of capacity management, in which the digital content is static, and server
duties are fairly homogeneous and thus interchangeable.
(Required) “How do the large web sites handle the load of millions of
visitors per day?” HowStuffWorks.com
http://www.howstuffworks.com/question342.htm
The next
short article indicates the two halves of the capacity management problem,
leading to two approaches being needed to study an e-Service’s capacity.
(Required) Butler, J., “E-Performance Management Gains Attention at CMG,” Software Magazine, May 8, 2000.
This
Microsoft White Paper provides an overview of capacity planning projection
methods for dynamic e-Services (both B2C and B2B) on the WWW. The methods
described are for making projections about the feasible site capacity.
I would suggest that you start at the end of the article – which is a Case Study of capacity planning issues at MSNBC – then go back to the front end and read until you get techied-out (in the middle, many calculations are presented, for which you may not have the patience or interest). Note all of the additional e-Service capacity types mentioned in the first page of the article. If you are interested in some of these other capacities, such as how a third-party payment service can affect a site’s performance, or how to track users within a site to gauge their capacity use, you may want to read Philip Greenspun’s book at http://www.arsdigita.com/books/panda/, which humorously discusses the difficulties involved with each.
(Required – At Least the Non-Technical First Half, and the MSNBC Case Study) “Capacity Planning,” Microsoft White Paper
If you are using Netscape Navigator to print this out, you may not have the following embedded in the document, due to its lack of support for inline frames:
Click here to download a page with all of the missing Figures.
Automated Analysis of
Demand Loads
One
approach to testing a web site (or any other e-Service) before it goes live is
to have actual humans within your company test the site out, by generating
demand loads for the site. This approach has numerous shortcomings, as you can
imagine, which are documented on many of the sites below.
The
natural way to improve on the above approach is through automated tools for
capacity management. The approach is described very briefly in the short
Entrepreneur Magazine article. Basically, for each of the tools below, a
manager would set up the real website’s service-process configuration, test the
site with “real” demand loads generated by a demand-load simulator, and after
adjusting the site’s performance, make the site go into operation. The
MercuryInteractive articles lay out various issues that are important in (i)
load testing before going live, and (ii) monitoring performance after going
live. If you are interested in additional examples of such technology, the links
to tools found below present similar tools.
(Required) “Stress Test for Web Sites That Won’t Affect Live Performance,” Entrepreneur Magazine
http://www.entrepreneur.com/Your_Business/YB_SegArticle/0,1314,279364-8----,00.html
Related Link: http://www.appgenesys.com/services.htm
(Required) “Load Testing to Predict Web Performance”
http://www-svca.mercuryinteractive.com/products/whitepapers/load_testing/index.html
(Optional – Browse/Read) “Isolating Bottlenecks with Performance Monitors”
(Optional – Browse/Read) “What is Web Performance Monitoring?”
http://www-svca.mercuryinteractive.com/products/monitoring/
A variant of this approach is to
use actual consumer computers – based on a peer-to-peer strategy – to study a
site under actual Internet traffic conditions from actual users’ desktops.
(Optional) “Load Testing Uses Distributed PCs -- Exodus service generates loads from users in peer-computing mode”
http://www.techweb.com/se/directlink.cgi?INW20001113S0019
Another approach
– not considered here – is to formally model the system using OR-based mathematical
tools for queueing networks, which might not do you much good in a turbulent
e-Service competitive environment, and might require you to employ someone with
a PhD in that topic. If you are interested in this approach, I suggest you buy
a book by Daniel A. Menasce and Virgilio A. F. Almeida, either Capacity
Planning for Web Performance (1998) or Scaling for E-Business
(2000).
Interestingly,
I haven’t found any tools that use a software model of both the client (i.e., “virtual
users”) and server (i.e., “virtual service-process”) sides to do capacity
analysis, as with the Operations Support Systems we read about during Session 3
for network management.
Tools for Load Testing and Web Performance Monitoring
GomezNetworks Methodology
http://www.gomeznetworks.com/mktg/method/method1.asp
“Rational Software Introduces Rational SiteLoad; Industry’s First Web-Based Load Testing Product,” Press Release, August 28, 2000.
http://www.rational.com/news/press/pr_view.jsp?ID=7978
Data Sheet: SiteLoad - http://www.rational.com/media/news/presskit/siteload.pdf
http://www.rational.com/products/siteload/readme.jsp
“What is Web Performance Monitoring?”
http://www-svca.mercuryinteractive.com/products/monitoring/
Product: ActiveWatch - http://www-svca.mercuryinteractive.com/products/activewatch/
Product: Topaz - http://www-svca.mercuryinteractive.com/products/topaz/
Rapoza, J., “SilkPerformer Tests Web-Site Fabrics,” PC Week, July 29, 1999.
http://www.zdnet.com/products/stories/reviews/0,4161,410219,00.html
Schindler, E., “Smooth Site Testing,” Sm@rtPartner, September 11, 2000.
http://www.segue.com/html/s_news/recent_articles/SmartPartner 9.00.pdf
Product: SilkPerformer - http://www.segue.com/html/s_solutions/s_performer/s_performer.htm
Product: EConfidenceScale - http://www.segue.com/html/s_solutions/s_hosted/scale_home.htm
Hendrick, K., and S. D. Hendrick, “RadView Software’s WebLoad: Integrated Testing for the Web,” IDC Bulletin #21616, February 2000.
http://www.radview.com/products/papers/IDC/paper.asp
Product: WebLoad - http://www.radview.com/products/webload.htm
Product: WebLoad Resource Manager - http://www.radview.com/products/webloadmgr.htm
Radware
RSW Software – E-Test Suite
http://www.rswsoftware.com/products/etest-suite_index.shtml
Loadtesting.com
http://www.loadtesting.com/compare.asp
Softlight Technologies – SiteTools
http://www.softlight.com/mainv20/products/products_stee_ov.asp
Netscape Links to Web Site Testing Applications
http://directory.netscape.com/Computers/Programming/Software_Testing/E-Commerce_Testing
Capacity Analysis Tools for Period-by-Period Demand and Demand Load Summary
PerfMan for WebServers
http://www.perfman.com/sellSheets/WebServer/PerfManforWebServers.html
Web Testing and Monitoring Newsletter – Comparison of Several Approaches and Tools
http://members.tripod.co.uk/wtmn/
Related
Readings – Not Required
Tutorials on almost any type of capacity you might be interested in managing
Providers of monitoring systems for billing of capacity and services
http://www.billingworld.com/ (Click on “Buyer’s Guide”)
User Tracking
http://www.arsdigita.com/books/panda/server
Interfacing a relational database to the Web
http://www.arsdigita.com/books/panda/databases-interfacing
Assignment
Visit the following sites and analyze the following
web site load testing software and services:
http://www.segue.com/html/s_solutions/s_performer/s_performer.htm
http://www-svca.mercuryinteractive.com/products/activewatch/
http://www.gomeznetworks.com/mktg/method/method1.asp
Submit a 1-2 page report critiquing the capabilities of the various approaches.