book

Web Caching

by Duane Wessels

June 2001

Intermediate to advanced

320 pages

9h 18m

English

O'Reilly Media, Inc.

Read now

Unlock full access

Audience
Web SitesMailing Lists
Web ArchitectureClients and ServersProxiesWeb ObjectsResource Identifiers
HTTPFTPSSL/TLSGopher
LatencyBandwidthServer Load

Browser CachesCaching ProxiesSurrogates
HTTP RequestsOrigin Server RequestsProxy RequestsNon-HTTP Proxy Requests
Status CodesRequest MethodsExpiration and ValidationCache-controlAuthenticationCookiesDynamic Content
Last-modified TimestampsEntity TagsWeak and Strong Validators
The no-cache DirectiveThe max-age DirectiveThe min-fresh Directive
Least Recently Used (LRU)First In, First Out (FIFO)Least Frequently Used (LFU)SizeGreedyDual-Size (GDS)Other Algorithms
PrivacyAccess LogsMaking Requests Anonymous
Does Caching Infringe?Cases and PrecedentsThe DMCAHTTP’s Role
Java Applets
Proxy Addresses
Configuring Microsoft Internet ExplorerConfiguring Netscape NavigatorNCSA Mosaic, Lynx, and Wget
Writing a Proxy Auto-Configuration FunctionSample PAC ScriptsSetting the Proxy Auto-Configuration Script
Overview
Inline CachesLayer Four SwitchesWCCPCisco Policy Routing
LinuxipchainsiptablesFreeBSDOther Operating Systems
It’s Difficult for Users to BypassPacket Transport ServiceRouting ChangesIt Affects More Than Browsers and UsersNo-Intercept ListsAre Port 80 Packets Always HTTP?HTTP Interoperation ProblemsIP Interoperation Problems
Important HTTP HeadersDateLast-modifiedExpiresCache-controlContent-length
Why?LatencyHiding network failuresServer load reductionTen Ways to be Cache-FriendlyApacheThe Expires headerGeneral header manipulationSetting headers from CGI scriptsHow to Choose Expiration Times
What About Dynamic Responses?What About Advertisements?Getting Accurate Access Counts
How Hierarchies Work
PerformanceNondefault Routing
TrustLow Hit RatiosEffects on RoutingFreshnessLarge FamiliesAbuses, Real and ImaginedError MessagesFalse HitsForwarding LoopsFailures and Service Denial
ICPHistoryFeaturesHit predictionProbing the networkObject data with hitsSource RTT measurementsIssuesDelaysBandwidthFalse hitsUDPNo request methodQueries for uncachable responsesInteroperationUnwanted queriesMulticast ICP
Issues
Bloom FiltersComparing Digests and ICP
The Hot Spare
Appliance or Software SolutionAppliancesSoftware
What to Monitor?
UCD-SNMPRRDToolOther Tools
MetricsThroughputResponse TimeHit RatioConnection CapacityCost
Disk ThroughputCPU PowerNIC BandwidthMemoryNetwork State
Web PolygraphBlastWisconsin Proxy BenchmarkWebJammaOther Benchmarks
TCP Delayed ACKsPort Number ExhaustionNIC Duplex ModeBad Ethernet CablesFull CachesTest DurationLong-Lived ConnectionsSmall Working SetsClock SyncMSL (TIME_WAIT) Values
Configure SystemsTest the NetworkNo-Proxy TestFill the CacheRun the Benchmark
ThroughputResponse TimeHit RatioOther Results
Reply and Object Sizes
Client Request HeadersClient Reply Headers
Size and Popularity
ICPv2 Message FormatOpcodeVersionMessage LengthReqnumOptionsOption DataSender Host AddressPayload
PointersObject AdvertisementRequest NotificationObject Removal and InvalidationMD5 Object KeysEliminating URLs from RepliesWiretappingPrefetching
Membership Table
Message Format and Magic ConstantsHEADERDATAAUTH
COUNTSTRSPECIFIERDETAILIDENTITY
NOPTSTTST requestTST responseMONMON requestMON responseSETSET requestSET responseCLRCLR requestCLR response
The Cache Digest ImplementationKeysHash FunctionsSizing the FilterSelecting Objects for the DigestFalse Hits and Digest FreshnessExchanging Digests
1xx Intermediate Status
Books and Articles

Content preview from Web Caching

Request For Comments

Bhushan, Abhay and others.: RFC 172 The File Transfer Protocol, June 1971.
Clark, David D.: RFC 813 Window and Acknowledgement Strategy in TCP, July 1982.
Postel, Jon and Joyce Reynolds: RFC 959 File Transfer Protocol (FTP), October 1985.
IETF: RFC 1122 Requirements for Internet Hosts—Communication Layers, Robert Braden, Ed. October 1989.
Rivest, Ronald L.: RFC 1321 The MD5 Message-Digest Algorithm, April 1992.
Berners-Lee, Tim: RFC 1630 Universal Resource Identifiers in WWW, June 1994.
Hanks, S., Tony Li, D. Farinacci and P. Traina: RFC 1701 Generic Routing Encapsulation (GRE), October 1994.
Berners-Lee, Tim, Larry Masinter and Mark Masinter: RFC 1736 Uniform Resource Locators (URL), December 1994.
Berners-Lee, Tim, Roy Fielding and Henrik Frystyk: RFC 1945 Hypertext Transfer Protocol—HTTP/1.0, May 1996.
Krawczyk, H., M. Bellare and R. Canetti: RFC 2104 HMAC: Keyed-Hashing for Message Authentication, February 1997.
Moats, Ryan: RFC 2141 URN Syntax, May 1997.
Mogul, Jeffrey C., Roy Fielding, Jim Gettys, and Henrik Frystyk: RFC 2145 Use and Interpretation of HTTP Version Numbers, May 1997.
Mogul, Jeffrey and Paul Leach: RFC 2227 Simple Hit-Metering and Usage-Limiting for HTTP, October 1997.
Dierks, Tim and Christopher Allen: RFC 2246 The TLS Protocol Version 1.0, January 1999.
Berners-Lee, Tim, Roy Fielding, and Larry Masinter: RFC 2396 Uniform Resource Identifiers (URI): Generic Syntax, August 1998.
Goland, Y.Y., E.J. Whitehead, A. Faizi, S.R. Carter, and D. Jensen: RFC 2518 HTTP Extensions ...