Measuring e-business Web Usage, Performance, and Availability

Measuring e-business Web Usage, Performance, and Availability

by Morten Moeller, Claudio Cicaterri, Anja Presser, Meiji Wang
Released September 2003
Publisher(s): IBM Redbooks
ISBN: None

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

How profitable (or successful) is your e-business investment?

How effective is your e-business at attracting new customers and retaining existing ones?

What is the availability of your e-business Web server infrastructure and performance of your Web transactions?

These questions, which are critical in measuring e-business success, are both behavioral and operational in nature. It is necessary to measure both e-business and IT metrics, which are closely linked, and have a direct effect on each other. For example, a spike in web traffic (or a single hit for that matter) has a direct effect on server load and the systems that process the transaction. Therefore, it is critical to analyze each of these metrics and draw correlations between them.

This IBM Redbooks publication describes the value of Tivoli’s e-business management solutions for the Web. It will provide practical guidance on installation and implementation and on how the individual solutions operate in tandem, giving you the whole picture of your Web application’s health and effectiveness. The information in this book is structured to provide valuable information to IT decision makers as well as Web administrators and systems management specialists dealing with the day-to-day care of the e-business infrastructure.

Table of contents

  1. Figures (1/2)
  2. Figures (2/2)
  3. Tables
  4. Notices
    1. Trademarks
  5. Preface
    1. The team that wrote this redbook
    2. Become a published author
    3. Comments welcome
  6. Part 1: Management overview
    1. Chapter 1: Evaluating the business value of your e-business Web sites
      1. Why have a Web presence?
      2. Why monitor Web traffic and behavior?
      3. Analyzing traffic and usage
      4. Monitoring the performance of transactions
      5. Business transactions
      6. e-business applications: complex layers of services (1/3)
      7. e-business applications: complex layers of services (2/3)
      8. e-business applications: complex layers of services (3/3)
        1. Managing e-business applications
        2. Architecting e-business application infrastructures
      9. Tivoli product structure
    2. Chapter 2: Web analytics
      1. Measuring Web traffic (1/3)
      2. Measuring Web traffic (2/3)
      3. Measuring Web traffic (3/3)
        1. Why Web metrics are important
        2. Web metrics delivery methods
        3. What to do with your data
        4. Conclusion
    3. Chapter 3: Tivoli e-business management solution architecture
      1. Tivoli e-business management overview
        1. e-business infrastructure and application systems
      2. Managing e-business applications using Tivoli (1/2)
      3. Managing e-business applications using Tivoli (2/2)
        1. e-business infrastructure management using Tivoli
      4. Tivoli Web Site Analyzer (1/3)
      5. Tivoli Web Site Analyzer (2/3)
      6. Tivoli Web Site Analyzer (3/3)
        1. Complementary data collection methods
        2. Open data management
        3. Comprehensive e-business analysis possibilities
        4. Other feature benefits
      7. Inside Tivoli Web Site Analyzer
        1. Base component overview
        2. Data flow
      8. Preparing for Web analytics
  7. Part 2: Deployment and management
    1. Chapter 4: Data sources for Tivoli Web Site Analyzer
      1. Web server log files (1/4)
      2. Web server log files (2/4)
      3. Web server log files (3/4)
      4. Web server log files (4/4)
        1. Log file formats
        2. IBM HTTP Server for Windows NT
        3. Using IBM HTTP Server V5R3M0 for OS/390® log files
        4. IBM WebSphere Edge Server log files
        5. IBM Tivoli Access Manager for e-business log files
        6. WebSphere Portal Server
        7. Microsoft IIS Server log files
      5. WebSphere Application Server ALS (1/3)
      6. WebSphere Application Server ALS (2/3)
      7. WebSphere Application Server ALS (3/3)
        1. The Analytic Logging Service
        2. WebSphere Application Server ALS record format
        3. ALS persistence
        4. WebSphere Application Server ALS programming sample
      8. WebSphere Personalization Server
      9. WebSphere Commerce Suite Version 5.1 database format
      10. Incorporating non-HTTP data
        1. Correlation
        2. Logging Web Application Data using Web Tracker
    2. Chapter 5: Extending your monitoring with Web Tracker
      1. Web Tracker (1/2)
      2. Web Tracker (2/2)
        1. What is Web Tracker?
        2. Where to use Web Tracker
        3. Benefits of Web Tracker over log file analysis
        4. Information collected and reported by Web Tracker
        5. Site enablement guidelines
      3. Enabling Web Tracker (1/4)
      4. Enabling Web Tracker (2/4)
      5. Enabling Web Tracker (3/4)
      6. Enabling Web Tracker (4/4)
        1. The Web Tracker Enablement Tool
        2. Starting Web Tracker data collection
      7. Web Tracker in detail (1/4)
      8. Web Tracker in detail (2/4)
      9. Web Tracker in detail (3/4)
      10. Web Tracker in detail (4/4)
        1. Web Tracker data transmissions
        2. Records sent and received
        3. The Web Tracker run-time environment
        4. Advanced topics
        5. Migrating to Web Tracker 4.2
      11. Web Tracker coding basics (1/3)
      12. Web Tracker coding basics (2/3)
      13. Web Tracker coding basics (3/3)
        1. Coding for JavaScript disabled browsers
        2. Coding for JavaScript enabled browsers
        3. Coding for both JavaScript disabled and enabled browsers
    3. Chapter 6: Installing a full function Web site management solution
      1. Planning for Site Analyzer (1/2)
      2. Planning for Site Analyzer (2/2)
        1. Planning Site Analyzer roles
        2. Site Analyzer configuration
        3. Network placement
      3. Pre-installation tasks (1/3)
      4. Pre-installation tasks (2/3)
      5. Pre-installation tasks (3/3)
        1. Requirements for TWSA
        2. DB2 database considerations
        3. WebSphere Application Server considerations
        4. Additional pre-installation considerations
      6. Tivoli Web Site Analyzer installation (1/3)
      7. Tivoli Web Site Analyzer installation (2/3)
      8. Tivoli Web Site Analyzer installation (3/3)
        1. Automatic installation
        2. Manual installation
        3. Migration and uninstallation of Tivoli Web Site Analyzer
      9. Using Tivoli Web Site Analyzer (1/5)
      10. Using Tivoli Web Site Analyzer (2/5)
      11. Using Tivoli Web Site Analyzer (3/5)
      12. Using Tivoli Web Site Analyzer (4/5)
      13. Using Tivoli Web Site Analyzer (5/5)
        1. Starting Tivoli Web Site Analyzer
        2. Logging on to Tivoli Web Site Analyzer
        3. Tivoli Web Site Analyzer overview
        4. Add a new project
        5. Add Data Imports
        6. Creating a report
        7. The TWSA sample Web application YourCoHotel
        8. Get Help
    4. Chapter 7: Ensuring Web service provisioning
      1. Keeping Web and application servers online
      2. ITM for Web Infrastructure installation
        1. IBM WebSphere Application Server
        2. IBM HTTP Server
      3. Creating managed application objects
      4. WebSphere monitoring (1/2)
      5. WebSphere monitoring (2/2)
        1. Resource Models
        2. Tivoli Enterprise Console adapter
      6. Event handling
        1. IBM Tivoli Monitoring for Web Infrastructure events and rules
      7. Surveillance: Web Health Console
  8. Part 3: Monitoring Web sites
    1. Chapter 8: Ensuring Web site content compliance with company policies
      1. Web content analysis
      2. How content analysis works
      3. Defining the analysis parameters (1/2)
      4. Defining the analysis parameters (2/2)
        1. Web Crawler global setting
        2. Web Crawler report element setting
      5. Content analysis reports (1/2)
      6. Content analysis reports (2/2)
        1. Web Crawler setting
      7. What happens when you run the content analysis?
    2. Chapter 9: Monitoring Web traffic
      1. Usage analysis (1/2)
      2. Usage analysis (2/2)
        1. How the data is gathered
        2. Measurements for usage analysis
    3. Chapter 10: Turning data into information
      1. User communities of reports
        1. Web usage technical reporting
        2. Reports for Web masters
        3. Reports for the business office
        4. Reports for page designers
        5. Reports for marketing and sales
      2. How the data is gathered and measured (1/2)
      3. How the data is gathered and measured (2/2)
        1. Measurements for usage analysis
      4. Generating reports
        1. Reports and report elements and charts
        2. Standard report elements
        3. Customized report elements
        4. Combined reports
      5. Web site availability reports
        1. Broken links
        2. HTTP return codes
        3. Content availability tracking
      6. User agent information reports (1/2)
      7. User agent information reports (2/2)
        1. Browser Ranking
        2. Browser Trend
        3. Platform Ranking
        4. Platform Trend
        5. User Agent Ranking
        6. User Agent Trends
      8. User information reports (1/2)
      9. User information reports (2/2)
        1. User Trend
        2. New User Trend
        3. Repeat User Trend
        4. Unique Visitor Trend
      10. Web site activity reports (1/2)
      11. Web site activity reports (2/2)
        1. Total site activity
        2. Site activity trend
        3. Server Ranking
        4. Protocol Ranking
        5. Image Ranking
        6. The top list of Redbooks
      12. Web site standards compliance reports
        1. Pages with aggregate size over optimum
        2. Resources over optimum size
        3. Optimum resource number in a page
      13. Web site design effectiveness reports
        1. Where did users spend the most time?
        2. Pages accessed the most or least often
      14. Web site integrity
        1. URI availability summary
        2. HTTP error codes by browser type and platform
        3. Invalid access attempt
      15. User group information
        1. Where do my users come from?
        2. Organizations visiting the site
        3. Competitors visiting the site
        4. Determining visitor origin by subdomain
      16. Site activity distribution pattern
        1. Hits activities by hour of the day
        2. Sessions distribution by hour of the day
        3. Page view distribution by hour of the day
        4. Traffic volume (bytes) distribution by hour of the day
      17. Strategic alliances (1/2)
      18. Strategic alliances (2/2)
        1. Site referrals
        2. Referrals
        3. Top referring URLs
        4. Top referring subdomains
        5. Top referring Web sites
        6. Traffic trend for referrals
        7. Referrer host key/value pair ranking
        8. Referrer Host Key/Value Pair Trend
      19. User activity (1/4)
      20. User activity (2/4)
      21. User activity (3/4)
      22. User activity (4/4)
        1. Number of visits per user
        2. Number of hits per user
        3. Who viewed the most pages?
        4. Time spent by user
        5. Abandoned cart
        6. Shopping cart information
        7. Shopping cart information by using Data Integration
        8. Product display information
        9. Products looked at by user
        10. Shopping cart checkout information
        11. Time spent before check out
        12. First accessed page
        13. Order processing information
      23. Combined reports
    4. Chapter 11: Advanced reporting options
      1. Data transformations and the report database (1/3)
      2. Data transformations and the report database (2/3)
      3. Data transformations and the report database (3/3)
        1. Sessionization
        2. Categorization
        3. Aggregates
        4. Using sessionization, categories, and aggregates
      4. Customizing filters
        1. Define a filter
        2. Add a filter in project definition
      5. Using Tivoli Web Site Analyzer interactive tools (1/2)
      6. Using Tivoli Web Site Analyzer interactive tools (2/2)
        1. Page Inspector
        2. Path analysis
        3. Personalization Topic ranking
    5. Chapter 12: TWSA administration tasks
      1. Enable e-mail notification
      2. Expiring data
      3. Enabling Tivoli Web Site Analyzer security
      4. Publishing reports
        1. Publishing to the local host or a shared network drive
        2. Publishing to a FTP server
  9. Part 4: Extending Web analytics
    1. Chapter 13: Monitoring Web transaction performance
      1. TMTP architecture
        1. TMTP: Enterprise Transaction Performance
        2. TMTP: Web Transaction Performance
      2. Planning for transaction performance monitoring (1/3)
      3. Planning for transaction performance monitoring (2/3)
      4. Planning for transaction performance monitoring (3/3)
        1. Planning for ITM for Transaction Performance
        2. Transaction performance measurement tools
        3. Alerts and event management
        4. Integration with IBM Tivoli Monitoring Version 5.1.1
      5. Planning for the monitoring infrastructure (1/2)
      6. Planning for the monitoring infrastructure (2/2)
        1. Web site availability and real-time response times
        2. ARMing applications and alerting
        3. Fine-grained monitoring and performance breakdown analysis
      7. Implementing Enterprise Transaction Performance (1/2)
      8. Implementing Enterprise Transaction Performance (2/2)
        1. Product infrastructure
        2. Monitors
        3. Alerting interfaces
        4. Consoles
        5. ITM 5.1.1 Web Health Console installation
        6. Simulation engines
        7. Reporting interfaces
      9. Setting up Web Transaction Performance (1/2)
      10. Setting up Web Transaction Performance (2/2)
        1. Product infrastructure
        2. Monitors
        3. Alerting interfaces
      11. Consoles
      12. Reporting
        1. Reporting interfaces
    2. Chapter 14: Extending the solution
      1. Tivoli Enterprise Data Warehouse
      2. IBM Tivoli Service Level Advisor
      3. Integration of Tivoli Web Site Analyzer (1/9)
      4. Integration of Tivoli Web Site Analyzer (2/9)
      5. Integration of Tivoli Web Site Analyzer (3/9)
      6. Integration of Tivoli Web Site Analyzer (4/9)
      7. Integration of Tivoli Web Site Analyzer (5/9)
      8. Integration of Tivoli Web Site Analyzer (6/9)
      9. Integration of Tivoli Web Site Analyzer (7/9)
      10. Integration of Tivoli Web Site Analyzer (8/9)
      11. Integration of Tivoli Web Site Analyzer (9/9)
        1. Transferring TWSA data to the Warehouse
        2. Installing the Warehouse Enablement Pack
        3. Post-installation steps
        4. Source ETLs management
        5. Target ETLs management
        6. Timing considerations for the ITSLA environment
      12. Tivoli Enterprise Data Warehouse Report Interface (1/3)
      13. Tivoli Enterprise Data Warehouse Report Interface (2/3)
      14. Tivoli Enterprise Data Warehouse Report Interface (3/3)
        1. Set up the data mart
        2. Generate a report
    3. Chapter 15: Integration with WebSphere Commerce Server
      1. Collecting data from WebSphere Commerce Suite (1/2)
      2. Collecting data from WebSphere Commerce Suite (2/2)
        1. Logging the data in the Commerce Suite database
        2. Creating a log from the Commerce Suite data
        3. Which log files should we use?
      3. Analyzing Commerce Suite commands
        1. Defining Web application patterns
      4. What does user ID mean in Commerce Suite?
      5. Gathering shopping cart information
      6. Gathering product display information
        1. ProductDisplay command
        2. CategoryDisplay command
        3. Product and category information
      7. Gathering order processing information
      8. Commerce reports versus TWSA reports
    4. Chapter 16: Troubleshooting TWSA
      1. Analyzing the TWSA output file
        1. TWSA server initialization, settings, and status
        2. Status of data imports
        3. Report status
      2. Tivoli Web Site Analyzer configuration
        1. Tivoli Web Site Analyzer Admin module fails to initialize
        2. Tables are not created in the Admin database
        3. Tivoli Web Site Analyzer project DB2 access
      3. Performance of the analysis run
  10. Part 5: Appendixes
    1. Appendix A: HTTP status codes
      1. HTTP status codes
    2. Appendix B: Patterns for e-business
      1. Introduction to Patterns for e-business
      2. The Patterns for e-business layered asset model
      3. How to use the Patterns for e-business (1/2)
      4. How to use the Patterns for e-business (2/2)
    3. Appendix C: Improving DB2 performance
    4. Appendix D: FTP access through a firewall (1/2)
    5. Appendix D: FTP access through a firewall (2/2)
    6. Appendix E: Report element list
      1. Tivoli Web Site Analyzer Version 4.2 base reports (1/2)
      2. Tivoli Web Site Analyzer Version 4.2 base reports (2/2)
      3. TWSA 4.2 Tivoli Enterprise Data Warehouse reports
      4. TWSA 4.2 Web Tracker Reports
      5. TWSA 4.2 eCommerce reports
      6. TWSA 4.2 WebSphere Personalization reports
      7. TWSA 4.2 WebSphere Portal Server reports
    7. Appendix F: TWSA 4.2 database schema
      1. Schema overview
      2. Details I
      3. Details II
      4. Details III
      5. Details IV
      6. Schema table names and descriptions
      7. Aggregate content
      8. AggregateKey
      9. Aggregates
      10. AggregateStatus
      11. Browsers
      12. Calendar
      13. Categories
      14. Category patterns
      15. Category sets
      16. CategoryMap
      17. ColumnIds
      18. CookiesStatus
      19. Domain
      20. Entities
      21. EntityTraversal
      22. Hit_Facts
      23. HitFactsIds
      24. HitParms
      25. HTTPVersion
      26. ImportHistory
      27. JavaScriptStatus
      28. Key
      29. Key/value combo
      30. Key/value pair
      31. Linkage
      32. Log_file_status
      33. Logs
      34. Networks
      35. Parms
      36. Platforms
      37. Protocols
      38. Referrer
      39. ReferrerHost
      40. ReferrerURL
      41. ResetStatus
      42. Resources
      43. Result
      44. ReturnCodes
      45. SAVersion
      46. ServerNodes
      47. Servers
      48. Session_Facts
      49. SessionFactsIds
      50. SessionParms
      51. Subdomains
      52. TimeOfDay
      53. TimeSpan
      54. UserAgents
      55. Users
      56. Value
      57. Web nodes
    8. Appendix G: Web Tracker coding
      1. Hexadecimal equivalents for special characters
      2. Capturing application data
      3. Logging data with multiple flags
      4. Code sample: JavaScript enabled and disabled
    9. Appendix H: Service Management
      1. Service Management
      2. Service Support disciplines
      3. Configuration Management (1/2)
      4. Configuration Management (2/2)
      5. Help Desk
      6. Problem Management
      7. Change Management (1/2)
      8. Change Management (2/2)
      9. Software Control and Distribution
      10. Service Delivery disciplines
      11. Capacity Management (1/2)
      12. Capacity Management (2/2)
      13. Availability Management
      14. Cost Management
      15. Contingency Planning
      16. Service Level Management (1/3)
      17. Service Level Management (2/3)
      18. Service Level Management (3/3)
      19. Bringing it all together (1/2)
      20. Bringing it all together (2/2)
      21. The power of integration
  11. Glossary
  12. Abbreviations and acronyms
  13. Related publications
    1. IBM Redbooks
      1. Other resources
    2. Referenced Web sites
    3. How to get IBM Redbooks
      1. IBM Redbooks collections
  14. Index (1/5)
  15. Index (2/5)
  16. Index (3/5)
  17. Index (4/5)
  18. Index (5/5)
  19. Back cover

Product information

  • Title: Measuring e-business Web Usage, Performance, and Availability
  • Author(s): Morten Moeller, Claudio Cicaterri, Anja Presser, Meiji Wang
  • Release date: September 2003
  • Publisher(s): IBM Redbooks
  • ISBN: None