Professional Documents
Culture Documents
Agenda
Why Application Performance Monitoring/Management ? Introscope & Application Performance Management Architecture / How / What Introscopes Blame Technology An Introduction To .NET Monitoring Customer Experience Manager (CEM) Summary / Q & A
Todays IT Challenges
Web-Tier Application-Tier Database-Tier Mainframe-Tier
Shift to web based apps Quick time to market, increased importance and reliance Increased complexity N-tier environments, access from anywhere anytime Seas of data Overwhelmed by various alarms and health information Customer satisfaction, IT reports all is well, yet users are complaining how do you know Wasting resources Constant mis-diagnosis, false positives, finger-pointing, rework Do more with less Pressure to reduce operating costs and improve quality of service PROBLEM Inconsistent performance of business applications PROBLEM Lack of understanding of the business impact of an incident PROBLEM The time & resources to identify, isolate, and solve customer incidents
Whats
Siebel mainframe
Mainframe
response time?
Database
Web Services
Databases
SAP
Firewall
Portal
Mainframe
Router
Database
Web Services
Most web applications are made up on three tiers: Most web-based Front end client applications do NOT process much of the transaction, only presentation. When Middleware monitoring the (databases, client and the clients network it is Back ends transaction systems, and critical to focus on problems to you CAN control legacy systems) -- your own systems andinclude network. SOA architectures which Enterprise Services Bus (ESB) and Web Service layers, complicate the picture.
Identity Manager
Databases
Identity Manager
SAP
PSFT
Firewall
Portal
Mainframe
Database
Web Services
Databases
To solve this
Too Many EJB Calls?
HTTP Server
Application Server
Is it JDBC?
Transaction Server
CPU Overloaded?
Web Servers
Wheres the Problem? Application code? Hardware? Web App Server? Database Servers? Mainframes? Security Systems? Internet traffic? MQSeries
App Server
Wilys Business is Web Application Management (not just Java App Management)
Our goal is to manage all business-critical transaction-oriented
environment
Also monitors non-Java/.NET systems from the
V1.0 shipped in 1999 Currently shipping version V7.0 (GA in May 2006) 600+ worldwide customers
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 13
Authentication
Real time monitoring from end-to-end for ALL transactions Correlate actual user experience with application performance Predict problems before customers are impacted Quickly triage problems to improve availability & performance Monitor and document SLA performance Collaborate across IT and the Business to insure customer success
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 14
Customer Benefits
End-to-end transaction visibility into all transactions,
application environment
Deep visibility into each transaction across processes Capture 100% of performance data for SLA
15
problems occur
Overhead issues affect end-user performance Single console is not appropriate for collaborative
management
Require usage of different tools throughout the life
cycle
Generally require a framework with many
components
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 16
Introscope provides a common Language for Various IT Stakeholders to Manage and Solve Problems Together
Business-Facing Application Owner
Negotiate SLAs with Business Measure customer satisfaction and business processes Provide reports to Bus and Operations Management
Operations 24x7 live views of application P&A SLA monitoring Proactive incident detection
App Developer Deep views into web application Component-level blame Pinpoint root cause
Application Support Consistent, end-to-end view Evidence collection based on hard data Route problem to right person for fix
17
Identity Manager
SAP
Whats
Siebel mainframe
Mainframe
response time?
Database
Web Services
Databases
3rd
This picture applies to both Java-only & .NET-only environments except the Java environments are probably slightly more complex
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 18
And if you were to look inside the Java app SOA-based Java Web Apps are Complex
Highly componentized, distributed across your enterprise and connected to multiple back-end systems
Login JSP JNDI LDAP Server Account Info Servlet Account EJB Account Transaction Servlet WebSphere BI SAP, Siebel, PeopleSoft Database CICS/TuxedoConnector WebSphere MQ Connector CICS/IMS/Tuxedo
Login
Request Response
MQ Series
Sessions
JDBC Driver
APPLICATION
Request Response
Pools
Transaction
19
ASP.NET
SQL Server
Browser
Enterprises Services
Web Services
Directory Service
and imagine what happens when you have a heterogeneous environment with BOTH Java and .NET Web Apps
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 20
.NET APP
J2EE APP
SQL Server
05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00
% available
End-User App
Unavailable or Slow Available, Performant
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved.
80%
22
Only Wily Gives You Deep Visibility into Java/.NET Apps from the INSIDE to Predict, Diagnose and Record Performance in Real-Time
Introscope PowerPacks Databases, Web Services, Back-End Systems Availability, Performance, Errors, SLAs CA Network, Database, Systems, Workload, 3rd Party Applications
Identity Manager SAP
PSFT
Mainframe
Switch
Web Services
CEM Customer Experience, Transaction Success Rates, Failures, Errors, Defects, Scorecards, SLAs, Six Sigma Business Cost $$ and Impact
Introscope Availability, Performance, Failed TXs, Errors, SLAs Always-On Recording Transaction Tracing
Databases
23
Introscope Highlights
Wily is committed to enabling enterprises to put Java-based web applications into production quickly, and to keep them there
24 x 7 monitoring Incident detection & notification Rapid triage Root cause analysis Trend Analysis / Planning
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 24
25
26
27
For example: Many small DB calls => Death by thousand paper cuts
28
Introscope Highlights
Trend Analysis / Planning: Are we performing as well as 6 months ago?
Online Purchasing
Historical views using live dashboards Every transaction is stored for review
29
30
Additional Components
Web Services MQ Series / Tuxedo Portals (WPS) 5.02 and above. Integration (WBI, WLI, SAP Enterprise Portal) Web Servers (Apache, IIS, etc.) And others including: (z/OS, Oracle Databases, etc.)
31
Inside to Outside
Internal JVM View with No Source Code Changes
CICS / IMS / Tuxedo
Mainframe
Inside-to-Outside
Transaction Request MQ Series Third Parties
End-to-End
Response
PORTAL
Content
JAVA APPLICATION
APPLICATION SERVER
JVM AIX HP-UX Linux Solaris Windows OS/390
INTEGRATION
OS/400
z/OS
Java Community
CLASS
10100101 11101010 10010010 10100101 00010110
Probes Inserted
33
Managing Heterogeneous Apps with 1 Single Tool and 1 Single User Interface
Swing or Browser Workstations
Real-time, Historical, and Performance Alerting J2EE Applications
Java Agent
Application Server
Introscope Agents
JVM
.NET Applications
CLR
Agent
Historical Data
Introscope EPA
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 34
Advanced Metrics
35
pinger
Associated customizable
dashboards
Answers these questions Is it our application or the network? Is the problem between the browser and the app server? What are average response times for this URL? This IP?
36
Slow transaction
38
View detailed information about errors as soon as they happen and improve end user experience
You need the ability to detect and diagnose the causes of serious errors, which can prevent individual users from completing web transactions
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 39
ChangeDetector:
What change affected my App?
Graphic visualization of change events
Files (text & binary) Archives & JAR files Classes loaded into the JVM System properties Oracle Database tables Configuration of connected subsystems (via EPA)
performance metrics Type of change (addition, deletion, modification) Time of change Difference between versions (for text files) Hierarchical and historical views of changes Customized reporting
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 40
Isolate problematic individual transactions Analyze and pinpoint bottleneck for each Improve overall app performance From Browser to Back-end
HELP HELP
41
data required to manage applications In addition to Java Code Performance, this includes:
Process monitoring Disk Utilization CPU Etc. Log File Message counts and monitoring
42
LeakHunter
- Eliminating Production Memory Problems
App is Down Again!!! Server Ran Out of Memory
inside production apps 2. Pinpoint sources of leaks in app components and methods 3. Monitor life of all Java objects in memory 4. Isolate and remove leaks during stress testing
Restart App
24 Hours Later
43
Instance Counts
Monitor the life of all Java
Objects in Memory
Number of instances in memory at any given time
44
Introscope SmartStore Historical Repository captures all Metrics all the time.
Analysis of Historical Data available in Workstation Client and via Reports Historical Data available for ANY Introscope Metrics
JVM Heap Usage CPU and other Resources AppServer Resources Java code performance
Records 100% of performance data for problem solving, trend analysis and capacity planning
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 45
IT to Business
Technical Data & Business Views
CICS / IMS / Tuxedo
Mainframe
Transaction Request
PORTAL
Content
JAVA APPLICATION
APPLICATION SERVER
JVM AIX HP-UX Linux Solaris Windows OS/390
INTEGRATION
OS/400
z/OS
IT to Business
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 46
Production Hosting
Characterise runtime
load
Establish problem
process
48
+ +
Look for components down the hierarchy that are color coded according to weight. Drills down is used in many views, such as the Introscope Investigator and Transaction Tracer.
50
Look for the widest and deepest components when troubleshooting performance bottlenecks. This topographical view is the default Transaction Tracer view.
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 51
Network Time
52
53
Transaction Tracer shows the whole transaction from front ends to back end SQL interaction.
54
Transaction Tracer provides multiple views of same data. Tree view provides quick drill down.
55
Overview
The (Microsoft) .NET version
Browser Apps
ASP. NET
ServiceOriented Apps
Other Apps
More
ADO. NET
Product Architecture
J2EE Applications
Agent
Application Server
Introscope Agents
JVM
.Net Agent
.NET apps
CLR
Agent
NonJava Systems
Historical Data
Introscope EPA
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 58
.NET Agent
Web Application
Probes
.NET Agent
59
App Domain A
App Domain B
not link to EM
60
IIS Architecture
61
62
6 2 3
AutoProbe components
Environment Variables
5 1
AutoProbe locates the Agent in the GAC and loads it 5. The Agent finds its profile from environmental variables 6. Each application is instrumented according to PBDs
4.
.NET Agent
CLR Environment
Windows OS
63
.NET
64
version:
Thus similar types of metrics measured for .NET applications
Average Response Time, Concurrent Invocations, Errors Per Interval, Responses per Interval and Stall Count Compatibility with Introscope 7 Frontend/Backend scheme: Data reported about frontends, application health tracked in Application Overview grid ADO.NET data layer tracked in Backends category .NET Agent supports tracking of Web Services layer
65
Application-specific Metrics For a Particular ASP.NET Application. System-level Metrics (CPU, CLR, ASP.NET process, etc) reported in PerfMon, GC Heap and Sockets categories
{
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 66
resource categories:
J2EE Application
JSP, Servlets
.NET Application
ASP.NET
Notes ASPX user-facing components listed SQLAgent-reported data appears under Backends category All Windows-reported infrastructure metrics appear here
JDBC
CPU
67
68
ASPX Metrics
Listed under ASP.NET category:
Metrics reported here represent user-facing aspects of page as well
as code-behind logic
69
| | Called Backends
70
monitored by Agent:
Appears under Web Services
71
72
Triage-oriented Metric Groupings and Alerts Detection and Triage Dashboards, and Application and Database Detail Dashboards
73
74
WebView) PowerPack for .NET CLR Web Services Manager for Microsoft .NET
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 75
Continuous Improvement
Improve performance, consistency Reducing risk of changes Greatest benefit to the business
Actual customers experience Reports in business terms $ Unique customer information API
Accurate communication Improved alignment with business Analytics and custom reporting
77
Shift to web based apps Quick time to market, increased importance and reliance Increased complexity N-tier environments, access from anywhere anytime Seas of data Overwhelmed by various alarms and health information Inaccurate, inconsistent data IT reports all is well, yet users are complaining Wasting resources Constant mis-diagnosis, false positives, finger-pointing, rework Do more with less Pressure to reduce operating costs and improve quality of service
PROBLEM Inconsistent performance of business applications PROBLEM Lack of understanding of the business impact of an incident PROBLEM The time & resources to identify, isolate, and solve customer
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 78
incidents
TESS
Intranet / Internet
App Tier
Routers
Firewalls
Switches
LDAP
Database Tier
80
CEM Architecture
Low Risk, Zero Overhead
Router Network
Firewall
Switch
Load Balancer
Database Tier
Mainframe Tier
Customers
Production Out-of-path
Mirrored Port for XX Application Web VLAN (i.e. Cisco SPAN Port)
Management VLAN
TI M
Real-time copy of production customer traffic Mirrored port of the application VLAN Core Ethernet Switch, Load Balancer, Network TAP
TE S
81
CEM - Deployed
Production
Bob Wright Process Order Slow Transaction Time = 22.8s 06.01.05 8:59:48am
Mirrored Port for XX Application Web VLAN (i.e. Cisco SPAN Port)
Identifies and Measures Customer Transactions Behavior and Content Defect Detection Correlation of Defects into Incidents Business Prioritization and $$ Impact Analysis Evidence Collection of Infrastructure State (performance, utilization, configuration, logs) Incident Forwarding into Existing Systems and Procedures Unique Customer Transaction Repository (Current and Historical Reporting, Scorecards, Analytics)
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved.
CEM Incident: Process Order Slow Time > 5.0s 256 Customers, 22 Premier Time: 06.01.05 8:59am Duration: 35minutes Incident cost: $278,00 Evidence Collection: Network, Web, App, DB,MF
82
CEM - Features
Transaction Impact AnalysisTM
Production customer transactions Customer / user identity by name Business impact $$ analysis
CE M
CEM Platform
(Transaction Impact AnalysisTM)
Open API
NOTE: In most J2EE applications a Business Transition and a Transaction are the same
Copyright 2006 CA and Wily Technology, Inc. All Rights Reserved. 84
servers
No IP address on the monitored network Encrypted using AES Does NOT terminate sessions
transactions
Stores NO personal information (passwords, SSN, account balances, etc.)
86
TESS
Intranet / Internet
App Tier
Routers
Firewalls
Switches
LDAP
Database Tier
87
CEM
Siebel Order Provisioning Login Execute Login (SWE) & 14 Components Scripts
88
89
Proactive Management
Pinpoints bottlenecks in app, app server, backend systems and environment, and solves customer problem
90
For The Introscope & CEM Demo, please visit our stand.
91
Q&A
Any Questions ?
92