Agile Business Webcast

Test, Validate & Virtualize for Agile SOA

Moderator
Patrick Egan - Publisher – Agile Journal

Speakers
John Michelsen - Founder and Chief Scientist of iTKO LISA
Zach Nies - Vice President, Products Rally Software

© CMC Media 2008

John Michelsen
Founder and Chief Scientist of iTKO LISA, an
automated SOA software testing and virtualization
company. John has more than 15 years of high-
level enterprise development experience, as a chief
architect of development teams and as an
executive in designing, developing, and managing
large-scale, object-oriented solutions in traditional
and network architectures. He is the chief architect
of iTKO's LISA automated testing and virtualization
product, and a leading industry advocate for
software quality, with several published articles and
speaking appearances at technology conferences
under his belt.

© CMC Media Inc. 2008

Zach Nies
Zach Nies brings close to 20 years of engineering and product
development experience to Rally’s innovative products. Prior to
joining Rally, Zach served as Principal Architect and Director of
Systems Architecture for Level 3 Communications and founded a
small start up which was quickly acquired by the publicly traded
Creo, Inc, now a division of Kodak. He also served as Chief Software
Architect at Quark, where he provided the overarching technological
vision for the company. Zach’s product vision has won numerous
industry awards, including Jolt Product Excellence awards, Seybold
HotPicks and the prized MacWorld Best of Show. Zach has served
on standards bodies such as the W3C's HTML working group and
currently serves on the board of directors for Agile Denver.

At the age of 13, Zach began commercially publishing software and,

at age 16, started a successful consulting business. A Boettcher
Scholar, Zach received his BS with distinction in Computer Science
Engineering from the University of Colorado at Boulder. He spends
his spare time tuning his golf swing and spending time with his
family.

© CMC Media Inc. 2008

Rally Perspective

Zach Nies – Rally Software

₋ Vice President, Products

4
Rally – The #1 Agile Provider
∙ #1 On-Demand Tool
₋ 900 customers, 20,000 projects and 35,000 users across 50 countries
and three-time JOLT Product Excellence awards
₋ Preferred provider for the large enterprise by Trail Ridge Consulting
independent survey in 2007
∙ #1 Training Services for Agility
₋ World’s largest source for Agile training with 90 expert trainers and
2,500 students trained
₋ Leading the forefront of Agile knowledge – more than 100,000
downloads of white papers, articles and webinars
∙ #1 Community for Collaboration
₋ Largest online community dedicated to advancing all aspects of
software agility with more than 3,300 members
₋ Industry-disrupting Rally User Community includes a product backlog
that is prioritized by customers

5
Thesis and Agenda

∙ Software can be delivered faster, with higher

quality, when automation and lean thinking are
applied to the development cycle.

∙ Agenda
₋ Cycles and Feedback – Lessons from Lean
₋ Short, Time-Boxed Development
₋ Automation and Visibility

6
Cycles and Feedback
Lessons from Lean
Improving Cycle Times

∙ Limit work to capacity

∙ Even out the arrival of work
∙ Minimize the number of Things-in-Process
∙ Minimize the size of the Things-in-Process
∙ Establish a regular cadence
∙ Use pull scheduling

Poppendieck, Mary and Tom. “Managing the Pipeline.” Poppendieck.LLC. 7 Oct 2007.
http://www.poppendieck.com/pipeline.htm.

8
 Cycle Times and Going Faster

45
Cycle Time as a Function of Utilization and Batch Size
40
Cycle Time (hours)

35
Large Batches
30 Medium Batches
Small Batches
25

20

15

10

0
10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
©2003 Poppendieck.LL

Poppendieck, Mary and Tom. Lean Software Development, An Agile Toolkit. Boston: Addison-Wesley,
2003.

9
Development Cycle

10
Reduce Batching & Queuing

11
By Improving Your Automation

AUTOMATION

12
Short, Time-Boxed Development
Traditional Software Development
Long, Large, Linear, Late

Time to 12 to 36 months
Market

Lifecycle Define Code Test Deploy

Tech Test Funct

Deliverable MRD PRD Code Doc Train
s
spec plan test

14
Agile Software Development
Iterate, Increment and Innovate

Time to 1 to 6 months Waterfall 12 to 36 months

Market

Waterfall Waterfall
Lifecycle
test deploy

Deliverable Working, tested code on short cycles Waterfall documentation

s

15
Working in a Time-Box

Release Backlog

Fixed Resources
Story Card A
Story Card B

Review
Plan
Story Card C
Story Card D
Story Card …

Fixed Time
Define (Iteration)

Develop

Accept

16
Automation and Visibility
Code Level Quality Feedback

18
Automated Functional Quality Feedback

19
Manual GUI & Regression Quality
Feedback

20
Visibility from Rally

21
How Much Faster?
37% Faster Time-to-Market

23
 Test, Validate & Virtualize
for Agile SOA

John Michelsen
Founder & Chief Geek
iTKO LISA
September 23, 2008

24 © 2008, Interactive TKO, Inc. | PROPRIETARY /

24 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM
CONFIDENTIAL
 iTKO: Our Ecosystem
Customers

Technology Partners Delivery Partners Awards

TestCenter

Everyone should own quality™.

25 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM
 Business Trends are Driving a
Major Shift in IT Environments
 Business Initiatives • IT Initiatives
 Agility • SOA
 Cost Reduction • Outsource/Offshore
 Globalization • Agile Development
 Mergers & Acquisitions • BPM
 Compliance • Leverage and Extend

Composite
Mainframe Client/Server Applications/
SOA

1980 … 1985 … 1990 … 1995 … 2000 … 2005 … 2010 …

26 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM

 The Goal of Agile SOA
Minimize Business Risk inherent in making
Frequent Changes to Complex IT
Environments
SOA & Composite
Apps
High Complexity A strong collaborative
methodology delivers:
Increasing Complexity in the IT

High Change

Client/server
 Shorter Time To
apps
Market
 Reduced Failure
Low Rate
environment

Complexity  Faster Time To

Low Change Recovery
Mainframe / Web
Packaged applications  Lower Maintenance
Increasing rate of change in applications & Cost
workflows
27 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM
 Risk Factors for SOA

 Inadequate Testing: Traditional testing techniques cannot

automate testing against component and middleware-based
workflows
 Unintended Consequences: Individual components and
technologies are changing at their own pace and can create
severe issues within business processes
 Lack of Controls: Governance techniques to dictate
standards may be useless due to inability to enforce policies
 Dependency on Constrained Systems: Access and
capacity constraints on key systems reduces agility, and
increases dependencies and costs between teams

28 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM

 Siloed Tests in the SOA Lifecycle

Agile Integration QA/QE Teams Operations

Developers Teams Teams
1.2s

Functional & UI
Limited smoke “Acceptance” Performance
testing at tests, manual Testing &
Unit Tests assembly scripts Monitoring

What are the constraints that keep

us from collaborating in a more
parallel way
for Agile SOA?

29 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM

 Agile SOA takes Collaboration
Developers
unit test
components and
jump-start QA
with testability
Business Analysts
outline business
processes as „not
implemented‟
test cases

QA expands dev tests

and create functional
and load tests for
integration

Support rapidly
debugs
SLA or Policy issues
and communicates
appropriately

Production tests in
deployment and report
issues to support

30 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM

 Collaboration at Business Process level

31 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM

 Team to Team Collaboration

Productio
Production
n
Continuous
Validation

Pre-

Continuous SOA Test

Staging
production
Continuous
Regression
Testing
Test Bed
QA/QE Test Bed

Platform
Developmen
t Dev Build
Dev Build

Component/
Service
Teams Product Component Product Component

32 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM

 Complete SOA Testing - Simplified

Presentati
on Layer web UI Swing UI web 2.0 U

Service/Proce
ss Layer Java BPM CORBA Web J2EE
Service

Integration
Layer Web
Batch ESB RMI Custom
Feeds Service

Data/
Applications File Packaged Database Custom Legacy
System Apps Apps
33 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM
 Validating Complex, Distributed Systems

3 4
CORBA
App Database

2 Business
5 Process App
Ordering A
Swing App
1 6 Business
Process App
B

App Server Additional

EJB, WS, Apps Now &
POJO Future
8
Processing ESB
Web App
9
Problem may
7
Error in message
not appear for layer
end users
Problems will not
appear in XML
Database from SOAP

34 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM

 Contention for Shared Resources

 Live services are not always available for dev & testing
 Administrators control or prohibit access to prevent overload
and downtime
 Multiple dev & test teams create scheduling conflicts for
access to key systems
SOA Development =
Constrained by Access
Traditional Dev & QA = Mainframe
Centralized Control, Longer
Cycles IT Ops control
Mainframe

Live or Synthetic
Transactions
Client
Dev team test team
Dev & Test teams
35 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM
 Dependencies in Development Cycles

Conventional “Waterfall” development cycle…

PROJECT TEAM
Define Develop Test Integrate Deploy

Delivered
Functionality

Attempt to break up SOA development to distributed teams

Team1 Completed

Dependency
Team2 Completed Delivered
Functionality
downtime Some
Dependency
Completed
improvement,
Team/QA3
but
downtime
Dependency
dependencies on
Tested finished services
Integration
downtime still limit agility

36 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM

Expense of Test Data Creation
Connect 

Test Context
i Yo
T ur
K  Gather info Sy
O st
Invoke  e
L m
I  Get response
S
Steps
A 

React 

i Connect  Yo
T ur
K  Gather info Sy
O st
Invoke  e

Service Metadata
L m
I  Get response
S
Steps
A 

React 

Test i
T
K
O
Connect 

 Gather info
Yo
ur
Sy
st

Process
Invoke  e
L m
I  Get response
S

Transactional Data
Steps
A 

React 

i Connect  Yo
T ur
K  Gather info Sy
O st
Invoke  e
L m
I  Get response
S
Steps
A 

Customer Data
React 

• Creating realistic, repeatable test scenarios for

SOA represents a huge data maintenance effort
• Changing behavior of services makes test data
37 brittle
© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM
 Virtualization Example
Eliminating Dependency on Live Apps, Data & Components

CORBA
Load & App Database
Performance
Testers
Business
Process App
Ordering A
Swing App
Business
Process App
B

App Server Additional

Component EJB, WS, Apps Now &
Developers & POJO Future
Testers
Processing ESB
Web App

LISA VSE
Database

38 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM

 Performance Management in SOA requires
Collaboration

Without Component-Level Performance Testing

Add more Hardware!
Verify
SLA Test: Test
2.1 seconds 4.0 3.2
Lookup
Seconds Seconds
Solution
Quote

Timeline 8 mo. 9 mo. PR

With Earlier Component-Level Performance Testing, Deliver with Les

Verify 0.5s 0.3s 0.3s

Lookup 0.5s 0.5s Test:

2.1
Seconds
Quote 1.9s 1.2s 1.2s
Solution

39 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM

 Agility with Validation & Virtualization

Data Svc Completed

OrderMgmt Completed Delivered Original SOA Conventional

Functionality Delivery Date Delivery Date

PartnerPortal Completed

downtime Time saved

Tested
Integration/Perf.
downtime

 Team producing a service can provide a Virtual Service

earlier in development to allow earlier access by other
dependent teams
 Team consuming a service can capture and model a current
or incomplete Service as a Virtual Service
40 © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL. WWW .I TK O.COM
 iTKO: Our Solution - LISA

• Constraint
Simulations

• Eliminates
• Complete Dependencies

• Collaborative • Complete
Environment
• Extensible
Virtualiza • Supports Load
Testing
tion • Pass thru mode

Validation
• Continuous

• Functional Monitoring

• Policy Validation

• Proactive Alerting

41 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM

 Summary: iTKO LISA

 Complex SOA Dependencies and Rate of Change are

causing Increase in Business Risk
 iTKO LISA can help in minimizing this Risk through Best
Practices and Technology

• For more info on LISA‟s SOA

Testing, Validation &
Virtualization capabilities:
• Download Resources:
http://www.itko.com
• John‟s Blog: http://blog.itko.com
• Email: info@itko.com
42 © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL WWW .I T KO .C OM
Questions and Answers

Please post your questions now using

the “Ask a Question” box
on left side of the screen

View other Webcasts in the Series at www.cmcrossroads.com/wc

© CMC Media Inc. 2008