Professional Documents
Culture Documents
CHICAGO
Hexaware Welcomes You to QUEST 2016!
Whats INSIDE Enterprises are looking to increase agility and performance in the IT organizations to maintain
their competitive edge through adoption of devops, agile delivery models, shift left focus and are
5 Managers Workshop embracing digital technologies for their business process transformation. With this, traditional
Quality Assurance methodologies are also undergoing a rapid disruption. The existing themes
6 Networking Events of independent testing, sequential testing life cycle and Testing COEs are evolving now into
12 Full-Day Classes collaborative testing services, business assurance and on-demand Testing as-a-service themes
with innovative commercial models linked to business outcomes.
14 Half-Day Tutorials
The focus on extreme automation, omni-channel support, consistent user experience and speed
18 Keynote Presentations with quality is driving QA organizations to create new service offerings, partner with multiple
25 Hotel Map product/ solution providers to provide an integrated QA platform and leverage the digital platform
to enable significantly faster time to market at a lower cost of ownership with the expectations of
27 Quest at a Glance zero-defect delivery.
28 Training & Certification There has never been a more dire need to redefine the role of QA and to re-skill QA consultants
Prep with multi-functional skills, to provide the requisite Digital Assurance to our clients.
29 EXPO Talks QUEST 2016 provides an excellent opportunity to participate in this phase of QA revolution and to
32 Early Bird Sessions & share and discuss different perspectives on the way organizations and practitioners are painting
Panel Discussion the canvas of testing services, while trying to re-define the QA horizons as they see it.
34 Presentations/Workshops Welcome to QUEST 2016, a must-attend conference that provides a unique platform for IT
professionals, SMEs, service providers, and product vendors to discuss the shift left within the
47 Sponsors & Exhibitors software development process to build in quality. Continue being a thought leader in the testing
and QA domain and know how your teams can stay relevant for the future, by participating in the
discussions on diverse breath-taking strategies for steering QA into the new frontiers of the Digital
world to ensure customer delight and maximize the business outcomes.
Tony Mohanty
Global Head, Digital Assurance Services
Hexaware Technologies Limited
Featured Articles
ZAP, Youre QA Team Leader! How to Build a High Performance Team
By Rebecca Staton-Reinstein, PhD, Advantage Leadership, Inc. ............................................... 8
Why QUEST?
The QAI Global Institutes Quality Engineered Software and Testing Conference (QUEST) is a week of classes, tutorials, educational
sessions, hands-on workshops, discussion groups, and networking events for IT professionals from around the world. QUESTs unique
learning opportunities address high interest topics and aids IT professionals in increasing their knowledge and skills in this dynamically
changing industry.
Prep class for Certified Software Tester Tools panel and 4 tools roundtables
(CSTE)
Exhibitor EXPO and Talks (2 Days)
Prep class for Certified Software Quality
Analyst (CSQA) Exhibitors to browse
Full practice tests for CSTE and CSQA 16 EXPO Talk products/services
demonstrations
SPONSORS
Participating Companies:
Why Attend
QAI Global Institutes studies show that if an IT organization
forms an internal team to develop a solution to a current Carolyn Swadron Chris Lawson Angela Dugan Paul Herzog
challenge, the cost to the organization can range from $10,000
to $50,000. By attending the Managers Solutions Workshop you
will get solutions to your work challenges at a fraction of this cost,
plus connect with peers who can be contacted for advice in the
future.
Workshop Format
Prior to the Managers Solutions Workshop, participants complete
a survey about their current challenges. These challenges are
consolidated into a list of potential topics, which are ranked in Nancy Kastl Shaun Bradshaw Beth Wisdom
order of importance to the workshop participants. Four to six
challenges become the agenda for the workshop.
Testimonies
Each challenge is introduced to the workshop participants, The Managers Workshop is a valuable way to share your
who then break into small work groups. Using the QAI Global lessons learned, current needs, concerns, and challenges. I
Institutes problem-solving approach, the work groups define highly recommend attending and look forward to returning next
the challenge and develop potential solutions based on their year.
collective experiences and shared knowledge. Each group
selects one of their potential solutions and defines how to Well chose and well balanced selection of topics presented. A
tactics for the solution. Each group presents their proposed nice diverse group of attendees. Well worth the time. Thanks.
best solution which is critiqued by the workshops leaders and
guest industry experts. Additional time is spent by the guest An awesome lineup of guest experts! Great venue!
industry thought leaders to share their solutions and answer I love the excellent practical experience that I can actually
specific questions from the workshop participants. All workshop implement! Very nice.
participants are given opportunities throughout the workshop to
bring their specific challenge before the group to ask for friendly Dont miss this great opportunity to be part of a select group of
group advice. Participants will leave the workshop with a series managers and industry thought leaders who will aggressively
of potential solutions to todays quality challenges. tackle todays most pressing quality issues!
**The Managers Solutions Workshop is an entirely independent function of the QUEST Conference. Prior registration is required to attend.**
Opportunities to Connect
Managers Workshop Connection Dinner
Monday, April 18th ~ 5:30 - 8:30
Hosted by Tom Ticknor, QAI COO and Nancy Kastl, Quest Conference Chair
Reserved for the attendees of the Managers Solutions Workshop, this dinner event provides
an opportunity to continue discussions from the workshop and connect with your peers, the QAI
faculty, and thought leaders in a more informal setting. This evening outing is an ideal forum for
networking as well as sharing and exchanging ideas and experiences.
Welcome Reception
Tuesday, April 19th ~ 4:30 - 6:00
Sponsored by
This reception is open to all conference attendees and is included in the registration fee. This
event provides an opportunity to meet fellow conference attendees in an informal setting with
appetizers, drinks, and raffles. Information will be provided to help out-of-town guests become
familiar with the Chicago area.
Sponsored by
Join tap|QA and your fellow attendees for a spectacular private event at the
Chicago House of Blues. This notoriously cool venue is located in historic
Marina City Complex, downtown along the Chicago River. You can let loose
after a day of education at Quest in one of the windy citys premier music
venues. Attendees will enjoy dinner and live music.
The events live entertainment will be provided by the Gina Glocksen Band.
Gina Glocksen is best known as a top finalist of the 6th season of American
Idol. Ginas musical influences and styles range from rock, performing pop,
country and hip-hop favorites in her live show.
EXPO Reception
Thursday, April 21st ~ 5:00 - 6:30 PM
Sponsored by EXPO Exhibitors
The closing event of the Exhibitors EXPO is a reception open to all conference attendees. This
is a great opportunity to meet with the exhibitors in a social setting and to network with fellow
conference attendees. The main event at this reception will be the raffle of exhibitors prizes.
There is also surprise entertainment planned for this reception!
Average leaders focus on results...Good leaders focus on... Ten Dos and Donts of Engaging and Motivating People
behaviors that will get the results...great leaders focus on...emotions
People are coin operated! Barry Gibbons, former CEO, Burger
that will drive these behaviors. Hitendra Wadhwa King
QA managers often start with no experience. One day youre a highly People need to be rewarded with money - a powerful symbol of the
competent technical person; the next youre in charge of people and at a value exchange between company and employee. You cant just hand
loss. Youre told to continue technical work while managing your team. out pounds, dollars, rubles, rupees, or Euros every day. Every QA team
Poor IT results from this tradition are well documented. leader has an infinite supply of highly effective, nonmonetary motivators
that can be quite powerful day-to-day.
Break the pattern. Learn great management skills. Forget titles. Use
practical, proven solutions to get results your management requires.
DELEGATION DOS DELEGATION DONTS
These are survival and thrival skills in todays global, do-more-with-
less business culture. DO place motivation in context of your strategic, DONT expect the random atta boy to have an effect
operational, or project plan on performance
Start with a solid plan and Delegate, Motivate, and Coach for results.
DO describe positive and corrective feedback DONT say, Nice report. Person doesnt know what
specifically. to repeat.
SPR.CO M
Quest Advertisement.Finalai.pdf 1 1/8/2016 9:47:02 AM
Hard
C
things
made
M
CM
easy with
MY
m
CY
. co
CMY
y x
en
K
AscentialTest ww
w.z
e
The daily stand-up meeting is the easiest Agile practice to 6. Make sure the meeting stays crisp. Stand-up meetings by
adopt and the easiest to get wrong. Distributed teams, teams definition are short and to the point. The team needs to ensure
where one or more team members are in a different location, that the meeting stays as disciplined as possible. All team
present several challenges, including time zones, accents, members should show up on time and be prepared to discuss
organization affiliation and sometimes language. Distributed their role in the project. Discussion includes the willingness to ask
Agile teams require a different level of care and feeding than a for help and to provide help to team members.
co-located team in order to ensure that they are as effective as 7. Use a physical status wall. While the term distributed
possible. This is even truer for a team that is working through screams tool usage, using a physical wall helps to focus the
their forming-storming-norming process. Core to making Agile- team. The simplicity of a physical wall takes the complexity of tool
as-framework work effectively are the concepts of team and usage off the table so the focus can be on communication. Use
communication. Daily stand-up meetings are one the most of a physical wall in a distributed environment will mean using
important communication tools used in Scrum or other Agile/Lean videoconferencing to show moving tasks on the wall (a picture
frameworks. Techniques that are effective in making daily stand- can be provided to the team after). If videoconferencing is not
ups work for distributed teams include: available, use a tool that EVERYONE has access to. Keep tools
1. Deal with the time zone issue. There are two primary options as simple as possible.
to deal with time zones. The first is to keep the team members 8. Dont stop doing stand-ups. Stand-up meetings are a critical
within three or four time zones of each other. Given typical communication and planning event, not doing stand-ups for a
sourcing options, this tends to be difficult. A second option is to distributed team is an indicator that the organization should go
rotate the time for the stand-up meeting from sprint to sprint so back to project manager/plan-based methods.
that everyone loses a similar amount of sleep (share the pain
option). One usable solution that can be tried when distributed Like any other distributed team meeting, having good
teams cant overlap is to have one team member (rotate) staying telecommunication/video tools is not only important, it is a
late or coming in early to overlap work times. prerequisite. If team members cant hear each other, they CANT
communicate.
2. Identify and attack blockers between stand-ups. Typically,
on distributed teams, all parties will not work at the same time. The practice of stand-up meetings is one of the first techniques
Team members should be counseled to communicate blockers most organizations adopt when they begin to implement Agile
to the team as soon as they are discovered so that something regardless of whether the team is co-located or distributed.
discovered late in the day in a one-time zone does not affect Because of the simplicity of the technique, organizations forgo
the team in a different time zone that might just be starting to coaching or training on how to do stand-up meetings. They
work. One group, I worked with had stand-ups twice each day rely instead on the best efforts of everyone involved. Without
(at the beginning of the day and at the end of the day) to ensure coaching, stand-up meetings can be implemented poorly, robbing
continuous communication. the organization of the benefits of the technique.
3. Push status outside the stand-up. A solution suggested by Matt The daily stand-up meeting IS the easiest Agile practice to adopt
Hauser is to have the team answer the classic three questions and the easiest to get wrong. The stand-up meeting provides
(What did you do yesterday? What will you do today? Is there teams with a lightweight tool to re-plan and coordinates activities
anything blocking your progress?) on a WIKI for everyone on the on a daily basis. Doing a daily stand-up well helps to ensure that
team to read before the stand-up meeting. This helps focus the a team cant get dramatically off course without notice. While
meeting on planning or dealing with issues. the process is easy to understand and to deploy, a good stand-
up requires care and feeding so that bad habits dont develop.
4. Vary the question set being asked. The process of varying the Organizations should have a coach participate on a regular basis
question set keeps the team focused on communication rather so that specific problems are exposed. The coach can provide
than giving a memorized speech. For example ask: feedback and constructive criticism to help teams continually
1. Is anyone stuck? improve. Investing in good stand-ups helps teams deliver value
effectively.
2. Does anyone need help?
Stand-ups are nearly ubiquitous in Agile. I would do stand-ups
3. What did not get completed yesterday?
even if I were not doing Agile. However, despite their simplicity,
4. Is there anything everyone should know? the added complexity of distributed teams can cause problems.
This technique can be used for non-distributed teams as The whole team is responsible for making the stand-up meetings
well as distributed teams. work. While the Scrum master may take the lead in ensuring
the logistics are right or to facilitate the session when needed,
5. Ensure that everyone is standing. This is code for making sure everyone needs to play a role.
that everyone is paying attention and staying focused. Standing
is just one technique for helping team members stay focused.
Other tips include banning cell phones and side conversations.
Certification Programs CE
Software
S
F IC
e
CERTIFICATIONS
www.softwarecertifications.org
No prior sign-up is required, but seating will be based on a first come first serve basis.
Coaching Sessions
Wednesday, Thursday and Friday based on availability
Have you ever heard an interesting idea or solution in a conference presentation and would have liked to discuss it further with
the speaker? But, when you tried to talk to the speaker immediately at the end of the presentation, you found that the conference
schedule just didnt allow enough time?
Included with the QUEST conference experience is the opportunity for you to meet one-on-one with conference speakers or the
professional QAI instructors in an informal setting to discuss how to turn ideas into solutions that address your specific needs.
Speakers will be available for free coaching sessions on the day of their conference presentation. Sign-up sheets with available
speakers and times will be posted at the conference on Wednesday, Thursday & Friday based on availability. Sign-up at the
conference is required to reserve your coaching session.
Ensure there are sufficient tracking and reporting capabilities so that any
failed test cases can be easily identified for further resolution
Matt Chessler is a Principal in Capgeminis Financial Services Testing practice. He has over 20 years consulting
experience successfully delivering business and technical solutions for clients in a variety of industries. For the past 14
years, Matt has focused exclusively on QA consulting and has successfully managed testing strategy, functional validation
and performance optimization projects for clients in the financial services, technology and healthcare industries. During this
time, he has advised clients in all facets of testing strategy, from transformation and process improvements to the design and
implementation of large-scale Testing CoEs.
Certified Software Tester (CSTE) Prep Course Monday & Tuesday, April 18 - 19
The Certified Software Test Engineer Prep Course is designed specifically to prepare the quality testing professional for the CSTE
examination. This is a 2-day course taught by a certified QAI instructor. The course aids the quality testing professional in focusing in on
the topics that are important for understanding, thus helping toward the successful completion of the exam. This course is not intended
to supplant the need for proper examination preparation. However, it will serve as an excellent review of the Software Testing Body of
Knowledge for CSTE (STBOK) which consists of the ten skill categories listed below. Sample exam questions are provided throughout
the course.
1. Software Testing Principles and Concepts 6. Walkthroughs, Checkpoint Reviews, and Inspections
CSTE
2. Building the Software Testing Ecosystem 7. Designing Test Cases
3. Managing the Test Project 8. Executing the Test Process
4. Risk in the Software Development Life Cycle 9. Measurement, Test Status, and Reporting Certified Software Tester
Certified Software Quality Analyst (CSQA) Prep Course Monday & Tuesday, April 18 - 19
The Certified Software Quality Analyst Prep Course is designed specifically to prepare the quality assurance professional for the
CSQA examination. This is a 2-day course taught by a certified QAI instructor. The course assists the quality assurance professional
in focusing on the topics that are important for understanding, thus helping toward the successful completion of the exam. This course
is not intended to supplant the need for proper examination preparation. However, it will serve as an excellent review of the CSQA
Common Body of Knowledge (CBOK) which consists of the ten skill categories listed below. Sample exam questions are provided
throughout the course.
1. Quality Principles and Concepts 6. Define, Build, Implement, and Improve Work Processes
2. Quality Leadership 7. Quality Control Practices
3. Quality Baselines (Assessments and Models) 8. Metrics and Measurement
4. Quality Assurance 9. Internal Control and Security
5. Quality Planning 10. Outsourcing, COTS, and Contracting Quality
Have you thought about becoming certified but wondered how your current knowledge and skills compare to the Common Bodies of
Knowledge for CSTE and CSQA?
With your registration to the 3-day conference, you can take a complimentary full practice examination for the Certified Software Test
Engineer (CSTE) or the Certified Software Quality Analyst (CSQA). The practice examinations will be held on Friday and will begin
immediately after the Keynote Speaker presentation. The multiple choice section of the examinations will be graded on-site when you
turn in your completed exam, so that you will receive an immediate assessment of your skills. The essay section will be evaluated after
the conference by Software Certifications and feedback will be provided to you.
The impact of these changes is particularly acute in mobile testing, 5. KNOW HOW TO AUTOMATE
which often presents large user volumes, device proliferation, and Earlier in this article, we discussed the importance of analyzing
fast cycles. This article discusses seven key strategies for mobile and understanding the testing matrix. This helps you prioritize core
testing that can result in faster, yet more comprehensive, testing functions vs. edge functions. That analysis also plays a crucial role
cycles that are more aligned with product strategies and market in helping us determine which tests are best suited for automated
goals. These are the things you should know! testing approaches. There are a few tricks to determining how to
automate (the first four strategies in this paper prepare you for this
assessment). One of the keys may not be intuitive: timing.
1. KNOW YOUR USER
A good test plan starts with a thorough, comprehensive Ideally, we want to automate the test cases that are repetitive. Key
understanding of the user. Testers should take the time to immerse experiences that are in your regression suite are the best targets.
themselves into the users world to fully understand the use cases These are the tests that you want to repeat every time a build is
for the application. For instance, before you test, it can be helpful to complete to ensure nothing has been inadvertently broken in/by the
consider some of the following factors: new build.
What time of day does a user typically access the app? The next factor is evaluate how long your tests take. Save the
How long is the typical session? hard tests for your people, and use those tests to challenge your
Is the user in a hurry-up mode looking for quick answers and engineering/testing teams. Build your regression suite of tests with
information or is he browsing in couch potato mode? the simple and most repeatable tests, and your team productivity will
increase significantly and consistently with every iteration.
To gain the most complete understanding of the intended user,
talk to your product manager or read the marketing requirements 6. KNOW YOUR PERFORMANCE
document. For high-profile apps, you may even consider investing in We can think of an applications true quality as the intersection of
market research or focus-group testing to identify preferences and real-user data, mobile performance, and functional testing all
behavior patterns that can inform your testing plans further. of which are critical to the users entire experience. Companies
use this data to create realistic user test cases and to correlate
2. KNOW YOUR APP performance to business metrics.
To properly perform user testing, you must know how the user
prefers to use the app and where those preferences deviate from Unquestionably, performance testing with real-user data is a game-
how the app was intended to be used. Engineers will build beautiful changer. Does your testing strategy encompass these five industry
things but users have the final say and they will frequently use best practices?
another path that we never thought about.
Develop an in-depth mobile performance strategy that
Your ability to know your customer and know your app is critical to encompasses real-world scenarios and real-world data
devising, executing, and analyzing tests. This user intimacy helps Analyze your app back-end metrics to get a fuller picture of
you determine what are core functions and what are edge cases. the factors that affect performance
Without this differentiation, the test matrix is merely a list of features. Analyze your front-end performance metrics to get a truer
But customers dont care about the features. They only care about understanding of your end users experience
the experience. Tie your apps performance with revenue- or cost-
generating transactions
3. KNOW YOUR MATRIX Identify the hot zones where you can have a fast impact
In many companies, the testing organizations budget and value are to most effectively improve your app performance
highly correlated simply with the size and scale of the testing matrix
the entire set of use cases and tests that have been identified 7. KNOW YOUR EDGE
and defined for evaluating the softwares performance. The criteria Every tester knows that the edge cases the scenarios that occur
often revolves around how effectively and thoroughly the matrix is less frequently are the greatest sources of crashes or obstacles
completed; it is the core to your success. Unfortunately, with the that cripple app performance. But with so much of your time
increasing complexity of software and mobile devices, the testing consumed simply by testing core functionality, its often impossible
matrix is vastly larger than it was even five years ago. to complete a test plan all the way to edge and evaluate all of the
scenarios that users seldom encounter.
However, all tests are not created equal because not all functions
are created equal. Different tests shouldnt carry the same priority Depending on your overall product strategy, you can allocate testing
because they dont all equally affect the user experience to the same resources in order to get the app to market faster. You may target
degree. Some tests are non-negotiable must-dos. But others competitive feature sets or you may aim for deeper functional and
are nice to haves. Thats because tests take time sometimes a user-experience testing to pursue the highest level of product
lot of time. Some tests can take so long that they are not worth the quality. Its essential to make these strategic priorities explicit.
effort, and, conversely, some of the most important tests can be the
shortest to complete. A PASSION FOR TESTING
Headquartered in Mountain View, California, SOASTA is the
4. KNOW YOUR DEVICES leader in performance analytics. The SOASTA platform enables
The first three strategies have prepared us to identify what to test. digital business owners to gain unprecedented and continuous
Now, we want to explore how we should be testing. Whether your performance insights into their real user experience on mobile and
company is a mobile pioneer or your organization is just launching Web devices in real time, and at scale. To help you get started
its mobile testing initiatives, chances are youre now all too familiar with performance tools, SOASTA offers a rapid assessment and
with the need for access to a broadening portfolio of devices. And implementation service that can quickly jumpstart your testing
the rate of change in that portfolio can be daunting: new hardware, initiatives. For more information, please visit www.soasta.com.
Do you?
PROVE IT.
Continuous Performance Validation
A process achieved by testing, monitoring and improving performance at
every stage of the application development lifecycle, from development to
production, leveraging automated and collaborative tooling.
Dont miss out on a special presentation from Senior Performance Engineer Steve Weisfeldt where youll learn:w
How to Fit Performance Testing into Agile Dev Cycles
April 21, 2016 | 11:15 am 12:15 pm
CONFERENCE AT A GLANCE 25
MANAGERS
LEADERSHIP Test Leadership Problem Solving
SOLUTIONS Manager's Solutions Workshop
Cloud Gate 1 Lynn McKee, Quality Perspectives
Discover
CERTIFICATION
Break CSTE Certification Prep AGILE Agile Estimation
10:00 AM
Morningstar
Hosted by Morningstar Cloud Gate 2 Tom Cagley, DCG Software Value
Training Center
Lunch
[Looking Glass] CERTIFICATION
CSQA Certification Prep LEAN Trimming Down Your QA Effort While Maintaining Quality
12:00 PM 1:00 PM Morningstar
Hosted by Morningstar Cloud Gate 3 Clyneice Chaney, MITRE
Training Center
Break
2:30 PM MOBILE Mobile Testing: Manual and Automated
Cloud Gate 4 Michael Yudanin, Conflair
AUTOMATION Getting Started with Selenium Test Automation
Cloud Gate 5 Chris Lawson, Zenergy Technologies
5:30 PM 8:30 PM Managers Connection Dinner - Hosted by Tom Ticknor and Nancy Kastl, Quest Conferences
Half Day Tutorials: 8:30 AM 12:00 PM Half Day Tutorials: 1:00 PM 4:30 PM
LEADERSHIP Leading Change When Youre Not in Charge LEADERSHIP Whats Your Leadership IQ?
Cloud Gate 1 Jennifer Bonine, tap|QA Cloud Gate 1 Jennifer Bonine, tap|QA
Break PROCESS Agile Metrics - Its Not About Velocity PROCESS Value Stream Mapping and Kaizen in Agile Retrospectives
10:00 AM Cloud Gate 2 Philip Lew and Steve Gohres, XBOSoft Cloud Gate 2 Angela Dugan, Polaris Solutions
Lunch REQUIREMENTS Making Requirements and User Stories Testable RISK (Almost) Everything I know about testing I learned playing poker
[Looking Glass] Cloud Gate 3 David DeWitt, NueVista Cloud Gate 3 Matthew Eakin, Centric Consulting
12:00 PM 1:00 PM
MEASUREMENTS Maintaining Testing Integrity Under Pressure MOBILE Usability Goes Mobile
Break Cloud Gate 4 Carolyn Swadron, CIBC Cloud Gate 4 Susan Brockley, ExxonMobil
2:30 PM
The Development and Implementation of an Automation
AUTOMATION AUTOMATION Introduction to ATDD using Ruby, Cucumber, Watir-WebDriver
Framework
Cloud Gate 5 Cloud Gate 5 Joseph Ours, Centric Consulting
Dean Carvin, Checkpoint Technologies
4:30 PM 6:00 PM [Looking Glass] Welcome Reception - Sponsored by QAI Global Institute
8:15 AM 8:30 AM [Grand Ballroom 1-3] Opening Remarks & Announcements - Nancy Kastl, QUEST Conference Chairperson
[Grand Ballroom 1-3] Keynote Presentation: Keeping Pace with Digital Transformation: Trends and Recommendations from the 2015-2016 World Quality
8:30 AM 9:30 AM
Report - Matt Chessler, Capgemini
9:30 AM 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by Microexcel
9:25 AM 4:00 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industrys leading service and technology providers!
[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]
Pursuing World Class Quality: Simplicity: The Path to Mobile App Testing: What and The Testers Story: Painting the Leveraging Free, Open Source,
Transforming Your Organization Achieving Agile Testing How to Test? Picture of Risk and Low-Cost Tools for Back
Presentations
Clyneice Chaney, Quality Squared Efficiency Nikhil Kaul, SmartBear Software Shaun Bradshaw, Zenergy End Testing
Paul Herzog, SPR Consulting Technologies Elysia Lock, Emmi
11:15 AM 12:15 PM LEADERSHIP AGILE MOBILE RISK OPEN SOURCE
What Time is It Over There? Budgeting, Estimation, Faster and Better Mobile Testing Risk Based Testing at the How to Tackle Open Source
Maximizing the Effectiveness of Planning, #NoEstimates and the in the Cloud Enterprise Level Test Automation in Incredible
Presentations Your Global QA Team Agile Planning Onion Jamie Moore, Mobile Labs Bernd Bornhausen, Banque Ways
Elizabeth Wisdom, Ulta Beauty Tom Cagley, David Consulting Nationale du Canada Harpreat Singh and Piyush
Group Sachar, Microexcel
11:15 AM 11:45 AM [Discover] EXPO TALK: Test Workbench for Holistic Test Management - Chaithanya Rajanna, Deloitte Consulting
11:45 AM 12:15 AM [Discover] EXPO TALK: Automated Tests without Recording or Scripting with AscentialTest - Brian LeSuer, Zeenyx Software
12:15 PM - 1:30 PM [Grand Ballroom 1-3] Special Interests Roundtables & Lunch
ZAP, Youre QA Team Deconstructing SAFe the Mobile Testing: To Automate or Making the Case for Getting Started with Jmeter!
Leader! How to Build a High Scaled Agile Framework Not to Automate? Collaborative Test Case Daniel Schiff, edo Interactive
Workshops Performance Team Angela Dugan, Polaris Solutions David Dang, Zenergy Development
Rebecca Staton-Reinstein, Technologies Todd Peak, Seapine Software
Advantage Leadership
1:30 PM - 2:00 PM [Discover] EXPO TALK: Sizing, Estimating and Testing: Can You Answer the 3 questions? - Tony Timbol, DCG Software Value
2:00 PM 2:30 PM [Discover] EXPO TALK: Right Data, Right Place, Right Time - Mike Cartina, Orasi Software
2:30 PM 3:00 PM [Discover] EXPO TALK: Moving to an Onshore team and Managing Technical Millennials - Michael Faulise, tap|QA
3:00 PM 3:30 PM [Grand Ballroom Foyer and Cloud Gate Foyer] Afternoon Refreshment Break - Sponsored by Zeenyx Software, Inc.
3:30 PM 4:00 PM [Discover] EXPO TALK: Automation for Devs and Testers with TestComplete - Gregory Hanson, SmartBear Software
4:00 PM 4:30 PM [Discover] EXPO TALK: QA Best Practices for Agile Environment - Piyush Sachar, Microexcel
Culture of Quality: Integrating Using BDD and Specifications Mobile Test Automation and the The Testing Pyramid: Its Not Acceptance Test Driven
QA in the SDLC by Example in Increase Software Need for Continuous Quality about Testing Development (ATDD) with
Presentations Helene Simmons, Lincoln Value Eran Kinsbruner, Perfecto Gary Pedretti, Sodoto Solutions SpecFlow
Financial Group; Jackie Wilson, Diane Walker and Nick Hussey, Chris Taylor, Polaris Solutions
Lincoln Financial Group Equifax
5:30 PM 9:30 PM [House of Blues] Attendee Appreciation Night in Chicago, sponsored by tap|QA
7:45 AM 8:15 AM [Discover] Early Bird Session: Successful Networking: Making the Right Connection - Charlene Wooley, Equifax
8:15 AM 8:30 AM [Grand Ballroom 1-3] Announcements - Nancy Kastl, QUEST Conference Chairperson
8:30 AM 9:30 AM [Grand Ballroom 1-3] Keynote Presentation: Agility and Reliability Need Not Be Mutually Exclusive - John Chang, CAST North America
9:30 AM 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by Mobile Labs
9:25 AM 6:30 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industrys leading service and technology providers!
[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]
The Art of Testing Metrics: The Force Awakens How to make Test Automation Load It UP: Effectively Agilify Your Manual Testing
Transformation: Blending Joseph Ours, Centric Consulting SMARTER Combining Functional and Through an Exploratory
Technology with Cutting-Edge Jim Trentadue, Original Software Performance Testing Approach
Presentations
Processes Chris Lawson, Zenergy Ryan Yackel, QASymphony
Jennifer Bonine, tap|QA Technologies
10:00 AM 10:30 AM [Discover] EXPO TALK: Selenium: The Core of Automation - Manju Naglapur, CompuGain Solutions
10:30 AM 11:00 AM [Discover] EXPO TALK: Mobile SLA Monitoring & Validation Automated Framework - Vinayak Gaur, Hexaware
11:15 AM 11:45 PM [Discover] EXPO TALK: Cross-Platform Mobile Apps Testing Using a Mobile Device Cloud - Jamie Moore, Mobile Labs
11:45 AM 12:15 PM [Discover] EXPO TALK: Beyond Resizing a Browser: Useful Responsive Web Testing Tips - Eran Kinsbruner, Perfecto
Business Case for Software Creating Useful Metrics to Dont Be Another Statistic! How to Fit Performance Testing Tips for Maintaining UAT
Testing and QA Operations Provide Quality Software Develop a Strategy for Long- into Agile Dev Cycles Integrity
Presentations
Bernd Haber, Accenture Helene Astier, Cars.com Term Test Automation Success Steve Weisfeldt, Neotys Carolyn Swadron, CIBC
Lee Barnes, Utopia Solutions
12:15 PM 1:30 PM [Grand Ballroom 1-3] Special Interests Roundtables & Lunch - Sponsored by Neotys
Enhancing Your Leadership 10 Steps to Continuous Applying Design Patterns to Real World Security Testing The Red Bead Experiment
Skills to Become an Effective Integration, Testing and Delivery Automated Testing Matt Konda, Jemurai Mike Kaufman, EMC
Workshops
Test Manager Tanya Kravtsov, ROKITT Brian Le Suer, Zeenyx Software
Michael W Ennis, TEKsystems
1:30 PM 2:00 PM [Discover] EXPO TALK: Combining Manual and Automated Testing with Microsoft Visual Studio - Paul Herzog, SPR Consulting
2:00 PM 2:30 PM [Discover] EXPO TALK: Jump Start Automation through Utopia Automation Framework (UAF) - Lee Barnes, Utopia Solutions
2:30 PM 3:00 PM [Discover] EXPO TALK: Making the Most of Selenium: Your Tough Questions Answered - David Dang and Chris Lawson, Zenergy Technologies
3:00 PM 3:30 PM [Grand Ballroom Foyer and Cloud Gate Foyer] Afternoon Refreshment Break - Sponsored by DCG Software Value
Polyskilling Testers: Good, Bad DevOps: A Testers Best Friend Keyword Driven Testing with Security Testing Scripts for the Testing Deliverables: Define,
or Ugly? Thomas Janik and ken Robertson, Selenium: The Good, the Bad Non-Hacker: Straight from the Align, Document and Approve
Presentations Matthew Eakin, Centric Consulting American Family Insurance and the Use Case Security Pros Handbook! Clareice Chaney, MITRE and
Brian Van Stone, QualiTest Group Glenn Stout, HALOCK Security Clyneice Chaney, Quality Squared
Labs
3:30 PM 4:00 PM [Discover] EXPO TALK: Linking Requirements to Test Cases with TestTrack - Kayla Gillman and Mike Turton, Seapine Software
4:00 PM 4:30 PM [Discover] EXPO TALK: Continuous Performance Validation with NeoLoad and NeoSense - Steve Weisfeldt, Neotys
4:00 PM 4:30 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industrys leading service and technology providers!
7:30 AM 8:15 AM [Discover] Early Bird Session: Take Leadership by the Marshmallow! - Mike Kaufman, EMC
8:15 AM 8:30 AM [Grand Ballroom 1-3] Announcements - Nancy Kastl, QUEST Conference Chairperson
8:30 AM 9:30 AM [Grand Ballroom 1-3] Keynote Presentation: Shift Left and Steer Right - Joe Colavito, Corevu
9:30 AM 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by CompuGain Solutions
[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]
Leading Indicators of Quality: 5 Critical Elements for Isnt an Enterprise Test Strategy Regression Test Management CSTE/CSQA Practice
Driving the Conversation & a Successful Test Data just for an Enterprise Project Using a User Interface Certification Exam
Presentations Managing Risk Management Program Release? CARTTS Tool
Dana Dietz, Nationwide Robert Kelman, AT&T Susan Schanta, Cognizant Mani Rajappa, GSI Health
Technology Solutions
Efficiency and Effectiveness: Data, Data Everywhere! Building Quality Software The Clouds Impact on Testing
When Process and Pressure Understand Your Data & with Continuous Integration & Tom Chavez, SOASTA
Presentations Collide Maximize Test Coverage Continuous Testing
Frank Rios and Rich Valde Jessica Paddock, Orasi Software Ashish Nirgudkar,Cognizant
Technology Solutions
12:15 PM 1:30 PM [Grand Ballroom 1-3] Lunch & QAI Grand Prize Drawing
1:30 PM 2:30 PM [Cloud Gate 1-2] Panel Discussion: Achieving Cross Roles Collaboration to Build Quality Software
1:30 PM 2:30 PM [Cloud Gate 5] TCOE: Harmonizing Business and Technology Needs Using Next Generation Testing - Kimberly Tatum
[Cloud Gate 3-4] [Cloud Gate 3-4] [Cloud Gate 3-4] [Cloud Gate 3-4]
2:30 PM 3:00 PM ALM COLLABORATION ALM COLLABORATION ALM COLLABORATION ALM COLLABORATION
Shift Left through Tester Shift Left through Tester Shift Left through Tester Shift Left through Tester
Roundtable Project Manager Collaboration Business Analyst Collaboration Developer Collaboration Scrum Master Collaboration
Discussions PMI Chicagoland David DeWitt, IIBA Chicagoland Christopher Jones, IEEE Michael Marchi, Agile Professional
Chapter Learning Network-Chicago
www.orasi.com
EXPO TALKS 29
CompuGain
SOLUTIONS
Scale your
business applications
ENTER WIN! to
Schedule an appointment or demo with one of our software
& future~proof your
infrastructure
using our expertise.
quality experts to enter our drawing for a $100 gift card!
www.checkpointech.com 813-818-8324
www.compugain-solutions.com | sales@compugain-solutions.com | 703.956.7500
The purpose of this article is to provide a set of criteria that can be Well-designed automated tests are comprised of reusable steps. Steps
used to evaluate automation candidates. These criteria can be broadly are created to drive the target application to a test state, verify an
organized into two categories: efficiency, which involves a financial application response and then return the application to a known base
cost/benefit analysis and effectiveness of manual vs. automated state. The steps required to verify the actual against the expected
testing. result usually present the biggest challenge. Revisiting the eCommerce
example, the best way to design a test that verifies the contents of a
Efficiency and Effectiveness Shopping Cart is to generate the expected results by capturing the
The most basic set of questions regard cost/benefit analysis and price, quantity and other attributes of the products being purchased
consider the cost of development and maintenance. How many person as part of the test. Again, this approach requires more effort, but the
hours will it take for test development? How many hours will it take to tests will be self-maintaining as the content of the dynamic storefront
maintain the tests for a selected time horizon? These costs need to be changes.
compared with an estimate of how long it takes to perform the same Some test types can be developed in such a way that they can be
tests manually. How often do these tests need to be executed? This used universally against any application. Examples include verifying
analysis is not as simple as it might seem for a number of reasons. field data types, field length, required/optional fields, tab order and
First, it is not always well known how the target application will change adherence to GUI standards. Writing a universal test requires an
over time. Application change may translate into script maintenance, understanding of abstraction, but otherwise, they are not difficult to
but it is also the primary reason for automating tests in the first place. write. The following is a simple example:
After all, if the application didnt change, there would be no need to
retest it. Therefore the frequency of change needs to be factored into
both sides of the equation. Tests that can be automated quickly may be
able to pay for themselves the very first time that they are run. Others
may never achieve a positive cost/benefit ratio.
There are other factors impacting the cost/benefit analysis beyond a
comparison of person hour costs for manual and automated testing.
Time to market for software products must also be considered. More
difficult to measure, of course, are the less tangible aspects of testing.
For example, what is the likelihood that a manual tester will fail to catch
a defect that an automated test would have caught. Here is a place
where a look at the tests themselves can help bring some clarity to the
decision. Automated tests are very effective at validating a lot of detail.
If a single character does not match when a comparison between an
actual and expected result is made, a properly designed test will alert
the tester to have a closer look to determine if there is in fact a failure.
Testing software installations and un-installations are good candidates
for automation. Testing tools are more effective than manual testers at
validating a large amount of detail.
There are types of tests that are difficult to perform manually. Stress This simple test step is capable of verifying the field length of any field
and performance tests are obvious examples. But even on a single that accepts a string. It takes two parameters: the name of the field
desktop, an automated testing tool is much more effective at running and the expected field length. It assumes that the field will truncate
a routine set of tasks repeatedly to ensure that the target application characters beyond the field length limit. It raises an error if the field
is not leaking memory and that system resources are being utilized accepts characters beyond the limit. Executing tests of this type
properly. They are also better at measuring the duration of an event. manually are not a good use of a domain experts time and are better
Its easy to create a script that performs a task, starts a timer, waits for assigned to the automated testing tool.
a cue from the GUI that the system is finished responding and then
measures the elapsed time. Attempting to do the same thing with a There are a number of reasons why a software development
stopwatch seems like a poor use of person power. organization should consider test automation including: Productivity,
Repeatability, Efficiency, Effectiveness, Flexibility, Accountability,
Evaluating the Feasibility of Automating a Test Stability, Complacency, and Preservation.
One of the most challenging aspects of choosing what to automate is And if the right choices are made in choosing what to automate, a good
evaluating the relative difficulty of automating a given test. return on investment can be achieved. Yet, as thorough a job as we
First, consider the complexity of the test. Tests that navigate a few might do analyzing the costs and benefits of a test automation effort,
pages or screens and can be verified with data captured directly from some things defy quantification.
the application will be relatively easy to automate. When prioritizing Brian Le Suer is the CEO of Zeenyx Software, Inc., a company
automation tasks, schedule the easier tests first so that the benefits of dedicated to building next generation solutions for manual and
automation are realized quickly. There are plenty of tests that can be automated software testing. Visit www.zeenyx.com to learn about their
executed on a single page or screen like validating error messages innovative step-based approach.
when required fields are omitted or testing boundary conditions.
The traditional time versus cost versus quality conundrum is faced Identifying risk by detecting bugs may be the primary goal of a tester
L by organizations trying to keep pace with the rapid pace of market but we have a unique responsibility within software development
E driven changes today. The Quality Management/Assurance/ projects. Clearly communicating risk can mean the difference
Testing organization is constantly under pressure to deliver low between successful mitigation and the nightmare scenario of critical
A incident products in continuously shrinking development timelines. revenue streams being interrupted. But no one wants to channel
D Some enterprises establish world-leading quality assurance (QA) Chicken Little or conjure images of the boy who cried wolf every time
E functions while others implement small-scale change. a bug is discovered.
R R
S
Clyneice provides practical hands-on techniques for changing I Critical issues must be communicated in a manner that delivers
organizations. Join Clyneice to align expectations with reality and the right messages while building trust. But trust can be difficult to
H S
improve the view of testing. Effect change in your organizations create given the special nature of testing and the challenges it can
I utilizing principles and methodologies. Transform your organization K present in the relationship between testers and developers. Add the
P and get respect. stakeholders into the mix and it is not always easy for testers to be
heard, much less trusted. Learn how to better communicate with
developers and stakeholders, build and maintain trust, and ensure
issues and defects are proactively addressed by telling an effective
story that paints the right picture for all parties.
Simplicity: The Path to Achieving Agile Testing Join Shaun to determine the best way to communicate your story
Efficiency to the relevant stakeholders and identify the risks that exist without
losing trust or crying wolf. Get your voice heard in your organization.
Paul Herzog, SPR Consulting
11:15 AM - 12:15 PM
What Time is It Over There? Maximizing the
Effectiveness of Your Global QA Team Risk Based Testing at the Enterprise Level
Elizabeth Wisdom, Ulta Beauty Bernd Bornhausen, Banque Nationale du Canada
Cheaper! Faster! Smarter! These 3 words are what a QA team The test organization of an enterprise has unlimited resources at its
L leader hears almost every day. Many organizations today recognize disposal in order to test all applications used by this enterprise. This
E that a globally distributed QA model will achieve some of those is the dream world of QA organizations around the globe. In reality
A objectives, but it comes with some challenges! there is no such thing as unlimited resources for any given QA or-
D ganization as it is true for all organizations within an enterprise. The
Create a global QA team that can effectively engage and R enterprise, thus the QA organization, has to prioritize its resources
E collaborate with each other as well as with with project stakeholders in order to maximize the benefits of the invested effort. In order to
R operationally with maximum effectiveness and efficiency. Set
I do so we need to apply a prioritization method to identify the ap-
S the correct expectations and assumptions with a global resource S plications the most critical as these will be the ones the most effort
H team model. Build trust within the team and create effective K should be spend on. Risk based testing at the enterprise level tries
communication channels and daily reporting to help the QA team exactly that and gives the QA organization the method to utilize its
I act as a cohesive team without boundaries. Join Elizabeth to get resources where they are needed.
P your global team to the highest level.
Deconstructing SAFe the Scales Agile Framework Making the Case for Collaborative Test Case
in a Nutshell Development
Angela Dugan, Polaris Solutions Todd Peak & Mike Lipps, Seapine Software
With so many software delivery process frameworks and Collaboration between quality analysts and developers enriches
methodologies out there, its hard to know where to begin. And just softwares quality in ways that increase its value to the end user and
when the industry seems to be warming up to agile, here comes P helps ship the release! Poor or non-existent collaboration between
SCALED agile with frameworks like SAFe, LESS, and a host of L these departments bogs down development efforts, resulting in
others. Should we all just be SAFe? But then maybe SAFe is just a delays, blown budgets, and buggy releases. Throwing new builds
glorified waterfall process for companies that cant handle real Agile. A
A SAFe, the Scaled Agile Framework, leverages the best of several
over the wall is inefficient and can create a counter-productive
N us vs. them mentality between QA and developers. Creating test
G well-established frameworks, including Lean, Kanban, and scrum. cases independently has unmistakable merit, but stopping there does
While SAFe is certainly intended for large, enterprise organizations /
I delivering extremely complex and interdependent systems, many
the software a disservice. Quality analysts and developers working
D together create better test cases, a better work environment, and
L SAFe principles and practices can be used to improve much smaller better software. Each team brings important talents to the table, and
teams. Join Angela in this workshop to gain a better understanding of E
E the SAFe, and how teams can adopt SAFe principles and practices to
breaking down barriers between them through collaboration and
improve the development, testing, and delivery of products.
S knowledge sharing uncovers potential issues before they occur,
increases testing coverage, and fosters an appreciation for each
I others contributions. Technology was intended to make our lives
Learning Objectives: G easierbut collaboration can make making technology easier.
Get an overview of SAFe processes, roles, and terminology
Take a SAFe approach to large scaled software delivery and learn N Learning Objectives:
best practices for both large and small teams Learn how collaboration leads to better software
Procure all of the resources you need to do this Determine the most valuable service each group can provide
Leverage the groups to make your life easier
3:30 PM - 4:30 PM
Culture of Quality: Integrating QA in the SDLC The Testing Pyramid: Its Not about Testing
Helene Simmons, Lincoln Financial Group Gary Pedretti, Sodoto Solutions
Jackie Wilson, Lincoln Financial Group
Do you struggle with building and maintaining an automated
The Culture of Quality program plays a strategic role in test suite? Do you wonder how you can work together with other
implementing best practices to achieve quality excellence through P specialists in a true cross-functional agile team? Do you push all
L collaboration with our IT and Business Partners. The objective L testing to the end, even though youre using agile techniques and
E of a Culture of Quality Program is to support the IT Enterprise shorter cycles snowplowing risk forward and compressing the test
by incorporating Quality Assurance into the SDLC process
A
cycle like we did in waterfall?
A during the project stages. It will maximize performance in the N
D production environment, will increase business and technical / Mike Cohn introduced the Testing Pyramid in his 2009 book,
E partner satisfaction, and reduce redundancy and waste during D Succeeding with Agile, as a model for thinking about sustainable
R the testing cycle. This has included process improvements such test automation. But it also has powerful implications for analysis,
as Risk-Based Testing, Entry/Exit Criteria, Metrics, Professional
E
architecture, coding, and documentation. Building a product that
S Development, and Consistency in Quality Center usage and a S is well covered by tests, in the ratios described by the Testing
H common QA Terminology. Implementing a Culture of Quality will I Pyramid, requires specific thinking and approaches at both
I require the support of various IT organizations as you verify and G the technical and human levels. In this talk we cover modern
P improve processes, standards, execution, and measurements. techniques and patterns that allow for all software specialists to be
Our journey started in 2014-15 with the formation of workgroups
N
guided by the Testing Pyramid to build shared, collaborative team
focused on improvement. We continue to learn through environments.
development of metrics. Find out how weve succeeded in process
maturity and continued promotion of a Culture of Quality, and how
weve impacted our QA teams and IT/Business Partners.
Using BDD and Specifications by Example in Acceptance Test Driven Development (ATDD) with
Increase Software Value SpecFlow
Diane Walker and Nick Hussey, Equifax Chris Taylor, Polaris Solutions
Software that works but doesnt solve the right problem isnt O Acceptance Test-Driven Development is a test methodology that
valuable! We have a habit of focusing our attention on whether P picks up where unit testing ends and can be leveraged to make
the applications are doing things right. But how do we know if our testing a collaborative effort for the entire agile team. You will
application is doing something valuable? Diane and Nick share
E learn the Given-When-Then nomenclature of ATDD and how it
their journey to solve this and other quality issues using BDD and N can be applied to writing requirements or acceptance criteria that
A Specification by Example. They use these tried and true techniques easily flow into test case development. Well look at the setup,
G to increase the clarity of specifications for the entire software team S syntax, roles of each agile team member in making it work, and
I as well as their business partners. Find out how they increased
O
also at some strategies for using SpecFlow in a project regardless
time for test analysis and increased test automation. They will share of testers technical expertise. Although SpecFlow is Microsofts
L U
with you how they were able to shift the entire schedule left and implementation of Cucumber for .NET, what you will learn in this
E decrease time to market. Increase the Value of your Software with R session can be applied to any other tool of your preference.
Diane and Nick. C
E
11:15 AM - 12:15 PM
Business Case for Software Testing and QA How to Fit Performance Testing into Agile Dev
Operations Cycles
Bernd Haber, Accenture Steve Weisfeldt, Neotys
L Too often companies try to test-in quality at the end of the devel- P Agile development methodologies have many benefits like
E opment life cycle rather than shifting quality left. The holistic view of E increasing visibility into a projects progress and keeping
A Quality is ignored. The Application Testing Services Blueprint Re- R requirements fluid enough to respond to what customers want
D port published by HfS Research Ltd. in August of 2015 states under F today not what they wanted two years ago. However, many
Trends in Application Testing that the testing community has to Agile (or Agile-ish) teams struggle with determining which testing
E overcome its focus on tools and technology [and] it has to speak O practices to keep, which ones to automate, and which ones to stop
R the language of C-level executives and work around the strategic R doing all together. Performance testing is no exception. Creating
S business imperatives. In this talk Bernd shows how to create a M a performance testing plan that fits into your development process
H compelling and convincing test service business case. Assume you A is easier than you might think. Join Steve to learn when to do
only have 15 minutes to talk to the CIO, SVP or VP of IT to make continuous performance testing and when to fit load testing into
I your case. Join Bernd to make your case for your future! N your sprints. One size does not fit all! Steve will present you with
P C practical tips for sizing tests to match your needs.
E
A
are typically thought of as the main challenges to successful
test automation. However, even after careful tool selection and
advanced automation framework construction, long-term success
Lunchtime Reminders
U
proves elusive to many. Lee Barnes discusses the key strategy
T components that must be in place to avoid becoming another test
O automation statistic. Learn the importance of, and techniques for, Thursday lunch is another opportunity to participate in
M assessing your organizations readiness for test automation in the Special Interest Roundtables. Join fellow attendees
foundational areas including test objectives, organizational structure, for a discussion on hot topics relevant to the everyday
A
process integration, environment and resources/skills. Once you practitioner.
T understand your state of readiness, you can begin to formulate a
Remember to visit the Exhibitor EXPO and have your
I strategy for addressing gaps and laying the groundwork for long-
EXPO Passport stamped by all the vendors before
O term success. Lee presents a framework for developing a solid test
the conclusion of Thursdays program. Turn in your
automation strategy that addresses automation scope, required
N completed EXPO Passport to the QAI Registration desk
organizational & process changes, and implementation roadmap.
to receive a raffle ticket for QAIs Grand Prize Drawing
Take back a blue print for implementing successful test automation
during Friday lunch (must be present to win).
in a way that uniquely fits your organization, and become a positive
test automation statistic!
3:30 PM - 4:30 PM
Security Testing Scripts for the Non-Hacker:
Polyskilling Testers: Good, Bad or Ugly? Straight from the Security Pros Handbook!
Matthew Eakin, Centric Consulting Glenn Stout, HALOCK Security Labs
L Agile demands much more of the tester. Testers are now asked Do you feel unsure about web application security? Are you not an
to be much more technical. They have to test database changes, expert but still responsible for application security? This session
E web services, and integration with other systems. On top of that S
will arm the participant with a guide to test web applications
A testers have to automate our test scripts as fast as they are being E for common security threats that can be tested without a deep
D written. But is this change a good thing? Are testers becoming C knowledge of hacker type tools. A usable takeaway checklist
better testers? Are products becoming better or more solid? In
E this session Mr. Eakin will examine polyskilling and the Dunning- U with test scripts that the non-hacker can use to give applications
R Kruger Effect from a testing point of view and try to explain how it R a good security review is provided. Hacker-esque tools to do
can destroy teams if applied incorrectly and make them stronger if some additional security testing are identified and demonstrated.
S I Join Glenn and become an ethical hacker of your own web
applied correctly.
H T applications.
I Y
P
Thomas Janik and Ken Robertson, American Family Clareice Chaney, MITRE and Clyneice Chaney, Quality
Insurance Squared
Have you ever asked yourself how DevOps could succeed in a D Deliverables are outcomes and often tangible representations
company that has an existing set of testing processes, deployment E in determining the success of a project. Deliverables must be
practices, multiple segregated environments, and silo teams? Is identified, specified, designed, scheduled, produced, tested,
it possible to take autonomous teams and bring them together L
D accepted and implemented. With the rising cost of testing and
to increase efficiencies within the deployment pipeline in a large I the increased need for and the pace of software development
E company thats ingrained with weve always done it this way? We V and testinglets look at testing deliverables, both project and
V asked these same questions at American Family Insurance. What product, and identify methodologies for identifying, aligning and
we discovered was that by uniting certain teams, re-evaluating E
/ documenting them. The focus of this session is to look at identifying
the tools we used, streamlining processes, and integrating our R and aligning test deliverables with outcomes; determine the
O environments, we could evolve into a DevOps culture that offered A impact of the use of Waterfall and Agile software development
P our developers continuous integration and our testers expediently methodologies on test deliverables; and clarify why clearly
deployed code in stable environments, all seamlessly integrated. B
S defining and documenting deliverables is a critical component
Join us as we discuss the before, the, after, and the step-by-step L to demonstrating progress so that your customers, internal and
process American Family took to evolve toward planned production E external, can achieve their desired outcomes.
maintenance releases, an automated deployment pipeline,
standardized smoke tests, rapid deployment of defect fixes for S
retesting, and stable testing environments to facilitate better
functional and integrated testing processes.
5 Critical Elements for a Successful Test Data Regression Test Management Using a User
Management Program Interface CARTTS Tool
Robert Kelman, AT&T Mani Rajappa, GSI Health
The Effectiveness of a Test Data Management program can Change requests originating from both clients and internal
determine success or failure of any enterprise testing effort. R departments create a need for regression testing. Regression
T
However, implementing a successful Test Data Management E testing for every change is challenging based on the sheer amount
E program can be technically challenging and costly. This G of changes and deployment timing. In this session, we illustrate the
S presentation highlights the critical components which the DIRECTV solution to ensure regression test cases are successfully executed
R
T Software QA Team (now part of the AT&T family) has implemented for enhancements, patches, configuration changes or code
to ensure testing success. Join Robb as he walks through the E changes using the CARTTS (Coordinator Application Regression
evolution of DIRECTVs current Test Data Management program. S Testing Test Suite) Tool. The CARTTS Tool is a custom user
D Learn the five critical components of the program, which makes S interface designed to execute regression test cases by downloading
A the testing effective and will allow DIRECTV to move into the future tests from a list. Using the CARTTS tool, regression tests can be
I
T and create additional opportunities. This includes a centralized run by the infrastructure team, the development team and client
team, automation, refresh process, Use Case categorization and O teams. This helps to ensure the reusability of tests created by
A
experimentation. N the QA team. Learn the capabilities of the CARTTS tool, how this
custom UI tool was built, and the value that it is providing.
11:15 AM - 12:15 PM
Efficiency and Effectiveness: When Process and Data, Data Everywhere! Understand Your Data &
Pressure Collide Maximize Test Coverage
Frank Rios and Rich Valde, HERE Jessica Paddock, Orasi Software
Imagine having a defined process so important that not following
Measuring your test cases against the most appropriate conditions
it means the potential destruction of a priceless and irreplaceable
L item. So why would any rational, well-intentioned person T
to ensure that all of your requirements are tested is critical. The
testing process needs to provide the best coverage possible to
E deliberately choose not to follow the process? Better yet, why E improve quality. Data coverage analysis is critical in identifying what
A would three intelligent, rational, well-intentioned people choose
S data is required to ensure that faults related to code interaction
D not to follow the process? Prepare for a shocking, real-world case
T are discovered during the test phases and not in production. This
study where we discuss this exact scenario, the potential causes of
E pressure these three people felt, and the dangerous environment
session focuses on the issues and risks of poor data coverage.
The process of Test Data Management (TDM) must be broken
R where it was not safe to speak up. Further, we will use this scenario D down into a cycle of phases, which follow the environment setup.
S to highlight the impact of focusing on efficiency over effectiveness.
A These phases are; Data analysis, Data pools creation, Data pools
H All three people knew the process, but the pressure they felt from
T validation, Data delivery, and Continuous improvement. Join
management to be efficient in fixing the problem, caused them to
I solve it ineffectively. Dont be like this company. Learn to recognize A
Jessica to learn how to use TDM tools to measure and improve
data coverage and provide a better quality product.
P the real root-cause and take action to correct it, before it causes
permanent damage to an irreplaceable artifact.
11:15 AM - 12:15 PM
Building Quality Software with Continuous
Integration & Continuous Testing The Clouds Impact on Testing
Ashish Nirgudkar,Cognizant Technology Solutions Tom Chavez, SOASTA
C
O Highly integrated application environments prevalent in Cloud computing, now almost ten years old, continues to grow at
N Telecommunications and Financial industries result in many a rapid pace, and it seems that everything is moving to the cloud.
T dependencies and challenges for agile teams. This causes Cloud services are replacing what used to be done on desktops, in
I prolonged integration and regression testing phases, and no labs, and data centers. What is the impact of the cloud on testing?
N improvement in time to market or quality. As business and Can the cloud make testing better? The cloud enables building
U C solutions that scale larger and faster than before where adding
technology leaders push for continuous delivery, the testing team
O needs to partner with the development team in building the right
L capacity in data centers took weeks to months. Now applications
U software. Ashish shares his experience of implementing continuous O can be deployed to cloud servers in not hours but minutes. As
S the cloud enables increases in app deliveries, it also enables
testing across multiple environments with early automation, early U
performance testing and even early User Acceptance Testing. He new services that increase testing efficiency and quality while
T D decreasing total testing time. Tom will discuss the migration of
E explains the core principles of continuous integration/continuous
delivery pipeline, continuous testing and ongoing quality feedback applications to the cloud and the new tools and services that enable
S
T and why testers also need to look at a role transformation testing to be just as agile as the new development processes. He
I into Quality Engineers and Partners with development team. will also address some of the concerns companies have with cloud
N Continuous testing is not easy. Ashish provides a learning strategy computing such as security, reproducibility, and repeatability.
G to help your teams transition from Testers to Quality Engineers so
they can be partners in Agile Transformation journey.
1:30 - 2:30 PM
Learning Objectives:
Leverage the existing test repository through Intention Driven Testing
Implement optimal demand management across concurrent projects and reduce costs
Create visibility into testing progress through standardized and effective communication in business terms
POC Services
C
MY
Test Automation CY
Mobile Testing
2:30 - 3:00 PM
Experienced instructors with subject matter expertise offer a full years worth of public training
courses at popular locations across the United States and Canada. QAI Global Institute has
trained over 140,000 professionals in software quality management, project management, agile
method testing, test automation, estimation, software reviews, and more. Find the right training
for you and your team!
Accenture
Gold Sponsor | www.accenture.com
Accenture is a global management consulting, technology services and outsourcing company, with more
than 358,000 people serving clients in more than 120 countries. Accenture offers the entire breadth
and depth of testing services across a broad array of applications, digital technologies and industries
delivered under flexible business arrangements to help companies shape their digital future and lead
their industry while delivering an exceptional customer experience. With more than 31,000 testing
professionals across more than 30 delivery centers in 17 countries, Accenture serves over 1,000 testing
clients across more than 40 industries. Sponsoring Breakfast.
Checkpoint Technologies
Gold Sponsor and Exhibitor | www.checkpointech.com
Checkpoint Technologies, Inc. is a solutions provider that specializes in Business Technology
Optimization. We are experts in all areas of quality assurance and software testing performance,
functional, and security. Checkpoint Technologies provides leading-edge software solutions, training,
mentoring, senior consulting, and staff augmentation. Our services include both manual and automated
testing with automated testing being an area in which we are known for our expertise. Checkpoint
Technologies is an HP Business Partner and Certified Training Partner. We have assisted numerous
organizations with their implementation of testing solutions with on-site consulting, staff augmentation,
and training. Sponsoring pens.
CompuGain Solutions
Bronze Sponsor and Exhibitor | www.compugain.com
CompuGain Solutions is your trusted product-engineering firm. As a Microsoft Gold Partner, we have
over a decade of experience in legacy modernization, infrastructure virtualization, and cloud migration.
Over time we have mastered one simple paradigm: learn, engage, deliver. Through this process we are
able to continually match the needs of our clients with quality delivery. Our expertise lies in four main
areas: Cloud Engineering, Application Development, Data Services, and Testing Services. CompuGain
Solutions is strategically headquartered in the Washington DC Metropolitan area. Sponsoring Friday
morning coffee break.
Deloitte Consulting
Silver Sponsor and Exhibitor | www.deloitte.com
Deloittes Testing Practice is uniquely positioned to utilize our very strong industry knowledge
coupled with global delivery capabilities to offer a solution that enables building quality across the life
cycle. Whether its a large critical implementation or an Enterprise Testing CoE, we offer end-to-end
functional testing services along with specialized services such as test data management, testing tool
management, mobile, performance, automation, SOA and service virtualization. Sponsoring Bags.
Hexaware Technologies
Platinum Sponsor and Exhibitor | www.hexaware.com/digital-assurance.htm
Hexawares Digital Assurance practice enables enterprises to be digital disruptors in their market place.
In addition to providing end-to-end quality assurance services for modern and legacy enterprise systems,
we have specific offerings to cover the digital dimension of a business assuring the multifaceted testing
needs of a Digital transformation across Digital ecosystem which includes cloud, mobility, big data and
connected devices. More than 100 enterprises worldwide trust Hexawares end-to-end QA for sustained,
predictable quality of their products/applications. We deliver significant value by ensuring customer delight
through significantly lower cost of quality, agility in delivery, secure applications and an excellent end user
experience across multi-channel platforms. Sponsoring QUEST Magazine.
Microexcel
Bronze Sponsor and Exhibitor | www.microexcel.com
Microexcel provides end-to-end QA services in ERP, Product and Web Application testing segments
across various domain, technologies and database leveraging their proven experience and expertise
in functional and non-functional testing. Their perennial focus is in delivering Test Consulting services
that include Testing Evaluation Services, Customized Test Lifecycle Process, Test Automation
Roadmap, Designing & Maintaining Regression Test Suite and measuring performance parameters.
They have experience in setting-up, operating and managing Testing Centers of Excellence (TCoE). As
a part of Managed Testing Services they have dedicated QA Group which helps customers formulate
and establish a set of standardized QA processes. Microexcel offers various automated test solutions
for mobile, web and Continuous integration builds with custom frameworks and industry best practices.
Sponsoring Wednesday morning coffee break.
Mobile Labs
Bronze Sponsor and Exhibitor | www.mobilelabsinc.com
Mobile Labs is a leading provider and innovator of cross-platform mobile application testing solutions.
Its private, internal device cloud, deviceConnect, delivers comprehensive management capabilities
for mobile devices, apps, and users in corporate test labs. deviceConnect fully supports manual testing
and in conjunction with Mobile Labs Trust provides effective and efficient automated mobile application
testing. All without jailbreaking or rooting smartphones or tablets. Sponsoring the Thursday morning
coffee break.
Morningstar
Supporter | www.morningstar.com
Morningstar, Inc. is a leading provider of independent investment research in North America, Europe,
Australia, and Asia. We offer an extensive line of products and services for individual investors, financial
advisors, asset managers, and retirement plan providers and sponsors. Morningstar provides data on
more than 500,000 investment offerings, including stocks, mutual funds, and similar vehicles, along with
real-time global market data on more than 17 million equities, indexes, futures, options, commodities,
and precious metals, in addition to foreign exchange and Treasury markets. Morningstar also offers
investment management services through its investment advisory subsidiaries, with more than $170
billion in assets under advisement or management as of Sept. 30, 2015. We have operations in 27
countries.
Neotys
Platinum Sponsor and Exhibitor | www.neotys.com
Neotys is the leading innovator in Continuous Performance Validation for Web and Mobile applications.
Neotys load testing (NeoLoad) and performance monitoring (NeoSense) enable teams to produce faster
applications, deliver new features and enhancements in less time and simplify interactions across Dev,
QA, Ops and business stakeholders. Neotys has helped over 1600 customers test, monitor and improve
performance at every stage of the application development lifecycle, from development to production,
leveraging its automated and collaborative tooling. Sponsoring Thursday Lunch.
Olenick
Exhibitor | www.olenick.com
Olenick is the largest US-Headquartered software quality specialist. We are experts at ensuring client
success with software projects. Our service offerings include software testing and quality assurance,
project management, business analysis, and other custom solutions.
Founded in 1998, Olenick has over 300 consultants, four global locations, and a client base with a mix of
small- to mid-sized businesses as well as Fortune 500 companies. We have deep industry expertise and
offer delivery methods that include managed services and nearshore. We reduce risk, improve quality,
and provide ROI for our clients.
Orasi Software
Exhibitor | www.orasi.com
Orasi is a leading provider of software, support, training, and consulting services. Through strategic
industry partnerships, we offer market-leading test management, automated testing, application
performance management/intelligence, test data management, continuous delivery/integration, and
mobile testing technologies to enable our customers to focus on a complete software quality lifecycle. For
more than 13 years, Orasi has helped customers successfully implement and integrate software testing
environments to reduce the cost and risk of software failures.
Original Software
Exhibitor | www.origsoft.com
With a world class record of innovation, Original Software offers a test automation solution focused
completely on the goal of effective software quality management. By embracing the full spectrum of
Application Quality Management across a wide range of applications and environments, the company
partners with customers and helps make software quality a business imperative. Solutions include manual
testing, full test automation mobile, UAT and a software quality management platform all delivered with
the control of business risk, cost, time and resources in mind.
Parasoft
Exhibitor | www.parasoft.com
Parasoft develops automated software quality solutions that prevent and detect risks associated with
application failure. To combat the risk of software failure while accelerating the SDLC, Parasoft offers a
Development Testing Platform and Continuous Testing Platform.
Perfecto
Exhibitor | www.perfectomobile.com
Perfecto enables exceptional digital experiences. We help you transform your business and strengthen
every digital interaction with a quality-first approach to creating web and native apps, through a cloud-
based test environment called the Continuous Quality Lab. The CQL is comprised of real devices and
real end-user conditions, giving you the truest test environment available. More than 1,500 customers,
including 50% of the Fortune 500 across the banking, insurance, retail, telecommunications and media
industries rely on Perfecto to deliver optimal mobile app functionality and end user experiences, ensuring
their brands reputation, establishing loyal customers, and continually attracting new users.
QualiTest
Exhibitor | www.qualitestgroup.com QualiTest is the worlds second largest pure play software testing
and QA company. Testing and QA is all that we do! QualiTest is pleased to have been recognized as a
Visionary in Gartners Magic Quadrant for Application Testing Services, Worldwide for two consecutive
years. We design and deliver contextualized solutions that leverage deep industry-specific
understanding with technology-specific competencies and unique testing-focused assets. QualiTest
produces results by combining customer-centric business models, critical thinking and the ability to
gain a profound comprehension of customers goals and challenges.
Seapine Software
Exhibitor | www.seapine.com
Seapine Software, Inc. is a privately held technology company whose application lifecycle
management (ALM) solutions help companies manage the process of developing high-quality complex
productsoften in regulated industries. Our award-winning ALM solutions drive the creation of
recognized brands, life-saving medical devices, even games of the year. From a home-based startup
founded in 1995, Seapine has grown into a multinational corporation with headquarters in Cincinnati,
Ohio, and offices in Europe, Asia-Pacific, and Africa with over 8,500 customers worldwide.
SmartBear Software
Exhibitor | www.smartbear.com
As the leader in software quality tools for the connected world, SmartBear supports more than three
million software professionals and over 25,000 organizations in 194 countries that use its products to
build and deliver the worlds greatest applications. With todays applications deploying on mobile, Web,
desktop, Internet of Things (IoT) or even embedded computing platforms, the connected nature of
these applications through public and private APIs presents a unique set of challenges for developers,
testers and operations teams. SmartBears software quality tools assist with code review, functional
and load testing, API readiness as well as performance monitoring of these modern applications.
SPR Consulting
Gold Sponsor and Exhibitor | www.spr.com
A trusted partner to businesses for more than 40 years, SPR Consulting builds, integrates, tests and
manages technologies that drive enterprise revenue and improve operational efficiency. With its expert
onshore testing team, SPR applies automated, manual, and exploratory testing methods to an array of
web, mobile, and enterprise applications to increase technology usability, functionality, compatibility,
accessibility, security, and performance. Testing services range from setting strategic direction and
transforming testing organizations to building reusable test repositories and performing test execution
as a trusted testing partner. SPR improves access to information, company-wide collaboration and
helps organizations more effectively connect with their customers. Sponsoring Lanyards.
tap|QA
Diamond Sponsor and Exhibitor | www.tapqa.com
tap|QA is a consulting services firm 100% focused on quality. Our consultants wide range of
experience includes Strategic Analysis, Business Analysis, Quality Assurance & Testing within a vast
array of industries. We enable organizations to meet the growing demands of their business partners
and customers. Our solutions include: tap|Strategy- Strategic Consulting to Optimize IT Capabilities,
Technology & Organizational Structure; tap|Technology Implementing Continuous Integration,
Delivery and Deployment through Automation; tap|Lakeshore Cost-Competitive with Offshore, but
embedded Locally with your team, or at our site in Minneapolis; and tap|Consulting Leveraging our
Key Experts and Consultants for your IT & Business needs. Sponsoring the Attendee Appreciation
Night, Exhibitor.
Utopia Solutions
Gold Sponsor and Exhibitor | www.utopiasolutions.com
Utopia Solutions is a global quality and testing firm known for its innovative quality solutions built from
over a decade of helping hundreds of companies achieve breakthrough performance. Utopia Solutions
offers packaged and custom solutions, including mobile quality, performance testing, test automation,
and test outsourcing. These solutions enable businesses and their IT departments to focus on achieving
business outcomes rather than struggle with quality and performance barriers. Sponsoring Portfolios.
Zeenyx Software
Bronze Sponsor and Exhibitor | www.zeenyx.org Zeenyx Software, Inc. is the creator of AscentialTest,
an enterprise level Test Management System that encompasses test planning, development, data
management and execution for applications running on Windows, the web, java, dotNet, terminals and
PowerBuilder. Our patented snapshot technology is the core of AscentialTest. By interacting with these
graphical representations of the target application, users build test steps by dragging and dropping
objects in a visual test editor without recording or scripting. Re-usable steps can be combined to form a
multitude of tests that are as easy to maintain as they are to create. Sponsoring Wednesday afternoon
break.
Zenergy Technologies
Exhibitor | www.zenergytechnologies.com Zenergy Technologies helps its clients launch and maintain
better software. Utilizing QA, test, and automation techniques that enhance software development,
Zenergy tailors solutions that contribute maximum benefit with minimal disruption. Zenergy is on the
forefront of test automation, both commercial and open-source toolsets, including Selenium, and creates
advanced frameworks that reduce maintenance and increase scalability while ensuring a higher return on
investment. Zenergy performs significant amounts of mobile testing, both manual and automated, and has
a U.S. based facility with test engineers at all levels who augment clients own testing efforts and offshore
capabilities.
6
Hexawares
point
Are you formula for
digital delight:
assured of
delivering
Digital assurance: Providing end to
end validation of Bi-Modal IT from
digital transformation to digital maturity
Performance Engineering:
Ensure high performance &
responsiveness across all devices