You are on page 1of 52

2 TABLE OF CONTENTS & FEATURED ARTICLES

CHICAGO
Hexaware Welcomes You to QUEST 2016!
Whats INSIDE Enterprises are looking to increase agility and performance in the IT organizations to maintain
their competitive edge through adoption of devops, agile delivery models, shift left focus and are
5 Managers Workshop embracing digital technologies for their business process transformation. With this, traditional
Quality Assurance methodologies are also undergoing a rapid disruption. The existing themes
6 Networking Events of independent testing, sequential testing life cycle and Testing COEs are evolving now into
12 Full-Day Classes collaborative testing services, business assurance and on-demand Testing as-a-service themes
with innovative commercial models linked to business outcomes.
14 Half-Day Tutorials
The focus on extreme automation, omni-channel support, consistent user experience and speed
18 Keynote Presentations with quality is driving QA organizations to create new service offerings, partner with multiple
25 Hotel Map product/ solution providers to provide an integrated QA platform and leverage the digital platform
to enable significantly faster time to market at a lower cost of ownership with the expectations of
27 Quest at a Glance zero-defect delivery.
28 Training & Certification There has never been a more dire need to redefine the role of QA and to re-skill QA consultants
Prep with multi-functional skills, to provide the requisite Digital Assurance to our clients.
29 EXPO Talks QUEST 2016 provides an excellent opportunity to participate in this phase of QA revolution and to
32 Early Bird Sessions & share and discuss different perspectives on the way organizations and practitioners are painting
Panel Discussion the canvas of testing services, while trying to re-define the QA horizons as they see it.
34 Presentations/Workshops Welcome to QUEST 2016, a must-attend conference that provides a unique platform for IT
professionals, SMEs, service providers, and product vendors to discuss the shift left within the
47 Sponsors & Exhibitors software development process to build in quality. Continue being a thought leader in the testing
and QA domain and know how your teams can stay relevant for the future, by participating in the
discussions on diverse breath-taking strategies for steering QA into the new frontiers of the Digital
world to ensure customer delight and maximize the business outcomes.

Tony Mohanty
Global Head, Digital Assurance Services
Hexaware Technologies Limited
Featured Articles
ZAP, Youre QA Team Leader! How to Build a High Performance Team
By Rebecca Staton-Reinstein, PhD, Advantage Leadership, Inc. ............................................... 8

Distributed Agile Stand-Up Meetings


By Tom Cagley, DCG Software Value ....................................................................................... 10

Regression Test Management Using a User Interface CARTTS Tool


By Mani Rajappa, Quality Assurance, GSI Health ........................................................................ 17

7 Steps to Pragmatic Mobile Testing


By Tom Chavez, SOASTA .......................................................................................................... 21

Test Automation Rant


By Lee Barnes, Utopia Solutions ................................................................................................ 23

Choosing What to Automate


By Brian Le Suer, Zeenyx Software .............................................................................................. 33

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


HOTEL & CONFERENCE OVERVIEW 3

The Renaissance Chicago Downtown


1 West Wacker Drive - Chicago, Illinois 60601 - Phone: (312) 372-7200

About the Hotel


QUEST 2016 will be held at The Renaissance Chicago Downtown. Located in the heart of
the downtown Chicagos theater and shopping corridor, the Renaissance provides the best in
downtown Chicago style, sophistication, and full-service. Each of the luxurious guest rooms
and suites features all the comfort and amenities for which Renaissance has become known.
To accommodate all your travel needs, the hotel will offer a fully-equipped business center,
Club Lounge, and the new WestinWORKOUT Gym. In addition to their expansive fitness
center, you can unwind with a relaxing swim in the indoor pool. The Renaissance is one of
the premier hotel and conference facilities in downtown Chicago. For more information visit:
www.renaissancechicagodowntown.com

Why QUEST?
The QAI Global Institutes Quality Engineered Software and Testing Conference (QUEST) is a week of classes, tutorials, educational
sessions, hands-on workshops, discussion groups, and networking events for IT professionals from around the world. QUESTs unique
learning opportunities address high interest topics and aids IT professionals in increasing their knowledge and skills in this dynamically
changing industry.

Why attend QUEST?


LEARN from industry thought leaders through attending sessions, participating in workshops and discussion groups, and coaching sessions.
ASSESS your practices against those of other companies and organizations as presented by peer managers and practitioners.
APPLY your experience and knowledge to produce solutions during classes, tutorials, and interactive work groups.
CONNECT with fellow practitioners, contribute to the industry, and explore career possibilities. Enjoy four outstanding networking events.

Managers Solutions Workshop (2 Days) Conference (3 Days) Networking


2-day Managers Solutions Workshop with 3 keynote presentations by industry leaders Hundreds of quality professionals to network
experts leading solutions discussions with
48 sessions by leading industry experts
Classes & Tutorials (2 Days) and corporate practitioners in concurrent Managers Solutions Workshop Connection
conference tracks Dinner
5 full-day skills based classes
10 extended workshop sessions Welcome reception
10 half-day skills based tutorials
2 bonus sessions Attendee Appreciation Evening Event
Certification Opportunities Collaboration panel and 4 roundtables Evening reception with exhibitors

Prep class for Certified Software Tester Tools panel and 4 tools roundtables
(CSTE)
Exhibitor EXPO and Talks (2 Days)
Prep class for Certified Software Quality
Analyst (CSQA) Exhibitors to browse
Full practice tests for CSTE and CSQA 16 EXPO Talk products/services
demonstrations

Leadership Built-in Software Quality Automation & Tools Testing Innovations


Collaboration
Agile ATDD CI
Culture of Quality
Deliverables Cucumber Cloud
Global Teams
Estimation Frameworks Dev/Ops
High Performance Teams
Lean Jmeter Exploratory
Problem Solving
Planning & Design Open Source Mobile
Quality Indicators
Process Selenium Performance
Risk Management
Requirements SpecFlow Test Data
Selling Quality
Test Strategy Security
Transformation

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


4 PARTICIPATING COMPANIES/ORGANIZATIONS

SPONSORS

Participating Companies:

Accenture Emmi Solutions PMI Chicagoland


Agile Professional Learning Equifax Polaris Solutions
Network-Chicago ExxonMobil QAI
American Family Insurance GSI Health QASymphony
AT&T HALOCK Security Labs QualiTest Group
Audible Inc. HERE Quality Perspectives
Banque Nationale du Canada Hexaware Technologies Quality Squared
Cars.com IEEE Chicago Section ROKITT
CAST software IIBA Chicagoland Chapter Seapine Software
Centric Consulting Jemurai SmartBear Software
Checkpoint Technologies Lincoln Financial Group SOASTA
Chicago Quality Assurance Microexcel Inc. Sodoto Solutions
Association
MITRE SPR Consulting
CIBC
Mobile Labs tap|QA
Cognizant Technology
Solutions Nationwide TEKsystems
CompuGain Neotys Ulta Beauty
Conflair Inc NueVista Utopia Solutions
Corevu, LLC OLENIK XBOSoft
DCG Software Value Orasi Software Zeenyx Software
Deloitte Consulting Original Software Zenergy Technologies
edo Interactive Parasoft
EMC Perfecto

*Participating entities are as of March 25, 2016.


All logos are trademarks of their respective companies and/or organizations.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


QAI EXCLUSIVE MANAGERS SOLUTIONS WORKSHOP 5

Managers Solutions Workshop


Monday & Tuesday, April 18 & 19

The Managers Solutions Workshop focuses on the top Connections Dinner


challenges facing managers in building, testing, and delivering In addition to the two-days interactive workshop, participants will
quality software applications and products in todays fast-paced also have the opportunity to attend the Managers Connection
and demanding environment. This intense and interactive Dinner. This evening will provide the workshop attendees a
workshop provides a unique opportunity for managers to learn chance to discuss the topics and related quality issues in a more
from the QAI Global Institutes professional staff and industry relaxed setting, and provides an ideal opportunity for networking
leaders and to develop solutions with their peers from other with peers and exchanging ideas.
companies. Each attendee will have the opportunity to have
their specific challenges and concerns addressed during the Who Should Attend
workshop. An example of some of the challenges that have been This workshop is designed for managers responsible for the
addressed in past Managers Solutions Workshops include: building, testing, and delivering quality software applications
within their companies or software products for the marketplace.
Proving the value of software quality and testing Persons who would benefit the most from attending the
Managers Workshop are those holding positions of, or similar to:
Transitioning to Agile
IT/IS Vice Presidents and Directors
Defining quality and testing metrics
Quality Managers
Improving the software testing process
Quality Assurance Managers
Building quality in throughout the software development
process Testing Managers
Making test automation work Project Managers
Establishing a testing center of excellence
Thought Leaders
Estimating the testing effort
Improving requirements
Building effective teams

Why Attend
QAI Global Institutes studies show that if an IT organization
forms an internal team to develop a solution to a current Carolyn Swadron Chris Lawson Angela Dugan Paul Herzog
challenge, the cost to the organization can range from $10,000
to $50,000. By attending the Managers Solutions Workshop you
will get solutions to your work challenges at a fraction of this cost,
plus connect with peers who can be contacted for advice in the
future.
Workshop Format
Prior to the Managers Solutions Workshop, participants complete
a survey about their current challenges. These challenges are
consolidated into a list of potential topics, which are ranked in Nancy Kastl Shaun Bradshaw Beth Wisdom
order of importance to the workshop participants. Four to six
challenges become the agenda for the workshop.
Testimonies
Each challenge is introduced to the workshop participants, The Managers Workshop is a valuable way to share your
who then break into small work groups. Using the QAI Global lessons learned, current needs, concerns, and challenges. I
Institutes problem-solving approach, the work groups define highly recommend attending and look forward to returning next
the challenge and develop potential solutions based on their year.
collective experiences and shared knowledge. Each group
selects one of their potential solutions and defines how to Well chose and well balanced selection of topics presented. A
tactics for the solution. Each group presents their proposed nice diverse group of attendees. Well worth the time. Thanks.
best solution which is critiqued by the workshops leaders and
guest industry experts. Additional time is spent by the guest An awesome lineup of guest experts! Great venue!
industry thought leaders to share their solutions and answer I love the excellent practical experience that I can actually
specific questions from the workshop participants. All workshop implement! Very nice.
participants are given opportunities throughout the workshop to
bring their specific challenge before the group to ask for friendly Dont miss this great opportunity to be part of a select group of
group advice. Participants will leave the workshop with a series managers and industry thought leaders who will aggressively
of potential solutions to todays quality challenges. tackle todays most pressing quality issues!

**The Managers Solutions Workshop is an entirely independent function of the QUEST Conference. Prior registration is required to attend.**

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


6 NETWORKING EVENTS

Opportunities to Connect
Managers Workshop Connection Dinner
Monday, April 18th ~ 5:30 - 8:30
Hosted by Tom Ticknor, QAI COO and Nancy Kastl, Quest Conference Chair
Reserved for the attendees of the Managers Solutions Workshop, this dinner event provides
an opportunity to continue discussions from the workshop and connect with your peers, the QAI
faculty, and thought leaders in a more informal setting. This evening outing is an ideal forum for
networking as well as sharing and exchanging ideas and experiences.

Welcome Reception
Tuesday, April 19th ~ 4:30 - 6:00

Sponsored by

This reception is open to all conference attendees and is included in the registration fee. This
event provides an opportunity to meet fellow conference attendees in an informal setting with
appetizers, drinks, and raffles. Information will be provided to help out-of-town guests become
familiar with the Chicago area.

Attendee Appreciation Night in Chicago House of Blues


Wednesday, April 20th ~ 5:30 - 9:30 PM

Sponsored by
Join tap|QA and your fellow attendees for a spectacular private event at the
Chicago House of Blues. This notoriously cool venue is located in historic
Marina City Complex, downtown along the Chicago River. You can let loose
after a day of education at Quest in one of the windy citys premier music
venues. Attendees will enjoy dinner and live music.
The events live entertainment will be provided by the Gina Glocksen Band.
Gina Glocksen is best known as a top finalist of the 6th season of American
Idol. Ginas musical influences and styles range from rock, performing pop,
country and hip-hop favorites in her live show.

EXPO Reception
Thursday, April 21st ~ 5:00 - 6:30 PM
Sponsored by EXPO Exhibitors
The closing event of the Exhibitors EXPO is a reception open to all conference attendees. This
is a great opportunity to meet with the exhibitors in a social setting and to network with fellow
conference attendees. The main event at this reception will be the raffle of exhibitors prizes.
There is also surprise entertainment planned for this reception!

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


We test software.
Find out how our nearshore model, tap | Lakeshore is
replacing offshore at similar costs and delivering higher value
with the growing demand of quality and mobile readiness.

Meet Jennifer Bonine at her


sessions, Leading Change When
Youre Not In Charge and Whats
Your Leadership IQ?
Tuesday, April 19th 8:30am -and
12:00pm
1pm.

At our booth and tapQA.com, we will be discussing:


Strategic and tactical mobile quality
Continuous integration
Mobile device automation and emulation
Nearshore solutions for automation and manual
8 FEATURED ARTICLE

ZAP, Youre QA Team Leader! How to Build a High Performance Team


By Rebecca Staton-Reinstein, PhD, Advantage Leadership, Inc.

Average leaders focus on results...Good leaders focus on... Ten Dos and Donts of Engaging and Motivating People
behaviors that will get the results...great leaders focus on...emotions
People are coin operated! Barry Gibbons, former CEO, Burger
that will drive these behaviors. Hitendra Wadhwa King
QA managers often start with no experience. One day youre a highly People need to be rewarded with money - a powerful symbol of the
competent technical person; the next youre in charge of people and at a value exchange between company and employee. You cant just hand
loss. Youre told to continue technical work while managing your team. out pounds, dollars, rubles, rupees, or Euros every day. Every QA team
Poor IT results from this tradition are well documented. leader has an infinite supply of highly effective, nonmonetary motivators
that can be quite powerful day-to-day.
Break the pattern. Learn great management skills. Forget titles. Use
practical, proven solutions to get results your management requires.
DELEGATION DOS DELEGATION DONTS
These are survival and thrival skills in todays global, do-more-with-
less business culture. DO place motivation in context of your strategic, DONT expect the random atta boy to have an effect
operational, or project plan on performance
Start with a solid plan and Delegate, Motivate, and Coach for results.
DO describe positive and corrective feedback DONT say, Nice report. Person doesnt know what
specifically. to repeat.

Ten Dos and Donts to Assure Successful Delegation


DO give feedback as soon as possible to reinforce DONT wait until yearly evaluation; its too late for
Dont tell people how to do things, tell them what to do and let them effectively. learning.
surprise you with their results. - General George S. Patton
DO learn what motivates person. Target rewards DONT expect one-size-fits-all rewards to work for
Heed General Pattons admonition; get more work done, improve team are authentic. everyone.
morale and engagement, and let team members focus on what they do
best. Avoid being a team leader who only delegates when its crunch time.
DO involve people to plan details and foster DONT hand person the work plan and expect
ownership. enthusiasm
To get great results, plan well and delegate well. Delegated tasks, projects
or assignments should be based on your strategic project plans. Have
team members develop their detailed work plans based on the nature of DO catch em doing something right. DONT deny praise because person just doing the job.
the work.
Delegation prepares you to motivate and coach as the person carries out DO select specific rewards based on person. DONT assume everyone wants the same things.
work, reviews progress, and takes ownership, and you give feedback for
continued results. DO set up situations where person will be self- DONT assume you have power to motivate.
motivated.
Delegation is THE critical way to get work done through others. Here are
keys to successful delegation, no matter how big or small the assignment. DO understand people need a sense of purpose, DONT keep people in the dark about the big picture
Get results while team members are more engaged and productive. mission, and WHY.

People expect raises, bonuses or other monetary rewards eventually.


DELEGATION DOS DELEGATION DONTS
Discover what helps each individual become more engaged. Some people
thrive on titles, others on relationship building, and others on solving
DO review what you are asking him or her to do - DONT DUMP tasks on people, especially if you didnt
interesting problems. Study psychology AND individuals. Chat informally.
simple task or complex project. finish on time. Observe what people gravitate towards or are involved in outside of work.
Start slowly with one person. Develop a simple motivation plan based on
DO set concrete objectives for delegated work; DONT expect the person to read your mind or know your observations. Advance to the next team member. Motivating is a self-
due dates, targets, quality of output. everything. motivating process for you too. Remember, people coin operated AND
thank-you operated.
DO share constraints person must deal with to DONT leave person with impression there are no
plan. constraints.

Ten Dos and Donts of Employee Coaching


DO ask for plan and provide guidelines: simple
tasks, a few actions; projects, extensive.
DONT TELL team member HOW to complete work. Let
person develop a plan for review. Success seems to be connected with action. Successful people
keep moving. They make mistakes, but they dont quit. -- Conrad
Hilton
DO review plan. Ask questions; stimulate thinking, DONT TELL person whats wrong, missing or weak.
engagement, and ownership. Guide discovery. Coaching combines Delegation and Motivation. When you delegate work
and provide feedback regularly to your team members, you stay focused
on helping people get great results, improve, and make progress against
DO help person develop a reasonable plan for full
ownership by team member.
DONT insist person do things exactly as you do. They
may have a better way. the plan. Coaching is not just an activity where you deal with problems.
Coaching is a process to prevent problems. Dont avoid coaching until
a crisis or the annual review. Planning is the basis for good coaching.
DO regular, formal reviews of results at logical DONT TELL people, See me if you have problems. Delegate well and motivate well to coach well.
time points.
Good coaching takes time time to delegate, time to prepare, time to
DO use reviews to examine Lessons Learned to DONT ignore slippage or Lessons Learned. Help
deliver, time to motivateand time to develop an effective coaching style.
adjust plan. person learn and grow. As a QA team leader, invest in your teams success. Results are greater
employee engagement, growth, and productivity so you achieve your
DO encourage person to look for ways to improve DONT ignore need to develop a new plan when results objectives when you act on results and dont quit.
results even if they are good. are off track.
Rebecca Staton-Reinstein, Ph.D., CSQA, and President of Advantage
DO give feedback immediately; take corrective DONT let poor results continue or delay discussion until
Leadership, Inc., works with companies and IT departments that want
action or praise good performance specifically. performance evaluation. greater results through engaged employees to transform the organization.
She is the author of several books based on successful work with her
clients in all economic sectors spanning the globe. Visit our website http://
www.AdvantageLeadership.com/ Rebecca@AdvantageLeadership.com
Your return on time invested is a high performing, engaged team. You are
free to be an effective QA team leader. As you improve your delegation
skills, you and your team improve results. Let them surprise you with their
(great) results.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


YO U R W I L L I S TO W E R
TESTING TEAM
SPRs suite of testing services
Automated Exploratory Functionality Accessibility Data
Manual Usability Compatibility Security Performance

SPR.CO M
Quest Advertisement.Finalai.pdf 1 1/8/2016 9:47:02 AM

Hard
C
things
made
M

CM

easy with
MY

m
CY

. co
CMY

y x
en
K

AscentialTest ww
w.z
e

Automated testing, manual testing and test management for


Windows. Web. DotNet. Java. PowerBuilder. Terminal.
10 FEATURED ARTICLE

Distributed Agile Stand-Up Meetings


By Tom Cagley, DCG Software Value

The daily stand-up meeting is the easiest Agile practice to 6. Make sure the meeting stays crisp. Stand-up meetings by
adopt and the easiest to get wrong. Distributed teams, teams definition are short and to the point. The team needs to ensure
where one or more team members are in a different location, that the meeting stays as disciplined as possible. All team
present several challenges, including time zones, accents, members should show up on time and be prepared to discuss
organization affiliation and sometimes language. Distributed their role in the project. Discussion includes the willingness to ask
Agile teams require a different level of care and feeding than a for help and to provide help to team members.
co-located team in order to ensure that they are as effective as 7. Use a physical status wall. While the term distributed
possible. This is even truer for a team that is working through screams tool usage, using a physical wall helps to focus the
their forming-storming-norming process. Core to making Agile- team. The simplicity of a physical wall takes the complexity of tool
as-framework work effectively are the concepts of team and usage off the table so the focus can be on communication. Use
communication. Daily stand-up meetings are one the most of a physical wall in a distributed environment will mean using
important communication tools used in Scrum or other Agile/Lean videoconferencing to show moving tasks on the wall (a picture
frameworks. Techniques that are effective in making daily stand- can be provided to the team after). If videoconferencing is not
ups work for distributed teams include: available, use a tool that EVERYONE has access to. Keep tools
1. Deal with the time zone issue. There are two primary options as simple as possible.
to deal with time zones. The first is to keep the team members 8. Dont stop doing stand-ups. Stand-up meetings are a critical
within three or four time zones of each other. Given typical communication and planning event, not doing stand-ups for a
sourcing options, this tends to be difficult. A second option is to distributed team is an indicator that the organization should go
rotate the time for the stand-up meeting from sprint to sprint so back to project manager/plan-based methods.
that everyone loses a similar amount of sleep (share the pain
option). One usable solution that can be tried when distributed Like any other distributed team meeting, having good
teams cant overlap is to have one team member (rotate) staying telecommunication/video tools is not only important, it is a
late or coming in early to overlap work times. prerequisite. If team members cant hear each other, they CANT
communicate.
2. Identify and attack blockers between stand-ups. Typically,
on distributed teams, all parties will not work at the same time. The practice of stand-up meetings is one of the first techniques
Team members should be counseled to communicate blockers most organizations adopt when they begin to implement Agile
to the team as soon as they are discovered so that something regardless of whether the team is co-located or distributed.
discovered late in the day in a one-time zone does not affect Because of the simplicity of the technique, organizations forgo
the team in a different time zone that might just be starting to coaching or training on how to do stand-up meetings. They
work. One group, I worked with had stand-ups twice each day rely instead on the best efforts of everyone involved. Without
(at the beginning of the day and at the end of the day) to ensure coaching, stand-up meetings can be implemented poorly, robbing
continuous communication. the organization of the benefits of the technique.
3. Push status outside the stand-up. A solution suggested by Matt The daily stand-up meeting IS the easiest Agile practice to adopt
Hauser is to have the team answer the classic three questions and the easiest to get wrong. The stand-up meeting provides
(What did you do yesterday? What will you do today? Is there teams with a lightweight tool to re-plan and coordinates activities
anything blocking your progress?) on a WIKI for everyone on the on a daily basis. Doing a daily stand-up well helps to ensure that
team to read before the stand-up meeting. This helps focus the a team cant get dramatically off course without notice. While
meeting on planning or dealing with issues. the process is easy to understand and to deploy, a good stand-
up requires care and feeding so that bad habits dont develop.
4. Vary the question set being asked. The process of varying the Organizations should have a coach participate on a regular basis
question set keeps the team focused on communication rather so that specific problems are exposed. The coach can provide
than giving a memorized speech. For example ask: feedback and constructive criticism to help teams continually
1. Is anyone stuck? improve. Investing in good stand-ups helps teams deliver value
effectively.
2. Does anyone need help?
Stand-ups are nearly ubiquitous in Agile. I would do stand-ups
3. What did not get completed yesterday?
even if I were not doing Agile. However, despite their simplicity,
4. Is there anything everyone should know? the added complexity of distributed teams can cause problems.
This technique can be used for non-distributed teams as The whole team is responsible for making the stand-up meetings
well as distributed teams. work. While the Scrum master may take the lead in ensuring
the logistics are right or to facilitate the session when needed,
5. Ensure that everyone is standing. This is code for making sure everyone needs to play a role.
that everyone is paying attention and staying focused. Standing
is just one technique for helping team members stay focused.
Other tips include banning cell phones and side conversations.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


INTERNATIONAL SOFTWARE CERTIFICATIONS BOARD CERTIFICATIONS 11

Certification Programs CE
Software
S
F IC
e
CERTIFICATIONS
www.softwarecertifications.org

Software Testing Business Analysis


Aligned to the Software Testing Body of Knowledge, these certifications The need for improved and more reliable information transfer requires
evaluate awareness of the testing principles, knowledge of the testing Software Business Analyst professionals who can effectively bridge the
function, the different types of testing and the techniques and tools which knowledge and language gap between the business and IT communities.
can be used to carry out and manage the Testing process.
Certified Associate Business Analyst (CABA)
Certified Associate in Software Testing (CAST) A Foundation Level Certification for Software Business Analysts, System Ana-
A Foundation Level Certification for Software Testers, Software Developers, lysts, and recent college graduates.
System Analysts and recent engineering graduates. Demonstrates an understanding of software business analysis principles
Demonstrates an understanding of testing principles and practices. and practices.
Suitable for entry-level individuals who are interested in making a career Suitable for entry-level software engineers interested in making a career in
in testing. software business analysis.

Certified Software Tester (CSTE) Certified Software Business Analyst (CSBA)


A Practitioner Level Certification for Test Engineers, Test Architects, Design A Practitioner Level Certification for Business Analysts, Project Leads and
Analysts and Test Leads. Architects.
Demonstrates a professional competency for practice of quality control Demonstrates proficiency to manage the link between the business and
and testing. information technology communities.

Certified Manager of Software Testing (CMST)


A Managerial Level Certification for Test Managers, Test Leads, Test Architects
and Project Managers.
Demonstrates capabilities to practice and manage the software testing
On Demand Training Courses
function.
Suitable for existing and to-be managers in the software testing function. On Demand Virtual Courses provide 24/7 access to the best exam
prep courseware available. The courses include a downloadable
copy of the Body of Knowledge book, course workbook,
recordings of each session, and the course specific items listed below.

Software Quality Assurance Certified Associate in Software Testing (CAST)


Overview of the Software Testing Body of Knowledge for CAST with
Aligned to the Software Quality Assurance Body of Knowledge, these certi- expert instructors (totaling over 40 lessons).
fications check the proficiency in the principles and practices of the quality Over 200 multiple choice questions that simulate the types of objective
assurance function. questions that will be experienced on the CAST exam.
70 essay questions with sample answers to reinforce the material.
Certified Associate in Software Quality (CASQ) A final sample exam to test your exam readiness is provided.
A Foundation Level Certification for Software Engineers and recent graduates.
Demonstrates foundation level understanding of quality assurance prin- Certified Software Tester (CSTE)
ciples and practices. Overview of Software Testing Body of Knowledge for CSTE with
Demonstrates the understanding of quality principles, concepts, and expert instructors (totaling over 50 lessons).
practices. Over 250 multiple choice questions that simulate the types of objective
questions that will be experienced on the CSTE exam.
Certified Software Quality Analyst (CSQA) 90 essay questions with sample answers which simulate constructive
A Practitioner Level Certification for experienced Quality Analyst, SQA Team response questions that will be experienced on the CSTE exam.
Leaders and Members. A final sample exam to test your exam readiness is provided.
Demonstrates professional competence in the practices of QA in the IT
profession.
Provides a complete overview of the quality function. Certified Software Quality Analyst (CSQA)
Overview of CSQA Common Body of Knowledge with expert
Certified Manager of Software Quality (CMSQ) instructors (totaling over 40 lessons).
A Managerial Level Certification for SQA Managers, Architects and Project Over 200 multiple choice questions that simulate the types of objective
Managers. questions that will be experienced on the CSQA exam.
Demonstrates capabilities to practice and manage the software quality 40 essay questions with sample answers which simulate constructive
function. response questions that will be experienced on the CSQA exam.
Suitable for existing and to-be managers in the software quality function. A final sample exam to test your exam readiness is provided.
Provides a tool to predict the likelihood of success of individuals consider-
ing managerial roles.

Certified Manger of Software Testing (CMST) and Certified Manager of Software


Quality (CMSQ) On Demand Courses will be available in second quarter of 2016.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


12 FULL-DAY CLASSES
Monday, April 18, 8:30 AM - 4:30 PM

LEADERSHIP Test Leadership Problem Solving


Lynn McKee, Quality Perspectives
This one day course focuses on developing problem solving skills given the ongoing challenges facing testing leaders.
Challenges including unrealistic project mandates, delivering bad news, doing more with less, team morale and
inspiration, the perceptions and misconceptions of testing, leading change, and more. Real world examples and specific
techniques for tackling these challenges will be explored. A combination of lecture, facilitated discussion, and experiential
techniques will provide attendees opportunity to share their experiences and add to what theyve learned.
Learning Objectives:
See beyond the obvious and find opportunities within every problem
Apply the 4 Most Effective Ways Leaders Solve Problems as defined by Glenn Llopis, to testing specific challenges:
- Transparent Communication
- Breaking Down Silos
- Partnering with Open-minded People
- Solid Foundational Strategy
Developing the positive perspective to tackle problem solving on a daily basis
Recognize your current leadership strengths and weaknesses for problem solving
Apply lessons learned in the workshop to a current organizational challenge

AGILE Agile Estimation


Tom Cagley, DCG Software Value
Estimates and customer satisfaction are intertwined because they set expectations. Estimates set the development
teams expectations about resources that will be available to deliver the project, including effort, people, and calendar
time. From the customers point of view, an estimate will generate expectations about what will be delivered, when it will
be delivered and what the project will cost. The dark side of estimation is that once an estimate is even whispered, it
quickly become set in stone and gains the power to dissatisfy. Learning to estimate better yields better relations whether
you are estimating value, coding or testing! This one-day course focuses on providing QA managers, test analysts, and
test automation engineers with an in-depth understanding of the principles and methods of estimating leveraged in an
Agile development environments through a combination of lectures with hands on technique practice.
Learning Objectives:
Managing Agile projects
Impact of size, speed and behaviors in an Agile environment
Agile and Lean estimation practices
Release Planning
Why cycle time is more important than capacity utilization
Visibility both to and from the team

LEAN Trimming Down Your QA Effort While Maintaining Quality


Clyneice Chaney, MITRE
Are you struggling meeting demands for quality and effective testing in your organization? Do you feel that there has to
be a better, quicker way to get things done? Is your quality organization delivering effective and precise work? Are the
processes that comprise your organization fine-tuned for excellence? Do you know the value that you are bringing to
your organization? If you dont know or arent sure, this course is for you. Those of us in quality face many challenges
in todays software development world. Quality Assurance and even testing is often perceived as an extra, as overhead
and generally, a cost center. To some extent, this is true. It is an investment in the long term and quality of your product
or service in where the value can come back to you in any number of ways and most are not immediate or instant.
Quality organizations that know the effectiveness of their organization and can demonstrate value are much more
successful. This course takes a look at applying Lean principles to Quality Assurance and testing processes to see if we
can eliminate waste and improve.
Learning Objectives:
Been introduced to basic lean concepts and their applicability to testing and quality assurance
Looked at the quality assurance and testing process from a lean perspective
Explored potential areas of waste in quality assurance and testing
Been introduced to techniques to implement improvements for potential waste areas
Practiced using lean techniques for identifying and resolving potential testing and quality assurance waste

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


FULL-DAY CLASSES 13

Monday, April 18, 8:30 AM - 4:30 PM

MOBILE Mobile Testing: Manual and Automated


Michael Yudanin, Conflair
The course is designed to provide software quality assurance and testing professionals with the background and tools
necessary to organize manual and automated testing for mobile applications. It surveys the state of mobile technology,
focuses on the software quality challenges it poses, and offers ways to increase the efficiency and effectiveness of
mobile testing. The course discusses how to integrate mobile testing effort into the overall testing process. It also offers
a focused look on the automation of mobile testing: the need, the options, and the tools. The course will end with a live
demonstration of a mobile test automation approach.
Learning Objectives:
What is the state of the art of mobile world
What are the challenges mobile technologies pose to software QA and testing
How to integrate mobile testing in the overall testing process
How is it possible to automate mobile application testing
What are the criteria for choosing mobile automation approach
What are the main types of tools, their advantages and disadvantages

AUTOMATION Getting Started with Selenium Test Automation


Chris Lawson, Zenergy Technologies
Have you ever wanted to dive into an open source test automation tool but didnt know where to begin? This one-day
course focuses on getting started with developing automated web tests using Selenium. This class is for anyone who
would like to learn more about core Selenium capabilities or even those new to automation. A combination of lecture with
concrete examples, classroom discussions, and proven techniques provide attendees with a good understanding of what
it takes to successfully write Selenium automated tests. This includes basic object oriented programming concepts with
JAVA through implementing effective Selenium WebDriver methods.
Learning Objectives:
What Selenium is and how it can be used in real world scenarios
Essential object oriented programming constructs necessary for developing basic automated tests
Core Selenium methods and syntax for programmatically controlling browsers
Challenges of automated Web testing and approaches for overcoming them
Key development strategies for creating maintainable automated tests
Integrating additional open-source tools to enhance automated testing process
Basic automation framework concepts and design considerations

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


14 HALF-DAY TUTORIALS
Tuesday, April 19, 8:30 AM - 12:00 PM

LEADERSHIP Leading Change When Youre Not in Charge


Jennifer Bonine, tap|QA
You try to implement a change in your organization and it doesnt get the support that you thought it would and you cant figure out why. You have a
great idea but cant get the resources required for successful implementation. Determine which ideas will and will-not work within your organization using
Jennifers shared toolkit. Learn five rules for change management. Use a checklist to determine the type of change process needed in your organization.
Master techniques for communicating your ideas to your target audience and a set of questions you can ask to better understand your
executives goals, and methods for overcoming resistance to change from teams you dont lead. These tools, together with an awareness
of your organizations core culture, will help you identify which changes you can successfully implement and which you should leave until
another day.
Learning Objectives:
Learn your organizational culture and align that to the changes you are looking to make
Anticipate reactions to changes and target your communication strategy
Apply personality type differences to your communication strategy and overcome resistance

MEASUREMENT Agile Metrics - Its Not About Velocity


Philip Lew and Steve Gohres, XBOSoft
When implementing software quality metrics, we need to first understand the purpose of the metric and who will be using it. Will the metric be used for
measuring people, the process, illustrate the level of quality in software products, or drive towards a specific objective? QA managers typically want to
deliver productivity metrics while management may want to see metrics that support customer or user satisfaction or cost related (ROI) initiatives. With
agile development methods, we often lose sight that our primary objective is the same, quality. Many organizations are myopic on the primary objective
of velocity. However, velocity means little without quality. Define quality for your organization with an agile looking glass with intermediate metrics that
lead to both quality and velocity. Learn to develop and implement software quality metrics with actions toward improving on these two primary objectives.
Learning Objectives:
How to connect your metrics with agile related objectives, to ensure your agile process is on track
How to develop a measurement framework that measures not only typical test results such as defects, but processes and
functions and their alignment with your agile objectives.
How to include measurements, metrics, objectives, questions and answers (for your stakeholders) to see if they really want
to be agile or are just talking
How to use metrics to not only evaluate, but also predict what could go wrong in your agile process

REQUIRMENTS Making Requirements and User Stories Testable


David DeWitt, NueVista
Regardless of the format, requirements are often written without adequate attention to how they can be tested and accepted by the business
stakeholders. During this interactive session the participants will be given a practical framework for understanding how to strengthen the testability of use
cases, user stories, and requirements specifications.
Learning Objectives:
Review the frameworks for typical requirements statements, including use cases, user stories, and traditional requirements
specifications
Identify typical verification and acceptance shortcomings of use cases, user stories, and traditional requirements specifications
Review a requirements quality checklist that can help predict the testability of the requirement regardless of format

PROCESS Maintaining Testing Integrity Under Pressure


Carolyn Swadron, CIBC
Effective quality assurance / testing adds critical value to a project providing that project managers, stakeholders and test leads understand its purpose
and plans, and carry out execution effectively. This session describes different types of testing that need to occur and what they need to accomplish.
It addresses options and respective pros and cons of testers with different skills and backgrounds participating at different times during a project. It
reviews common challenges that test leads face when planning and executing testing and suggests approaches for handling these
effectively. This session provides the opportunity for attendees to participate in realistic testing scenario exercises, share their testing
challenges, and benefit from others experiences in similar situations.
Learning Objectives:
Learn about different types and purposes of testing that occur under the label Quality Assurance
Learn how different types of testers can affect the value that testing provides
Learn common major challenges that increasingly affect testing today and options for addressing them.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


HALF-DAY TUTORIALS 15

Tuesday, April 19, 8:30 AM - 12:00 PM

AUTOMATION The Development and Implementation of an Automation Framework


Dean Carvin, Checkpoint Technologies
Shift left testing has created a strong push in the market to apply new tools and techniques to support faster, leaner test automation earlier in
the SDLC. While this is an important and logical step in the evolution of test automation, it causes many organizations to lose sight of the still
critical regression phase of testing. Regression testing remains the phase of testing where you are most likely to realize the greatest ROI utilizing
test automation. With the ever-growing speed with which software must go to market and the number of platforms it must support,
its imperative to have a regression test automation strategy allowing fast script development, solid data management, and minimal
maintenance. Dean provides an automation strategy that supports your organizations culture, resources and budget by determining the
type of framework to implement along with a plan to accomplish it. Keep your regression testing effective and maintainable by using this
framework.
Learning Objectives:
Learn the benefits of a well-planned and designed test automation solution
Understand your organization and what automation solution (tools & methodology) would best fit
Be introduced to a strategic process to implement your test automation solution

Tuesday, April 19, 1:00 PM - 4:30 PM

LEADERSHIP Whats Your Leadership IQ?


Jennifer Bonine, tap|QA
Need a way to measure your leadership IQ or improve as a leader? Find out your core leadership competencies and how to build on and improve them.
Jennifer shares a toolkit to help you with all of the above including personal assessment of your leadership competencies. Use the toolkit to explore
a set of eight dimensions of successful leaders and improve competencies that are not in your core set of strengths. Use these tools to become a
more effective and valued leader in your organization. This interactive session will involve team activities and case studies on leadership
situations. Exercises help you gain an understanding of yourself and strive for balanced leadership through recognition of both your
strengths and your development opportunities.
Learning Objectives:
Explore your personal leadership style and see how others lead
Adapt your style to work well with other leaders and contributors in your organization for success
Sell your ideas and suggestions in the organization and influence for impact

PROCESS Value Stream Mapping and Kaizen in Agile Retrospectives


Angela Dugan, Polaris Solutions
Continuous self-improvement in agile teams is traditionally done through agile retrospectives, a form of post-mortem after the completion of an iteration.
More often than not, retrospectives begin to fade and the list of action items keeps growing until teams simply succumb to business-as-usual practices.
Learning Objectives:
Determining if your current agile retrospectives are being effective
Learn Value Stream Mapping and Kaizen Burst lean techniques
Using VSM and Kaizen in agile retrospectives

RISK (Almost) Everything I know about testing I learned playing poker


Matthew Eakin, Centric Consulting
What do software testing and Texas Hold Em poker have in common? More than you might think. Risk assessments, planning (but not writing a plan),
bluffing, reading a bluff, resource allocation and many more software testing techniques are found in playing poker. In this highly interactive session Mr.
Eakin will walk some volunteers through one (or many) hands of Texas Hold Em. With each turn of the cards we will apply testing techniques familiar
to us to (hopefully) win the hand. Dont worry, unlike real life poker were not going to take your money! At least not all of it.
Learning Objectives:
Learn how to effectively do and apply a risk assessment
Understand how to plan and the importance of planning
Understand why creating a plan can be a bad idea

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


16 HALF-DAY TUTORIALS
Tuesday, April 19, 1:00 PM - 4:30 PM

MOBILE Usability Goes Mobile


Susan Brockley, ExxonMobil
The introduction of mobile devices and applications presents new challenges to traditional usability testing practices. Identifying the differences
between usability testing techniques for mobile applications and traditional desktop applications is critical to ensuring the acceptance and use of mobile
applications. New equipment requirements for the mobile platforms testing add to the transition issues.
Experience a short mobility usability test and identify the process changes that need to be considered for your change to the mobile platform. Create a
plan that will help you transition your traditional usability testing program into a mobile environment. Learn a series of tips that will smooth the
path of starting to test in the mobile area. Join Susan to make your transition into the mobile testing field successful. Join Susan to expand
your skills in Mobile Usability Testing
Learning Objectives:
Learn what makes mobile usability different from traditional usability and why that matters
Modify traditional usability techniques to make them applicable to mobile devices
Tailor usability these techniques to get traction in your organization

AUTOMATION Introduction to ATDD using Ruby, Cucumber, Watir-WebDriver


Joseph Ours, Centric Consulting
There are multiple challenges with automating in an agile context however, there are some tools that can make this easier. Using Behavior Driven
Development (BDD) and Acceptance Test Driven Development (ATDD) with Cucumber and WATiR-WebDriver, we will show how it is possible to
automate within a sprint. This class introduces students to agile automation using Open Source tools Ruby, Cucumber, and WATiR. By the end of the
class, students will have a functioning project and basic test script. Join Joseph to see how easy this technology is and start on a path of continued
automation and ATDD learning. This will be a hands on workshop where everyone will learn, through doing, how to automate running a browser, how to
tie tests into living specifications, and basic ATDD principles, all guided by one of our senior subject matter experts.
Learning Objectives:
Create your own project and test script
Learn Acceptance Test Driven Development
Wire scenarios to test steps

ROUNDTABLES & COACHING

Special Interests Roundtables


Wednesday & Thursday during Lunch
Conference attendees have a wealth of knowledge and experience to share. That is why we are turning some of our circular tables
at lunch into special interest group roundtable discussions. Look for the topic signs at these special designated tables and join in
the group discussion over lunch. This is also an excellent opportunity to connect with others who share your topic of interest and
add them to your network of professional contacts. All you need to bring to the table are your questions and your experience.

No prior sign-up is required, but seating will be based on a first come first serve basis.

Coaching Sessions
Wednesday, Thursday and Friday based on availability
Have you ever heard an interesting idea or solution in a conference presentation and would have liked to discuss it further with
the speaker? But, when you tried to talk to the speaker immediately at the end of the presentation, you found that the conference
schedule just didnt allow enough time?

Included with the QUEST conference experience is the opportunity for you to meet one-on-one with conference speakers or the
professional QAI instructors in an informal setting to discuss how to turn ideas into solutions that address your specific needs.

Speakers will be available for free coaching sessions on the day of their conference presentation. Sign-up sheets with available
speakers and times will be posted at the conference on Wednesday, Thursday & Friday based on availability. Sign-up at the
conference is required to reserve your coaching session.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


FEATURED ARTICLE 17

Regression Test Management Using a User Interface CARTTS Tool


By Mani Rajappa Rajappa, Quality Assurance, GSI Health
Introduction Implementation
Every Regression test is a means for testers to identify new CARTTS Tool uses Selenium scripts created previously for
defects in their software products current functional areas when testing the GSIHealthCoordinator application. Users can execute
updates or changes have been made to the product. Regression regression tests and verify the test results by following simple
testing by itself becomes challenging when you are in a fast- steps using Google Chrome or the Microsoft IE browser.
paced organization dealing with changes on a continual basis.
The CARTTS Tool client-side web application is built on
To add to the complexity, if the changes are made by several AngularJS technology. After successfully logging in to the
groups within the organization, the sheer effort to coordinate CARTTS, the user will select a client, a browser and the test
test the changes becomes even more challenging. Given the scripts to execute. The user will then submit the request by
important role played by regression testing in the software clicking the Run Test button. This request is submitted to the
development life cycle, the focus needs to be to execute all server in a JSON format. If the user selected multiple tests to be
the regression test cases since the impact of the changes can executed then they are split and each is submitted as a single http
be substantial and ripple effects can occur. To handle this request so the user can receive a result as soon as one test is
ever-growing problem, GSIH Healths QA team designed and complete.
developed a responsive design based User interface to execute
The server-side application is built with Spring framework which
regression test cases for all changes requested to the software
receives the client request and converts the JSON formatted
product. The key benefits of this solution are:
request to a plain Java Object. Based on the request, the
application dynamically generates a test suite for TestNG which is
Easy to navigate user interface to execute regression tests
a framework to support automated software testing. Based on the
Can be executed independently of QA teams involvement and time user selection in the CARTTS Tool UI, Java classes which contain
commitment the requested Selenium scripts are added to this test suite. For
each regression test, a Selenium WebDriver which manages and
Provides a tracking mechanism for further analysis and course correction
controls a browser is instantiated, and launches a web browser
Provides additional client reporting capabilities of the requested type with a new session in the server machine.
Each WebDriver interacts with the GSIHealthCoordinator web
Background application for the targeted client to examine its behavior. Both
the error logs and report logs during the test are recorded by
Regression testing for every change implemented on the product
TestNGs Reporter. If any test step fails during the test, the
platform was becoming a challenge based on the sheer amount
Selenium WebDriver exits the test. Regardless of the test result,
of changes implemented and also based on the timing of
Selenium WebDriver always quits the launched browser at the
deployment of the changes. Some of the key questions to which
end of the test.
the QA team was trying to get answers were:
When a regression test execution is completed, the test result is
How can we execute our regression test cases on a timely basis submitted to SpiraTest which is a Test Management Tool. This
based on the change implemented? How can we create a solution to is automatically done by Spiras TestNG Listener which retrieves
reuse our existing library of automated regression tests? SpiraTest authentication and a test case number from Spira Test
Configuration & Spira Test Case which are annotated on the
Can we create a solution for us to maintain and execute regression
tested classes and methods in advance. The test result is then
tests for all the changes implemented for our Coordinator product?
sent back to the browser of the requested user. A Java object
Can we identify and define a solution for other departments to easily which contains test result data is converted to JSON format and
adopt and execute regression tests? sent back to the client-side application as an http response. The
Can we create this solution in such a manner that other departments
test result including execution time and log reports is viewable on
can execute the regression tests based on their availability and not being
the users browser as soon as client-side receives the response.
dependent entirely on the QA team?
The client-side application also updates progression status of test
run. When all the tests are completed, the user may submit the
The solution we defined was a user interface called CARTTS next test run request
Tool (Coordinator Application Regression Testing Test Suite)
Conclusion
which can be accessed over the web. The regression test cases
can be executed from this tool. The test cases are available The CARTTS Tool has helped the QA team to execute
in a drop down to be selected based on the client and those regression test cases on an as needed basis and also extended
test cases will be executed on a server hosted on our network. the availability of these test cases to other departments in a
Once successfully executed, the CARTTS Tool provides a test convenient and user-friendly manner. The capability for other
execution status along with useful auditing information. It also departments to execute regression tests cases based on their
provides linkage to our test management system where the users access to the CARTTS is a big win for the QA team wherein
can track the tests for better reporting capabilities. we not only stand for quality in QA but also created a value-
add solution for the company. The CARTTS Tool helps several
departments within GSI Health to execute regression test cases.In
Objective
the future we may extend the use of the tool to other departments.
Some of the key objectives are:
Reuse our existing library of automated regression tests

Define a solution which can be used by any our internal departments


with minimal intervention from the QA Team

Ensure there are sufficient tracking and reporting capabilities so that any
failed test cases can be easily identified for further resolution

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


18 KEYNOTES

Keeping Pace with Digital Transformation: Trends and


Recommendations from the 2015-2016 World Quality Report
Matt Chessler, Capgemini 8:30 AM 9:30 AM
Digital transformation is rapidly shaking up business operations and organizations are placing more focus on
QA and Testing, with the aim to develop a true business assurance capability and ensure a smoother customer
experience. The seventh edition of the World Quality Report provides findings on application quality and testing
trends as well as recommendations for organizations to build strong testing practices focused on business
assurance. The report is based on a global market research study conducted with 1,560 senior IT executives and
testing leaders from 32 countries. Testing and QA SMEs, along with business and sector leaders, have studied
the research data and provided their valuable insights on the contemporary global Testing landscape. The themes
covered in this report are:
W Digital Transformation
E QA and testing Budgets Outperform
D Security testing is the Top IT Strategy Priority
N Agile testing Maturing to the Enterprise
E Industrialization Becoming More Advanced
S Test environments and Test Data Management
D
A Learning Objectives
Y Understand how digital transformation is impacting QA and testing
Be aware of the current trends in QA and testing as reported by the 2015-2016 World Quality Report
Discover the key recommendations of the report and how they can affect your organization

Matt Chessler is a Principal in Capgeminis Financial Services Testing practice. He has over 20 years consulting
experience successfully delivering business and technical solutions for clients in a variety of industries. For the past 14
years, Matt has focused exclusively on QA consulting and has successfully managed testing strategy, functional validation
and performance optimization projects for clients in the financial services, technology and healthcare industries. During this
time, he has advised clients in all facets of testing strategy, from transformation and process improvements to the design and
implementation of large-scale Testing CoEs.

Agility and Reliability Need Not Be Mutually Exclusive


John Chang, CAST Software 8:30 AM 9:30 AM
System-level defects kill apps and are essentially invisible to developers and testers alike. However, these
defects cause news-breaking catastrophes for organizations, such as United Airlines, the U.S Office of Personnel
Management and NASDAQ (to name a few). In this keynote presentation, John Chang will discuss the causes
of system-level defects and why they create chaos in all applications regardless of technology, platform, and
development methodology. Explore the impacts caused by the lack of right solutions and processes to intercept
system-level defects before software is released into production.
T John will also share successful models that companies have established in order to efficiently identify, prioritize
H and remove system-level defects from their software. Attendees are invited to discover insights sure to change
U the perception of non-functional defects and leave with ideas that can be put into action immediately.
R Learning Objectives:
S Discover the of causes system-level defects
D
Explore the types of issues caused as a result of system-level defects
A
Leverage actionable ideas for non-functional testing
Y
John Chang is the Head of Solution Design for CAST in North America, helping Fortune 2000 companies leverage
CASTs solutions to reduce system-level defects and improve application development outcome success.
John began his career in 2003, leading the development of various business intelligence applications for large
companies such as CSX and Maersk Line. After completing his MBA at Rutgers University, he joined INTTRA in
2011 as the Director of Product Marketing, in charge of writing requirements and working with development leads
to enhance their cloud-based flagship product used by tens of thousands of clients. John Chang joined CAST in
2014.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


KEYNOTES 19

Shift Left and Steer Right


Joe Colavito, Corevu 8:30 AM 9:30 AM
You play a vital role in the software development cycle. Your ability to shift left directly increases software quality,
drives competitive advantage, and decreases cycle time. In fact, deep down inside, you know that unless you
steer right the final product will not arrive in optimal condition or reach its desired destination on time. Imagine
yourself having more fun at work, while drawing out the best in the rest of your co-workers. Now envision yourself
collaborating with, contributing to, and steering your team to make the right decisions, for the right reasons, at the
F right time.
R Learning Objectives:
I Earn a seat at the table, engage and connect with key decision makers
D Ask more effective questions, so you can gain more influence
A Manage self-talk (yours and others) and remove inter-FEAR-ence to maximize overall performance
Y
Joe Colavito is a student of people, performance and success. Since he cant stand the thought of talented motivated individuals
underperforming, he has dedicated his life to helping others increase their focus, influence and performance in business and
life. Joe began his career as a financial auditor, before working as an executive headhunter. Therefore, he relates to software
testers who may have their work under-appreciated by others. Joe has delivered dynamic interactive keynote presentations to
over 12,000 professionals, leaving them feeling encouraged, empowered and highly valued. Joe and his wife, Debbie, have five
children, and he claims to have learned his most valuable life lessons from them.
20 TRAINING AND CERTIFICATION PREPARATION

Certified Software Tester (CSTE) Prep Course Monday & Tuesday, April 18 - 19
The Certified Software Test Engineer Prep Course is designed specifically to prepare the quality testing professional for the CSTE
examination. This is a 2-day course taught by a certified QAI instructor. The course aids the quality testing professional in focusing in on
the topics that are important for understanding, thus helping toward the successful completion of the exam. This course is not intended
to supplant the need for proper examination preparation. However, it will serve as an excellent review of the Software Testing Body of
Knowledge for CSTE (STBOK) which consists of the ten skill categories listed below. Sample exam questions are provided throughout
the course.

1. Software Testing Principles and Concepts 6. Walkthroughs, Checkpoint Reviews, and Inspections

CSTE
2. Building the Software Testing Ecosystem 7. Designing Test Cases
3. Managing the Test Project 8. Executing the Test Process
4. Risk in the Software Development Life Cycle 9. Measurement, Test Status, and Reporting Certified Software Tester

5. Test Planning 10. Testing Specialized Technologies

Certified Software Quality Analyst (CSQA) Prep Course Monday & Tuesday, April 18 - 19

The Certified Software Quality Analyst Prep Course is designed specifically to prepare the quality assurance professional for the
CSQA examination. This is a 2-day course taught by a certified QAI instructor. The course assists the quality assurance professional
in focusing on the topics that are important for understanding, thus helping toward the successful completion of the exam. This course
is not intended to supplant the need for proper examination preparation. However, it will serve as an excellent review of the CSQA
Common Body of Knowledge (CBOK) which consists of the ten skill categories listed below. Sample exam questions are provided
throughout the course.

1. Quality Principles and Concepts 6. Define, Build, Implement, and Improve Work Processes
2. Quality Leadership 7. Quality Control Practices
3. Quality Baselines (Assessments and Models) 8. Metrics and Measurement
4. Quality Assurance 9. Internal Control and Security
5. Quality Planning 10. Outsourcing, COTS, and Contracting Quality

CSTE and CSQA Practice Examinations Friday, April 22

Have you thought about becoming certified but wondered how your current knowledge and skills compare to the Common Bodies of
Knowledge for CSTE and CSQA?
With your registration to the 3-day conference, you can take a complimentary full practice examination for the Certified Software Test
Engineer (CSTE) or the Certified Software Quality Analyst (CSQA). The practice examinations will be held on Friday and will begin
immediately after the Keynote Speaker presentation. The multiple choice section of the examinations will be graded on-site when you
turn in your completed exam, so that you will receive an immediate assessment of your skills. The essay section will be evaluated after
the conference by Software Certifications and feedback will be provided to you.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R
R

QAI GLOBAL INSTITUTE


FEATURED ARTICLE 21
7 Steps to Pragmatic Mobile Testing
By Tom Chavez, SOASTA
INTRODUCTION constant upgrades to multiple operating systems, and an expanding
The software-testing discipline continues to undergo seismic shifts set of features.
from a variety of perspectives. What has traditionally been viewed as
a tactical exercise has evolved into a strategic process. Previously, The marketing information from the manufacturer is a good first
test engineers have executed suites of tests and produced pass/fail indicator of what devices and what functions you should test as
results that merely evaluated the performance of the software. But part of your core functions. More challenging is: what edge cases
numerous factors are dramatically reshaping the testing process will you cover. How far down the long tail will you go? One helpful
including: Expanding Test Plans, Shorter Product Cycles, More strategy to prioritize testing initiatives is to compare a device and its
Device Platforms, A Changing Focus, and An Emphasis on OS vs. correlated revenue and use that analysis to assess the risk of
Analysis. eliminating testing for any given device.

The impact of these changes is particularly acute in mobile testing, 5. KNOW HOW TO AUTOMATE
which often presents large user volumes, device proliferation, and Earlier in this article, we discussed the importance of analyzing
fast cycles. This article discusses seven key strategies for mobile and understanding the testing matrix. This helps you prioritize core
testing that can result in faster, yet more comprehensive, testing functions vs. edge functions. That analysis also plays a crucial role
cycles that are more aligned with product strategies and market in helping us determine which tests are best suited for automated
goals. These are the things you should know! testing approaches. There are a few tricks to determining how to
automate (the first four strategies in this paper prepare you for this
assessment). One of the keys may not be intuitive: timing.
1. KNOW YOUR USER
A good test plan starts with a thorough, comprehensive Ideally, we want to automate the test cases that are repetitive. Key
understanding of the user. Testers should take the time to immerse experiences that are in your regression suite are the best targets.
themselves into the users world to fully understand the use cases These are the tests that you want to repeat every time a build is
for the application. For instance, before you test, it can be helpful to complete to ensure nothing has been inadvertently broken in/by the
consider some of the following factors: new build.
What time of day does a user typically access the app? The next factor is evaluate how long your tests take. Save the
How long is the typical session? hard tests for your people, and use those tests to challenge your
Is the user in a hurry-up mode looking for quick answers and engineering/testing teams. Build your regression suite of tests with
information or is he browsing in couch potato mode? the simple and most repeatable tests, and your team productivity will
increase significantly and consistently with every iteration.
To gain the most complete understanding of the intended user,
talk to your product manager or read the marketing requirements 6. KNOW YOUR PERFORMANCE
document. For high-profile apps, you may even consider investing in We can think of an applications true quality as the intersection of
market research or focus-group testing to identify preferences and real-user data, mobile performance, and functional testing all
behavior patterns that can inform your testing plans further. of which are critical to the users entire experience. Companies
use this data to create realistic user test cases and to correlate
2. KNOW YOUR APP performance to business metrics.
To properly perform user testing, you must know how the user
prefers to use the app and where those preferences deviate from Unquestionably, performance testing with real-user data is a game-
how the app was intended to be used. Engineers will build beautiful changer. Does your testing strategy encompass these five industry
things but users have the final say and they will frequently use best practices?
another path that we never thought about.
Develop an in-depth mobile performance strategy that
Your ability to know your customer and know your app is critical to encompasses real-world scenarios and real-world data
devising, executing, and analyzing tests. This user intimacy helps Analyze your app back-end metrics to get a fuller picture of
you determine what are core functions and what are edge cases. the factors that affect performance
Without this differentiation, the test matrix is merely a list of features. Analyze your front-end performance metrics to get a truer
But customers dont care about the features. They only care about understanding of your end users experience
the experience. Tie your apps performance with revenue- or cost-
generating transactions
3. KNOW YOUR MATRIX Identify the hot zones where you can have a fast impact
In many companies, the testing organizations budget and value are to most effectively improve your app performance
highly correlated simply with the size and scale of the testing matrix
the entire set of use cases and tests that have been identified 7. KNOW YOUR EDGE
and defined for evaluating the softwares performance. The criteria Every tester knows that the edge cases the scenarios that occur
often revolves around how effectively and thoroughly the matrix is less frequently are the greatest sources of crashes or obstacles
completed; it is the core to your success. Unfortunately, with the that cripple app performance. But with so much of your time
increasing complexity of software and mobile devices, the testing consumed simply by testing core functionality, its often impossible
matrix is vastly larger than it was even five years ago. to complete a test plan all the way to edge and evaluate all of the
scenarios that users seldom encounter.
However, all tests are not created equal because not all functions
are created equal. Different tests shouldnt carry the same priority Depending on your overall product strategy, you can allocate testing
because they dont all equally affect the user experience to the same resources in order to get the app to market faster. You may target
degree. Some tests are non-negotiable must-dos. But others competitive feature sets or you may aim for deeper functional and
are nice to haves. Thats because tests take time sometimes a user-experience testing to pursue the highest level of product
lot of time. Some tests can take so long that they are not worth the quality. Its essential to make these strategic priorities explicit.
effort, and, conversely, some of the most important tests can be the
shortest to complete. A PASSION FOR TESTING
Headquartered in Mountain View, California, SOASTA is the
4. KNOW YOUR DEVICES leader in performance analytics. The SOASTA platform enables
The first three strategies have prepared us to identify what to test. digital business owners to gain unprecedented and continuous
Now, we want to explore how we should be testing. Whether your performance insights into their real user experience on mobile and
company is a mobile pioneer or your organization is just launching Web devices in real time, and at scale. To help you get started
its mobile testing initiatives, chances are youre now all too familiar with performance tools, SOASTA offers a rapid assessment and
with the need for access to a broadening portfolio of devices. And implementation service that can quickly jumpstart your testing
the rate of change in that portfolio can be daunting: new hardware, initiatives. For more information, please visit www.soasta.com.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2015


R

QAI GLOBAL INSTITUTE


FEATURED ARTICLE 23

Test Automation Rant


By Lee Barnes, Utopia Solutions
I need to blow off a little steam about this circus that is test Oh, a web based application with QTP? I have the perfect
automation. Theres big, important life-impacting problems being framework for you... and a nice bridge for sale in Brooklyn. I
solved every day, and yet test automation seems to bring out the understand these posts are coming from individuals with limited
worst in everyone! experience. But how about asking questions from a learning
From the absurd expectations by those wanting to implement perspective? We all need to learn Ive been involved in test
automation in their shop, to the so-called test automation expert automation for over 20 years and I learn something new every
that thinks the worlds problems will be solved if someone hands day. Asking for someone to give you an answer to a ridiculously
them the right framework to copy test automation is becoming broad and ambiguous question will not result in learning. Before
an IT cesspool. you worry about a framework, you need to be thinking about why
youre automating in the first place. What are the organizational,
Ive got a litany of test automation pet peeves that I need to get processes, environmental and technical factors with which youre
off my chest. Hopefully, somewhere between the lines of the dealing? If you know the answer to those questions, then why
forthcoming acidic rant there will be some educational tidbits. If it not include them in your post and start a discussion around the
saves me even one explanation to an IT manager why they cant appropriate approach to automation? This wont result a cut-and-
automate 100% of their SAP regression testing in threeweeks (or dried solution, but it likely will result in a conversation that will get
ever), or the time to read one resume with the same BS copied you thinking in the right direction and enable all parties to share
across 10 pages, it will be worth it... ideas (and maybe learn something!)

Managing Expectations Percentage of Test Cases Automated


I suggest you read Test Automation Snake Oil by James Bach So... whats the industry standard for percentage of test cases
immediately. No, really, read it NOW! Its only six pages, Ill wait... automated? is usually one of the first questions I hear when
Youre back? Good. Yes, I know it was written in 1999. It could introduced to new organizations. Its soooo tempting to respond
have been written yesterday. Learn it, love it, live it. The paper is with some ridiculously precise number and then wait to see how
about principles, not practices. The principles are the same today long it takes them to realize Im mocking them.
as 15+ years ago. If youre fundamentally against what James I wasnt kidding about the importance developing a strategy!
is saying then you should not invite me to help you with test Take the time to understand the activities associated with your
automation, and certainly dont ask me for a job!Theres probably software development and testing efforts. It helps to think
not much reason for you to continue reading either. about test automation in a more general sense. You can get
Now, back to the rant! One of my biggest pet peeves is some ideas by reading a great presentation titled Agile Test
unrealistic expectations. Im all about helping people learn about Automation by James Bach (I swear hes not paying me for this)
an area that Im passionate about, but cmon, cant you meet me
at least a little bit of the way. Ive lost count of the organizations Automation ROI
that Ive seen that think they have implemented test automation Why do so many automation implementations seemingly have
just because theyve installed a tool. very little value from a testing perspective? In my experience
its because theres no overarching strategy driving the
While were on the subject of unrealistic expectations, lets talk implementation. You wouldnt build a business system by sitting
about test automation resources. Just because you have the a bunch of developers in a room and tell them to start coding.
most skilled testers, business analysts, etc. does not mean you Yet, so many teams take this approach with automation. If
have a group of budding automation engineers. Yes, I know, automation isnt supporting your testing objectives, its completely
the tool vendor told you that their tool has a scriptlessmode worthless and will never deliver a ROI!
and everything can be done via point-and-click by anyone that
can operate a DVR. The reality is that the skills required to be So lets talk about ROI. ROI is a calculation, and, by definition,
successful with automation are fairly technical. calculations require inputs. If youre not measuring your
automation effort, you dont know your ROI. Period. End of story.
On a similar note, having the appropriate technical skills does
not guarantee success. Ive seen just as many messes created While were on the topic of ROI, lets discuss the business cases
by rogue developers who have gotten their hands on a test that are put together to get approval to implement test automation
automation tool. Being able to sling code and address technical solutions in the first place (I should have told you not to get me
challenges like dealing with custom UI objects is important, but started). I saw one earlier this year as part of a recovery project
so is an understanding of software testing and what should (and that compared the cost of the tool and training to the labor cost
should not) be automated. associated with manually executing a large regression test suite.
Nothing else!
Consultants and the Perfect Framework I think Ive gone on long enough...If youre thinking a little more
This rant wouldnt be complete without addressing consultants critically about test automation then Ive accomplished my
who purport to be automation experts. I have limited patience objective.If Ive offended you in the process maybe you should go
for people who proclaim to possess a level of expertise and back re-read that Bach article.
then wear out Google trying to find the magical one-size-fits-all
automation framework that they can plop in and take credit for.
The testing forums are filled with posts like the one below: Watch the Videos
Want to see the Test Automation
Rant Videos? Scan the QR Code:
Automation framework
Hi,
I was wondering if anyone has tried to come up with an Automation
framework for QTP to work with web based application. If so, could
you please share it?

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


Your users care about performance.

Do you?

PROVE IT.
Continuous Performance Validation
A process achieved by testing, monitoring and improving performance at
every stage of the application development lifecycle, from development to
production, leveraging automated and collaborative tooling.

Produce Faster Applications


Deliver New Features & Enhancements in Less Time
Simplify Interactions Across Dev, QA, Ops and Business Stakeholders
Around Application Performance

Visit neotys.com to get started!

Visit our booth at the QUEST 2016 Conference!

Dont miss out on a special presentation from Senior Performance Engineer Steve Weisfeldt where youll learn:w
How to Fit Performance Testing into Agile Dev Cycles
April 21, 2016 | 11:15 am 12:15 pm
CONFERENCE AT A GLANCE 25

MONDAY, APRIL 18: Pre-Conference Classes & Workshop


7:30 AM 8:30 AM Registration (Level 2 Foyer) & Breakfast (Cloud Gate Foyer)

8:30 AM 4:30 PM Two-Day Workshop and Classes Full Day Classes

MANAGERS
LEADERSHIP Test Leadership Problem Solving
SOLUTIONS Manager's Solutions Workshop
Cloud Gate 1 Lynn McKee, Quality Perspectives
Discover
CERTIFICATION
Break CSTE Certification Prep AGILE Agile Estimation
10:00 AM
Morningstar
Hosted by Morningstar Cloud Gate 2 Tom Cagley, DCG Software Value
Training Center
Lunch
[Looking Glass] CERTIFICATION
CSQA Certification Prep LEAN Trimming Down Your QA Effort While Maintaining Quality
12:00 PM 1:00 PM Morningstar
Hosted by Morningstar Cloud Gate 3 Clyneice Chaney, MITRE
Training Center
Break
2:30 PM MOBILE Mobile Testing: Manual and Automated
Cloud Gate 4 Michael Yudanin, Conflair
AUTOMATION Getting Started with Selenium Test Automation
Cloud Gate 5 Chris Lawson, Zenergy Technologies
5:30 PM 8:30 PM Managers Connection Dinner - Hosted by Tom Ticknor and Nancy Kastl, Quest Conferences

TUESDAY, APRIL 19: Pre-Conference Tutorials, Classes & Workshop


]7:30 AM 8:30 AM Registration [Level 2 Foyer] & Breakfast [Cloud Gate Foyer]

Two-Day Workshop and Certification Prep Classes


8:30 AM 4:30 PM
Continued from Monday

Half Day Tutorials: 8:30 AM 12:00 PM Half Day Tutorials: 1:00 PM 4:30 PM

LEADERSHIP Leading Change When Youre Not in Charge LEADERSHIP Whats Your Leadership IQ?
Cloud Gate 1 Jennifer Bonine, tap|QA Cloud Gate 1 Jennifer Bonine, tap|QA

Break PROCESS Agile Metrics - Its Not About Velocity PROCESS Value Stream Mapping and Kaizen in Agile Retrospectives
10:00 AM Cloud Gate 2 Philip Lew and Steve Gohres, XBOSoft Cloud Gate 2 Angela Dugan, Polaris Solutions

Lunch REQUIREMENTS Making Requirements and User Stories Testable RISK (Almost) Everything I know about testing I learned playing poker
[Looking Glass] Cloud Gate 3 David DeWitt, NueVista Cloud Gate 3 Matthew Eakin, Centric Consulting
12:00 PM 1:00 PM
MEASUREMENTS Maintaining Testing Integrity Under Pressure MOBILE Usability Goes Mobile
Break Cloud Gate 4 Carolyn Swadron, CIBC Cloud Gate 4 Susan Brockley, ExxonMobil
2:30 PM
The Development and Implementation of an Automation
AUTOMATION AUTOMATION Introduction to ATDD using Ruby, Cucumber, Watir-WebDriver
Framework
Cloud Gate 5 Cloud Gate 5 Joseph Ours, Centric Consulting
Dean Carvin, Checkpoint Technologies
4:30 PM 6:00 PM [Looking Glass] Welcome Reception - Sponsored by QAI Global Institute

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


26 CONFERENCE AT A GLANCE
WEDNESDAY, APRIL 20: Conference & EXPO
7:30 AM 8:15 AM [Level 2] Registration & Breakfast - Sponsored by Accenture

8:15 AM 8:30 AM [Grand Ballroom 1-3] Opening Remarks & Announcements - Nancy Kastl, QUEST Conference Chairperson

[Grand Ballroom 1-3] Keynote Presentation: Keeping Pace with Digital Transformation: Trends and Recommendations from the 2015-2016 World Quality
8:30 AM 9:30 AM
Report - Matt Chessler, Capgemini

9:30 AM 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by Microexcel

9:25 AM 4:00 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industrys leading service and technology providers!

[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]

10:00 AM 11:00 AM LEADERSHIP AGILE MOBILE RISK OPEN SOURCE

Pursuing World Class Quality: Simplicity: The Path to Mobile App Testing: What and The Testers Story: Painting the Leveraging Free, Open Source,
Transforming Your Organization Achieving Agile Testing How to Test? Picture of Risk and Low-Cost Tools for Back
Presentations
Clyneice Chaney, Quality Squared Efficiency Nikhil Kaul, SmartBear Software Shaun Bradshaw, Zenergy End Testing
Paul Herzog, SPR Consulting Technologies Elysia Lock, Emmi
11:15 AM 12:15 PM LEADERSHIP AGILE MOBILE RISK OPEN SOURCE

What Time is It Over There? Budgeting, Estimation, Faster and Better Mobile Testing Risk Based Testing at the How to Tackle Open Source
Maximizing the Effectiveness of Planning, #NoEstimates and the in the Cloud Enterprise Level Test Automation in Incredible
Presentations Your Global QA Team Agile Planning Onion Jamie Moore, Mobile Labs Bernd Bornhausen, Banque Ways
Elizabeth Wisdom, Ulta Beauty Tom Cagley, David Consulting Nationale du Canada Harpreat Singh and Piyush
Group Sachar, Microexcel

11:15 AM 11:45 AM [Discover] EXPO TALK: Test Workbench for Holistic Test Management - Chaithanya Rajanna, Deloitte Consulting

11:45 AM 12:15 AM [Discover] EXPO TALK: Automated Tests without Recording or Scripting with AscentialTest - Brian LeSuer, Zeenyx Software

12:15 PM - 1:30 PM [Grand Ballroom 1-3] Special Interests Roundtables & Lunch

1:30 PM 3:00 PM LEADERSHIP AGILE MOBILE PLAN/DESIGN OPEN SOURCE

ZAP, Youre QA Team Deconstructing SAFe the Mobile Testing: To Automate or Making the Case for Getting Started with Jmeter!
Leader! How to Build a High Scaled Agile Framework Not to Automate? Collaborative Test Case Daniel Schiff, edo Interactive
Workshops Performance Team Angela Dugan, Polaris Solutions David Dang, Zenergy Development
Rebecca Staton-Reinstein, Technologies Todd Peak, Seapine Software
Advantage Leadership

1:30 PM - 2:00 PM [Discover] EXPO TALK: Sizing, Estimating and Testing: Can You Answer the 3 questions? - Tony Timbol, DCG Software Value

2:00 PM 2:30 PM [Discover] EXPO TALK: Right Data, Right Place, Right Time - Mike Cartina, Orasi Software

2:30 PM 3:00 PM [Discover] EXPO TALK: Moving to an Onshore team and Managing Technical Millennials - Michael Faulise, tap|QA

3:00 PM 3:30 PM [Grand Ballroom Foyer and Cloud Gate Foyer] Afternoon Refreshment Break - Sponsored by Zeenyx Software, Inc.

3:30 PM 4:00 PM [Discover] EXPO TALK: Automation for Devs and Testers with TestComplete - Gregory Hanson, SmartBear Software

4:00 PM 4:30 PM [Discover] EXPO TALK: QA Best Practices for Agile Environment - Piyush Sachar, Microexcel

3:30 PM 4:30 PM LEADERSHIP AGILE MOBILE PLAN/DESIGN OPEN SOURCE

Culture of Quality: Integrating Using BDD and Specifications Mobile Test Automation and the The Testing Pyramid: Its Not Acceptance Test Driven
QA in the SDLC by Example in Increase Software Need for Continuous Quality about Testing Development (ATDD) with
Presentations Helene Simmons, Lincoln Value Eran Kinsbruner, Perfecto Gary Pedretti, Sodoto Solutions SpecFlow
Financial Group; Jackie Wilson, Diane Walker and Nick Hussey, Chris Taylor, Polaris Solutions
Lincoln Financial Group Equifax

5:30 PM 9:30 PM [House of Blues] Attendee Appreciation Night in Chicago, sponsored by tap|QA

THURSDAY, APRIL 21: Conference & EXPO


7:30 AM 8:15 AM Registration & Breakfast

7:45 AM 8:15 AM [Discover] Early Bird Session: Successful Networking: Making the Right Connection - Charlene Wooley, Equifax

8:15 AM 8:30 AM [Grand Ballroom 1-3] Announcements - Nancy Kastl, QUEST Conference Chairperson

8:30 AM 9:30 AM [Grand Ballroom 1-3] Keynote Presentation: Agility and Reliability Need Not Be Mutually Exclusive - John Chang, CAST North America

9:30 AM 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by Mobile Labs

9:25 AM 6:30 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industrys leading service and technology providers!

[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]

10:00 AM 11:00 AM LEADERSHIP MEASUREMENT AUTOMATION PERFORMANCE EXPLORATORY TESTING

The Art of Testing Metrics: The Force Awakens How to make Test Automation Load It UP: Effectively Agilify Your Manual Testing
Transformation: Blending Joseph Ours, Centric Consulting SMARTER Combining Functional and Through an Exploratory
Technology with Cutting-Edge Jim Trentadue, Original Software Performance Testing Approach
Presentations
Processes Chris Lawson, Zenergy Ryan Yackel, QASymphony
Jennifer Bonine, tap|QA Technologies

10:00 AM 10:30 AM [Discover] EXPO TALK: Selenium: The Core of Automation - Manju Naglapur, CompuGain Solutions

10:30 AM 11:00 AM [Discover] EXPO TALK: Mobile SLA Monitoring & Validation Automated Framework - Vinayak Gaur, Hexaware

11:15 AM 11:45 PM [Discover] EXPO TALK: Cross-Platform Mobile Apps Testing Using a Mobile Device Cloud - Jamie Moore, Mobile Labs

11:45 AM 12:15 PM [Discover] EXPO TALK: Beyond Resizing a Browser: Useful Responsive Web Testing Tips - Eran Kinsbruner, Perfecto

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


CONFERENCE AT A GLANCE 27

THURSDAY, APRIL 21 CONTINUED: Conference & EXPO


[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]

11:15 AM 12:15 PM LEADERSHIP MEASUREMENT AUTOMATION PERFORMANCE UAT

Business Case for Software Creating Useful Metrics to Dont Be Another Statistic! How to Fit Performance Testing Tips for Maintaining UAT
Testing and QA Operations Provide Quality Software Develop a Strategy for Long- into Agile Dev Cycles Integrity
Presentations
Bernd Haber, Accenture Helene Astier, Cars.com Term Test Automation Success Steve Weisfeldt, Neotys Carolyn Swadron, CIBC
Lee Barnes, Utopia Solutions

12:15 PM 1:30 PM [Grand Ballroom 1-3] Special Interests Roundtables & Lunch - Sponsored by Neotys

1:30 PM 3:00 PM LEADERSHIP DEV/OPS AUTOMATION SECURITY PROCESS IMPROVEMENT

Enhancing Your Leadership 10 Steps to Continuous Applying Design Patterns to Real World Security Testing The Red Bead Experiment
Skills to Become an Effective Integration, Testing and Delivery Automated Testing Matt Konda, Jemurai Mike Kaufman, EMC
Workshops
Test Manager Tanya Kravtsov, ROKITT Brian Le Suer, Zeenyx Software
Michael W Ennis, TEKsystems

1:30 PM 2:00 PM [Discover] EXPO TALK: Combining Manual and Automated Testing with Microsoft Visual Studio - Paul Herzog, SPR Consulting

2:00 PM 2:30 PM [Discover] EXPO TALK: Jump Start Automation through Utopia Automation Framework (UAF) - Lee Barnes, Utopia Solutions

2:30 PM 3:00 PM [Discover] EXPO TALK: Making the Most of Selenium: Your Tough Questions Answered - David Dang and Chris Lawson, Zenergy Technologies

3:00 PM 3:30 PM [Grand Ballroom Foyer and Cloud Gate Foyer] Afternoon Refreshment Break - Sponsored by DCG Software Value

3:30 PM 4:30 PM LEADERSHIP DEV/OPS AUTOMATION SECURITY DELIVERABLES

Polyskilling Testers: Good, Bad DevOps: A Testers Best Friend Keyword Driven Testing with Security Testing Scripts for the Testing Deliverables: Define,
or Ugly? Thomas Janik and ken Robertson, Selenium: The Good, the Bad Non-Hacker: Straight from the Align, Document and Approve
Presentations Matthew Eakin, Centric Consulting American Family Insurance and the Use Case Security Pros Handbook! Clareice Chaney, MITRE and
Brian Van Stone, QualiTest Group Glenn Stout, HALOCK Security Clyneice Chaney, Quality Squared
Labs
3:30 PM 4:00 PM [Discover] EXPO TALK: Linking Requirements to Test Cases with TestTrack - Kayla Gillman and Mike Turton, Seapine Software

4:00 PM 4:30 PM [Discover] EXPO TALK: Continuous Performance Validation with NeoLoad and NeoSense - Steve Weisfeldt, Neotys

4:00 PM 4:30 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industrys leading service and technology providers!

5:00 PM 6:30 PM [Grand Ballroom Foyer] EXPO Reception

FRIDAY, APRIL 22: Conference


7:30 AM 8:15 AM Registration & Breakfast

7:30 AM 8:15 AM [Discover] Early Bird Session: Take Leadership by the Marshmallow! - Mike Kaufman, EMC

8:15 AM 8:30 AM [Grand Ballroom 1-3] Announcements - Nancy Kastl, QUEST Conference Chairperson

8:30 AM 9:30 AM [Grand Ballroom 1-3] Keynote Presentation: Shift Left and Steer Right - Joe Colavito, Corevu

9:30 AM 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by CompuGain Solutions

[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]

10:00 AM 11:00 AM LEADERSHIP TEST DATA TEST STRATEGY REGRESSION CERTIFICATION

Leading Indicators of Quality: 5 Critical Elements for Isnt an Enterprise Test Strategy Regression Test Management CSTE/CSQA Practice
Driving the Conversation & a Successful Test Data just for an Enterprise Project Using a User Interface Certification Exam
Presentations Managing Risk Management Program Release? CARTTS Tool
Dana Dietz, Nationwide Robert Kelman, AT&T Susan Schanta, Cognizant Mani Rajappa, GSI Health
Technology Solutions

11:15 AM 12:15 PM LEADERSHIP TEST DATA CONTINUOUS TESTING CLOUD

Efficiency and Effectiveness: Data, Data Everywhere! Building Quality Software The Clouds Impact on Testing
When Process and Pressure Understand Your Data & with Continuous Integration & Tom Chavez, SOASTA
Presentations Collide Maximize Test Coverage Continuous Testing
Frank Rios and Rich Valde Jessica Paddock, Orasi Software Ashish Nirgudkar,Cognizant
Technology Solutions

12:15 PM 1:30 PM [Grand Ballroom 1-3] Lunch & QAI Grand Prize Drawing

1:30 PM 2:30 PM [Cloud Gate 1-2] Panel Discussion: Achieving Cross Roles Collaboration to Build Quality Software

1:30 PM 2:30 PM [Cloud Gate 5] TCOE: Harmonizing Business and Technology Needs Using Next Generation Testing - Kimberly Tatum

[Cloud Gate 3-4] [Cloud Gate 3-4] [Cloud Gate 3-4] [Cloud Gate 3-4]

2:30 PM 3:00 PM ALM COLLABORATION ALM COLLABORATION ALM COLLABORATION ALM COLLABORATION

Shift Left through Tester Shift Left through Tester Shift Left through Tester Shift Left through Tester
Roundtable Project Manager Collaboration Business Analyst Collaboration Developer Collaboration Scrum Master Collaboration
Discussions PMI Chicagoland David DeWitt, IIBA Chicagoland Christopher Jones, IEEE Michael Marchi, Agile Professional
Chapter Learning Network-Chicago

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


Are Software Testing Efforts
Being Impaired by Bad Data?
Reduce Costs, Improve Efficiency across the SDLC
with More Effective Test Data Management
Most enterprises take a disorganized approach and helps develop and implement a mature
to test data management, with roles and methodology for gathering the right test data,
responsibilities poorly defined, if at all. Often, on time and on budget. Better data means
testers end up handling data gathering with more effective tests, so teams can pinpoint and
little to no understanding of exactly what data is resolve more defects before application release
needed for the tests. In the process, testers likely to production.
spend 50% of their timeor moregathering
data for tests instead of doing their jobs. To learn more, visit www2.orasi.com/tdm.

Orasis professional services team assesses


organizational test data management processes

Orasi Software, Inc.


114 TownPark Drive, Suite 400
Kennesaw, GA 30144
Automate Your
Mobile
Testing Global
to Increase Device Consulting
Functional &
Coverage and Services Automate Your
Performance
App Reliability Orasis Experts Test Data Testing
Know SAP Management for the Busiest
for Fast of Software
and Accurate Development
Testing Schedules

www.orasi.com
EXPO TALKS 29

Test Workbench for Holistic Test Management


Wednesday, 11:15 11:45 AM Chaithanya Rajanna, Deloitte Consulting
Learn how tools can reduce the gap between business and IT through holistic test management and creating automated scripts without
writing code. Test Workbench by Deloitte is one stop shop solution that helps transform testing organizations to higher maturity.
Workbench is built on an integrated platform with multiple modules that cater to increasing efficiencies and effectiveness across testing
life cycles. Some of the key modules are Holistic Test Planning, Automated Status Reporting, Demand Management, efficient test
design management using Design Workspace and Scriptless Automation and Effective Test Coverage Analyzer.

Automated Tests without Recording or Scripting with AscentialTest


Wednesday, 11:45 AM 12:15 PM Brian Le Suer, Zeenyx Software
Get a brief introduction to AscentialTest from Zeenyx Software and learn how it helps organizations save time and reduce costs by
enabling domain experts to design and create manual and automated tests without recording or scripting. In this product demonstration,
youll find out how AscentialTest eliminates costly and inefficient test frameworks, while minimizing the test maintenance effort.
AscentialTest is an enterprise level Test Management System that encompasses test planning, development, data management and
execution for applications running on Windows, the web, java, dotNet, terminals and PowerBuilder. Come and learn how Zeenyx is
making testers more productive.

Sizing, Estimating and Testing: Can You Answer the 3 Questions?


Wednesday, 1:30 2:00 PM Tony Timbol, DCG Software Value
Sizing software establishes timelines for completing work, including appropriately allocating resources (team members and budget). But
how does this relate to the testing process? The adage, What you cant measure, you cant manage, applies here. What is needed
is a method of making the importance and effectiveness of testing visible and measurable. This presentation will outline how sizing in
testing can help you answer 3 important testing questions: Is there enough time?, Is there enough data?, and Are there enough people
to test what is needed?

Right Data, Right Place, Right Time


Wednesday, 2:00 2:30 PM Mike Cartina, Orasi Software
The application economy is driving massive digital transformation. As a result, organizations are increasingly under pressure to
continuously deliver valuable and high quality applications faster than ever. Yet the quality of an application depends on the quality of
the testing data, and creating the right test data, to the right place, at the right time, remains a significant challenge. Orasi provides
best-of-class partner technologies and services that can help organizations find, create and provision the data needed for testing
automatically and quickly. Test data constraints, which routinely compromise application quality, can be eliminated, accelerating
application delivery to market, on time and within budget.

Moving to an Onshore team and Managing Technical Millennials


Wednesday, 2:30 3:30 PM Michael Faulise, tap|QA
Are you struggling with how to keep up with the demands being made on your testing team and managing Millennials? Come see
how transitioning to an on-shore model using tap|Lakeshore can improve your productivity, reduce cost, and increase the quality of
deliverables. With increased security concerns and agile methodologies many companies are leveraging a near-shore solution for their
testing needs. We see a 33% to 50% reduced cost for companies that transition to tap|Lakeshore. Attend this session and see how
companies are using this model to solve testing challenges, new management techniques with Millennials, mobile testing, automation,
and CI needs.

Automation for Devs and Testers with TestComplete


Wednesday, 3:30 4:00 PM Gregory Hanson, SmartBear Software
In this talk you will gain insight into how mixed teams of devs and testers are able to use TestComplete and our new Visual Studio
plugin to enhance your automation suite. With the world moving to a more DevTest model, having combined teams of testers that can
work in a Record and Playback model as well in their development IDE on the same platform is a necessity.

QA Best Practices for Agile Environment


Wednesday, 4:00 4:30 PM Piyush Sachar, Microexcel
In an Agile/Scrum project, QA is a teams responsibility. Everyone should know what type of testing is needed and who will perform
testing at what time in the sprint process. The QA team member selects the tools for the desired testing. For example, system testing
can be performed through Selenium and integration testing can be done through SOAP UI or REST API. Test case prioritization and
test coverage should follow QA best practices. Team selection also plays an important role in delivery of Agile projects. The discussion
on Agile QA best practices will be followed by a case study of a large enterprise that includes Demandware, Marketo, Ampliance, SAP,
OMS and Highway 905.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


30 EXPO TALKS

Selenium: The Core of Automation


Thursday, 10:00 10:30 AM Manju Naglapur, CompuGain Solutions
When examining the rapid development of the software industry over the past several years, automation has taken a central role in
delivering effective and reliable software-based business tools and solutions. Today, business tools must be agile and able to adapt to
the frequently changing approaches and strategies shifting markets and consumer trends require. Such agility is a key component of
modern software tools seeking to minimize disruptions to in-place solutions.

Mobile SLA Monitoring & Validation Automated Framework


Thursday, 10:30 11:00 AM Vinayak Gaur, Hexaware Technologies
Business critical mobile applications require constant monitoring of business SLAs to ensure the reliability, availability and efficiency
of services to the customers. A new mobile testing trend is to establish a framework that combines the validation and monitoring
requirements in a common integrated testing approach on supported mobile platforms. Hexaware has implemented an automated
mobile Test/Monitoring framework for one of our telephony clients to diagnose, check (24X7) and report the overall health of functional
components and features of a core business critical mobile application that provides VoIP calling features across various countries.

Secure Mobile App Testing with Mobile Labs


Thursday, 11:15 11:45 AM Jamie Moore, Mobile Labs
Winning in todays mobile-first enterprise means delivering quality cross-platform mobile apps that perform perfectly. Getting apps ready
for prime time takes the right mobile app testing solutions to help conquer the challenging dynamics of mobility. Mobile Labs patented
technology provides enterprise-grade mobile app testing solutions and worldwide, 247 device access and management from a secure
mobile device cloud. The result is more efficient testing, improved quality and increased user satisfaction. Come hear about the Mobile
Labs solution: deviceConnect: a private mobile device cloud, Labs Trust: a certified add-in to HP QTP, and deviceBridge: the only
virtual USB cord available today.

SOFTWARE TESTING &


IT QUALITY ASSURANCE EXPERTS

CompuGain
SOLUTIONS

Scale your
business applications

ENTER WIN! to
Schedule an appointment or demo with one of our software
& future~proof your
infrastructure
using our expertise.
quality experts to enter our drawing for a $100 gift card!

www.checkpointech.com 813-818-8324
www.compugain-solutions.com | sales@compugain-solutions.com | 703.956.7500

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


EXPO TALKS 31

Beyond Resizing a Browser: Useful Responsive Web Testing Tips


Thursday, 11:45 AM 12:15 PM Eran Kinsbruner, Perfecto
Half of web traffic comes from a mobile device, so its no surprise that organizations are adopting different strategies to ensure a
consistent user experience on any device. However, theres a lot more to a quality digital experience than simply viewing a website
in different screen sizes. To truly deliver seamless web viewing and interaction on any device from laptop to smartphone, RWD
apps using Selenium need to go through testing rigors including: testing on actual devices (not emulators), testing against real user
conditions and interruptions, and testing visual aspects such as screen orientation changes. In this talk, Perfectos Eran Kinsbruner will
discuss practical RWD testing tips and also demonstrate RWD testing scenarios.

Combining Manual and Automated Testing with Microsoft Visual Studio


Thursday, 1:30 2:00 PM Paul Herzog, SPR Consulting
There are very few tools on the market that combine all aspects of application lifecycle management as efficiently as Microsofts Visual
Studio/Team Foundation Server, especially when incorporating Microsoft Test Manager. You can build manual test cases, control
manual testing cycles, build test data, and also integrate automated tests from Visual Studio and its CodedUI library into a common
testing approach and planning structure. Theres no need to have multiple testing tools, test repositories and referencing multiple
dashboards for testing status. Join Paul in an investigation of a singular approach to test management, execution, metrics, and defect
tracking for manual and automated testing.

Jump Start Automation through Utopia Automation Framework (UAF)


Thursday, 2:00 2:30 PM Lee Barnes, Utopia Solutions
Over more than 15 years of implementing test automation, Utopia Solutions engineers have collected best practices and core features
that are required independent the functionality or technology of the application youre testing. These features have been incorporated
into the Utopia Solutions Automation Framework (UAF) and form the foundation for implementing successful test automation across a
variety of technologies and applications. The UAF supports HP UFT and Selenium and includes an extensible common UI interaction
layer, flexible reporting, error detection and recovery, and interacting with external data sources. Attend this talk to understand how the
UAF can jump start your automation success. If you have existing automation assets, learn the critical test automation factors your
solution must include.

Making the Most of Selenium: Your Tough Questions Answered


Thursday, 2:30 3:00 PM David Dang and Chris Lawson, Zenergy Technologies
Join QUEST presenters and workshop instructors, David Dang and Chris Lawson of Zenergy Technologies, for a question and answer
session on Selenium implementations. This open session is a chance to share your specific questions with experts who, having
conducted numerous Selenium engagements for clients, have encountered and solved a multitude of challenges with the open source
framework. Let David and Chris make your Selenium implementation smoother by learning from their first-hand experience.

Linking Requirements to Test Cases with TestTrack


Thursday, 3:30 4:00 PM Kayla Gillman and Mike Turton, Seapine Software
By linking test cases to their requirements, TestTrack makes it possible for you to go directly to the exact requirement the test case
was written for. No more combing through design documents for a specific requirement! Seapine Softwares Kayla Gillman, Solutions
Specialist, and Mike Turton, Business Development Manager, will show you firsthand how much time and frustration TestTrack can
spare you when you have to refer back to the requirement from a test case or test run.

Continuous Performance Validation with NeoLoad and NeoSense


Thursday, 4:00 4:30 PM Steve Weisfeldt, Neotys
At Neotys, we think Continuous Performance Validation is the best way to produce faster applications, deliver new features and
enhancements in less time and simplify interactions across Dev, QA, Ops and business stakeholders around application performance.
This is achieved by testing, monitoring and improving performance at every stage of the application development lifecycle, from
development to production, leveraging automated and collaborative tooling. In this talk, well show a live demo of our products NeoLoad
and NeoSense working together to validate the performance of an application from Dev to Prod.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


32 EARLY BIRD SESSIONS & PANEL DISCUSSION

Successful Networking: Making the Right Connection


Thursday, 7:45 AM 8:15 AM Charlene Woolley, Equifax
E
Networking is vital for anyone and everyone today to be successful. There are so many ways to network, so A
how do you know which method is the right one for you to follow? Join Charlene to explore some Out of the
Box Networking styles, tips and tricks, and learn how to expand your Networking skills in order to make the
R
right connections! L
Learning Objectives:
Y
Learn the importance of a connection and how they can help you B
Understand different ways to network using Out of the Box networking styles I
Obtain the key steps to networking Dos and Donts R
D

Take Leadership by the Marshmallow!


Friday, 7:30 AM 8:15 AM Mike Kaufman, EMC
E
Every guru, philosopher, and management leader out there says the first step to Leadership is taking A
Responsibility. But none of them tell you how! We will explore the research-driven approach that provides clear
steps on how to take Responsibility in any situation work, home, or life. This session is targeted to all team
R
members who wish to explore and expand their Leadership capabilities. Anyone, not just managers or leaders, L
can exhibit leadership, regardless of their role, by demonstrating responsibility in their own actions. Come for a Y
fun breakfast of spaghetti and marshmallows and discover the leader in you!
Learning Objectives: B
Differentiate between responsibility and accountability
I
R
Learn how to take responsibility
D
Transform to personal responsibility and leadership using three key pillars

Achieving Cross Roles Collaboration to Build Quality Software


Friday, 1:30 PM - 2:30 PM Moderator: Nancy Kastl, QUEST Conference Chairperson
Todays software development teams are comprised of specialists, each playing a specific role based on skills P
and responsibilities. Project managers are responsible for managing projects. Scrum masters guide Agile teams.
Business analysts focus on analyzing business requirements. Developers code the software, and QA/testers
A
test the software. Many of these roles are defined by a body of knowledge (BOK), have certifications, and/or N
professional communities for continuous learning. Whether a software development project is agile, iterative or A
waterfall, the projects ultimate success is based on collaboration and an emphasis on building quality into the L
software instead of testing in quality at the end. Our panelists, representing each of the roles within a software
project and are leaders within their respective professions. Come join them as they breakdown role-based silos
and share insights to collaboratively building quality software.
D
I
How does each role define quality software? What are the similarities and differences in these perspectives? S
How does each roles Certification Body of Knowledge support building quality software? C
What challenges does each role face within a project team? How can collaboration overcome these challenges in waterfall, U
iterative or agile?
What are the pros and cons of specialized roles vs. project team members interchangeable in their roles?
S
How can application lifecycle management (ALM) tools foster cross role collaboration?
S
How can other roles help testers shift left within a project? I
O
Panelists include: N
Nancy Kastl, Chicago Quality Assurance Association Aisleigh McGanni, PMI Chicagoland
David DeWitt, IIBA Chicagoland Chapter Christopher Jones, IEEE Chicago Section
Michael Marchi, APLN Chicago

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


FEATURED ARTICLE 33
Choosing What to Automate
By Brian Le Suer, Zeenyx Software
Job descriptions for QA engineers almost routinely require experience Next, consider the number of different test cases that follow the
with one or more commercial automated testing tools. From a distance, same path through the target application. When automated tests are
it would appear that most software products were tested via scripting or properly designed with separation of test steps and test data, a good
record/playback. Yet despite how long these tools have been around, return on the work effort can be achieved very quickly. In fact, it is
how many organizations really know how to harness the potential of possible that the tests could pay for themselves the very first time that
test automation? they are run because it is likely that most of the data combinations will
One of the most fundamental reasons why organizations may not never have to be executed manually. Order Entry in an eCommerce
get the most from their investment in commercial testing tools is in application is a good example where sales of different products and
choosing what and what not to automate. Most software applications quantities are loaded into a shopping cart and where subtotals and
do in fact provide plenty of good opportunities to increase productivity totals must be verified. Search engines offer another good opportunity,
and improve reliability of testing through effective use of automated where only a few user events need to be simulated in order to
testing tools. complete the test.

The purpose of this article is to provide a set of criteria that can be Well-designed automated tests are comprised of reusable steps. Steps
used to evaluate automation candidates. These criteria can be broadly are created to drive the target application to a test state, verify an
organized into two categories: efficiency, which involves a financial application response and then return the application to a known base
cost/benefit analysis and effectiveness of manual vs. automated state. The steps required to verify the actual against the expected
testing. result usually present the biggest challenge. Revisiting the eCommerce
example, the best way to design a test that verifies the contents of a
Efficiency and Effectiveness Shopping Cart is to generate the expected results by capturing the
The most basic set of questions regard cost/benefit analysis and price, quantity and other attributes of the products being purchased
consider the cost of development and maintenance. How many person as part of the test. Again, this approach requires more effort, but the
hours will it take for test development? How many hours will it take to tests will be self-maintaining as the content of the dynamic storefront
maintain the tests for a selected time horizon? These costs need to be changes.
compared with an estimate of how long it takes to perform the same Some test types can be developed in such a way that they can be
tests manually. How often do these tests need to be executed? This used universally against any application. Examples include verifying
analysis is not as simple as it might seem for a number of reasons. field data types, field length, required/optional fields, tab order and
First, it is not always well known how the target application will change adherence to GUI standards. Writing a universal test requires an
over time. Application change may translate into script maintenance, understanding of abstraction, but otherwise, they are not difficult to
but it is also the primary reason for automating tests in the first place. write. The following is a simple example:
After all, if the application didnt change, there would be no need to
retest it. Therefore the frequency of change needs to be factored into
both sides of the equation. Tests that can be automated quickly may be
able to pay for themselves the very first time that they are run. Others
may never achieve a positive cost/benefit ratio.
There are other factors impacting the cost/benefit analysis beyond a
comparison of person hour costs for manual and automated testing.
Time to market for software products must also be considered. More
difficult to measure, of course, are the less tangible aspects of testing.
For example, what is the likelihood that a manual tester will fail to catch
a defect that an automated test would have caught. Here is a place
where a look at the tests themselves can help bring some clarity to the
decision. Automated tests are very effective at validating a lot of detail.
If a single character does not match when a comparison between an
actual and expected result is made, a properly designed test will alert
the tester to have a closer look to determine if there is in fact a failure.
Testing software installations and un-installations are good candidates
for automation. Testing tools are more effective than manual testers at
validating a large amount of detail.
There are types of tests that are difficult to perform manually. Stress This simple test step is capable of verifying the field length of any field
and performance tests are obvious examples. But even on a single that accepts a string. It takes two parameters: the name of the field
desktop, an automated testing tool is much more effective at running and the expected field length. It assumes that the field will truncate
a routine set of tasks repeatedly to ensure that the target application characters beyond the field length limit. It raises an error if the field
is not leaking memory and that system resources are being utilized accepts characters beyond the limit. Executing tests of this type
properly. They are also better at measuring the duration of an event. manually are not a good use of a domain experts time and are better
Its easy to create a script that performs a task, starts a timer, waits for assigned to the automated testing tool.
a cue from the GUI that the system is finished responding and then
measures the elapsed time. Attempting to do the same thing with a There are a number of reasons why a software development
stopwatch seems like a poor use of person power. organization should consider test automation including: Productivity,
Repeatability, Efficiency, Effectiveness, Flexibility, Accountability,
Evaluating the Feasibility of Automating a Test Stability, Complacency, and Preservation.
One of the most challenging aspects of choosing what to automate is And if the right choices are made in choosing what to automate, a good
evaluating the relative difficulty of automating a given test. return on investment can be achieved. Yet, as thorough a job as we
First, consider the complexity of the test. Tests that navigate a few might do analyzing the costs and benefits of a test automation effort,
pages or screens and can be verified with data captured directly from some things defy quantification.
the application will be relatively easy to automate. When prioritizing Brian Le Suer is the CEO of Zeenyx Software, Inc., a company
automation tasks, schedule the easier tests first so that the benefits of dedicated to building next generation solutions for manual and
automation are realized quickly. There are plenty of tests that can be automated software testing. Visit www.zeenyx.com to learn about their
executed on a single page or screen like validating error messages innovative step-based approach.
when required fields are omitted or testing boundary conditions.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


34 WEDNESDAY, APRIL 20 - PRESENTATIONS
10:00 AM - 11:00 AM

Pursuing World Class Quality: Transforming Your
Organization The Testers Story: Painting the Picture of Risk
Clyneice Chaney, Quality Squared Shaun Bradshaw, Zenergy Technologies

The traditional time versus cost versus quality conundrum is faced Identifying risk by detecting bugs may be the primary goal of a tester
L by organizations trying to keep pace with the rapid pace of market but we have a unique responsibility within software development
E driven changes today. The Quality Management/Assurance/ projects. Clearly communicating risk can mean the difference
Testing organization is constantly under pressure to deliver low between successful mitigation and the nightmare scenario of critical
A incident products in continuously shrinking development timelines. revenue streams being interrupted. But no one wants to channel
D Some enterprises establish world-leading quality assurance (QA) Chicken Little or conjure images of the boy who cried wolf every time
E functions while others implement small-scale change. a bug is discovered.
R R
S
Clyneice provides practical hands-on techniques for changing I Critical issues must be communicated in a manner that delivers
organizations. Join Clyneice to align expectations with reality and the right messages while building trust. But trust can be difficult to
H S
improve the view of testing. Effect change in your organizations create given the special nature of testing and the challenges it can
I utilizing principles and methodologies. Transform your organization K present in the relationship between testers and developers. Add the
P and get respect. stakeholders into the mix and it is not always easy for testers to be
heard, much less trusted. Learn how to better communicate with
developers and stakeholders, build and maintain trust, and ensure
issues and defects are proactively addressed by telling an effective
story that paints the right picture for all parties.

Simplicity: The Path to Achieving Agile Testing Join Shaun to determine the best way to communicate your story
Efficiency to the relevant stakeholders and identify the risks that exist without
losing trust or crying wolf. Get your voice heard in your organization.
Paul Herzog, SPR Consulting

The pace of an Agile project creates demands efficiency in all


Leveraging Free, Open Source, and Low-Cost
testing techniques and processes. Traditional approaches run
counter to this efficiency and must be changed during the Agile Tools for Back End Testing
transition. Join Paul as he applies the Agile Manifesto Principle
A #10: Simplicity the art of maximizing the amount of work not Elysia Lock, Emmi
G done is essential to distinguish what past testing practices O
work and dont work to clean out the clutter of the non-working. P Front-end GUI testing is a small slice of the QA pie. Much more goes
I He will identify common process traps when adopting Agile on beyond the interface in the server, database, and API layers. Many
L methodologies, suggest priorities that are most important to
E testers are discouraged from really digging into the back-end to find
E Agile testing, and present ways to remove testing inefficiencies. N the source of issues and uncover bugs that arent presented in the
Determine how to include process evaluation in regular Sprint applications GUI. Learn how to identify some areas of the back-end
Retrospectives or other checkpoints and implement continuous S that are prime targets for low-effort, low-cost testing. Elysia shows
improvement focused on simplicity. Experience a successful how back-end testing does not need to be expensive by giving a
transition to Agile with Paul!
O real-world demo of back-end testing of popular web applications such
U as Google and Twitter using grep and tail, jmeter, SoapUI, and smart
R SQL queries. Join Elysia to learn some quick and easy ways to get
C started with back-end testing for true white-box testing. Finish with a
Q & A session aimed at real-life challenges.
E

Mobile App Testing: What and How to Test?

QUEST Exhibitor EXPO & EXPO Talks


Nikhil Kaul, SmartBear Software

With Apple, Google, and Microsoft making it easier for developers


to build cross-platform apps, mobile app testing will continue to
come under more pressure. There is more to test in less time. Opening on Wednesday morning, the Exhibitor EXPO features vendor
Simultaneously, with recent releases such as Windows 10, the line booths from leading organizations in the industry. Enter for a chance to
M between desktop and mobile is getting blurred, essentially meaning win exhibitor prizes, and get your QUEST Passport stamped to enter in
O traditional testing frameworks wouldnt work for long. Add to all the QAI Grand Prize drawing on Friday during lunch (must be present
B of this, the challenges mobile app testing faces from increased to win).
I API dependency, fragmented marketplace, and hardware data
determining the user experience. And with app store approval If you are looking to learn more about specific products and services
L processes becoming more stringent, these challenges just continue showcased by EXPO exhibitors, then the EXPO Talks are designed for
E to grow. Join Nikhil to learn about the recent trends in mobile you! Starting on Wednesday and ending with the EXPO Reception,
app development and what they mean for testers. Gain insights these Talks are short 30-minute sessions featuring innovative product
into how to roll out a robust mobile app testing framework, while demos or service presentations. You will have the chance to talk with
following reusability practices that reduce testing time. exhibitor representatives and have your questions answered away from
the busy EXPO booths. The EXPO Talks are a convenient one-stop-shop
to learn the latest about products and services.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


WEDNESDAY, APRIL 20 - PRESENTATIONS 35

11:15 AM - 12:15 PM
What Time is It Over There? Maximizing the
Effectiveness of Your Global QA Team Risk Based Testing at the Enterprise Level
Elizabeth Wisdom, Ulta Beauty Bernd Bornhausen, Banque Nationale du Canada

Cheaper! Faster! Smarter! These 3 words are what a QA team The test organization of an enterprise has unlimited resources at its
L leader hears almost every day. Many organizations today recognize disposal in order to test all applications used by this enterprise. This
E that a globally distributed QA model will achieve some of those is the dream world of QA organizations around the globe. In reality
A objectives, but it comes with some challenges! there is no such thing as unlimited resources for any given QA or-
D ganization as it is true for all organizations within an enterprise. The
Create a global QA team that can effectively engage and R enterprise, thus the QA organization, has to prioritize its resources
E collaborate with each other as well as with with project stakeholders in order to maximize the benefits of the invested effort. In order to
R operationally with maximum effectiveness and efficiency. Set
I do so we need to apply a prioritization method to identify the ap-
S the correct expectations and assumptions with a global resource S plications the most critical as these will be the ones the most effort
H team model. Build trust within the team and create effective K should be spend on. Risk based testing at the enterprise level tries
communication channels and daily reporting to help the QA team exactly that and gives the QA organization the method to utilize its
I act as a cohesive team without boundaries. Join Elizabeth to get resources where they are needed.
P your global team to the highest level.

Budgeting, Estimation, Planning, #NoEstimates and


the Agile Planning Onion How to Tackle Open Source Test Automation in
Incredible Ways
Tom Cagley, DCG Software Value
Harpreat Singh and Piyush Sachar, Microexcel
Observed from the outside, the idea of estimation might seem
like a foreign concept when applied to Agile testing. However, O Open Source Tools for Test Automation has been crowded with
agile practitioners implement many levels of estimation, including many options in the last few years. The presence of so many
budgeting, high-level estimation and task planning (detailed
P tools and the various ways of using them makes the choice of tool
A estimation). We can link a more classic view of estimation to E difficult for stakeholders and all the supporting tools has made
G the Agile planning onion popularized by Mike Cohn. In the Agile N the choice harder. Mobile Automation has now been added to the
planning onion, strategic planning is on the outside of the onion and mix. This session introduces open source tools along with their
I the planning that occurs in the daily sprint meetings is at the core supporting tools to give a perspective in the wide world of Open
L of the onion. Each layer closer to the core relates more to the day-
S Source Test Automation along with the strategies and mindsets
E to-day activity of a team. The #NoEstimates movement eschews O behind them. Join Harpreat and Piyush to make a success of your
developing story- or task-level estimates and sometimes higher U Test Automation initiative. Find out the strategies to use to serve
levels of estimation. As you get closer to the core of the planning R development models like Agile, TDD and BDD. Learn about open
onion the case for #NoEstimates becomes more compelling and, source mobile test automation tools like Appium which are using
dare I say, useful. A case study will be used to focus on how an
C similar APIs to Selenium.
organization that tests both within the Agile teams and through an E
independent testing group has implemented estimates for Agile
testing activities.

Faster and Better Mobile Testing in the Cloud


Jamie Moore, Mobile Labs

Developers and QA professionals face tough challenges managing


mobile devices. Existing tools can force you to tie devices to a
Lunchtime Reminders
single machine. Then you have to pass them around physically
when its time to share or collaborate. This diminishes team agility Wednesday and Thursday of the QUEST Conference features Special
M and DevOps efficiency in mobility and impacts test coverage. Find Interest Roundtables during lunch, which encourages attendees
O out what makes mobile so different than other types of testing in to connect over specific topics of interest. As you enter the general
B environments and processes. Recapture lost efficiencies using the session room for lunch, certain tables will have signage indicating that
I correct strategy. Use a Private Device Cloud to build and manage it is reserved for roundtable discussions for that particular subject.
your device inventory. Automate your mobile application test cases Connect over similar interests and discuss your issues with your peers.
L in order to take full advantage of test automation ROI and include
E your mobile application testing process within DevOps. Join Jamie Also remember to confirm with QAI staff members whether you plan
to make use of the Cloud and other efficiencies for faster and better on attending the Evening Event in Chicago.
mobile testing.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


36 WEDNESDAY, APRIL 20 - WORKSHOPS
1:30 PM - 3:00 PM
ZAP, Youre QA Team Leader! How to Build a High
Performance Team Mobile Testing: To Automate or Not to Automate?
Rebecca Staton-Reinstein, Advantage Leadership David Dang, Zenergy Technologies
All too many QA managers begin their tenure with no previous Companies are moving into mobile technology at a rapid pace, which
managerial experience or training. One day youre a highly competent has significantly increased the need for manual testing in that area.
technical person and the next day youre in charge of at least one Companies are turning to automation to help ease the workload but it
L other person and are at a loss. To make things worse, youre often is not always obvious what should be automated. Mobile has its own
E told to continue all your technical work while you manage your team.
M set of complications, compounded by a huge variety of devices and
Unfortunately, this tradition is alive and well and the poor results OS platforms. This presentation helps attendees learn what mobile
A have been documented for decades. O testing activities are ripe for automation as well as those items best
D B left to manual efforts. In particular David will consider whether to
You choose to break this pattern. You learn the basic skills of great automate Mobile Web; Native Applications and Hybrid Applications. At
E management and use them to build a strong, high performing team. I the device level we will consider orientation (Portrait vs. landscape),
R Whatever your official title is or the size of your team, some basic facts
L pinching and zooming, calling feature and SMS. Types of testing will
apply because we are all dealing with human nature. You can hone cover User Experience, Functionality, and Business Process Flow and
S your leadership skills and apply practical solutions to get the robust E Data. Lastly we will consider some available tools.
H results your management requires. These are basic survival and
thrival skills in todays global marketplace and do-more-with-less Learning Objectives:
I business culture. Join Rebecca in this session to break with tradition Determine automation effectiveness based on all factors
P and thrive! Calculate a targeted automation percentage for your efforts
Use a success story to motivate your mobile testing
Learning Objectives:
Get results by bringing out the best in people
Apply management approaches with proven effectiveness
Avoid classic mistakes technical team leaders can make

Deconstructing SAFe the Scales Agile Framework Making the Case for Collaborative Test Case
in a Nutshell Development
Angela Dugan, Polaris Solutions Todd Peak & Mike Lipps, Seapine Software
With so many software delivery process frameworks and Collaboration between quality analysts and developers enriches
methodologies out there, its hard to know where to begin. And just softwares quality in ways that increase its value to the end user and
when the industry seems to be warming up to agile, here comes P helps ship the release! Poor or non-existent collaboration between
SCALED agile with frameworks like SAFe, LESS, and a host of L these departments bogs down development efforts, resulting in
others. Should we all just be SAFe? But then maybe SAFe is just a delays, blown budgets, and buggy releases. Throwing new builds
glorified waterfall process for companies that cant handle real Agile. A
A SAFe, the Scaled Agile Framework, leverages the best of several
over the wall is inefficient and can create a counter-productive
N us vs. them mentality between QA and developers. Creating test
G well-established frameworks, including Lean, Kanban, and scrum. cases independently has unmistakable merit, but stopping there does
While SAFe is certainly intended for large, enterprise organizations /
I delivering extremely complex and interdependent systems, many
the software a disservice. Quality analysts and developers working
D together create better test cases, a better work environment, and
L SAFe principles and practices can be used to improve much smaller better software. Each team brings important talents to the table, and
teams. Join Angela in this workshop to gain a better understanding of E
E the SAFe, and how teams can adopt SAFe principles and practices to
breaking down barriers between them through collaboration and
improve the development, testing, and delivery of products.
S knowledge sharing uncovers potential issues before they occur,
increases testing coverage, and fosters an appreciation for each
I others contributions. Technology was intended to make our lives
Learning Objectives: G easierbut collaboration can make making technology easier.
Get an overview of SAFe processes, roles, and terminology
Take a SAFe approach to large scaled software delivery and learn N Learning Objectives:
best practices for both large and small teams Learn how collaboration leads to better software
Procure all of the resources you need to do this Determine the most valuable service each group can provide
Leverage the groups to make your life easier

One-on-One Coaching Sessions Getting Started with Jmeter!


Daniel Schiff, edo Interactive
Have you ever heard an interesting idea or solution in a conference Get performance statistics on your web page and automate a web page
O functional test at that same time. Get introduced to test automation
presentation and would have liked to discuss it further with the
speaker? But, when you tried to talk to the speaker immediately at the P and obtaining performance metrics with JMeter, a popular, free, open
source competitor to HP LoadRunner. JMeter is one of the most popular
end of the presentation, you found that the conference schedule just E web performance and functional testing tools available. Together, we
didnt allow enough time? N will walk through obtaining performance statistics on a web page and
complete a functional test or two. The demonstrations will provide
Included with the QUEST conference experience is the opportunity for the basics and the foundation to build your own tests. Attendees are
you to meet one-on-one with conference speakers or the professional S encouraged to bring their laptops if possible, and it will be helpful (but
QAI instructors in an informal setting to discuss how to turn ideas into not required) to download and install Java and Apache JMeter prior
O to the workshop. A useful preparation for this session is: http://jmeter.
solutions that address your specific needs.
U apache.org/usermanual/best-practices.html
Speakers will be available for free coaching sessions on the day of their
R Learning Objectives:
conference presentation. Sign-up sheets with available speakers and
times will be posted at the conference on Wednesday, Thursday and C Learn how to write extensible tests
Use JMeter for functional API tests as well as load tests
Friday. Sign-up at the conference is required to reserve your coaching E Connect JMeter to a scheduler for great smoke tests and regression
session. tests

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


WEDNESDAY, APRIL 20 - PRESENTATIONS 37

3:30 PM - 4:30 PM

Culture of Quality: Integrating QA in the SDLC The Testing Pyramid: Its Not about Testing
Helene Simmons, Lincoln Financial Group Gary Pedretti, Sodoto Solutions
Jackie Wilson, Lincoln Financial Group
Do you struggle with building and maintaining an automated
The Culture of Quality program plays a strategic role in test suite? Do you wonder how you can work together with other
implementing best practices to achieve quality excellence through P specialists in a true cross-functional agile team? Do you push all
L collaboration with our IT and Business Partners. The objective L testing to the end, even though youre using agile techniques and
E of a Culture of Quality Program is to support the IT Enterprise shorter cycles snowplowing risk forward and compressing the test
by incorporating Quality Assurance into the SDLC process
A
cycle like we did in waterfall?
A during the project stages. It will maximize performance in the N
D production environment, will increase business and technical / Mike Cohn introduced the Testing Pyramid in his 2009 book,
E partner satisfaction, and reduce redundancy and waste during D Succeeding with Agile, as a model for thinking about sustainable
R the testing cycle. This has included process improvements such test automation. But it also has powerful implications for analysis,
as Risk-Based Testing, Entry/Exit Criteria, Metrics, Professional
E
architecture, coding, and documentation. Building a product that
S Development, and Consistency in Quality Center usage and a S is well covered by tests, in the ratios described by the Testing
H common QA Terminology. Implementing a Culture of Quality will I Pyramid, requires specific thinking and approaches at both
I require the support of various IT organizations as you verify and G the technical and human levels. In this talk we cover modern
P improve processes, standards, execution, and measurements. techniques and patterns that allow for all software specialists to be
Our journey started in 2014-15 with the formation of workgroups
N
guided by the Testing Pyramid to build shared, collaborative team
focused on improvement. We continue to learn through environments.
development of metrics. Find out how weve succeeded in process
maturity and continued promotion of a Culture of Quality, and how
weve impacted our QA teams and IT/Business Partners.

Using BDD and Specifications by Example in Acceptance Test Driven Development (ATDD) with
Increase Software Value SpecFlow
Diane Walker and Nick Hussey, Equifax Chris Taylor, Polaris Solutions
Software that works but doesnt solve the right problem isnt O Acceptance Test-Driven Development is a test methodology that
valuable! We have a habit of focusing our attention on whether P picks up where unit testing ends and can be leveraged to make
the applications are doing things right. But how do we know if our testing a collaborative effort for the entire agile team. You will
application is doing something valuable? Diane and Nick share
E learn the Given-When-Then nomenclature of ATDD and how it
their journey to solve this and other quality issues using BDD and N can be applied to writing requirements or acceptance criteria that
A Specification by Example. They use these tried and true techniques easily flow into test case development. Well look at the setup,
G to increase the clarity of specifications for the entire software team S syntax, roles of each agile team member in making it work, and
I as well as their business partners. Find out how they increased
O
also at some strategies for using SpecFlow in a project regardless
time for test analysis and increased test automation. They will share of testers technical expertise. Although SpecFlow is Microsofts
L U
with you how they were able to shift the entire schedule left and implementation of Cucumber for .NET, what you will learn in this
E decrease time to market. Increase the Value of your Software with R session can be applied to any other tool of your preference.
Diane and Nick. C
E

Mobile Test Automation and the Need for


Continuous Quality
Evening Event & Bonus Session
Eran Kinsbruner, Perfecto
Join tap|QA and your fellow attendees for a spectacular
Adopting agile practices is a struggle for many mobile app private event at the Chicago House of Blues. This
teams. Rapid introduction of new mobile devices and operating notoriously cool venue is located in historic Marina City
M systems along with internal time-to-market pressure is pushing Complex, downtown along the Chicago River. You can
O teams to discover the set of changes required to embed quality let loose after a day of education at Quest in one of the
throughout the code-build-test cycle. While the answer sounds windy citys premier music venues. Attendees will enjoy
B simple automate process, testing, environment provisioning and dinner and live music.
I deployment in reality this can be hard to achieve. In this session,
REMINDER: Thursday morning begins with an Early Bird
L Perfectos Eran Kinsbruner will dive into automating mobile
Session at 7:45 AM - Successful Networking: Making
E testing. The focus will be on implementing automation that can be
the Right Connection, presented by Charlene Woolley,
executed in parallel on real devices without requiring any manual
Equifax (see page 32).
intervention. Well cover the core pillars of a mobile automation
framework that work as part of a continuous quality process and
offer a template attendees can apply to their teams.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


38 THURSDAY, APRIL 21 - PRESENTATIONS
10:00 AM - 11:00 AM
The Art of Testing Transformation: Blending Load It UP: Effectively Combining Functional and
Technology with Cutting-Edge Processes Performance Testing
Jennifer Bonine, tap|QA Chris Lawson, Zenergy Technologies
Technologies, testing processes, and the role of the tester have P Software testing usually separates performance testing, functional
evolved significantly over the past several years. As testing test automation and manual testing procedures. Different teams
L E
professionals, it is critical that we evaluate and evolve ourselves with alternate skills and expertise perform their respective testing
E to continue to add tangible value to our organizations. In your R in Silos with limited cross-team collaboration. This lengthens the
A work, are you focused on the trivial or on real game changers? F test schedule, feedback loops and time to market. Doing multiple
D Jennifer Bonine describes critical elements that, like a skilled O practices in tandem shortens testing cycle times and uncovers
painter, help you artfully blend people, process, and technology potential defects sooner. Chris provides techniques to achieve
E R
into a masterpiece; woven together to create a synergistic optimal combined test results including conceptual framework
R relationship that adds value to your organization. Jennifer shares M design patterns, common functional and load modeling techniques
S ideas in the areas of mastering politics, maneuvering core versus A and a methodology for combining both and incorporating automated
H context, and innovating your technology strategies and processes. N tools. Accelerate your testing using the techniques in this session.
She addresses questions on how many new processes can be
I C
introduced in an organization, what the role of organizational
P culture is in determining the success of a project, and how can E
you know what tools will add value versus simply adding overhead
and complexity. This discussion can lead you to technologies and
processes you can stake your career on.

Agilify Your Manual Testing Through an


Metrics: The Force Awakens Exploratory Approach
Joseph Ours, Centric Consulting Ryan Yackel, QASymphony
E
You cannot improve what you cannot measure. That statement X Developers often have the unfortunate distinction of not thoroughly
has led to a proliferation of measure and metrics gather programs P testing their code. Its not that developers do not understand how
M throughout history. In software testing, metrics are used frequently to test well; its just that often they have not had an opportunity to
L
E to inform stakeholders regarding the quality and/or progress of
O understand how the product works. Ryan Yackel maintains that
testing in a project. Many time metrics are presented in visual
A form in order to tell a compelling story often to influence decision R implementing a team-wide exploratory testing initiative can help
S I build the collaboration and knowledge sharing needed to elevate all
making. That makes metrics a life force in the universe of quality
T team members to the level of product master. Exploratory testing
U assurance.
can be performed by anyone, but the real challenge is making sure
O
R Joseph discusses some common quality assurance and testing that the process is properly managed, documented, and optimized.
R
E metrics and demonstrates how the force can be manipulated
Y Ryan describes the techniques necessary to drive a deeper
M for good and evil. For those with ill intent, they will learn how to understanding of software quality and to implement an effective
manipulate the metrics for their own purposes. For those pure of and impactful exploratory testing practice. Creating better software
E heart, they will learn how to see past the visual and defend against T
is not just about writing code more accurately and efficiently; it is
N the dark arts. Join Joseph to determine the best metrics for your E
about delivering value to the end user. Well-executed exploratory
needs and how to present them to make your argument. Make sure S
T testing helps unlock this capability across the entire development
your antennae are attuned to any inaccurate stories and make sure T team.
your metrics are a force for good. I
N
G

How to Make Test Automation SMARTER


Jim Trentadue, Original Software

Test automation is not an exact science. As we drive toward an


Last Day Reminders!
A automation solution that validates accurately, the application or data
U undergoes changes, making it challenging to maintain the tests.
The test automation professional must plan to make each test as
T predictive as possible. Jim Trentadue introduces a framework called
Thursday will be your last chance to check out the
O Exhibitor EXPO and EXPO Talks. Be sure to attend the
S.M.A.R.T.E.R that can be used to accomplish this. The acronym
EXPO Reception at the conclusion of Thursdays program
M is defined as: Strategy for understanding application behavior
for light snacks, drinks, prize drawings, networking, and
and variations, Methodology for implementing the logical model,
A Adaptable across different platforms or browsers, Roadmap for entertainment!
T outlining the sequence and priority of those tests to address first, Friday will be the last day for Coaching Sessions. Check the
I Toolbox to work with technologies available, Experienced personnel schedule or with a QAI staff member to see what topics and
requirements for those to support such changes, and a Repeatable
O design for future success. By implementing this framework, your
speakers will be available for the day.
N automation will be structured for ongoing success by making your test
cases SMARTER!

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


THURSDAY, APRIL 21 - PRESENTATIONS 39

11:15 AM - 12:15 PM

Business Case for Software Testing and QA How to Fit Performance Testing into Agile Dev
Operations Cycles
Bernd Haber, Accenture Steve Weisfeldt, Neotys
L Too often companies try to test-in quality at the end of the devel- P Agile development methodologies have many benefits like
E opment life cycle rather than shifting quality left. The holistic view of E increasing visibility into a projects progress and keeping
A Quality is ignored. The Application Testing Services Blueprint Re- R requirements fluid enough to respond to what customers want
D port published by HfS Research Ltd. in August of 2015 states under F today not what they wanted two years ago. However, many
Trends in Application Testing that the testing community has to Agile (or Agile-ish) teams struggle with determining which testing
E overcome its focus on tools and technology [and] it has to speak O practices to keep, which ones to automate, and which ones to stop
R the language of C-level executives and work around the strategic R doing all together. Performance testing is no exception. Creating
S business imperatives. In this talk Bernd shows how to create a M a performance testing plan that fits into your development process
H compelling and convincing test service business case. Assume you A is easier than you might think. Join Steve to learn when to do
only have 15 minutes to talk to the CIO, SVP or VP of IT to make continuous performance testing and when to fit load testing into
I your case. Join Bernd to make your case for your future! N your sprints. One size does not fit all! Steve will present you with
P C practical tips for sizing tests to match your needs.
E

Creating Useful Metrics to Provide Quality


Software Tips For Maintaining Testing Integrity
Helene Astier, Cars.com Carolyn Swadron, CIBC
M
Metrics are the key to quality software but they must be useful, Requests to complete testing faster than planned in order to meet
E a project deadline are increasingly common. Shortening testing to
applicable and span the entire Software Development Life Cycle.
A meet a mandated schedule can threaten the integrity of testing results
Metrics are categorized in three ways people, process, and P
S technology. People metrics are used to monitor teams, to plan and conclusions. This session describes boundaries that testing
R team leads and managers need to establish in order to ensure that
U teams, and to measure team productivity. Process metrics evaluate
the health of products, the day to day operations and enforcement O their certification results are accurate, meaningful and valuable to the
R
of new practices. Technology metrics assess the impact of new C project and its stakeholders. It addresses approaches for resisting
E pressures to give in to demands that negate the value of testing, and
technology and measure QA automation. Making metrics actionable E
M is the key to a successful program, quality software and process provides guidelines for negotiating solutions that are acceptable to all
S parties. These include the need for proactive replanning as project
E improvement. This presentation provides the What to measure; the
Why to measure and the How to measure. It also shows how to S scope, knowledge and circumstances change, and identifying the
N best people for preparing and executing testing based on application
benchmark effectively, spot trends over time, interpret the results
T and convey the information back to the stakeholders. requirements, required testing deliverables and test results. The
session includes the opportunity to ask the group how to resolve
personal testing challenges.

Dont Be Another Statistic! Develop an


Automation Strategy for Long-Term Success
Lee Barnes, Utopia Solutions

Choosing the appropriate tool and building the right framework

A
are typically thought of as the main challenges to successful
test automation. However, even after careful tool selection and
advanced automation framework construction, long-term success
Lunchtime Reminders
U
proves elusive to many. Lee Barnes discusses the key strategy
T components that must be in place to avoid becoming another test
O automation statistic. Learn the importance of, and techniques for, Thursday lunch is another opportunity to participate in
M assessing your organizations readiness for test automation in the Special Interest Roundtables. Join fellow attendees
foundational areas including test objectives, organizational structure, for a discussion on hot topics relevant to the everyday
A
process integration, environment and resources/skills. Once you practitioner.
T understand your state of readiness, you can begin to formulate a
Remember to visit the Exhibitor EXPO and have your
I strategy for addressing gaps and laying the groundwork for long-
EXPO Passport stamped by all the vendors before
O term success. Lee presents a framework for developing a solid test
the conclusion of Thursdays program. Turn in your
automation strategy that addresses automation scope, required
N completed EXPO Passport to the QAI Registration desk
organizational & process changes, and implementation roadmap.
to receive a raffle ticket for QAIs Grand Prize Drawing
Take back a blue print for implementing successful test automation
during Friday lunch (must be present to win).
in a way that uniquely fits your organization, and become a positive
test automation statistic!

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


40 THURSDAY, APRIL 21 - WORKSHOPS
1:30 PM - 3:00 PM
Enhancing Your Leadership Skills to Become an
Effective Test Manager Real World Security Testing
Michael W Ennis, TEKsystems Matt Konda, Jemurai
L In the fast paced world of software development, often times Testing for security is an increasingly important and visible part
E the smartest or most technically savvy person is promoted to of software delivery. The classic formula for security testing isnt
working and security analysis tools cant reliably find certain basic
A becoming a Test Manager. While your technical skills may have
separated you as being a high performer, technical skills rarely problems. Matt introduces concrete things testing teams can do to
D contribute to the security of a system and identifies opportunities to
transfer into becoming an effective manager. Being an effective
E manager requires a combination of technical skills and what I term include more advanced manual testing of scenarios that are often
R as soft skills. As an individual contributor, your training curriculum S overlooked. Process improvements that range from articulating
security acceptance criteria to checklists are discussed. In some
S is almost always focused on increasing your knowledge and skills E
in the area of your technical focus but rarely are you prepared for cases, test automation can be used to raise the security of
H C delivered software. In all cases, the villain persona and negative
the emotional intelligence that is required to becoming an effective
I leader of your team. Join Mike Ennis in this workshop and see how U testing scenarios are foundational to effective security testing. In
P you can take your leadership to another level. R addition to specific actionable security testing strategies, one goal
of the talk will be to provide some high level context for thinking
I about security testing and how to integrate it into the software
T development lifecycle effectively. Take the security of your
10 Steps to Continuous Integration, Testing and Y applications to the next level and be more confident.
Delivery
Learning Objectives:
Tanya Kravtsov, ROKITT Learn manual testing steps for two classes of security
vulnerabilities (xss and authorization)
DevOps is based on continuous delivery and anything that breaks Identify where and when to use automated tools for security
the continuity is a bottleneck. QA often becomes that bottleneck due testing
to an unstable test environment, unavailable test data and/or manual Integrate security into the development process
processes. While Agile has become a common term in Development
D and Testing organizations, manual build and deployment processes
are still causing problems along with integration and testing. Tanya
E discusses various automation tools and techniques that can help
V to address process bottlenecks and achieve a true Continuous
/ Integration, Testing and Delivery state. Join Tanya to learn how to The Red Bead Experiment
O reduce the bottleneck that is QA.
Mike Kaufman, EMC
P Learning Objectives: Come watch, and participate, in this engaging, interactive and
S Identify bottlenecks/manual processes in your product development lassic experiment made famous by Dr. Deming. Learn about
and testing life cycle process improvement by exploring the link between special
Learn how to use tools and techniques to implement the cause and general cause of process variation, systems analysis,
Continuous integration, test and delivery and overall quality. Learn how changing a process without really
Identify best practices in addressing data, environment and test
P understanding the factors impacting the process can actually
bottlenecks R degrade the process instead of improving it. Join Mike and be part
O of the experiment. The White Bead Corporation is looking for Above
C Average Employees for expanded production. On-the- job training
Applying Design Patterns to Automated Testing provided. Earn bonuses! The White Bead Corporation is a proud
E producer of shiny, perfect, white beads. We work hard to meet our
S customers exacting demands and wont settle for anything less
Brian Le Suer, Zeenyx Software
S than perfection. We need Willing Workers who are Above Average
Design patterns are often used in the development of object-oriented Employees to handle this rigorous task in an inspiring environment.
software. A design pattern is a description of a commonly occurring Apply within.
problem along with a template for a reusable solution. Design
patterns can be applied to automated testing to make tests more Learning Objectives:
A reusable and easier to maintain. Brian explores the use of design Quality is not (just) about the employee
U patterns to solve common problems encountered in automated Special cause and general cause of process variation
T testing. According to the authors of Design Patterns: Elements System process evaluation and improvement
O of Reusable Object-Oriented Software, a design pattern has four
basic elements: the pattern name, the problem, the solution and the
M consequences of applying the pattern. Join Brian to explore how the
A four basic elements of patterns can be used to reduce the level of
T effort to build automated tests and reduce the costs associated with
I maintaining them.
O Learning Objectives:
N Use encapsulation to build general solutions instead of repeatedly
writing custom solutions to common problems
Learn specific scripting techniques that will translate to any scripting
language and take home samples
Save time and costs in test maintenance by building reusable
solutions to common problems in automated testing

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


THURSDAY, APRIL 21 - PRESENTATIONS 41

3:30 PM - 4:30 PM
Security Testing Scripts for the Non-Hacker:
Polyskilling Testers: Good, Bad or Ugly? Straight from the Security Pros Handbook!
Matthew Eakin, Centric Consulting Glenn Stout, HALOCK Security Labs

L Agile demands much more of the tester. Testers are now asked Do you feel unsure about web application security? Are you not an
to be much more technical. They have to test database changes, expert but still responsible for application security? This session
E web services, and integration with other systems. On top of that S
will arm the participant with a guide to test web applications
A testers have to automate our test scripts as fast as they are being E for common security threats that can be tested without a deep
D written. But is this change a good thing? Are testers becoming C knowledge of hacker type tools. A usable takeaway checklist
better testers? Are products becoming better or more solid? In
E this session Mr. Eakin will examine polyskilling and the Dunning- U with test scripts that the non-hacker can use to give applications
R Kruger Effect from a testing point of view and try to explain how it R a good security review is provided. Hacker-esque tools to do
can destroy teams if applied incorrectly and make them stronger if some additional security testing are identified and demonstrated.
S I Join Glenn and become an ethical hacker of your own web
applied correctly.
H T applications.
I Y
P

Testing Deliverables: Define, Align, Document


DevOps: A Testers Best Friend and Approve

Thomas Janik and Ken Robertson, American Family Clareice Chaney, MITRE and Clyneice Chaney, Quality
Insurance Squared

Have you ever asked yourself how DevOps could succeed in a D Deliverables are outcomes and often tangible representations
company that has an existing set of testing processes, deployment E in determining the success of a project. Deliverables must be
practices, multiple segregated environments, and silo teams? Is identified, specified, designed, scheduled, produced, tested,
it possible to take autonomous teams and bring them together L
D accepted and implemented. With the rising cost of testing and
to increase efficiencies within the deployment pipeline in a large I the increased need for and the pace of software development
E company thats ingrained with weve always done it this way? We V and testinglets look at testing deliverables, both project and
V asked these same questions at American Family Insurance. What product, and identify methodologies for identifying, aligning and
we discovered was that by uniting certain teams, re-evaluating E
/ documenting them. The focus of this session is to look at identifying
the tools we used, streamlining processes, and integrating our R and aligning test deliverables with outcomes; determine the
O environments, we could evolve into a DevOps culture that offered A impact of the use of Waterfall and Agile software development
P our developers continuous integration and our testers expediently methodologies on test deliverables; and clarify why clearly
deployed code in stable environments, all seamlessly integrated. B
S defining and documenting deliverables is a critical component
Join us as we discuss the before, the, after, and the step-by-step L to demonstrating progress so that your customers, internal and
process American Family took to evolve toward planned production E external, can achieve their desired outcomes.
maintenance releases, an automated deployment pipeline,
standardized smoke tests, rapid deployment of defect fixes for S
retesting, and stable testing environments to facilitate better
functional and integrated testing processes.

Keyword Driven Testing with Selenium: The


Good, the Bad and the Use Case

Brian Van Stone, QualiTest Group EXPO Reception & Evaluations


Keyword Driven Testing (KDT) is a design pattern that enables
A test automation to be designed around business logic and which
U At the conclusion of Thursdays program, stop by the
allows for non-technical business users to be more directly
Exhibitor EXPO for the EXPO Reception, sponsored
T involved in the process of test automation. It can also reduce the
by all our exhibitors participating in the QUEST 2016
cost of test automation maintenance. Many organizations have
O shied away from the prospect of developing a full featured KDT EXPO. Refreshments will be served, entertainment will be
M framework around Selenium because of the enormity of the task provided, and the exhibitors will raffle off their prizes to
A and instead fall victim to the maintenance nightmare that results eligible winners.
from record-and-play or one-off automation scripts. In this session
T we will discuss the benefits, challenges and use cases of KDT
Tell us how we did! Remember to fill out your Overall
I Conference Evaluations, and turn them in to QAI staff
with Selenium as well as how best to address some of the largest
members before lunch on Friday to enter the QAI Grand
O challenges therein. We discuss how to make up for the deficiencies
Prize Drawing.
in Selenium and when KDT is the right solution.
N

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


42 FRIDAY, APRIL 22 - PRESENTATIONS
10:00 AM - 11:00 AM
Leading Indicators of Quality: Driving the Isnt an Enterprise Test Strategy just for an
Conversation & Managing Risk Enterprise Project Release?
Dana Dietz, Nationwide Susan Schanta, Cognizant Technology Solutions
T
L Quality is not judged by defects alone. When you watch closely,
E Have you ever heard a Project Manager refer to it as a strategy for
E you can identify, monitor and act on issues long before a defect an enterprise project release? The purpose and use of an Enter-
appears. If youve ever hoped for a more proactive approach to
S prise Test Strategy exists in many organizations because there is
A quality, this session is the one for you! Leading indicators of quality T not a shared understanding regarding how to drive quality through
D abound if you are willing to look for and track them. In this session collaborative disciplines. The Enterprise Test Strategy provides
E well discuss options for getting out ahead of quality what factors S the foundation for how the collective software team delivers quality
might you chose to track, how you can make the indicators visible T to the organization. The strategy encompasses a mission state-
R R
to those who care and how can you connect the indicators to ment, standards for test analysis, planning and validation as well as
S metrics that you already measure on your teams? Youll leave this A expectations for interaction with cross-functional organizations. In
H session prepared to jump start the quality conversation and ready T this session, Susan will explain the value proposition of having an
I to track leading indicators of your own choosing. Youll be ready E Enterprise Test Strategy, how to introduce the strategy to your or-
P to tell the quality story in your organization so that associates and G ganization and how to measure against standards set. Learn how to
leaders alike can understand the current state of quality and act to Y create a customized template and build a comprehensive strategy
improve it. that documents a disciplined approach to quality practices.

5 Critical Elements for a Successful Test Data Regression Test Management Using a User
Management Program Interface CARTTS Tool
Robert Kelman, AT&T Mani Rajappa, GSI Health

The Effectiveness of a Test Data Management program can Change requests originating from both clients and internal
determine success or failure of any enterprise testing effort. R departments create a need for regression testing. Regression
T
However, implementing a successful Test Data Management E testing for every change is challenging based on the sheer amount
E program can be technically challenging and costly. This G of changes and deployment timing. In this session, we illustrate the
S presentation highlights the critical components which the DIRECTV solution to ensure regression test cases are successfully executed
R
T Software QA Team (now part of the AT&T family) has implemented for enhancements, patches, configuration changes or code
to ensure testing success. Join Robb as he walks through the E changes using the CARTTS (Coordinator Application Regression
evolution of DIRECTVs current Test Data Management program. S Testing Test Suite) Tool. The CARTTS Tool is a custom user
D Learn the five critical components of the program, which makes S interface designed to execute regression test cases by downloading
A the testing effective and will allow DIRECTV to move into the future tests from a list. Using the CARTTS tool, regression tests can be
I
T and create additional opportunities. This includes a centralized run by the infrastructure team, the development team and client
team, automation, refresh process, Use Case categorization and O teams. This helps to ensure the reusability of tests created by
A
experimentation. N the QA team. Learn the capabilities of the CARTTS tool, how this
custom UI tool was built, and the value that it is providing.

11:15 AM - 12:15 PM
Efficiency and Effectiveness: When Process and Data, Data Everywhere! Understand Your Data &
Pressure Collide Maximize Test Coverage
Frank Rios and Rich Valde, HERE Jessica Paddock, Orasi Software
Imagine having a defined process so important that not following
Measuring your test cases against the most appropriate conditions
it means the potential destruction of a priceless and irreplaceable
L item. So why would any rational, well-intentioned person T
to ensure that all of your requirements are tested is critical. The
testing process needs to provide the best coverage possible to
E deliberately choose not to follow the process? Better yet, why E improve quality. Data coverage analysis is critical in identifying what
A would three intelligent, rational, well-intentioned people choose
S data is required to ensure that faults related to code interaction
D not to follow the process? Prepare for a shocking, real-world case
T are discovered during the test phases and not in production. This
study where we discuss this exact scenario, the potential causes of
E pressure these three people felt, and the dangerous environment
session focuses on the issues and risks of poor data coverage.
The process of Test Data Management (TDM) must be broken
R where it was not safe to speak up. Further, we will use this scenario D down into a cycle of phases, which follow the environment setup.
S to highlight the impact of focusing on efficiency over effectiveness.
A These phases are; Data analysis, Data pools creation, Data pools
H All three people knew the process, but the pressure they felt from
T validation, Data delivery, and Continuous improvement. Join
management to be efficient in fixing the problem, caused them to
I solve it ineffectively. Dont be like this company. Learn to recognize A
Jessica to learn how to use TDM tools to measure and improve
data coverage and provide a better quality product.
P the real root-cause and take action to correct it, before it causes
permanent damage to an irreplaceable artifact.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


FRIDAY, APRIL 22 - PRESENTATIONS 43

11:15 AM - 12:15 PM
Building Quality Software with Continuous
Integration & Continuous Testing The Clouds Impact on Testing
Ashish Nirgudkar,Cognizant Technology Solutions Tom Chavez, SOASTA
C
O Highly integrated application environments prevalent in Cloud computing, now almost ten years old, continues to grow at
N Telecommunications and Financial industries result in many a rapid pace, and it seems that everything is moving to the cloud.
T dependencies and challenges for agile teams. This causes Cloud services are replacing what used to be done on desktops, in
I prolonged integration and regression testing phases, and no labs, and data centers. What is the impact of the cloud on testing?
N improvement in time to market or quality. As business and Can the cloud make testing better? The cloud enables building
U C solutions that scale larger and faster than before where adding
technology leaders push for continuous delivery, the testing team
O needs to partner with the development team in building the right
L capacity in data centers took weeks to months. Now applications
U software. Ashish shares his experience of implementing continuous O can be deployed to cloud servers in not hours but minutes. As
S the cloud enables increases in app deliveries, it also enables
testing across multiple environments with early automation, early U
performance testing and even early User Acceptance Testing. He new services that increase testing efficiency and quality while
T D decreasing total testing time. Tom will discuss the migration of
E explains the core principles of continuous integration/continuous
delivery pipeline, continuous testing and ongoing quality feedback applications to the cloud and the new tools and services that enable
S
T and why testers also need to look at a role transformation testing to be just as agile as the new development processes. He
I into Quality Engineers and Partners with development team. will also address some of the concerns companies have with cloud
N Continuous testing is not easy. Ashish provides a learning strategy computing such as security, reproducibility, and repeatability.
G to help your teams transition from Testers to Quality Engineers so
they can be partners in Agile Transformation journey.

1:30 - 2:30 PM

Panel Discussion: Achieving Cross Roles Collaboration to Build Quality Software


Nancy Kastl, Chicago Quality Assurance Association; David DeWitt, IIBA Chicagoland Chapter; Michael Marchi, APLN Chicago;
P Aisleigh McGann, PMI Chicagoland; Christopher Jones, IEEE Chicago Section
A
N Todays software development teams are comprised of specialists, each playing a specific role based on skills and responsibilities. Project
E managers are responsible for managing projects. Scrum masters guide Agile teams. Business analysts focus on analyzing business
L requirements. Developers code the software, and QA/testers test the software. Many of these roles are defined by a body of knowledge (BOK),
have certifications, and/or professional communities for continuous learning. Whether a software development project is agile, iterative or
D waterfall, the projects ultimate success is based on collaboration and an emphasis on building quality into the software instead of testing in quality
I at the end. Our panelists, representing each of the roles within a software project and are leaders within their respective professions. Come join
S them as they breakdown role-based silos and share insights to collaboratively building quality software.
C
U How does each role define quality software? What are the similarities and differences in these perspectives?
S How does each roles Certification Body of Knowledge support building quality software?
S What challenges does each role face within a project team? How can collaboration overcome these challenges in waterfall, iterative or agile?
I What are the pros and cons of specialized roles vs. project team members interchangeable in their roles?
O How can application lifecycle management (ALM) tools foster cross role collaboration?
N How can other roles help testers shift left within a project?

Harmonizing Business and Technology Needs Using Next Generation Testing


Kimberly Tatum, Deloitte Consulting
Operating a Testing Center of Excellence (TCoE) in an environment with increasing demand (50+ concurrent projects) and complexity (700+
applications) is exceedingly challenging. Some challenges include managing budgets when projects are running concurrently; balancing workload
across projects based on skillset; improving test coverage when there is limited access to subject matter expertise; and reducing repeated tasks;
T and understanding test progress in business terms. Join Kimberly to find out her solutions to the above challenges which included: holistic test
C planning that indicates Project health at all times; optimal demand management; Intention Driven Testing; using past performance to improve test
O coverage for the future; and creating visibility into testing progress through standardized and effective communication in business terms. Create
E successful Go-Live experiences free of critical defects.

Learning Objectives:
Leverage the existing test repository through Intention Driven Testing
Implement optimal demand management across concurrent projects and reduce costs
Create visibility into testing progress through standardized and effective communication in business terms

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


44 FRIDAY, APRIL 22 - ROUNDTABLE DISCUSSIONS
2:30 - 3:00 PM

Shift Left through Tester Shift Left through Tester


Project Manager Collaboration Business Analyst Collaboration
Aisleigh McGann, PMI Chicagoland David DeWitt, IIBA Chicagoland Chapter
A Testers can shift left to be involved earlier in software A Testers can shift left to be actively involved in requirements
L L
M development projects, if the overall project plan includes M definition or user stories creation instead of waiting for
testing activities early in the project instead of at the requirements/user stories to be finalized and turned over
C C
O end of the project. Project estimates must also include O for testing. QA/testers can provide valuable insight to
L adequate time for testers to be actively engaged throughout L whether or not the requirements/user stories are complete
L L
A the project. Join this discussion following the panel on A and testable. They can also suggest exception scenarios
B B outside of the happy path. Join this discussion following
O Achieving Cross Roles Collaboration to Build Quality O
R Software to define innovative ways to work with project R the panel on Achieving Cross Roles Collaboration to Build
A A
T managers in shifting testing left in projects. T Quality Software to define innovative ways for business
I I analysts and QA/testers to work together during business
O O
N N analysis activities to shift testing left in projects.

DCG Ad_PRINT.pdf 1 1/4/16 2:45 PM

OUR QA/TESTING SERVICES


Managed Services

POC Services
C

Test Evaluation/ Assessment Services Y

ERP Testing - SAP & Oracle


CM

MY

Test Automation CY

Performance Testing CMY

Mobile Testing

Open Source Test Automation

P: 201-866-6789 | sales@microexcel.com | www.microexcel.com

New Jersey | NewYork | Illinois | California | Utah


India | UK | UAE | South Africa

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


FRIDAY, APRIL 22 - ROUNDTABLE DISCUSSIONS 45

2:30 - 3:00 PM

Shift Left through Tester Shift Left through Tester


Developer Collaboration Scrum Master Collaboration
Christopher Jones, IEEE Chicago Section Michael Marchi, Agile Professional Learning Network-
Chicago
The traditional wall between developers and testers is
A counterproductive to building quality software. Bugs found A Agile holds the promise of testers shifting left in software
L L
M by QA/testers need to be addressed by developers as soon M development through involvement in sprint planning, daily
C as possible, while the code for the function/user story is still C stand-up meeting, application demos, retrospectives,
O top-of-mind for the developer. Challenges in reproducing O etc. However in some agile teams, the developers are
L L
L bugs, receiving false bugs, or insignificant bugs do not L agile while testing is still performed in a waterfall manner.
A foster a value-added working relationship between testers A Builds are delivered to testers the last couple of days
B B
O and developers. Join this discussion following the panel O within a two week sprint when there is not enough time to
R on Achieving Cross Roles Collaboration to Build Quality R complete testing within the sprint, so testing lags behind.
A A
T Software to define innovative ways for developers and QA/ T Join this discussion following the panel on Achieving Cross
I I Roles Collaboration to Build Quality Software to define
O testers to work side-by-side during development activities to O
N shift testing left in projects. N innovative ways for QA/testers to work with Scrum Masters
in transforming testing to be fully integrated within sprints to
prevent Scrumfall while shifting testing left in agile projects.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


Realize your potential.
Instructor-led courses bring the experts to you
with a full year of educational opportunities!

Experienced instructors with subject matter expertise offer a full years worth of public training
courses at popular locations across the United States and Canada. QAI Global Institute has
trained over 140,000 professionals in software quality management, project management, agile
method testing, test automation, estimation, software reviews, and more. Find the right training
for you and your team!

2016 Training Courses


Facilitated courses are available for all levels from the top-rated Managers Solutions Workshop to the Essentials of
Software Testing. Learn more about each of the following courses, including dates, locations, and instructors online at
www.qaiUSA.com.
Agile Test Strategies and Management Essentials of Software Testing
Boot Camp for Business Analysts Metrics for Managing and Improving Testing
Writing Testable Requirements Requirements Based Testing Techniques: Modeling and Use
CMST Exam Study Workshop Cases
CSTE Exam Study Course Selecting and Executing the Most Critical Tests
Managers Solutions Workshop Testing Mobile Applications
Effective Project Management for Leaders Security Testing for the Web and How to Automate It
Boot Camp for Software Quality Web Testing Techniques
Test Automation for Managers Find the training opportunities nearest you, or plan a trip to some
Effective Methods of Software Testing - Test Planning of the worlds most popular destinations! For course detail, visit
and Design www.qaiUSA.com.
Essentials of Leadership in Software Testing

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


2016 SPONSORS, EXHIBITORS AND SUPPORTERS 47

Accenture
Gold Sponsor | www.accenture.com
Accenture is a global management consulting, technology services and outsourcing company, with more
than 358,000 people serving clients in more than 120 countries. Accenture offers the entire breadth
and depth of testing services across a broad array of applications, digital technologies and industries
delivered under flexible business arrangements to help companies shape their digital future and lead
their industry while delivering an exceptional customer experience. With more than 31,000 testing
professionals across more than 30 delivery centers in 17 countries, Accenture serves over 1,000 testing
clients across more than 40 industries. Sponsoring Breakfast.

Checkpoint Technologies
Gold Sponsor and Exhibitor | www.checkpointech.com
Checkpoint Technologies, Inc. is a solutions provider that specializes in Business Technology
Optimization. We are experts in all areas of quality assurance and software testing performance,
functional, and security. Checkpoint Technologies provides leading-edge software solutions, training,
mentoring, senior consulting, and staff augmentation. Our services include both manual and automated
testing with automated testing being an area in which we are known for our expertise. Checkpoint
Technologies is an HP Business Partner and Certified Training Partner. We have assisted numerous
organizations with their implementation of testing solutions with on-site consulting, staff augmentation,
and training. Sponsoring pens.

CompuGain Solutions
Bronze Sponsor and Exhibitor | www.compugain.com
CompuGain Solutions is your trusted product-engineering firm. As a Microsoft Gold Partner, we have
over a decade of experience in legacy modernization, infrastructure virtualization, and cloud migration.
Over time we have mastered one simple paradigm: learn, engage, deliver. Through this process we are
able to continually match the needs of our clients with quality delivery. Our expertise lies in four main
areas: Cloud Engineering, Application Development, Data Services, and Testing Services. CompuGain
Solutions is strategically headquartered in the Washington DC Metropolitan area. Sponsoring Friday
morning coffee break.

The Chicago Quality Assurance Association


Supporter and Exhibitor | www.cqaa.org
The Chicago Quality Assurance Association was established in 1984 and is the second oldest
chapter of the QAI Global Institute. CQAA promotes software quality principles and practices within
the Chicagoland area by providing a forum for networking and information sharing. CQAA offers
monthly speaker programs, lunch & learns, webinars, and training classes a to over 1500 members for
continuing education. Professional certification is supported by hosting the CSQA and CSTE certification
prep classes in Chicago and facilitating local study groups. Other activities have included one-day
vendor showcases and symposiums, special interest groups for information exchange, co-hosting
programs with other professional organizations, and job search service.

DCG Software Value


Bronze Sponsor | www.dsoftwarevalue.com
David Consulting Group (DCG) helps its clients make software value visible. DCG is a global provider of
software analytics, software quality management and Agile development and measurement solutions.
We enable companies to understand and communicate the value of their software development
initiatives in terms of the greater goals of the business. Since 1994, large enterprises, growing mid-cap
companies and emerging technology leaders have relied on DCG to address immediate and long-term
software development issues, delivering key improvements that have a lasting impact on the bottom line.
DCG maintains corporate offices in the U.S. and Europe. Sponsoring Thursday afternoon coffee break.

Deloitte Consulting
Silver Sponsor and Exhibitor | www.deloitte.com
Deloittes Testing Practice is uniquely positioned to utilize our very strong industry knowledge
coupled with global delivery capabilities to offer a solution that enables building quality across the life
cycle. Whether its a large critical implementation or an Enterprise Testing CoE, we offer end-to-end
functional testing services along with specialized services such as test data management, testing tool
management, mobile, performance, automation, SOA and service virtualization. Sponsoring Bags.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


48 2016 SPONSORS, EXHIBITORS AND SUPPORTERS

Hexaware Technologies
Platinum Sponsor and Exhibitor | www.hexaware.com/digital-assurance.htm
Hexawares Digital Assurance practice enables enterprises to be digital disruptors in their market place.
In addition to providing end-to-end quality assurance services for modern and legacy enterprise systems,
we have specific offerings to cover the digital dimension of a business assuring the multifaceted testing
needs of a Digital transformation across Digital ecosystem which includes cloud, mobility, big data and
connected devices. More than 100 enterprises worldwide trust Hexawares end-to-end QA for sustained,
predictable quality of their products/applications. We deliver significant value by ensuring customer delight
through significantly lower cost of quality, agility in delivery, secure applications and an excellent end user
experience across multi-channel platforms. Sponsoring QUEST Magazine.

IEEE Chicago Section


Supporter and Exhibitor | www.ieeechicago.org
IEEE Chicago Section serves electrical engineers and computer related professionals in the Chicago
Metropolitan Area. It is an active professional network of over 5000 local technology practitioners,
innovators, business leaders, educators and students. It is part of the worlds largest professional
association (www.ieee.org) dedicated to advancing technological innovation via publications,
conferences, standards, and professional and educational activities.

IIBA Chicagoland Chapter


Supporter and Exhibitor | www.chicago.iiba.org
The Chicagoland Chapter of the International Institute of Business Analysis (IIBA) works to build
awareness of the business analyst profession and to promote the ongoing development of individual
practitioners. With the changing face of todays business organizations and IT departments, the
Business Analyst (BA) performs a role crucial to the success of the dynamic business cycle of planning,
implementing, and managing change within companies of all sizes and in every industry. Our meetings
are conducted 9 months of the year on the first Wednesday evening of the month at a variety of sites
around the Chicagoland area.

Microexcel
Bronze Sponsor and Exhibitor | www.microexcel.com
Microexcel provides end-to-end QA services in ERP, Product and Web Application testing segments
across various domain, technologies and database leveraging their proven experience and expertise
in functional and non-functional testing. Their perennial focus is in delivering Test Consulting services
that include Testing Evaluation Services, Customized Test Lifecycle Process, Test Automation
Roadmap, Designing & Maintaining Regression Test Suite and measuring performance parameters.
They have experience in setting-up, operating and managing Testing Centers of Excellence (TCoE). As
a part of Managed Testing Services they have dedicated QA Group which helps customers formulate
and establish a set of standardized QA processes. Microexcel offers various automated test solutions
for mobile, web and Continuous integration builds with custom frameworks and industry best practices.
Sponsoring Wednesday morning coffee break.

Mobile Labs
Bronze Sponsor and Exhibitor | www.mobilelabsinc.com
Mobile Labs is a leading provider and innovator of cross-platform mobile application testing solutions.
Its private, internal device cloud, deviceConnect, delivers comprehensive management capabilities
for mobile devices, apps, and users in corporate test labs. deviceConnect fully supports manual testing
and in conjunction with Mobile Labs Trust provides effective and efficient automated mobile application
testing. All without jailbreaking or rooting smartphones or tablets. Sponsoring the Thursday morning
coffee break.

Morningstar
Supporter | www.morningstar.com
Morningstar, Inc. is a leading provider of independent investment research in North America, Europe,
Australia, and Asia. We offer an extensive line of products and services for individual investors, financial
advisors, asset managers, and retirement plan providers and sponsors. Morningstar provides data on
more than 500,000 investment offerings, including stocks, mutual funds, and similar vehicles, along with
real-time global market data on more than 17 million equities, indexes, futures, options, commodities,
and precious metals, in addition to foreign exchange and Treasury markets. Morningstar also offers
investment management services through its investment advisory subsidiaries, with more than $170
billion in assets under advisement or management as of Sept. 30, 2015. We have operations in 27
countries.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


2016 SPONSORS, EXHIBITORS AND SUPPORTERS 49

Neotys
Platinum Sponsor and Exhibitor | www.neotys.com
Neotys is the leading innovator in Continuous Performance Validation for Web and Mobile applications.
Neotys load testing (NeoLoad) and performance monitoring (NeoSense) enable teams to produce faster
applications, deliver new features and enhancements in less time and simplify interactions across Dev,
QA, Ops and business stakeholders. Neotys has helped over 1600 customers test, monitor and improve
performance at every stage of the application development lifecycle, from development to production,
leveraging its automated and collaborative tooling. Sponsoring Thursday Lunch.

Olenick
Exhibitor | www.olenick.com
Olenick is the largest US-Headquartered software quality specialist. We are experts at ensuring client
success with software projects. Our service offerings include software testing and quality assurance,
project management, business analysis, and other custom solutions.
Founded in 1998, Olenick has over 300 consultants, four global locations, and a client base with a mix of
small- to mid-sized businesses as well as Fortune 500 companies. We have deep industry expertise and
offer delivery methods that include managed services and nearshore. We reduce risk, improve quality,
and provide ROI for our clients.

Orasi Software
Exhibitor | www.orasi.com
Orasi is a leading provider of software, support, training, and consulting services. Through strategic
industry partnerships, we offer market-leading test management, automated testing, application
performance management/intelligence, test data management, continuous delivery/integration, and
mobile testing technologies to enable our customers to focus on a complete software quality lifecycle. For
more than 13 years, Orasi has helped customers successfully implement and integrate software testing
environments to reduce the cost and risk of software failures.

Original Software
Exhibitor | www.origsoft.com
With a world class record of innovation, Original Software offers a test automation solution focused
completely on the goal of effective software quality management. By embracing the full spectrum of
Application Quality Management across a wide range of applications and environments, the company
partners with customers and helps make software quality a business imperative. Solutions include manual
testing, full test automation mobile, UAT and a software quality management platform all delivered with
the control of business risk, cost, time and resources in mind.

Parasoft
Exhibitor | www.parasoft.com
Parasoft develops automated software quality solutions that prevent and detect risks associated with
application failure. To combat the risk of software failure while accelerating the SDLC, Parasoft offers a
Development Testing Platform and Continuous Testing Platform.

Perfecto
Exhibitor | www.perfectomobile.com
Perfecto enables exceptional digital experiences. We help you transform your business and strengthen
every digital interaction with a quality-first approach to creating web and native apps, through a cloud-
based test environment called the Continuous Quality Lab. The CQL is comprised of real devices and
real end-user conditions, giving you the truest test environment available. More than 1,500 customers,
including 50% of the Fortune 500 across the banking, insurance, retail, telecommunications and media
industries rely on Perfecto to deliver optimal mobile app functionality and end user experiences, ensuring
their brands reputation, establishing loyal customers, and continually attracting new users.

Project Management Institute (PMI)


Supporter and Exhibitor | www.pmi-chicagoland.org
The Project Management Institute (PMI) establishes project management standards, provides seminars,
educational programs and professional certifications for project management professionals worldwide.
The Chicagoland Chapter of PMI was chartered in 1977 and today has more than 4,200 members. The
vision of the chapter is to be the professional association chapter of choice for project management
knowledge, accreditation, development and practice. It strives to promote project management
knowledge, standards and ethical practice, provide value to members, increase awareness of the
importance of project management among senior management, awareness of the PMI certification
process and improve communications with business and the community.
CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016
R

QAI GLOBAL INSTITUTE


50 2016 SPONSORS, EXHIBITORS AND SUPPORTERS

QAI Global Institute


Sponsor and Exhibitor | www.qaiusa.com
Founded in 1980 in Orlando Florida, QAI is a global workforce development and consulting
organization addressing the education and Operational Excellence needs of information technology
and knowledge-intensive organizations. QAI Global Institute, the workforce development division of
QAI, focuses on creating education and training products and services. The Institute caters to a wide
variety of industries and provides access to a wealth of concepts and skill building reinforced through
consulting, training, assessments, benchmarking, certification, conferences, and eLearning. QAI has
trained over 140,000 individuals and certified over 50,000 professionals.

QualiTest
Exhibitor | www.qualitestgroup.com QualiTest is the worlds second largest pure play software testing
and QA company. Testing and QA is all that we do! QualiTest is pleased to have been recognized as a
Visionary in Gartners Magic Quadrant for Application Testing Services, Worldwide for two consecutive
years. We design and deliver contextualized solutions that leverage deep industry-specific
understanding with technology-specific competencies and unique testing-focused assets. QualiTest
produces results by combining customer-centric business models, critical thinking and the ability to
gain a profound comprehension of customers goals and challenges.

Seapine Software
Exhibitor | www.seapine.com
Seapine Software, Inc. is a privately held technology company whose application lifecycle
management (ALM) solutions help companies manage the process of developing high-quality complex
productsoften in regulated industries. Our award-winning ALM solutions drive the creation of
recognized brands, life-saving medical devices, even games of the year. From a home-based startup
founded in 1995, Seapine has grown into a multinational corporation with headquarters in Cincinnati,
Ohio, and offices in Europe, Asia-Pacific, and Africa with over 8,500 customers worldwide.

SmartBear Software
Exhibitor | www.smartbear.com
As the leader in software quality tools for the connected world, SmartBear supports more than three
million software professionals and over 25,000 organizations in 194 countries that use its products to
build and deliver the worlds greatest applications. With todays applications deploying on mobile, Web,
desktop, Internet of Things (IoT) or even embedded computing platforms, the connected nature of
these applications through public and private APIs presents a unique set of challenges for developers,
testers and operations teams. SmartBears software quality tools assist with code review, functional
and load testing, API readiness as well as performance monitoring of these modern applications.

SPR Consulting
Gold Sponsor and Exhibitor | www.spr.com
A trusted partner to businesses for more than 40 years, SPR Consulting builds, integrates, tests and
manages technologies that drive enterprise revenue and improve operational efficiency. With its expert
onshore testing team, SPR applies automated, manual, and exploratory testing methods to an array of
web, mobile, and enterprise applications to increase technology usability, functionality, compatibility,
accessibility, security, and performance. Testing services range from setting strategic direction and
transforming testing organizations to building reusable test repositories and performing test execution
as a trusted testing partner. SPR improves access to information, company-wide collaboration and
helps organizations more effectively connect with their customers. Sponsoring Lanyards.

tap|QA
Diamond Sponsor and Exhibitor | www.tapqa.com
tap|QA is a consulting services firm 100% focused on quality. Our consultants wide range of
experience includes Strategic Analysis, Business Analysis, Quality Assurance & Testing within a vast
array of industries. We enable organizations to meet the growing demands of their business partners
and customers. Our solutions include: tap|Strategy- Strategic Consulting to Optimize IT Capabilities,
Technology & Organizational Structure; tap|Technology Implementing Continuous Integration,
Delivery and Deployment through Automation; tap|Lakeshore Cost-Competitive with Offshore, but
embedded Locally with your team, or at our site in Minneapolis; and tap|Consulting Leveraging our
Key Experts and Consultants for your IT & Business needs. Sponsoring the Attendee Appreciation
Night, Exhibitor.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


2016 SPONSORS, EXHIBITORS AND SUPPORTERS 51

Utopia Solutions
Gold Sponsor and Exhibitor | www.utopiasolutions.com
Utopia Solutions is a global quality and testing firm known for its innovative quality solutions built from
over a decade of helping hundreds of companies achieve breakthrough performance. Utopia Solutions
offers packaged and custom solutions, including mobile quality, performance testing, test automation,
and test outsourcing. These solutions enable businesses and their IT departments to focus on achieving
business outcomes rather than struggle with quality and performance barriers. Sponsoring Portfolios.

Zeenyx Software
Bronze Sponsor and Exhibitor | www.zeenyx.org Zeenyx Software, Inc. is the creator of AscentialTest,
an enterprise level Test Management System that encompasses test planning, development, data
management and execution for applications running on Windows, the web, java, dotNet, terminals and
PowerBuilder. Our patented snapshot technology is the core of AscentialTest. By interacting with these
graphical representations of the target application, users build test steps by dragging and dropping
objects in a visual test editor without recording or scripting. Re-usable steps can be combined to form a
multitude of tests that are as easy to maintain as they are to create. Sponsoring Wednesday afternoon
break.

Zenergy Technologies
Exhibitor | www.zenergytechnologies.com Zenergy Technologies helps its clients launch and maintain
better software. Utilizing QA, test, and automation techniques that enhance software development,
Zenergy tailors solutions that contribute maximum benefit with minimal disruption. Zenergy is on the
forefront of test automation, both commercial and open-source toolsets, including Selenium, and creates
advanced frameworks that reduce maintenance and increase scalability while ensuring a higher return on
investment. Zenergy performs significant amounts of mobile testing, both manual and automated, and has
a U.S. based facility with test engineers at all levels who augment clients own testing efforts and offshore
capabilities.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016


R

QAI GLOBAL INSTITUTE


Digital disruption and hyper convergence are
changing the business dynamics and enterprises
must leverage next generation digital assurance
to ensure flawless transformation and superior
customer experience

6
Hexawares
point
Are you formula for
digital delight:
assured of
delivering
Digital assurance: Providing end to
end validation of Bi-Modal IT from
digital transformation to digital maturity

Digital Xtreme Automation: Intelligence


powered automation for the complete
life cycle

Delight? Data quality: Make Big Data


meaningful by ensuring quality of data

Security: Manage reputation and


protect privacy

Performance Engineering:
Ensure high performance &
responsiveness across all devices

Omni-channel usability: Ensure


Reach us at superior user experience across all
platforms and channels.
info@hexaware.com
for more details on our
solutions and offerings
www.hexaware.com

You might also like