Professional Documents
Culture Documents
Empower business users Reduce development and support costs by as much as 60% Streamline processing
Page 1 of 24 Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
1 2 3
PREFACE ..............................................................................................................................................3 EXECUTIVE SUMMARY ...................................................................................................................4 THE FUNDAMENTAL REQUIREMENTS OF GOOD INTERFACING......................................6 3.1 3.2 3.3 3.4 3.5 DATA INTEGRITY ..............................................................................................................................6 TRACEABILITY, ORGANIZATION AND SECURITY ...............................................................................7 PROACTIVE MONITORING, AUTOMATIC NOTIFICATION AND STATISTICS ...........................................7 CHECKPOINT RESTART .....................................................................................................................8 DEPENDENCY CONTROLS AND SCHEDULING .....................................................................................8 NO STANDARD FRAMEWORK FOR INTERFACING ...............................................................................9 LACK OF DEPENDENCY CONTROLS ...................................................................................................9 LACK OF TRACEABILITY AND LOGGING MECHANISMS ....................................................................10 NO SINGLE POINT TO MONITOR AND MANAGE ALL PROCESSING .....................................................10 LACK OF COMMON PROVEN UTILITIES ............................................................................................11 NO HIGH VOLUME PERFORMANCE MANAGEMENT ...........................................................................12 NO SIMPLE CONDITIONAL PROCESSING LOGIC ................................................................................12 NO CHECKPOINT RESTART CAPABILITY ..........................................................................................12 INADEQUATE SCHEDULING CAPABILITY .........................................................................................13 NO ABILITY TO PERFORM LOW LEVEL MONITORING OF OUTPUT OR LOGS .......................................13 NO BUILT-IN DOCUMENTATION AND ANNOTATION FACILITIES .......................................................13
WHAT R/3 DOES NOT PROVIDE.....................................................................................................9 4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 4.9 4.10 4.11
5 6
THE HIDDEN COSTS OF POOR INTERFACES ..........................................................................14 HOW ECS PROVIDES COMPLETE INTERFACE MANAGEMENT........................................15 6.1 NOTIFICATION ................................................................................................................................15 6.2 MONITORING ..................................................................................................................................16 6.2.1 Monitoring the overall status of interfaces............................................................................16 6.2.2 Monitoring individual runs....................................................................................................17 6.3 THE ECS ONLINE WORKBENCH ......................................................................................................18 6.4 STATISTICS .....................................................................................................................................19 6.5 DEPENDENCY AND SCHEDULING CONTROLS ...................................................................................20 6.6 RESTART RECOVERY ......................................................................................................................21 6.7 ANNOTATION/DOCUMENTATION ....................................................................................................22 6.8 AUTOMATION .................................................................................................................................23
APPENDIX ..........................................................................................................................................24 7.1 7.2 CONTACTING TEXAS BARCODE ......................................................................................................24 SAP R/3 WHITE PAPERS ..................................................................................................................24
Page 2 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
1 Preface
The interfacing techniques mentioned in this paper are not unique to SAP R/3. Like many things in computing, the fundamentals have not changed since the days of mainframe processing. In fact the whole concept of the Event Control System (ECS) software was to compliment the SAP R/3 system by addressing much-needed gaps in interface management. Many managers are surprised that R/3 does not provide better facilities for managing interfaces. The fact is, whilst R/3 provides an excellent integrated business solution and many mechanisms for interfacing with external systems, it does not provide a consistent integrated technical framework for managing interfaces end-to-end. Subsequently, programmers expend large amounts of effort to address all those what if scenarios. Even worse, some are not even aware, or dont bother to build in the essential controls to guarantee data integrity, traceability, notification, restart/recovery etc. It seems that with every new technology, the same lessons are learnt over and over again. It is only those few, which have been already been through the mill, that pro-actively look to build the necessary safeguards and monitoring into the design. Five years ago when Sky first started integrating external systems and devices with SAP R/3, it became very obvious that there was no central monitoring system and no mechanism to logically link all the technical steps of an interface together. ECS was borne. Since then, the system has grown over the years to become a powerful effective interface management framework that has proven its worth time and time again! This white paper explores the necessity for an interface management framework and the hidden costs associated with poor interfacing techniques in R/3. This paper is the expressed opinion of Sky Technologies Pty Ltd of Australia and is intended to inform SAP R/3 customers of best practise interface management techniques with SAP R/3.
Page 3 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
2 Executive summary
Whilst SAP R/3 provides an excellent integrated business solution and many good mechanisms for interfacing with external systems and data, it does not provide a robust, consistent integrated technical framework for managing interfaces in the R/3 environment. IT and business users need be pro-actively notified of any problems, and have the ability to monitor all interface executions from a single point, and reprocess failures in a controlled fashion. The emphasis here is on interface management in SAP and not external middleware or EAI solutions. Standard SAP R/3 does not provide: A standard sub-system to define interfaces and their characteristics A single point from which to proactively monitor and manage all interfaces Effective dependency controls to dictate the order of processing Adequate data tracking and logging mechanisms A high volume performance management system An automatic notification and escalation facility Standard utility objects e.g. external file management and polling Advanced multi-level scheduling capability Online documentation and annotation facilities Checkpoint restart of failed interface runs.
There are hidden costs associated with poor interfacing: High maintenance and support cost. Predominantly Business and IT manpower Loss of credibility with external Suppliers/Customers Financial cost due to data loss, corruption, duplication etc. High development and upgrade cost due to inconsistency and having to provide the supporting architecture as well as the business solution.
Middleware is just another interface to be managed! The above holds true with the majority of, if not all, middleware solutions. Middleware, whilst offering good translation and brokering services, is essentially an interface to R/3 itself. Most wash their hands of transactions once they have been successfully submitted to R/3, thus customers are usually left struggling with the inadequate interface management facilities and the general unknowingness of what is happening in R/3.
Page 4 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
ECS is proven technology that provides a solution Sky Technologies has developed the Event Control System (ECS) to specifically address the lack of interface management capability in R/3. Toyota, Nissan, Visy Industries, Southcorp are just a few of the companies that totally rely on ECS to successfully manage their SAP interfacing and business scheduling. ECS has been in use in a production sense for over four years and is industry strength, handling thousands of transactions every day. The product is not only used in Australia, but in the US, UK, Malaysia and Indonesia. ECS actually runs in SAP R/3 and has the same look and feel as a SAP application, thus there is no need to incorporate another set of skills and the administration overhead that an external system incurs. The cost benefit Usually its hard to convince new SAP R/3 customers that they need to effectively manage interfacing. It is often seen as a lesser task in the scheme of things. But post go live, the same customers almost always regret not doing it better, and usually lack the budget, skills or inclination to fix it. Much time and materials is lost without the benefit of hindsight. However, it is a relatively simple exercise to measure the cost of finding and fixing and offset this against the cost of implementing a good management framework i.e. the return on investment (ROI). Sky has benchmarked this cost and has found on average that by implementing ECS, Customers have saved over 60% in measurable support and development costs, as well as intangible benefits such as regained credibility with external Suppliers and Customers. ECS is a low cost solution, starting at $10K USD. In most cases this outlay has been recouped within six months of implementation. ECS is designed specifically for R/3 and runs in the R/3 environment, thus existing SAP skills may be utilised to convert existing interfaces and develop new ones, without having to employ specialist consultants. Keeping it simple There is nothing wrong with using the right tool for the job and the same principle applies to interfacing. In SAP R/3 there are many different mechanisms available and all have their pros and cons. There is nothing wrong with using basic fixed record file transfer instead of XML, or a BDC instead of an IDOC, if there are justifiable reasons for doing so. Often, the IT architects vision of a centralised all things to all interfaces transaction broker becomes over complex, costly to implement and requires a high degree of specialist skill to maintain and operate. If the Customer is SAP centric, then direct interfacing to external systems should be used wherever possible without any middleware. The more layers, the more points of failure, and the more management required!
Page 5 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Page 6 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Page 7 of 24
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Page 8 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Page 9 of 24
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
In this simple example, there are five distinct technical steps that constitute a single interface run. R/3 provides no standard mechanism to logically group all the steps together and no central point to monitor it as such. Developers often resort to crude progress/status tables, which are updated along the way.
Page 10 of 24 Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
However, these are low level and the developer must implement the correct error processing and call options to ensure they are robust and upgradeable. R/3 does not provide standard proven common routines and utilities that may be reused time and time again i.e. the developer just plugs in the utility function, knowing it works. Many common functions should be provided by the interface framework and made configurable i.e. no code required. This saves considerable development, testing and support time, because the utilities are standard and are known to work with correct error handling. For example: In the typical interfacing scenario: 1. 2. 3. 4. 5. The SAP system receives a file The file is detected in the inbound directory and moved to a processing directory A job is triggered in SAP to execute a ABAP program to generate a BDC session The file is moved to the archive directory The BDC session is submitted for execution
The interface framework should handle all the steps (1,2,3,4,5) automatically. The developer need only provide the ABAP program to execute. In addition, the standard framework provides all the sequencing, documentation and logging mechanisms that would otherwise have to be developed.
Page 11 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Once you have these figures, you can then calculate the savings, if: Support staff are: o Notified immediately a failure occurred o Know exactly where the interface failed and why o Have the ability to automatically reprocess from the point of failure Business users are empowered to monitor (possibly manage) their own interfaces o Less reliance on IT o Less delay Recurring technical problems were eliminated through the use of a robust interface framework
For example: A company implemented an EDI interface with a financial institution to approve and process hire purchase agreements. The interface failed from time to time and went undetected, until customers complained. The business then contacted the IT department, which then started manually tracing the transactions through the EDI interface. For each failure, an entire man-day of effort was expended by the business and IT to find and correctly resolve the customers problem. The problem was occurring at least twice a week. The impact of this interface was 96 support days a year, lost credibility with customers and high administration fees with the financial institution.
Page 14 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
6.1 Notification
ECS automatically notifies support staff of any failures. This can be implemented in a variety of ways: Exception reporting Email (SMS) External notification system or paging service (e.g. HP-Open view, CAUnicenter)
This monitoring system promotes pro-active support, thus minimizing business downtime. ECS also provides an automatic escalation system that notifies the secondary contact, should the primary contact not respond in a given time frame.
Page 15 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
6.2 Monitoring
A real-time monitoring system is available, in SAP R/3, which provides information on all interfaces. Support staff can view the status of all, or specific interfaces, and can easily drill down on problem areas. The following are just a few samples of the many transactions available. 6.2.1 Monitoring the overall status of interfaces The following example screen shot shows an interface summary in R/3. The user can drill down on any specific interface by double clicking or selecting a hotspot on a specific line or field. In ECS terminology, an interface is known as a Process and each step is known as a Phase. SAP security may be implemented, so that users or specific roles can only view certain interfaces or groups of interfaces.
Page 16 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
6.2.2 Monitoring individual runs The following screen shot is a breakdown of a specific interface run, showing the individual technical steps. Failed runs may be reprocessed or force completed from this point. Each high level entry is a unique run of the interface, the next level down displays the steps that have been executed and/or re-processed.
From this central point, users can view all the details associated with an interface run, e.g.
The steps (Phases) executed to date The job logs, BDC sessions, IDOCs, files etc. The dependencies i.e. locks, sequencing, scheduling etc. Documentation and annotation logs
Users can also restart, cancel or force complete runs. SAP security can be implemented for any of these options against specific users or roles.
Page 17 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Using the workbench, developers can: Configure the Interface definition Test the interface definition Transport the interface definition across SAP systems Document the interface definition Configure the dependency and housekeeping rules Configure automatic notification rules Configure conditional processing
Page 18 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
6.4 Statistics
ECS keeps run time statistics on all interface runs i.e. started runs, clean runs, failures etc. The statistics manager may be used to list these statistics using multiple views, or they may be downloaded to the PC for analysis.
Using these statistics, effective trend analysis can be performed to quickly identify hot spots, bottlenecks in processing or the effectiveness of changes. KPI (key performance indicators) can also be checked to see how quickly failures were resolved.
Page 19 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Scheduling
It is important to note that ECS can also be used for other processing in the SAP system as well as interfacing e.g. month end scheduling.
Page 20 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
The run detail screen highlights failed runs and the Phase (step) that the error occurred on. Support staff may then investigate or simply execute the reprocess button. Runs may also be undone back to a specific point. In the above example, ECS has detected that BDC processing has failed. Support staff may view the BDC log, instruct ECS to execute the BDC again or re-process the BDC online.
Page 21 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
6.7 Annotation/documentation
ECS provides the facility to document Interfaces and their steps online in a number of ways. In this way, the documentation is kept up to date and is readily accessible to all support staff. In addition, any run or specific step of a run may be annotated to keep track of events and actions taken. The following options are available: Online documentation using a PC editor of choice e.g. Microsoft Word Online documentation using simple text notes Annotation of runs either manually or programmatically
ECS automatically annotates Interface runs where it can, for example: Failures (automatic extract and diagnosis of logs, short dumps etc.) File, BDC, IDOC, ABAP processing
Page 22 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
6.8 Automation
ECS provides many facilities to completely automate interface processing. For example: Poll directory definitions may be configured to automatically scan a nominated directory for a specified file name (or wild card) and automatically start an Interface when the file has been successfully received (i.e. finished growing).
Files may be automatically copied, moved, renamed or deleted as part of the Interface definition, by simply configuring options in the workbench. This saves considerable development and testing time.
Page 23 of 24
Version 1.1
Texas Barcode Systems 6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
7 Appendix
7.1 Contacting Sky
6504 International Pkwy. Suite 1500 Plano, TX 75093 www.texasbarcode.com (p) 972.267.7900 (f) 972.267.7901 Toll Free: 888.812.7226
Page 24 of 24
Version 1.1