Next Generation SOA

The Concise Introduction to Modern SOA: High-Value Approaches, Innovative Technologies, Proven Use Cases

After a decade of innovation in technology and practice, SOA is now a mainstream computing discipline, capable of transforming IT enterprises and optimizing business automation. In Next Generation SOA, top-selling SOA author Thomas Erl and a team of experts present a plain-English tour of SOA, service-orientation, and the key service technologies being used to build sophisticated contemporary service-oriented solutions.

The starting point for today’s IT professionals, this concise guide distills the increasingly growing and diverse field of service-oriented architecture and the real-world practice of building powerful service-driven systems. Accessible and jargon-free, this book intentionally avoids technical details to provide easy-to-understand, introductory coverage of the following topics:

• Services, service-orientation, and service-oriented computing: what they are and how they have evolved
• How SOA and service-orientation change businesses and transform IT culture, priorities, and technology decisions
• How services are defined and composed to solve a wide spectrum of business problems
• Deep implications of the service-orientation paradigm--illuminated through an annotation of the classic SOA Manifesto
• Traditional and contemporary service technologies and architectures
• How clouds and virtualization support the scalability and reliability of services-based solutions
• SOA-based industry models, from enterprise service to global trader
• A detailed case study: how real enterprises bring together contemporary SOA practices, models, and technologies

Next Generation SOA will be indispensable to wide audiences of business decision makers and technologists--including architects, developers, managers, executives, strategists, consultants, and researchers.

“A must for those who want to jumpstart their learning of SOA. A great starting point in SOA for any IT architect, designer, or developer.”

--Claude Baillargeon, Senior IT Architect, La Capitale

“What a monumental achievement! This book provides practical insights into next generation SOA for practitioners and newbies. It is a must-have compendium for anyone in the field of SOA.”

--Jean Bernard Mathias, Tolmai

“SOA makes the world go round! Even more so, with the recent explosive growth of cloud computing and the billions of connected devices and apps. Next Generation SOA gives excellent, practical guidance on envisioning, architecting, and designing innovative service-oriented solutions in this new, always-online era.”

--Gijs in ‘t Veld, CTO and Cofounder, Motion10

“This is the perfect book for anyone who wants to refresh or get a handle on the foundations of SOA without delving into the deep technical details and implementation specifics. By working from the principles, the book shows how the SOA concepts and goals have matured, influenced, and grown with technologies such as master data, virtualization, and cloud. The book points to other volumes in the series for the depth of detail and technicalities, allowing you to get the broad picture view without any vendor coloration.”

--Phil Wilkins, Enterprise Integration Architect

“Next Generation SOA elucidates the foundational principles of service-orientation in a concise and insightful manner. The core concepts presented within its pages are indispensable for gaining the insight and understanding to become a competent SOA practitioner. This book will be an invaluable guide as I continue my journey along the service-orientation path.”

--Christian Garcia, Vice President, Conning

“An excellent source for next generation SOA architectural patterns and solution orchestration, reflecting the perceptual mapping and processing of business patterns in alignment with the emerging technological transformation holistically.”

--Ahmed Aamer, Sky Computing Pvt. Ltd.

“Whether you’re a business decision maker or technologist, this book is a great read for those needing to grasp the complexities of SOA and its evolution to today’s emerging architecture landscape with real scenarios demonstrating the application of service-orientation.”

--Neil Walker, Enterprise Architect/SOA Specialist, Mindtree

“A power-packed introduction for newbies and a great reference for SOA practitioners. This book does it all and explains further in a concise manner the relevance of the service-orientation design paradigm for next generation architectures.”

--Abhijit Karode, Head of Architecture (AST), iNautix Technologies India Pvt. Ltd. (a BNY Mellon company)

“This book is a clear, concise, and very concentrated resource for relevant vendor-neutral service principles and technologies, for API and cloud, and definitely beyond. What I like especially is that this is finally a book that incorporates the heritage of the SOA Manifesto to complement the traditional theoretical approach that many books expose, with real-life mechanisms to bring balance (choosing the right priorities) to the decision-making involved with service architecture and service-orientation.”

--Roger Stoffers, Senior Solution Architect, Hewlett Packard

“The SOA landscape is changing so fast. With cloud, mobile, and social media so prevalent today, the conversation about SOA needs to go beyond the basic web service. In Next Generation SOA, Erl and his team explore the new frontier and introduce the technologies we all need to leverage to stay agile in this fast-paced IT world, which is really what SOA is all about!”

--Karen Patton, Manager Solution Architecture, Shaw Communications

“This book gives a clear overview of what makes SOA stand out now and in the future, while at the same time putting focus on those details that matter. This makes it not only a perfect starting point for novice people in our field, but also a great companion to the other books in the Prentice Hall Service Technology Series from Thomas Erl for the more experienced SOA professionals.

“Finally, its relatively small size and price make it an ideal give-away present to those who may not be directly involved in SOA projects but still are or should be interested in the subject at hand.”

-- Marco Frankel, Service-Oriented Architect, The Future Group

“Get an overview of how the SOA landscape has changed recently due to the advent of virtualization, cloud computing, big data, and mobile computing. Without getting into the intricacies of implementation, it provides a quick walk-through of concepts required for executives and IT professionals for their next SOA initiative.”

--Sanjay Singh, Certified SOA Architect, VP Engineering, ATMECS

“Next Generation SOA offers a fresh perspective on core SOA design and technology topics and affirms their relevance for modern industry operating models. It is a must-read for any enterprise looking to maximize existing or future investments in SOA technology.”

--Nicholas Bowman, Independent SOA Architect

“As I started reading Next Generation SOA, I went through a personal confusion in the contradiction I felt between ‘Next Generation’ and the fact that the book is a ‘Concise Introduction to Service Technology & Service-Orientation’. I found that contradictory until it clicked: The next generation SOA is an SOA that has freed itself from its initial dependence on vendor platforms. From then on, it all made sense. As an SOA Certified Professional I have found repeatedly, in the multiple workshops I have led, that there is a loud cry for an SOA workshop for IT top management. Analysts and architects all complain about the same thing: Top management just does not understand SOA and thinks it is just a new coat of paint on an old building.

“Well, this book fills this gap to a high extent: It is short and concise enough to be read by decision makers but gives enough basic concepts on many aspects of SOA to actually understand why things in the IT department--and in the business--just will not be the same.

“The case study at the end of the book--mainly oriented at legacy issues but useful even for eGov--is superb and will give enough material for study and discussions to a generation of SOA analysts, architects, and governance specialists. It even covers SOA governance nicely.

“Just the book you needed for your boss’s birthday.”

--Yves Chaix, Independent SOA Certified Consultant, Analyst, Architect, and Governance Specialist

“Nowadays, various web-based service technologies have expanded and emerged, offering options to industry practitioners to choose the best-fitting technology for their organization. This book helps you to understand and find out in a comprehensive way the variety of emerged service technologies, along with their importance, key elements, and how service-orientation became the fundamental pillar. This remarkable book, Thomas Erl’s Next Generation SOA: A Concise Introduction to Service Technology & Service-Orientation, is an accurate and complete reference of knowledge for those who are passionate to explore and exploit the latest emerged service technology.”

--Masykur Marhendra Sukmanegara, Advanced Technology Architect

“I recommend this book both for SOA professionals who want to keep abreast of market trends and for professionals who wish to have their first contact with this universe. It is a very enriching and enjoyable reading.”

--Claudia Charro, SOA/BPM Professional

“Very good job on publishing/divulging these innovative concepts. As with Thomas Erl’s previous SOA books, this one will help people gain a better understanding of the need for service-orientation (not only in IT, but in every aspect of work life).”

--Diego V. Martínez, IT Architect, Zurich Financial Services Argentina

• Services, service-orientation, and service-oriented computing: what they are and how they have evolved
• How SOA and service-orientation change businesses and transform IT culture, priorities, and technology decisions
• How services are defined and composed to solve a wide spectrum of business problems
• Deep implications of the service-orientation paradigm--illuminated through an annotation of the classic SOA Manifesto
• Traditional and contemporary service technologies and architectures
• How clouds and virtualization support the scalability and reliability of services-based solutions
• SOA-based industry models, from enterprise service to global trader
• A detailed case study: how real enterprises bring together contemporary SOA practices, models, and technologies

SOA is now a mainstream computing discipline, with accelerating adoption among organizations of all types and sizes. Increased ROI, enhanced organizational agility, and reduced IT burdens are all driving justifications for the significant investments needed to undertake these initiatives. Yet, despite the growing number of SOA implementations, field-proven best practices and use cases are only now emerging. In Next Generation SOA , Thomas Erl helps you use them to maximize the business value of your SOA investments.

Erl, a top-selling IT author and SOA expert, has written the ideal SOA introduction for today's IT professionals. This practical, use-case-driven guide distills the real-world practice of building successful service-oriented software systems. Accessible and jargon-free, it answers crucial questions IT professionals ask about SOA today -- and the questions they need to ask about crucial issues such as integration, security, and governance. Coverage includes:

• What exactly is loose coupling, and why does it matter?
• What is an ESB, and why do I need one?
• What are the worst SOA design errors, why do people keep making them, and how can I avoid them?
• How do I implement SOA to address projects of all sizes?
• How do I categorize services and define their requirements?
• What crucial lessons have been learned about securing services in SOA environments?

Clive Gee has over 30 years’ experience in the IT industry and has worked for IBM in both the UK and the United States, spending the majority of his career as a solution architect dedicated to the early customer implementations of emerging technologies such as object-orientation, mobile computing, and SOA. Clive has taken on the role of consulting architect on many customer engagements in the aerospace, manufacturing, and public sectors, as well as projects in the retail, transportation, telecommunications, insurance, and financial industries. He has a strong business focus and a track record of developing innovative and yet practical solutions to fulfill real business needs.

Over the last few years, Clive has turned his attention to SOA governance, a field in which he is considered to be a leading worldwide practitioner. He has led efforts with several major organizations in the United States, Japan, and Australia that were successful at establishing SOA Centers of Excellence and implementing effective governance in areas of service-orientation.

Clive is currently residing in Scotland’s Northern Isles as a semi-retiree who still agrees to take part in the occasional project. He is a co-author of the book titled SOA Governance: Achieving and Sustaining Business Agility (IBM Press 2008), as well as another book from the Prentice Hall Service Technology Series from Thomas Erl titled SOA Governance: Governing Shared Services On-Premise and in the Cloud.

An expert in middleware, Jurgen Kress currently works at Oracle EMEA Alliances and Channels and is responsible for Oracle’s EMEA fusion middleware partner business. He is the founder of the Oracle SOA & BPM, WebLogic Partner Communities, and the global Oracle Partner Advisory Councils. The Fusion Middleware Partner Community is home to over 5,000 members internationally as Oracle’s most active and successful community, which Jurgen manages with monthly newsletters, Webcasts, and conferences. He also hosts the annual Fusion Middleware Partner Community Forums and Fusion Middleware Summer Camps, where more than 200 partners receive product updates, roadmap insights, and hands-on training supplemented by a variety of Web 2.0 tools like Twitter, discussion forums, online communities, blogs, and wikis. Jurgen is also a member of the steering board of the International SOA, Cloud + Service Technology Symposium, and is a frequent speaker at conferences that include the SOA & BPM Integration Days, JAX, UKOUG, OUGN, and OOP.

Berthold Maier enjoys working for a wide portfolio of clients as a chief architect and enterprise architect, and possesses over 18 years of experience as a developer, coach, and architect in the building of complex mission-critical applications and in integration scenarios. Throughout his 11-year career at Oracle, Berthold has been given leading positions within the consulting division that notably included chief architect, a management position in which he assumed responsibility for reference architectures involving SOA and enterprise integration. Berthold is also the originator and architect of several frameworks around EAM and SOA, and is well-known as a conference speaker, book author, and magazine writer.

Hajo Normann works for Accenture in the role of SOA & BPM Community of Practice lead in ASG and is responsible for the architecture and solution design of SOA/BPM projects, primarily acting as the interface between business and IT. He enjoys tackling organizational and technical challenges and motivating solutions in customer workshops, conferences, and publications. Together with Torsten Winterberg, Hajo leads the DOAG SIG Middleware and is an Oracle ACE director and active member of a global network within Accenture who is in regular contact with SOA/BPM  architects from around the world.

Pethuru Raj possesses over 12 years of professional experience in the IT industry. In his academic career, he was granted international fellowships, JSPS and JST, to work as a postdoctoral researcher at two leading Japanese universities for three years. After earning a UGC-sponsored PhD degree from Anna University in Chennai, India, Pethuru obtained a CSIR fellowship to work as a research associate in the department of Computer Science and Automation at the Indian Institute of Science in Bangalore. Pethuru has worked as an application architect for eight years and a product architect for four years, leveraging the opportunities that came his way to become specialized in the business domains of telecommunications, retail, government, energy, and healthcare.

Prior to his career at Wipro Consulting, Pethuru spent one year as the enterprise architect at Sify Software Ltd. and over a year and a half as a lead architect in Bosch’s corporate research division. During his three years as a senior architect for the Oracle Fusion Middleware Practice of Wipro Technologies, Pethuru become well-versed in emerging technologies like cloud computing, SOA, event-driven architecture, and enterprise architecture. He has also developed a keen understanding of Big Data computing (Hadoop), realtime cloud analytics, and machine-to-machine (M2M) integration, as well as high-performance system design and various smartphone applications. Pethuru has authored chapters for a number of technology-centric books in collaboration with internationally acclaimed professors, and is author of a book titled Cloud Enterprise Architecture that is published by CRC Press.

Leo Shuster has directed efforts in enterprise architecture and SOA strategy and execution for a number of organizations, including the National City Corporation, Ohio Savings Bank, and Progressive Insurance. He currently holds the position of director, IT Architecture at Nationwide Insurance, and possesses almost 20 years of IT experience. Throughout his career, Leo has performed in a variety of roles that span all aspects of the software development lifecycle and IT management. As a result, Leo has gained expertise in enterprise and application architecture, SOA, and IT governance and transformation, as well as platform modernization, process management and reengineering, and strategic planning, among many other areas. He frequently shares this knowledge with the IT community through articles and blog posts. Leo holds an MS in computer science and engineering from the Case Western Reserve University, and an MBA from the Cleveland State University.

Leo has presented on enterprise architecture, SOA, BPM, and related topics for groups of all sizes at various industry events and conferences. He is a co-author of the book titled SOA Governance: Governing Shared Services On-Premise and in the Cloud, which is a part of the Prentice Hall Service Technology Series from Thomas Erl. Leo regularly discusses advanced software architecture topics on his blog, which can be viewed at http://leoshuster.blogspot.com.

Since the launch of his career in the mid-90s, Bernd Trops has worked as a system engineer, SOA architect, and coach on countless OO and SOA projects for a range of companies that include GemStone, Brokat, WebGain, and Oracle. During his time at Oracle, Bernd held the position of SOA architect and was primarily involved in large-scale initiatives. One notable project under his belt is the Deutsche Post Service-Backbone, which comprises the foundation of the Talend ESB. In his current role of principal solution architect at Talend, Bernd is closely involved in technical architecture and the design of complex IT solutions.

Bernd has presented at a number of industry conferences during his career, such as the SOA Symposium, Oracle Open World, JAX, and OOP. Bernd is co-author of SOA Design Patterns and SOA Speizial, as well as cofounder of the Mason of SOA.

Clemens Utschig-Utschig is currently heading Marketing & Sales Architecture at Boehringer Ingelheim, one of the world’s leading pharmaceutical companies, at its corporate headquarters in Germany, focusing on implementing the digital revolution and consolidating the global landscape onto standard platforms. Before joining Marketing and Sales he ran the global master data management program inside BI’s Shared Service Center--devel- oping the global process templates for customer, vendor and material maintainance, deploying those into BI’s network and providing global transactional services from Brazil to China. Prior to joining Boehringer Ingelheim, Clemens fostered a ten-year career at Oracle as a platform architect on the SOA/BPM development team, helping clients establish enterprise-wide SOA. He also drove the development of several platform components, such as the Weblogic SCA container and the Spring Service Engine.

Philip Wik is currently a DBA for Redflex Traffic Systems. With more than 30 years of experience, Philip has worked as an architect, analyst, integrator, and developer for prominent leading companies such as JPMorgan Chase, Wells Fargo, and American Express, as well as Honeywell, Boeing, and Intel.

Having received training and education on three different continents, Philip has a robust multinational orientation and has led a number of offshore teams. He has also published two business books titled How to Do Business With the People’s Republic of China and How to Buy and Manage Income Property, and is a frequent article contributor to the online Service Technology Magazine.

Active in several roles at OPITZ CONSULTING with strong dedication to delivering value to customers, Torsten Winterberg is part of the business development and innovation department. In this role, he focuses on identifying and evaluating emerging trends and technologies with the aim of delivering innovative and differentiated solutions to customers. Also a director of the competence center for integration and business process solutions, Torsten is following his passion for building the best delivery unit for customer solutions in the areas of SOA and BPM.

Torsten has extensive experience as a developer, coach, and architect in building complex mission-critical Java EE applications, although his proficiency and passion actually lie in the design and architecture of complex IT systems involving BPMN, BPEL, ESB, BAM, and SOA in general. A recognized speaker in the German Java and Oracle communities, Torsten has written numerous articles on SOA/BPM-related topics and is part of the Oracle ACE director team, leading the DOAG middleware community.

About This Book     2

Who This Book Is For     2

What This Book Does Not Cover     3

How This Book Is Organized     3

Additional Information     4

Updates, Errata, and Resources (www.servicetechbooks.com)      4

Service Technology Specifications (www.servicetechspecs.com)      4

The Service Technology Magazine (www.servicetechmag.com)      5

Service-Orientation (www.serviceorientation.com)      5

What Is REST? (www.whatisrest.com)      5

What Is Cloud? (www.whatiscloud.com)      5

SOA and Cloud Computing Design Patterns (www.soapatterns.org, www.cloudpatterns.org)      5

SOA Certified Professional (SOACP) (www.soaschool.com)      5

Cloud Certified Professional (CCP) (www.cloudschool.com)      5

Big Data Science Certified Professional (BDSCP) (www.bigdatascienceschool.com)      6

Notification Service     6

Chapter 2: An Overview of SOA & Service-Orientation     7

Services and Service-Orientation     8

Service-Orientation, Yesterday and Today     9

Applying Service-Orientation     12

The Eight Principles of Service-Orientation     12

The Four Characteristics of SOA     13

The Four Common Types of SOA     15

SOA Design Patterns     17

The Seven Goals of Applying Service-Orientation     18

Planning For and Governing SOA     20

The Four Pillars of Service-Orientation     20

The Seven Levels of Organizational Maturity     22

SOA Governance Controls     23

Chapter 3: A Look at How Services are Defined and Composed     25

Basic Concepts     27

Agnostic and Non-Agnostic Logic     27

Service Models and Service Layers     27

Service and Service Capability Candidates     28

Breaking Down the Business Problem     28

Functional Decomposition     28

Service Encapsulation     30

Agnostic Context     30

Agnostic Capability     32

Utility Abstraction     32

Entity Abstraction     33

Non-Agnostic Context     34

Process Abstraction and Task Services     35

Building Up the Service-Oriented Solution     36

Service-Orientation and Service Composition     36

Capability Composition and Capability Recomposition     39

Capability Composition     39

Capability Recomposition     40

Domain Service Inventories     44

Chapter 4: An Exploration of Service-Orientation with the SOA Manifesto     47

The SOA Manifesto     48

The SOA Manifesto Explored     49

Preamble     50

Priorities     51

Guiding Principles     55

Chapter 5: An Overview of Service Technology     63

Web-Based Services     64

SOAP-Based Web Services     65

REST Services     65

Components     66

Service Virtualization     66

Cloud Computing     67

API Management     68

Model-Driven Software Design     68

Semantic Web     69

Business Process Management     70

Composition and Orchestration     70

Master Data Management     71

Business Rule Engines     72

Social Network Technologies     72

Mobile Computing     72

Agent-Driven Architecture     73

Event-Driven Architecture and Complex Event Processing     74

Business Intelligence     75

Enterprise Information Integration and Extract-Transform-Load     76

Big Data     77

Chapter 6: A Look at Service-Driven Industry Models     79

The Enterprise Service Model     80

The Virtual Enterprise Model     81

The Capacity Trader Model     82

The Enhanced Wholesaler Model     83

The Price Comparator Model     83

The Content Provider Model     84

The Job Market Model     84

The Global Trader Model     86

Industry Watchdogs     86

Guarantors     87

Chapter 7: A Case Study     89

Systems Landscape     92

New Marketing Strategy     93

Corporate Culture     95

Vehicle Maintenance     97

The Billing System     97

Strategic Considerations     98

Cloud Adoption     99

New Reference Architecture     102

The Customer Profile Process     102

New Service Technology     105

The SOA Governance Program Office     107

The Enterprise Architecture Board     108

A Transformed Enterprise     110

APPENDICES

Appendix A: Additional Reading for Applying Service-Orientation     117

The Eight Service-Orientation Principles     118

Standardized Service Contract      119

Service Loose Coupling     121

Service Abstraction     122

Service Reusability     123

Service Autonomy     125

Service Statelessness     126

Service Discoverability     128

Service Composability     130

The Four Characteristics of SOA     132

Business-Driven     132

Vendor-Neutral     134

Enterprise-Centric     137

Composition-Centric     138

SOA Design Patterns     140

Appendix B: Additional Reading for Planning & Governing Service-Orientation     151

The Four Pillars of Service-Orientation     152

Teamwork     153

Education     153

Discipline     153

Balanced Scope     154

The Seven Levels of Organizational Maturity     156

Service Neutral Level     157

Service Aware Level     157

Service Capable Level     158

Business Aligned Level     158

Business Driven Level     159

Service Ineffectual Level     159

Service Aggressive Level     159

SOA Governance Controls     160

Precepts     160

Processes     161

People (Roles)      162

Metrics     162

Appendix C: Additional Reading for Cloud Computing     163

Goals and Benefits     164

Reduced Investments and Proportional Costs     164

Increased Scalability     166

Increased Availability and Reliability     167

Risks and Challenges     168

Increased Security Vulnerabilities     168

Reduced Operational Governance Control     168

Limited Portability Between Cloud Providers     170

Multi-Regional Compliance and Legal Issues     171

About the Authors     173

Index     179