Cover image for Software pipelines and SOA : releasing the power of multi-core processing
Title:
Software pipelines and SOA : releasing the power of multi-core processing
Personal Author:
Series:
Addison-Wesley information technology series
Publication Information:
Upper Saddle River, NJ : Addison-Wesley, 2009
Physical Description:
xxxii, 382 p. : ill. ; 24 cm.
ISBN:
9780137137978

Available:*

Library
Item Barcode
Call Number
Material Type
Item Category 1
Status
Searching...
30000010202639 QA76.58 I82 2009 Open Access Book Book
Searching...

On Order

Summary

Summary

Build Breakthrough Performance into Any SOA or Advanced Computing Application

To meet unprecedented demand, IT organizations must improve application performance by an order of magnitude. Improving performance is even more crucial in SOA environments, which demand far more computing power than older architectures. Today's multi-core servers can deliver the performance businesses require, but few applications take full advantage of them. Now, software innovator Cory Isaacson introduces an easier, more flexible approach to parallel processing-one that any IT organization can use to attain unprecedented levels of performance. Isaacson shows how Software Pipeline models can help you scale applications to any level required, maximize resources, deliver on challenging objectives, and achieve unprecedented ROI. He illuminates these techniques with real-life business scenarios and proven design patterns-everything architects, analysts, and developers need to start using them immediately.

This book's in-depth coverage includes

    How Software Pipelines work, what they can accomplish, and how you can apply them using the Software Pipelines Optimization Cycle (SPOC)     Scaling applications via parallel processing while guaranteeing order of processing in mission-critical applications     Solving performance problems in existing applications, and resolving bottlenecks in existing processes     A complete, easy-to-adapt Pipelines Reference Framework     Detailed code examples reflecting proven Pipelines Patterns     Techniques that can be applied in any industry, with any programming language     Specific architectural and design solutions for common business and technical challenges     The future of Software Pipelines: emerging opportunities for "greenfield" development     Tools, sample templates, and source code at www.informit.com/title/0137137974 , Download


Author Notes

Cory Isaacson is CEO of Prelude Innovations, Inc., a fi rm specializing in the incubation and introduction of leading software technology products. Actively involved in leading information technologies for over 20 years, Cory served as technical editor and columnist for WebSphere Advisor Magazine, has spoken at hundreds of public events and seminars, and authored numerous articles on architecture and practicalities of employing technology. Cory has provided guidance to hundreds of top architects and professional developers in the fi nancial services, entertainment, telco, and software industries on the development and implementation of powerful business applications.

Most recently Cory was president of Rogue Wave Software, managing the organization for over three years, building new product strategies, and culminating in a successful acquisition in mid-2007 by a leading private equity fi rm. Cory has focused on effi ciently addressing development and deployment challenges of emerging technologies such as SOA, virtualization, and commoditization of resources to support real-world business applications. Cory's expertise with highperformance transactional applications has helped leading IT organizations respond to the challenges of dramatic growth in business and data volumes, while still managing cost pressures. Most recently, Cory has been an active evangelist on the need for using concurrent processing and scalable database techniques in order to improve application performance on multi-core architectures.

Cory received his B.A. degree from the University of California at Santa Barbara.


Excerpts

Excerpts

We're now in the multicore era. As consumers of computing power, we've all come to expect a never-ending increase in power, and CPU manufacturers are now using multicore processors to continue that long-standing trend. If we want to take full advantage of this enormous capacity, our business applications must "do more than one thing at a time." However, traditional parallel computing methods (such as multithreading, SMP, and clustering) are either limiting or extremely difficult to implement, especially when used on top of application components that weren't originally designed for a parallel world. Software Pipelines architecture is a new architecture that specifically addresses the problem of using parallel processing in the multicore era. It is a new approach to the problem. Pipeline technology abstracts the complexities of parallel computing and makes it possible to use the power of the new CPUs for business applications. We wrote this book primarily for software architects, application developers, and application development managers who need high-performance, scalable business applications. Project managers, software quality assurance specialists, and IT operations managers will also find it useful; however, the main focus is software development. Our intention was to make the book as applicable as possible, and to provide tools that you can quickly learn and apply to your own development challenges. The book is divided into four sections, which we'll describe in this preface. Pipelines Theory The Pipelines Theory section, Chapters 1 through 5, covers the following topics: How pipelines work, including the fundamental concepts and underlying theory of Software Pipelines What pipelines can accomplish Methods for applying Software Pipelines Pipelines Patterns, including various ways to apply Software Pipelines in business application scenarios, setting the stage for the examples in later chapters As the foundation for the remainder of the book, this section is appropriate for all readers. If you're a software architect or an application developer, you should definitely study this section first. If you're reading the book from a managerial perspective, or if your interest is more general and less technical, you can focus on just this section. Pipelines Methodology The Pipelines Methodology section, Chapters 6 through 13, shows how to implement Software Pipelines by using the step-by-step Software Pipelines Optimization Cycle (SPOC). To illustrate how the methodology works, we use it to solve a business problem for a fictitious example company, the Pipelines Bank Corporation (PBCOR). In each chapter we present a new step, then show you how we used the step in our PBCOR example. This section will be of interest to all primary audiences of the book, including project managers. The PBCOR examples get into a fair amount of technical detail; therefore, application development managers might want to skip over the more complex examples. Pipelines Examples The Pipelines Examples section, Chapters 14 through 22, contains code examples based on the reference Pipelines Framework we developed for the book. We've included examples for each main Pipelines Pattern from the Pipelines Theory section. You can use these as guides for applying Software Pipelines directly to your own real-world applications. This section is for software architects and application developers, the roles directly involved in pipelines implementation. In addition, IT operations managers will find it helpful to read the configuration sections, which show how to modify the scalability of an application without modifying the actual application components. We recommend that you read the first three chapters of this section in detail. These basic chapters include Chapter 14, "Hello Software Pipelines"; Chapter 15, "Scaling Hello Software Pipelines"; and Chapter 16, "Additional Pipelines Router Configurations." After that, you might prefer to scan the more advanced examples in Chapters 17 through 22, then concentrate on the ones that most apply to your specific application scenarios. The Future of Software Pipelines In the final section we tell you about the future we envision for Software Pipelines architecture. There are plenty of greenfield areas that can be developed, and it is our hope that this section will inspire readers to help move the technology forward into the mainstream. Conventions In our examples, when we present a section of code or XML, refer to a command, or refer to a code element, we'll use a monospaced font, for example,. For names of components, such as services, clients, and distributors, we'll use an italic monospaced font, for example, Distributor1 . The Web Site We've established a Web site for Software Pipelines technology at softwarepipelines.org . The site is for readers of the book and for anyone else who is interested in using or advancing the Software Pipelines architecture. You can download the following items from the site: Tools and sample report templates for the Software Pipelines Optimization Cycle (SPOC) methodology Source code for the reference Pipelines Framework Complete source code for all examples in the book Articles and discussions on pipelines technology and its applications We hope you find Software Pipelines as exciting as we've found it, and that you take this opportunity to capitalize on its capabilities and use it to help overcome your own performance and scalability challenges. Excerpted from Software Pipelines and SOA: Releasing the Power of Multi-Core Processing by Cory Isaacson, Brad Abrams, Krzysztof Cwalina All rights reserved by the original copyright owners. Excerpts are provided for display purposes only and may not be reproduced, reprinted or distributed without the written permission of the publisher.

Table of Contents

Forewordp. xv
Prefacep. xvii
Acknowledgmentsp. xxi
About the Authorp. xxiii
Introductionp. xxv
Section I Pipelines Theoryp. 1
Chapter 1 Parallel Computing and Business Applicationsp. 3
Mechanical Solutions: Parallel Computing at the Operating System Levelp. 5
Automated Network Routing: Parallel Computing by Predetermined Logicp. 6
Grid Computing: Parallel Computing by Distributionp. 6
Parallel Computing for Business Applicationsp. 7
The Solution: Software Pipelinesp. 8
Fluid Dynamicsp. 10
Software Pipelines Examplep. 11
Summaryp. 16
Chapter 2 Pipelines Lawp. 17
The Problem of Wasted CPU Powerp. 17
Fluid Dynamicsp. 18
Pipelines Law: The Basic Rulep. 19
Corollary 1: Limitations on the Flowp. 20
Corollary 2: Restrictions on the Output Flowp. 21
Software Pipelines Rulesp. 22
Rule 1p. 22
Rule 2p. 23
Rule 3p. 26
Summaryp. 30
Chapter 3 Pipelines Examplesp. 31
Bank ATM System (Single-Tier Distribution)p. 31
Bank ATM System (Multi-Tier Distribution)p. 35
Summary 43
Chapter 4 Pipelines Patternsp. 45
Service Invocation Patternsp. 47
Message Exchange Patternsp. 49
Pipeline Routing Patternsp. 51
Distributor Patternsp. 55
Distributor Connector Patternsp. 60
Summaryp. 62
Chapter 5 Pipelines: The Organizational Impactp. 65
Strategic Evaluationp. 66
Budget Impactp. 68
Organizational Roles and Responsibilitiesp. 70
Summaryp. 78
Section II Pipelines Methodologyp. 79
Chapter 6 Software Pipelines Optimization Cycle: Overviewp. 81
Yet Another Software Methodology?p. 81
SPOC Overviewp. 82
Chapter 7 The Five Steps of SPOCp. 85
Summaryp. 88
Chapter 8 Pipelines by Example: Introducing the Pipelines Bank Corporationp. 89
SPOC Report Templatep. 93
Summaryp. 94
Chapter 9 SPOC Step 1: Pipelines Objectivesp. 95
Step 1.1 Identify Business Objectives/Requirementsp. 96
Step 1.2 Determine Input Processing Ratep. 102
Step 1.3 Determine Future Potential Input Processing Ratep. 104
Step 1.4 Measure Current Capacityp. 107
Step 1.5 Calculate Performance Gapp. 109
Step 1.6 Define Pipelines Targetsp. 111
Summaryp. 113
Chapter 10 SPOC Step 2: Pipelines Analysisp. 115
Step 2.1 Map Current Process Flowp. 116
Step 2.2 Identify Existing Componentsp. 119
Step 2.3 Measure Processing Rate of Existing Componentsp. 121
Step 2.4 Calculate Processing Rate of Entire Flowp. 124
Step 2.5 Identify Restriction Pointsp. 127
Summaryp. 129
Chapter 11 SPOC Step 3: Pipelines Designp. 131
Step 3.1 Define Service Flow Designp. 133
Step 3.2 Identify New Componentsp. 138
Step 3.3 Identify Pipeline Opportunitiesp. 141
Step 3.4 Define Pipelines Schemep. 145
Step 3.5 Determine Distributor Ratep. 151
Step 3.6 Design Physical Deployment Environmentp. 154
Step 3.7 Define/Optimize Pipelines Designp. 155
Summaryp. 168
Chapter 12 SPOC Step 4: Pipelines Implementationp. 169
Step 4.1 Establish Software Pipelines Frameworkp. 171
Step 4.2 Modify Existing Componentsp. 173
Step 4.3 Develop New Componentsp. 178
Step 4.4 Orchestrate Service Flowsp. 179
Step 4.5 Instrument Service Flowp. 181
Step 4.6 Develop/Modify Pipeline Setsp. 182
Step 4.7 Test and Optimize Pipelines Implementationp. 190
Summaryp. 193
Chapter 13 SPOC Step 5: Pipelines Deploymentp. 195