Cover image for Genetic programming IV : routine human-competitive machine intelligence
Title:
Genetic programming IV : routine human-competitive machine intelligence
Series:
Genetic programming series ; GPEM 5
Publication Information:
Norwell, Mass. : Kluwer Academic Publishers, 2003
Physical Description:
1 CD-ROM ; 12 cm
ISBN:
9781402074462
General Note:
Accompanies text with the same title : (QA76.623 G46 2003)
Added Author:

Available:*

Library
Item Barcode
Call Number
Material Type
Item Category 1
Status
Searching...
30000010037564 CP 2769 Computer File Accompanies Open Access Book Compact Disc Accompanies Open Access Book
Searching...

On Order

Summary

Summary

Genetic Programming IV: Routine Human-Competitive Machine Intelligence presents the application of GP to a wide variety of problems involving automated synthesis of controllers, circuits, antennas, genetic networks, and metabolic pathways. The book describes fifteen instances where GP has created an entity that either infringes or duplicates the functionality of a previously patented 20th-century invention, six instances where it has done the same with respect to post-2000 patented inventions, two instances where GP has created a patentable new invention, and thirteen other human-competitive results. The book additionally establishes:

GP now delivers routine human-competitive machine intelligence

GP is an automated invention machine

GP can create general solutions to problems in the form of parameterized topologies

GP has delivered qualitatively more substantial results in synchrony with the relentless iteration of Moore's Law


Author Notes

John R. Koza received his Ph.D. in Computer Science from the University of Michigan in 1972 under the supervision of John Holland. He was co-founder, Chairman, and CEO of Scientific Games Inc. from 1973 through 1987 where he co-invented the rub-off instant lottery ticket used by state lotteries. He has taught a course on genetic algorithms and genetic programming at Stanford University since 1988. He is currently a consulting professor in the Biomedical Informatics Program in the Department of Medicine at Stanford University and a consulting professor in the Department of Electrical Engineering at Stanford University
Martin A. Keane received a Ph.D. in Mathematics from Northwestern University in 1969. He worked for Applied Devices Corporation until 1972, in the Mathematics Department at General Motors Laboratory until 1976, and was Vice-President for Engineering of Bally Manufacturing Corporation until 1986. He is currently chief scientist of Econometrics Inc. of Chicago and a consultant to various computer-related and gaming-related companies
Matthew J. Streeter received a Masters degree in Computer Science from Worcester Polytechnic Institute in 2001. His Masters thesis applied genetic programming to the automated discovery of numerical approximation formulae for functions and surfaces. His primary research interest is applying genetic programming to problems of real-world scientific or practical importance. He is currently working at Genetic Programming Inc. as a systems programmer and researcher
William Mydlowec is Chief Executive Officer and co-founder of Pharmix Corporation, a venture-funded computational drug discovery company in Silicon Valley. He received his B.S. degree in Computer Science from Stanford University in 1998. He formerly did research at Genetic Programming Inc. with John Koza between 1997 and 2000
Jessen Yu is Director of Engineering of Pharmix Corporation. He received a B.S. degree in Computer Science and Chemistry from Stanford University. He formerly did research at Genetic Programming Inc. with John Koza between 1998 and 2000
Guido Lanza is Vice President of Biology and co-founder of Pharmix Corporation. He received his B.A. degree in 1998 from the University of California at Berkeley from the Department of Molecular and Cell Biology and Department of Integrative Biology. He received an M.Sc. in 1999 in Bioinformatics from the University of Manchester, UK. He formerly did research at Genetic Programming Inc. with John Koza in 2000


Table of Contents

1 Introductionp. 1
1.1 Genetic Programming Now Routinely Delivers High-Return Human-Competitive Machine Intelligencep. 3
1.1.1 What We Mean by "Human-Competitive"p. 3
1.1.2 What We Mean by "High-Return"p. 4
1.1.3 What We Mean by "Routine"p. 5
1.1.4 What We Mean by "Machine Intelligence"p. 6
1.1.5 Human-Competitiveness of the Results Produced by Genetic Programmingp. 7
1.1.6 High-Return of the Results Produced by Genetic Programmingp. 10
1.1.7 Routineness of the Results Produced by Genetic Programmingp. 14
1.1.8 Machine Intelligencep. 15
1.2 Genetic Programming Is an Automated Invention Machinep. 15
1.2.1 The Illogical Nature of Invention and Evolutionp. 19
1.2.2 Overcoming Established Beliefsp. 20
1.2.3 Automating the Invention Processp. 21
1.2.4 Patentable New Inventions Produced by Genetic Programmingp. 22
1.3 Genetic Programming Can Automatically Create Parameterized Topologiesp. 23
1.4 Historical Progression of Qualitatively More Substantial Results Produced by Genetic Programming in Synchrony with Increasing Computer Powerp. 25
2 Background on Genetic Programmingp. 29
2.1 Preparatory Steps of Genetic Programmingp. 29
2.2 Executional Steps of Genetic Programmingp. 31
2.2.1 Example of a Run of Genetic Programmingp. 34
2.3 Advanced Features of Genetic Programmingp. 38
2.3.1 Constrained Syntactic Structuresp. 38
2.3.2 Automatically Defined Functionsp. 39
2.3.3 Automatically Defined Iterations, Automatically Defined Loops, Automatically Defined Recursions, and Automatically Defined Storesp. 40
2.3.4 Program Architecture and Architecture-Altering Operationsp. 40
2.3.5 Genetic Programming Problem Solverp. 41
2.3.6 Developmental Genetic Programmingp. 41
2.3.7 Computer Code for Implementing Genetic Programmingp. 42
2.4 Main Points of Four Books on Genetic Programmingp. 42
2.5 Sources of Additional Information about Genetic Programmingp. 45
3 Automatic Synthesis of Controllersp. 49
3.1 Background on Controllersp. 50
3.2 Design Considerations for Controllersp. 52
3.3 Representation of a Controller by a Block Diagramp. 53
3.4 Possible Techniques for Designing Controllersp. 58
3.4.1 Search by Hill Climbingp. 59
3.4.2 Search by Gradient Methodsp. 60
3.4.3 Search by Simulated Annealingp. 61
3.4.4 Search by Genetic Algorithm and Genetic Programmingp. 61
3.4.5 Previous Work on Controller Synthesis by Means of Genetic and Evolutionary Computationp. 62
3.4.6 Possible Approaches to Automatic Controller Synthesis Using Genetic Programmingp. 62
3.5 Our Approach to the Automatic Synthesis of the Topology and Tuning of Controllersp. 64
3.5.1 Repertoire of Functionsp. 65
3.5.2 Repertoire of Terminalsp. 67
3.5.3 Representing the Plantp. 67
3.5.4 Automatically Defined Functionsp. 68
3.5.5 Three Approaches for Establishing Numerical Parameter Valuesp. 69
3.5.6 Constrained Syntactic Structure for Program Treesp. 73
3.6 Additional Representations of Controllersp. 73
3.6.1 Representation of a Controller by a Transfer Functionp. 73
3.6.2 Representation of a Controller as a LISP Symbolic Expressionp. 74
3.6.3 Representation of a Controller as a Program Treep. 74
3.6.4 Representation of a Controller in Mathematicap. 75
3.6.5 Representation of a Controller and Plant as a Connection Listp. 75
3.6.6 Representation of a Controller and Plant as a SPICE Netlistp. 78
3.7 Two-Lag Plantp. 87
3.7.1 Preparatory Steps for the Two-Lag Plantp. 88
3.7.2 Results for the Two-Lag Plantp. 102
3.7.3 Human-Competitiveness of the Result for the Two-Lag Plant Problemp. 111
3.7.4 AI Ratio for the Two-Lag Plant Problemp. 112
3.8 Three-Lag Plantp. 113
3.8.1 Preparatory Steps for the Three-Lag Plantp. 114
3.8.2 Results for the Three-Lag Plantp. 115
3.8.3 Routineness for the Three-Lag Plant Problemp. 119
3.8.4 AI Ratio for the Three-Lag Plant Problemp. 119
3.9 Three-Lag Plant with a Five-Second Delayp. 120
3.9.1 Preparatory Steps for the Three-Lag Plant with a Five-Second Delayp. 120
3.9.2 Results for the Three-Lag Plant with a Five-Second Delayp. 122
3.9.3 Routineness for the Three-Lag Plant with a Five-Second Delayp. 123
3.9.4 AI Ratio for the Three-Lag Plant with a Five-Second Delayp. 123
3.10 Non-Minimal-Phase Plantp. 125
3.10.1 Preparatory Steps for the Non-Minimal-Phase Plantp. 125
3.10.2 Results for the Non-Minimal Phase Plantp. 125
3.10.3 Routineness for the Non-Minimal Phase Plant Problemp. 127
3.10.4 AI Ratio for the Non-Minimal Phase Plant Problemp. 127
4 Automatic Synthesis of Circuitsp. 129
4.1 Our Approach to the Automatic Synthesis of the Topology and Sizing of Circuitsp. 131
4.1.1 Evolvable Hardwarep. 134
4.2 Searching for the Impossiblep. 135
4.2.1 Preparatory Steps for the RC Circuit with Gain Greater than Twop. 138
4.2.2 Results for the RC Circuit with Gain Greater than Twop. 142
4.2.3 Routineness of the Transition from a Problem of Controller Synthesis to a Problem of Circuit Synthesisp. 143
4.2.4 AI Ratio for the RC Circuit with Gain Greater than Twop. 145
4.3 Reinvention of the Philbrick Circuitp. 147
4.3.1 Preparatory Steps for the Philbrick Circuitp. 148
4.3.2 Results for the Philbrick Circuitp. 150
4.3.3 Human-Competitiveness of the Result for the Philbrick Circuit Problemp. 151
4.3.4 Routineness for the Philbrick Circuit Problemp. 152
4.3.5 AI Ratio for the Philbrick Circuit Problemp. 153
4.4 Circuit for the NAND Functionp. 153
4.4.1 Preparatory Steps for the NAND Circuitp. 154
4.4.2 Results for the NAND Circuitp. 157
4.4.3 Human-Competitiveness of the Result for the NAND Circuit Problemp. 158
4.4.4 Routineness for the NAND Circuit Problemp. 159
4.4.5 AI Ratio for the NAND Circuit Problemp. 159
4.5 Evolution of a Computerp. 159
4.5.1 Preparatory Steps for the Arithmetic Logic Unitp. 160
4.5.2 Results for the Arithmetic Logic Unitp. 161
4.5.3 Routineness for the Arithmetic Logic Unit Circuit Problemp. 161
4.5.4 AI Ratio for the Arithmetic Logic Unit Circuit Problemp. 162
4.6 Square Root Circuitp. 162
4.6.1 Preparatory Steps for Square Root Circuitp. 163
4.6.2 Results for Square Root Circuitp. 165
4.6.3 Routineness for the Square Root Circuit Problemp. 168
4.6.4 AI Ratio for the Square Root Circuit Problemp. 168
4.7 Automatic Circuit Synthesis Without an Explicit Test Fixturep. 168
4.7.1 Preparatory Steps for the Lowpass Filter Problem Without an Explicit Test Fixturep. 169
4.7.2 Results for the Lowpass Filter Problem without an Explicit Test Fixturep. 173
4.7.3 Routineness for the Lowpass Filter Problem without an Explicit Test Fixturep. 174
4.7.4 AI Ratio for the Lowpass Filter Problem without an Explicit Test Fixturep. 174
5 Automatic Synthesis of Circuit Topology, Sizing, Placement, and Routingp. 175
5.1 Our Approach to the Automatic Synthesis of Circuit Topology, Sizing, Placement, and Routingp. 177
5.1.1 Initial Circuitp. 177
5.1.2 Circuit-Constructing Functionsp. 178
5.1.3 Component-Creating Functionsp. 179
5.1.4 Topology-Modifying Functionsp. 181
5.1.5 Development-Controlling Functionsp. 186
5.1.6 Developmental Processp. 186
5.2 Lowpass Filter with Layoutp. 186
5.2.1 Preparatory Steps for the Lowpass Filter with Layoutp. 186
5.2.2 Results for the Lowpass Filter with Layoutp. 188
5.2.3 Human-Competitiveness of the Result for the Lowpass Filter Problem with Layoutp. 195
5.2.4 Routineness of the Transition from a Problem of Circuit Synthesis without Layout to a Problem of Circuit Synthesis with Layoutp. 196
5.2.5 AI Ratio for the Lowpass Filter Problem with Layoutp. 197
5.3 60 dB Amplifier with Layoutp. 197
5.3.1 Preparatory Steps for 60 dB Amplifier with Layoutp. 197
5.3.2 Results for 60 dB Amplifier with Layoutp. 199
5.3.3 Routineness for the 60 dB Amplifier Problem with Layoutp. 202
5.3.4 AI Ratio for the 60 dB Amplifier Problem with Layoutp. 203
6 Automatic Synthesis of Antennasp. 205
6.1 Our Approach to the Automatic Synthesis of the Geometry and Sizing of Antennasp. 206
6.2 Illustrative Problem of Antenna Synthesisp. 207
6.3 Repertoire of Functions and Terminalsp. 209
6.3.1 Repertoire of Functionsp. 209
6.3.2 Repertoire of Terminalsp. 210
6.3.3 Example of the Use of the Functions and Terminalsp. 211
6.4 Preparatory Steps for the Antenna Problemp. 212
6.4.1 Program Architecturep. 212
6.4.2 Function Setp. 212
6.4.3 Terminal Setp. 212
6.4.4 Fitness Measurep. 212
6.4.5 Control Parametersp. 216
6.5 Results for the Antenna Problemp. 216
6.6 Routineness of the Transition from Problems of Synthesizing Controllers, Circuits, and Circuit Layout to a Problem of Synthesizing an Antennap. 219
6.7 AI Ratio for the Antenna Problemp. 220
7 Automatic Synthesis of Genetic Networksp. 221
7.1 Statement of the Illustrative Problemp. 221
7.2 Representation of Genetic Networks by Computer Programsp. 223
7.2.1 Repertoire of Functionsp. 223
7.2.2 Repertoire of Terminalsp. 224
7.3 Preparatory Stepsp. 224
7.3.1 Program Architecturep. 224
7.3.2 Function Setp. 224
7.3.3 Terminal Setp. 224
7.3.4 Fitness Measurep. 224
7.3.5 Control Parametersp. 225
7.4 Resultsp. 225
7.4.1 Routineness of the Transition from Problems of Synthesizing Controllers, Circuits, Circuits With Layout, and Antennas to a Problem of Genetic Network Synthesisp. 226
7.4.2 AI Ratio for the Genetic Network Problemp. 227
8 Automatic Synthesis of Metabolic Pathwaysp. 229
8.1 Our Approach to the Automatic Synthesis of the Topology and Sizing of Networks of Chemical Reactionsp. 230
8.2 Statement of Two Illustrative Problemsp. 231
8.3 Types of Chemical Reactionsp. 234
8.3.1 One-Substrate, One-Product Reactionp. 234
8.3.2 One-Substrate, Two-Product Reactionp. 243
8.3.3 Two-Substrate, One-Product Reactionp. 244
8.3.4 Two-Substrate, Two-Product Reactionp. 248
8.4 Representation of Networks of Chemical Reactions by Computer Programsp. 250
8.4.1 Representation as a Program Treep. 250
8.4.2 Representation as a Symbolic Expressionp. 255
8.4.3 Representation as a System of Nonlinear Differential Equationsp. 256
8.4.4 Representation as an Analog Electrical Circuitp. 259
8.4.5 Flexibility of the Representationp. 262
8.5 Preparatory Stepsp. 263
8.5.1 Program Architecturep. 263
8.5.2 Function Setp. 264
8.5.3 Terminal Setp. 264
8.5.4 Fitness Measurep. 264
8.5.5 Control Parametersp. 267
8.6 Results for the Phospholipid Cyclep. 267
8.6.1 Routineness of the Transition from Problem of Synthesizing Controllers, Circuits, Circuits with Layout, Antennas, and Genetic Networks to a Problem of Synthesis of a Network of Chemical Reactionsp. 274
8.6.2 AI Ratio for the Metabolic Pathway Problem for the Phospholipid Cyclep. 275
8.7 Results for the Synthesis and Degradation of Ketone Bodiesp. 275
8.7.1 Routineness for the Metabolic Pathway Problem Involving Ketone Bodiesp. 278
8.7.2 AI Ratio for the Metabolic Pathway Problem Involving Ketone Bodiesp. 278
8.8 Future Work on Metabolic Pathwaysp. 278
8.8.1 Improved Program Tree Representationp. 278
8.8.2 Null Enzymep. 278
8.8.3 Minimum Amount of Data Neededp. 278
8.8.4 Opportunities to Use Knowledgep. 279
8.8.5 Designing Alternative Metabolismsp. 279
9 Automatic Synthesis of Parameterized Topologies for Controllersp. 281
9.1 Parameterized Controller for a Three-Lag Plantp. 282
9.1.1 Preparatory Steps for the Parameterized Controller for a Three-Lag Plantp. 283
9.1.2 Results for the Parameterized Controller for a Three-Lag Plantp. 286
9.1.3 Routineness of the Transition from a Problem Involving a Non-Parameterized Controller to a Problem Involving a Parameterized Controllerp. 290
9.1.4 AI Ratio for the Parameterized Controller for a Three-Lag Plantp. 291
9.2 Parameterized Controller for Two Families of Plantsp. 291
9.2.1 Preparatory Steps for the Parameterized Controller for Two Families of Plantsp. 292
9.2.2 Results for the Parameterized Controller for Two Families of Plantsp. 296
9.2.3 Human-Competitiveness of the Result for the Parameterized Controller for Two Families of Plantsp. 299
9.2.4 Routineness for the Parameterized Controller for Two Families of Plantsp. 300
9.2.5 AI Ratio for the Parameterized Controller for Two Families of Plantsp. 300
10 Automatic Synthesis of Parameterized Topologies for Circuitsp. 301
10.1 Five New Techniquesp. 301
10.1.1 New NODE Function for Connecting Distant Pointsp. 302
10.1.2 Symmetry-Breaking Procedure using Geometric Coordinatesp. 303
10.1.3 Depth-First Evaluationp. 304
10.1.4 New TWO_LEAD Function for Inserting Two-Leaded Componentsp. 305
10.1.5 New Q Transistor-Creating Functionp. 305
10.2 Zobel Network with Two Free Variablesp. 306
10.2.1 Preparatory Steps for the Zobel Network Problem with Two Free Variablesp. 307
10.2.2 Results for the Zobel Network Problem with Two Free Variablesp. 310
10.2.3 Routineness fo the Transition from a Problem Involving a Non-Parameterized Circuit to a Problem Involving a Parameterized Circuitp. 311
10.2.4 AI Ratio for the Zobel Network Problem with Two Free Variablesp. 312
10.3 Third-Order Elliptic Lowpass Filter with a Free Variable for the Modular Anglep. 312
10.3.1 Preparatory Steps for the Third-Order Elliptic Lowpass Filter with a Free Variable for the Modular Anglep. 313
10.3.2 Results for the Lowpass Third-Order Elliptic Filter with a Free Variable for the Modular Anglep. 318
10.3.3 Routineness for the Lowpass Third-Order Elliptic Filter with a Free Variable for the Modular Anglep. 324
10.3.4 AI Ratio for the Lowpass Third-Order Elliptic Filter with a Free Variable for the Modular Anglep. 324
10.4 Passive Lowpass Filter with a Free Variable for the Passband Boundaryp. 324
10.4.1 Preparatory Steps for the Passive Lowpass Filter with a Free Variable for the Passband Boundaryp. 325
10.4.2 Results for the Passive Lowpass Filter with a Free Variable for the Passband Boundaryp. 328
10.4.3 Routineness for the Passive Lowpass Filter with a Free Variable for the Passband Boundaryp. 331
10.4.4 AI Ratio for the Passive Lowpass Filter with a Free Variable for the Passband Boundaryp. 332
10.5 Active Lowpass Filter with a Free Variable for the Passband Boundaryp. 332
10.5.1 Preparatory Steps for the Active Lowpass Filter with a Free Variable for the Passband Boundaryp. 333
10.5.2 Results for the Active Lowpass Filter with a Free Variable for the Passband Boundaryp. 335
10.5.3 Routineness for the Active Lowpass Filter with a Free Variable for the Passband Boundaryp. 339
10.5.4 AI Ratio for the Active Lowpass Filter with a Free Variable for the Passband Boundaryp. 339
11 Automatic Synthesis of Parameterized Topologies with Conditional Developmental Operators for Circuitsp. 341
11.1 Lowpass/Highpass Filter Circuitp. 342
11.1.1 Preparatory Steps for the Lowpass/Highpass Filterp. 342
11.1.2 Results for the Lowpass/Highpass Filterp. 344
11.1.3 Routineness of the Transition from a Parameterized Topology Problem without Conditional Developmental Operators to a Problem with Conditional Developmental Operatorsp. 348
11.1.4 AI Ratio for the Lowpass/Highpass Filter Problemp. 348
11.2 Lowpass/Highpass Filter with Variable Passband Boundaryp. 348
11.2.1 Preparatory Steps for the Lowpass/Highpass Filter with Variable Passband Boundaryp. 349
11.2.2 Results for the Lowpass/Highpass Filter with a Variable Passband Boundaryp. 350
11.2.3 Routineness for the Lowpass/Highpass Filter with a Variable Passband Boundaryp. 357
11.2.4 AI Ratio for the Lowpass/Highpass Filter with a Variable Passband Boundaryp. 357
11.3 Quadratic/Cubic Computational Circuitp. 358
11.3.1 Preparatory Steps for the Quadratic/Cubic Computational Circuitp. 358
11.3.2 Results for the Quadratic/Cubic Computational Circuitp. 360
11.4 A 40/60 dB Amplifierp. 364
11.4.1 Preparatory Steps for the 40/60 dB Amplifierp. 364
11.4.2 Results for 40/60 dB Amplifierp. 366
12 Automatic Synthesis of Improved Tuning Rules for PID Controllersp. 367
12.1 Test Bed of Plantsp. 371
12.2 Preparatory Steps for Improved PID Tuning Rulesp. 374
12.2.1 Program Architecturep. 375
12.2.2 Terminal Setp. 375
12.2.3 Function Setp. 375
12.2.4 Fitness Measurep. 375
12.2.5 Control Parametersp. 376
12.3 Results for Improved PID Tuning Rulesp. 376
12.4 Human-Competitiveness of the Results for the Improved PID Tuning Rulesp. 382
12.5 Routineness of the Transition from Problems Involving Parameterized Topologies for Controllers to a Problem Involving PID Tuning Rulesp. 385
12.6 AI Ratio for the Improved PID Tuning Rulesp. 385
13 Automatic Synthesis of Parameterized Topologies for Improved Controllersp. 387
13.1 Preparatory Steps for Improved General-Purpose Controllersp. 387
13.1.1 Function Setp. 388
13.1.2 Terminal Setp. 388
13.1.3 Program Architecturep. 389
13.1.4 Fitness Measurep. 389
13.1.5 Control Parametersp. 390
13.2 Results for Improved General-Purpose Controllersp. 390
13.2.1 Results for First Run for Improved General-Purpose Controllersp. 390
13.2.2 Results for Second Run for Improved General-Purpose Controllersp. 398
13.2.3 Results for Third Run for Improved General-Purpose Controllersp. 402
13.3 Human-Competitiveness of the Results for the Improved General-Purpose Controllersp. 411
13.4 Routineness for the Improved General-Purpose Controllersp. 412
13.5 AI Ratio for the Improved General-Purpose Controllersp. 412
14 Reinvention of Negative Feedbackp. 413
14.1 Genetic Programming Takes a Ride on the Lackawanna Ferryp. 414
14.1.1 Fitness Measurep. 414
14.1.2 Initial Circuit, Function Set, Terminal Set, and Control Parametersp. 415
14.2 Results for the Problem of Reducing Amplifier Distortionp. 415
14.3 Human-Competitiveness of the Result for the Problem of Reducing Amplifier Distortionp. 418
14.4 Routineness for the Problem of Reducing Amplifier Distortionp. 419
14.5 AI Ratio for the Problem of Reducing Amplifier Distortionp. 419
15 Automated Reinvention of Six Post-2000 Patented Circuitsp. 421
15.1 The Six Circuitsp. 423
15.1.1 Low-Voltage Balun Circuitp. 423
15.1.2 Mixed Analog-Digital Variable Capacitorp. 423
15.1.3 Voltage-Current Conversion Circuitp. 423
15.1.4 Low-Voltage High-Current Transistor Circuitp. 424
15.1.5 Cubic Function Generatorp. 424
15.1.6 Tunable Integrated Active Filterp. 426
15.2 Uniformity of Treatment of the Six Problemsp. 426
15.3 Preparatory Steps for the Six Post-2000 Patented Circuitsp. 428
15.3.1 Initial Circuitp. 428
15.3.2 Program Architecturep. 433
15.3.3 Function Setp. 433
15.3.4 Terminal Setp. 434
15.3.5 Fitness Measurep. 435
15.3.6 Control Parametersp. 444
15.4 Results for the Six Post-2000 Patented Circuitsp. 444
15.4.1 Results for Low-Voltage Balun Circuitp. 444
15.4.2 Results for Mixed Analog-Digital Variable Capacitorp. 451
15.4.3 Results for High-Current Load Circuitp. 454
15.4.4 Results for Voltage-Current Conversion Circuitp. 458
15.4.5 Results for Cubic Function Generatorp. 461
15.4.6 Tunable Integrated Active Filterp. 466
15.5 Commercial Practicality of Genetic Programming for Automated Circuit Synthesisp. 478
15.6 Human-Competitiveness of the Results for the Six Post-2000 Patented Circuitsp. 481
15.7 Routineness for the Six Post-2000 Patented Circuitsp. 481
15.8 AI Ratio for the Six Post-2000 Patented Circuitsp. 482
16 Problems for Which Genetic Programming May Be Well Suitedp. 483
16.1 Characteristics Suggesting the Use of the Genetic Algorithmp. 483
16.2 Characteristics Suggesting the Use of Genetic Programmingp. 484
16.2.1 Discovering the Size and Shape of the Solutionp. 484
16.2.2 Reuse of Substructuresp. 486
16.2.3 The Number of Substructuresp. 495
16.2.4 Hierarchical References among the Substructuresp. 496
16.2.5 Passing Parameters to Substructuresp. 497
16.2.6 Type of Substructuresp. 499
16.2.7 Number of Arguments Possessed by Substructuresp. 500
16.2.8 The Developmental Processp. 500
16.2.9 Parameterized Topologies Containing Free Variablesp. 504
16.3 Characteristics Suggesting the Use of Genetic Methodsp. 505
16.3.1 Non-Greedy Nature of Genetic Methodsp. 505
16.3.2 Recombination in Conjunction with the Population in Genetic Methodsp. 506
17 Parallel Implementation and Computer Timep. 515
17.1 Computer Systems Used for Work in This Bookp. 516
17.1.1 Alpha Parallel Computer Systemp. 516
17.1.2 Pentium Parallel Computer Systemp. 517
17.2 Computer Time for Problems in This Bookp. 518
18 Historical Perspective on Moore's Law and the Progression of Qualitatively More Substantial Results Produced by Genetic Programmingp. 523
18.1 Five Computer Systems Used in 15-Year Periodp. 523
18.2 Qualitative Nature of Results Produced by the Five Computer Systemsp. 524
18.3 Effect of Order-of-Magnitude Increases in Computer Power on the Qualitative Nature of the Results Produced by Genetic Programmingp. 526
19 Conclusionp. 529
19.1 Genetic Programming Now Routinely Delivers High-Return Human-Competitive Machine Intelligencep. 529
19.2 Genetic Programming Is an Automated Invention Machinep. 530
19.3 Genetic Programming Can Automatically Create Parameterized Topologiesp. 530
19.4 Genetic Programming Has Delivered Qualitatively More Substantial Results in Synchrony with Increasing Computer Powerp. 531
Appendix A Functions and Terminalsp. 533
Appendix B Control Parametersp. 539
Appendix C Patented or Patentable Inventions Generated by Genetic Programmingp. 551
Bibliographyp. 555
Indexp. 575