Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks

by Robert J Marksii and Russell D. Reed

Book Overview

Artificial neural networks are nonlinear mapping systems whose structure is loosely based on principles observed in the nervous systems of humans and animals. The basic idea is that massive systems of simple units linked together in appropriate ways can generate many complex and interesting behaviors. This book focuses on the subset of feedforward artificial neural networks called multilayer perceptrons (MLP). These are the mostly widely used neural...

• Format: Hardcover
• Language: English
• ISBN: 0262181908
• ISBN13: 9780262181907
• Release Date: March 1999
• Publisher: MIT Press (MA)
• Length: 352 Pages
• Weight: 1.75 lbs.
• Dimensions: 1.0" x 7.3" x 9.4"
• Age Range: 18 years and up
• Grade Range: Postsecondary and higher

Customer Reviews

A real gem of a book

Some books just have the right feel about them and this is one of them. The author clearly knows neural networks and also knows how to communicate to others in a no-nonsense fashion. With so many books being published, you rarely find a technical book that is as good as this. The emphasis here is on conveying the insights that the experts in this area would know. Importantly, concepts are explained equally in words, graphics and mathematics, maximising the uptake of knowledge from the book. Tufte would be impressed by the quality of the line graphics in this book, and the information that they convey, not to mention the overall presentation. I suspect that this book would make an ideal textbook for a course in neural networks. Overall, I've enjoyed reading it very much.

Neural Smithing

Book is excellent. Covers the theory very well, such that you can make the computer code yourself. They also provide puedocode. You will be able to learn it better than other books that just give you the code. I find that once you understand the theory, writing the code is easy.

Run out of ideas to improve your Neural Network?

Many textbooks can help me to understand the different concepts of neural network, but not the practical tips needed to optimize neural network anlysis and implementation.The topics covered are reminicent to those discussed in part 2 and 3 of the Neural Network FAQ. In chapter 6, the relationships between learning rate, momontum, trainig time and learning modes are presented graphically. With this, it helps me to rule out and avoid learning parameters that are unlikely to improve the NN performance. This is especially important if the dataset is large and the NN program is implemented in Java. If the aim is to develop a NN solution that will give you the best results, I find both chapter 7 (heuristics for weights initialization) and 16 (heuristics for improving generation) are esential and saves me a lot of time from reading many journals.In summary, this book has helped me to develop the art of NN optimization. It shows me how to visualize decision surface and the various graphical relationships between learning paramters and various components of NN topology. I think you will find this book very useful after your NN program is up and running and you are looking for ideas and explaination on how to improve the NN performance further.

The book is a five star effort.

The book is a five star effort. Here is a review circulated in popular neural network newsgroup:Newsgroups: comp.ai.neural-nets From: saswss@hotellng.unx.sas.com (Warren Sarle) Subject: Neural Smithing Message-ID: Organization: SAS Institute Inc.I have added a new book to the list of "The best elementary textbooks on practical use of NNs" in the NN FAQ (it may not show up on the server for a few days):Reed, R.D., and Marks, R.J, II (1999), Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks, Cambridge, MA: The MIT Press, ISBN 0-262-18190-8.After you have read Smith (1993) or Weiss and Kulikowski (1991), Reed and Marks provide an excellent source of practical details for training MLPs. They cover both backprop and conventional optimization algorithms. Their coverage of initialization methods, constructive networks, pruning, and regularization methods is unusually thorough. Unlike the vast majority ofbooks on NNs, this one has lots of really informative graphs. The chapter on generalization assessment is a little weak, which is why you should read Smith (1993) or Weiss and Kulikowski (1991) first. There is a little elementary calculus, but not enough that it should scare off anybody.One minor complaint: "smith" is not a verb!Warren S. Sarle SAS Institute Inc. The opinions expressed here saswss@unx.sas.com SAS Campus Drive are mine and not necessarily (919) 677-8000 Cary, NC 27513, USA those of SAS Institute.

A handbook, reference book, and a documentary on Neural Nets

It was a pleasure to have the opportunity to read the Russell Reed, Robert Marks book "Neural Smithing". I have been an engineer at Boeing for 20 years involved in computing, CAD 3D design, and related applications. My current assignment includes supporting a sophisticated Neural Network based design retrieval system. I am also completing my Ph.D. dissertation based on Neural Network research.To begin with, it seems reasonable to characterize "Neural Smithing" in broad terms. The book is not just a stuffy, hypothetical, academic treatment of Neural Networks loaded with formulas and references. It does contain these elements but they are encapsulated in a larger presentation which leads the reader on an adventure of exploration and an ultimately satisfying journey of discovery. The book is certainly well grounded in theory and motivated by classical approach but the overall message is: you too can make neural networks from scratch by following the principles, guidelines, suggestions, and hints presented in this handbook. What's more, your network will probably perform correctly, or at least you'll understand the reason why not."Neural Smithing" guides the reader through various channels and pathways, around pitfalls, and ultimately to an understanding of neural networks on a personal level. The reader comes away from the first reading with a feeling of intimate knowledge and intuitive understanding of neural networks. After this, the book transforms from a required travel guide into a trusty reference book. With over 380 references, it is a veritable who's who in neural network technology and a "must have" for any serious experimenters workbench.The underlying assumption the authors seem to be working from is that the reader will in fact "Roll up their sleeves, sit down at a computer, and get involved with neural networks at a working level". Ultimately, they will arrive at the intersections of discovery marked by the various chapters of the book. Here, the information contained in the book stands ready to guide the "user" through these intersection in an interactive way where the reader participates in the choices. The reader is made to consider their particular application and the implication of a variety of choices on the results they are interested in achieving.The authors bring a unique understanding and hands-on experience to their discussions. While the book is liberally referenced, the originality of the book is recognized at a higher level as the authors use their experience to facilitate overall integration into a coherent, comprehensive presentation. This book gets high marks for presentation, particularly in the areas of line-of-reasoning and chain-of-development. The style will be instantly recognizable to readers versed in formal, axiomatic development and presentation."Neural Smithing" is a sophisticated work replete with Hypercubes, Conjugate Gradient Descents, Correlation and Variance, Voro