NEURAL NETWORKS AND APPLICATIONS

By Sangeeta Kumari 04415904411

Page 1

         

Introduction History Neural Network Model Characteristics Advantages Applications Strengths Limitations Conclusion Summary

Page 2

Introduction
An Artificial Neural Network (ANN) is an information processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information. The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurons) working in unison to solve specific problems. An Artificial Neural Network is a network of many very simple processors ("units"), each possibly having a (small amount of) local memory. The units are connected by unidirectional communication channels ("connections"), which carry numeric (as opposed to symbolic) data. The units operate only on their local data and on the inputs they receive via the connections.

Simplified view of a feedforward artificial neural network

Page 3

Introduction(Contd)
A neural network (NN), in the case of artificial neurons called artificial neural network (ANN) or simulated neural network (SNN), is an interconnected group of natural or artificial neurons that uses a mathematical or computational model for information processing based on a connectionist approach to computation. In most cases an ANN is an adaptive system that changes its structure based on external or internal information that flows through the network. Neural networks are non-linear statistical data modeling or decision making tools. They can be used to model complex relationships between inputs and outputs or to find patterns in data.

Page 4

History
The preliminary theoretical base for contemporary neural networks was independently proposed by Alexander Bain (1873) and William James (1890). In their work, both thoughts and body activity resulted from interactions among neurons within the brain. McCullouch and Pitts (1943) created a computational model for neural networks based on mathematics and algorithms. They called this model threshold logic. The model paved the way for neural network research to split into two distinct approaches. One approach focused on biological processes in the brain and the other focused on the application of neural networks to artificial intelligence.

Page 5

The Unit of a Neural Network

The unit of a neural network is modeled on the biological neuron The unit combines its inputs into a single value, which it then transforms to produce the output; together these are called the activation function
Page 6

Neural Network Model

A Neural Network (Expert System) is like a black box that knows how to process inputs to create a useful output. The calculation(s) are quite complex and difficult to understand
Page 7

Characteristics
Supervised networks are universal approximators (Non recurrent networks) Theorem : Any limited function can be approximated by a neural network with a finite number of hidden neurons to an arbitrary precision Type of Approximators
Linear approximators : for a given precision, the number of parameters grows exponentially with the number of variables (polynomials) Non-linear approximators (NN), the number of parameters grows linearly with the number of variables

Page 8

Other properties
Adaptivity Adapt weights to environment and retrained easily Generalization ability May provide against lack of data Fault tolerance Graceful degradation of performances if damaged => The information is distributed within the entire net.

Page 9

General Advantages
Advantages Adapt to unknown situations Robustness: fault tolerance due to network redundancy Autonomous learning and generalization Disadvantages Not exact Large complexity of the network structure

Page 10

Where are NN used?

Recognizing and matching complicated, vague, or incomplete patterns Data is unreliable Problems with noisy data Prediction Classification Data association Data conceptualization Filtering Planning

Page 11

Applications
Prediction: learning from past experience pick the best stocks in the market predict weather identify people with cancer risk Classification Image processing Predict bankruptcy for credit card companies Risk assessment

Page 12

Applications
Recognition Pattern recognition: SNOOPE (bomb detector in U.S. airports) Character recognition Handwriting: processing checks Data association Not only identify the characters that were scanned but identify when the scanner is not working properly

Page 13

Applications
Data Conceptualization infer grouping relationships e.g. extract from a database the names of those most likely to buy a particular product. Data Filtering e.g. take the noise out of a telephone signal, signal smoothing Planning Unknown environments Sensor data is noisy Fairly new approach to planning
Page 14

Creatures: The World Most Advance Artificial Life Cyber Life

Creatures is the most entertaining computer game we'll ever play which offers nothing to shoot, no puzzles to solve or difficult controls to master. And yet it is mesmerizing entertainment. One have to raise, teach, breed and love computer pets that are really alive. They are so alive that if it is not taken care of, they will die. Creatures features the most advanced, genuine Artificial Life software ever developed in a commercial product, technology that has blown the imaginations of scientists world-wide. This is a look into the future where new species of life emerge from ordinary home and office PCs.

Page 15

Page 16

Strengths of a Neural Network

Power: Model complex functions, nonlinearity built into the network Ease of use: Learn by example Very little user domain-specific expertise needed Intuitively appealing: based on model of biology, will it lead to genuinely intelligent computers/robots? Neural networks cannot do anything that cannot be done using traditional computing techniques, BUT they can do some things which would otherwise be very difficult

Page 17

Neural Net Limitations

Neural Nets are good for prediction and estimation when: Inputs are well understood Output is well understood Experience is available for examples to use to train the neural net application (expert system) Neural Nets are only as good as the training set used to generate it. The resulting model is static and must be updated with more recent examples and retraining for it to stay relevant

Page 18

Conclusion
Past and Present
The development of true Neural Networks is a fairly recent event, which has been met with success. Two of the different systems (among the many) that have been developed are: the basic feed forward Network and the Hopfield Net. In addition to the applications featured here, other application areas include: Financial Analysis -- stock predictions . Signature Analysis -- the banks in America have taken to NNs to compare signatures with what is stored. Process Control Oversight -- NNs are used to advise aircraft pilots of engine problems. Direct Marketing -- NNs can monitor results from a test mailing and determine the most successful areas. Pen PC's.
Page 19

Summary
Neural network solutions should be kept as simple as possible. For the sake of the gaming speed neural networks should be applied preferably off-line. A large data set should be collected and it should be divided into training, validation, and testing data. Neural networks fit as solutions of complex problems. A pool of candidate solutions should be generated, and the best candidate solution should be selected using the validation data. The solution should be represented to allow fast application.

Page 20

Page 21