ACTIVITY-2

CS-5005

SUBMITTED TO: SUBMITTED BY:

C.P Bhargava Sir Priyanshi Gupta 110 CS-2 5sem
What are Artificial Neural
Networks (ANNs)?
The inventor of the first
neuro-computer , Dr. Robert
Hecht-Nielsen, defines a
neural network as −
"...a computing system made
up of a number of simple,
highly interconnected
processing elements, which
process information by their
dynamic state response to
external inputs.”
 Artificial Neural Networks
• It is a system of hardware
and/or software patterned after
the operation of neurons in the
human brain.
• They are exceptionally good at
performing pattern recognition
and other tasks that are very
difficult to program using
conventional techniques.
• Programs that employ neural
nets are also capable of
learning on their own and
adapting to changing conditions
History of the Artificial Neural
Networks

• History of the ANNs

stems from the 1940s,
the decade of the first
electronic computer.
• However, the first
important step took
place in 1957 when
Rosenblatt introduced
the first concrete neural
model, the perceptron.
Rosenblatt also took
part in constructing the
first successful
neurocomputer, the
Mark I Perceptron.
Basic Structure of ANNs
• The idea of ANNs is based on
the belief that working of
human brain by making the
right connections, can be
imitated using silicon and
wires as
living neurons and dendrites.
• The human brain is composed
of 86 billion nerve cells
called neurons.
• They are connected to other
thousand cells by Axons.
Basic Structure of ANNs

• Stimuli from external

environment or inputs
from sensory organs are
accepted by dendrites.
• These inputs create
electric impulses, which
quickly travel through the
neural network. A neuron
can then send the message
to other neuron to handle
the issue or does not send
it forward.
 Basic Structure of ANNs
• ANNs are composed of multiple nodes,
which imitate biological neurons of
human brain.
• The neurons are connected by links and
they interact with each other. The nodes
can take input data and perform simple
operations on the data.
• The result of these operations is passed to
other neurons. The output at each node is
called its activation or node value.
• Each link is associated with weight. ANNs
are capable of learning, which takes place
by altering weight values.
Types of Artificial
Neural Networks

• FeedForward
• Feedback
 FeedForward ANN
• The information flow is unidirectional.
• A unit sends information to other unit from which
it does not receive any information. There are no
feedback loops.
• They are used in pattern
generation/recognition/classification. They have
fixed inputs and outputs.
 Feedback ANN
• Feedback loops are allowed.
• They are used in content addressable
memories.
 Working of ANNs
• Each arrow in a network represents a
connection between two neurons and
indicates the pathway for the flow of
information. Each connection has a weight,
an integer number that controls the signal
between the two neurons.
• If the network generates a “good or
desired” output, there is no need to adjust
the weights. However, if the network
generates a “poor or undesired” output or
an error, then the system alters the
weights in order to improve subsequent
results.
Computers vs. Neural Networks
“Standard” Computers Neural Networks

1. One CPU 1. Highly parallel processing

2. Fast processing units 2. Slow processing units

3. Reliable units 3. unreliable units

4. Static infrastructure 4. Dynamic infrastructure

 Applications of Neural Networks
• Aerospace − Autopilot aircrafts, aircraft fault detection.
• Automotive − Automobile guidance systems.
• Military − Weapon orientation and steering, target
tracking, object discrimination, facial recognition,
signal/image identification.
• Electronics − Code sequence prediction, IC chip layout,
chip failure analysis, machine vision, voice synthesis.
 Applications of Neural Networks
• Industrial − Manufacturing process control, product design and
analysis, quality inspection systems, welding quality analysis, paper
quality prediction, chemical product design analysis, dynamic
modeling of chemical process systems, machine maintenance
analysis, project bidding, planning, and management.
• Medical − Cancer cell analysis, EEG and ECG analysis, prosthetic
design, transplant time optimizer.
• Speech − Speech recognition, speech classification, text to speech
conversion.
• Telecommunications − Image and data compression, automated
information services, real-time spoken language translation.
 Applications of Neural Networks
• Financial − Real estate appraisal, loan advisor, mortgage screening, corporate
bond rating, portfolio trading program, corporate financial analysis, currency
value prediction, document readers, credit application evaluators.
• Transportation − Truck Brake system diagnosis, vehicle scheduling, routing
systems.
• Software − Pattern Recognition in facial recognition, optical character
recognition, etc.
• Time Series Prediction − ANNs are used to make predictions on stocks and
natural calamities.
• Signal Processing − Neural networks can be trained to process an audio signal
and filter it appropriately in the hearing aids.
• Control − ANNs are often used to make steering decisions of physical vehicles.
• Anomaly Detection − As ANNs are expert at recognizing patterns, they can
also be trained to generate an output when something unusual occurs that
misfits the pattern.
 Pattern Recognition
• An important application of neural networks is
pattern recognition. Pattern recognition can
be implemented by using a feed-forward
neural network that has been trained
accordingly.
• During training, the network is trained to
associate outputs with input patterns.
 Pattern Recognition
• When the network is used, it identifies the input
pattern and tries to output the associated output
pattern.
• The power of neural networks comes to life when
a pattern that has no output associated with it, is
given as an input.
• In this case, the network gives the output that
corresponds to a taught input pattern that is least
different from the given pattern.
 Network Layers
• Input Layer - The activity of
the input units represents the
raw information that is fed
into the network.
• Hidden Layer - The activity of
each hidden unit is
determined by the activities of
the input units and the
weights on the connections
between the input and the
hidden units.
• Output Layer - The behavior
of the output units depends
on the activity of the hidden
units and the weights between
the hidden and output units.
 Network Structure
• The number of layers and of neurons depend
on the specific task. In practice this issue is
solved by trial and error.
• Two types of adaptive algorithms can be used:
– start from a large network and successively
remove some neurons and links until network
performance degrades.
– begin with a small network and introduce new
neurons until performance is satisfactory.
 Advantages of Neural
Networks
 Having a distributed memory: In order for ANN to be able to
learn, it is necessary to determine the examples and to teach the
network according to the desired output by showing these examples
to the network. The network's success is directly proportional to the
selected instances, and if the event can not be shown to the
network in all its aspects, the network can produce false output 
 Gradual corruption:  A network slows over time and undergoes
relative degradation. The network problem does not immediately
corrode immediately.
 Ability to make machine learning: Artificial neural networks
learn events and make decisions by commenting on similar events. 
 Parallel processing capability:  Artificial neural networks have
numerical strength that can perform more than one job at the same
time.
Advantages of Neural
Networks
• Storing information on the entire network : Information
such as in traditional programming is stored on the entire
network, not on a database. The disappearance of a few
pieces of information in one place does not prevent the
network from functioning.
• Ability to work with incomplete knowledge : After ANN
training, the data may produce output even with
incomplete information. The loss of performance here
depends on the importance of the missing information.
• Having fault tolerance: Corruption of one or more cells of
ANN does not prevent it from generating output. This
feature makes the networks fault tolerant.
Disadvantage of Neural
Network
Hardware dependence:  Artificial neural
networks require processors with parallel
processing power, in accordance with their
structure. For this reason, the realization of the
equipment is dependent. 
Unexplained behavior of the network: This is
the most important problem of ANN. When ANN
produces a probing solution, it does not give a clue
as to why and how. This reduces trust in the
network. 
Determination of proper network
structure:  There is no specific rule for
determining the structure of artificial neural
networks. Appropriate network structure is
achieved through experience and trial and error. 
 Disadvantage of Neural Network
• Difficulty of showing the problem to the
network: ANNs can work with numerical
information. Problems have to be translated into
numerical values before being introduced to ANN. The
display mechanism to be determined here will directly
influence the performance of the network . This
depends on the user's ability.
• The duration of the network is unknown: The network
is reduced to a certain value of the error on the sample
means that the training has been completed. This value
does not give us optimum results.
THANK
YOU