Introduction Teams across the world are becoming more a n d m o r e p r o f e s s i o n a l with the way they pla y the game.

Team s n ow have o ffi cia l strategistsand technical support staff which help p la yers to st udy t heir past g a m e s a n d i m p r o v e . Devising strategies against opponent teams o r s p ec i fi c p la yer s i s a l s o ve r y c o m m o n i n modern day cricket. All thisha s b e c o m e pos sible due to the a dvent of tec hnolog y. Technologicald e v e l o p m e n t s h a v e b e e n harnessed to collect various data v e r y pr ecisely a nd use it f or va rious purposes.T h e HA WK EY E is one s uch techn olog y wh ich is c o n s i d e r e d t o b e reall y to p no tch i n cri ck et. The basic idea is to monitor the tra jector y of t h e cricket ball during the entire duration of pla y. This data is then processed to produce life like visualizations showing the paths whichthe ball took. Such data has b e e n u s e d fo r va r i o u s pu r p o s e s, p o p u l a r uses includi ng th e LB W decis ion makin g s oftware and colorful wagonwh e e l s s h o wi n g va r i o us statistics. This paper attempts to explain t h e intricate details of the technology which goes behind the HAWKEY E. We firs t s tart off wi t h a g e n er a l o v er vi e w o f t h e s ys t em a n d a n outlineof the challenges that we might face, then move on to the details of thet e c h n o l o g y and end with various applications where o n e s e e s t h i s technology being put to use.

HAWKEYE a generaloverview Hawk-Eye

is a complex computer system used incricket,tennisand other sports to visually track the path of the balland display a record of its moststatistically likely path as a moving image. In some sports, like tennis, it isnow part of the adj ud ica tion proces s. It i s als o u sed in s ome ins tan ces t o p r e d i c t t h e future pa th of a ba ll in cricket. H a w k - E y e u s e s s i x o r m o r e computer-linked television cameras situated around the cricket field of play.The computer reads in the video in real time, and tracks the path of the cricket ball on each camera. These six separate views are then combined together to produce an accurate 3Drepresentation of the path of the ball.Hawk-eye is able to track the ball from the point of release from the b owler to t he poin t at whi ch the bal l is in line with t he stumps. fur ther prediction is achieved through use of a parametric model. the output iswhere the ball piched and the direction in which it is headed. Hawk-eye ca n t ra c k a n y t yp e o f b o u n ce, s p i n, s wi n g a nd s e a m movement of the ball. Give a prediction as accurate as 99.99 percent Hawk-Eye was used for referring decisions to the third umpire inLBW.

In tennis Hawk-Eye generates the impact of the ball whether theball is IN or OUT HA WK EY E techno log y succes sfu ll y treat s each of the issuesa n d p r o v i d e s a r o b u s t s ys t e m to be used in practice. The top-

l e v e l s chemat ic p ictu re o f the s yst em and its various parts is as shown below(each color represents a block of steps which are r e l a t e d ) : Fi gu r e1 : To p Le v e l v i e w o f t h e Ha wk E ye S ys t e m

The figure above shows precisely the steps that a r e i n v o l v e d i n the computation. History The Hawk-eye technology, as with many recent developments, initially cameabout from a military application. Initially Hawk-

eye was used to track themovement and flight path of missiles, it was though soon realised that it could be used to track any independently moving projectile. Thus it was that Dr PaulHawkins and his colleagues sought to adapt the military version of Hawk-eyeto one that could be used in sports, and in particular cricket.It was developed by engineers atRoke Manor Research Limitedof Romsey, Hampshirei n t h e U K , i n 2 0 0 1 . A U K p a t e n t w a s s u b m i t t e d b y D r P a u l Hawkins and David Sherry. Later, the technology was spun off into a separatecompan y, Ha wk -E ye Inn ovati ons Lt d., as a joint ven tu re with tel evi s io n production companySunset + Vine.After intensive development the new Hawk-eye system was able to track theflight of a cricket ball with a great deal of accuracy. The Hawkeye systemwas launched in 2001.The system was first used during a Test match betweenPakistan and England at Lord's Cricket Ground, on 21 April 2001, in the TVcoverage by Channel 4. It was first used in television coverage of sportingevents such as Test cricket, and has now reached the stage of being used by

officials in tennis to assist in adjudicating close line calls. The Nasdaq-100Open in Miami was the first tour event to officially use the technology. The2006 US Open was the first Grand Slam event to feature the system, followed by the 2007 Australian Open. How does Hawk-Eye work?

For most sports fans it is not important to know how Hawkeye works, butth ere is a l ot of i nt eresti ng s cien ce an d tech no l og y b ehi nd th e ima g es t hatappear on the TV screen. In cricket matches Hawk-eye technology is basedupon the images captured by six cameras, three on each side to the wicket.Through these six cameras, all round and 3D images can be captured, whichallows for the path of the ball to be tracked. The prediction side comes aboutt h r o u g h t h e u s e o f logarithms based on known laws of physics a n d trajectories.Hawk-Eye uses 6 high speed specialist vision processing cameras which are positioned around the ground and calibrated. In addition the system uses thetwo Ma t broad cas t cameras and ca l ib rat es them s o tha t th e graph i c isalways overlaid in the right place. All cameras have anti wobble software todeal with camera movement. When a ball is bowled, the system is able toautomatically find the ball within each frame of video from each camera. Bycombining the positions of the ball in each of the cameras, the 3d position of the ball is measured through-out the delivery. By measuring the position of the ball at multiple frames post bounce, the speed, direction of travel, swing

and di p can b e ca lcu lat ed for that s peci fi c d el iver y. Using t hes e meas u red characteristics of the balls flight up to impact, the future path is predicted. Principle All Hawk-Eye systems are based on the principles of triangulationusing thevis ual ima ges and timing da ta pro vi ded b y a t l eas t s ix high -s peed video cameraslocated at different locations and angles around the area of play. Triangulation

: Triangualtion is a process of detem ining the location of a point by measuring angles to it from known points f r o m th e fix ed bas eli ne

Figure Triangulation Technology

In this section, we go into the technical details of the steps involved int h e H A W K E Y E sys tem. The process, as done before, can be broken down into the following steps (we wi l l d i vi d e th e p r o ces s i n t o t h e s e seemingly disjoint steps so that it is easy to explain the d e t a i l s , h o w e v e r many of the steps ar e overlapping): 1.The cameras: T yp i c a l l y, fo r a c r i ck et fi el d , 6 ca m eras a r e u s e d . T h e s e c a m e r a s a r e placed around the field at r oughl y the p la ces a s ind icat ed in t he diagram below:T h e c a m e r a s n e e d t o b e f i x e d t o s o m e f r a m e o f r e f e r e n c e , w h i c h defined very conveniently in terms of the wickets on the pitch, and thel i n e j o i n i n g t h e m . T h i s i s useful when we want to use an automated program to merge images from different cameras to form one 3 D image. 2 . Core Image Processing Job: H a w k -E ye ta k es 2 in p u t s

1. V id eo p rovided b y 6 d iffe rent cameras p la ced at 6 di fferen t pla ces. 2. The s p eed of th e ba ll.T h e sys tem rapidly processes the video feeds b y a h i g h s p e e d v i d e o p r o c e s s o r . This part of the system can be further divided into major parts: a) To identify the pixels representing the cricket ball in every image taken bye a c h o f t h e v i d e o c a m e r a s : A n algorithm is used to find the p i x e l s corresponding to the ball in the image obtained. The information which isused in order to achieve this is the size and shape of the ball. After this stage,we have as output the x and y co-ordinates of the ball in each image. b) Geometric Algorithm: The data of and co-ordinates from each camera iso b t a i n e d b y t h e G e o m e t r i c A l g o r i t h m w h i c h i s a t w o r k i n s i d e t h e H AWKEY E s ys tem. Now, kn owing th e exact pos it ions o f the cameras i nspace , and the and co-ordinates of the ball in more than one of the imagestaken by these cameras, one can determine accurately the position of the ball

3. Putting frames at various times together: Now we have the exact position of the ball in 3D space at a given instant of time. Next, what needs to be done is putting together this data, collected atvarious time instants into a single picture which shows us the trajectory of the ball. We can split this part of the process into two parts. (1) Tracking the ball at various instants : Suppose the images are taken bycameras at times during the play of a single ball. Doing the computation asdescribed above at each time t i :0<=i<=n instant , we will get n points, sayfo r .(x i, y i, z i ) fo r 0< =i <=n. With these points plotted in the 3D space, whenlooked at in their proper sequence, these points tell us about the path followed by the ball. (2) Predicting the flight or trajectory of the ball: W e h a v e p o i n t s i n s p a c e w h i c h w e k n o w

represent the position of the ball at some particular time instants, which areals o kn own. Now,there is a s tandard tec hn ique,us e d i n Co mpute r Ai ded Geometric Design which can be invoked here. This allows us to draw as goodan approximation as required to the original curve, passing through the given p o i n t s 2 . T h i s t e c h n i q u e g i v e s u s a c u r v e which is continuous and

differentiable, meaning it is smooth all along, starting at the first point endingat the last point among our points. This predicts the trajectory or flight of ball. Hawkeye innovations Cricket Ha wk -E ye ha s b ecom e a res i dent fea ture of cri cket broad cas ts acro ss t h eg l ob e. Alt ho ugh n o w famil iar to cri cket fa ns fro m all ar ou nd th e world,Hawk-Eye continually expands its arsenal of statistical features and seeks toincorporate slick new aspects to complement the mainstays of its televisionoutput. Examples of Hawk-Eye statistics include:1.Wagon Wheels : The singles, 2s, 3s, 4s and 6s that makeu p qu i ck -fi re 50s or vital cen turi es arer epres en ted b y th e d ifferent co lou rs

o f the Wagon Wheel, which shows the areaso f t h e f i e l d t h a t t h e b a t s m a n h a s b e e n targeting. Hawk-Eye now has the abilityt o d i s p l a y w a g o n w h e e l s o v e r p h o t o realistic or virtual realistic backgrounds,giving broadcasters even more scope totaylor the Hawk-Eye 'look' towards thestyle of their production.

2. Pitch Maps: Simple yet effective; Pitch Maps makea us efu l pa us e for refl ection after thefrenetic exchanges of the opening oversand highlight a bowlers consistency or expensiveness, line and length. Hawk-Eye can now display comparative Pitch Maps in a split screen format, as shownin the example to the right.

3. despin: Ha wk -E ye D eSp in Graph icsd e m o n s t r a t e h o w f a r a d e l i v e r y h a s deviated after pitching. Whilst the bluetra jecto r y bel ow repr es en ts a bal l thatd oes n ot s pi n or s eam, t he red a ct ua ldelivery shows just how much turn thespinner has achieved. 4. Railcam: Th e Rai lCam (s i de vi ew) sh o t of t heV R W o r l d c a n be used to representd i f f e r e nc e s i n s pe e d , b o u n c e a n d delivery. The trajectories are animated,w h i l s t t h e s p e e d s p r o v i d e f u r t h e r e v i d e n c e o f a b o w l e r s v a r i a t i o n o r a telling comparison between athletes. 5. Beehives:

Beehives show where the ball has passed the batsman. As with the Pitch Map,the coloured balls correspond to the number of runs that the batsman hasa chi eved from tha t del iver y. Ha wk -E ye Beeh ives can now be s hownaga ins t a ph o to rea lis tic or vir tua l rea li sti c world, as with th e Wa go n Wheel feature.

Black dots

Tennis

The Hawk-Eye Officiating System is the first and only ball-tracking system tohave passed stringent ITF testing measures. It is accurate, reliable and practical. N o t o n l y i s t h e H a w k - E y e O f f i c i a t i n g S ys t e m v i t a l f o r ensuring that high pressure points do not fall prey to umpiring mistakes,it brings the fans closer to the action. Spectators watch alongside their heroes and heroines on court as HawkEye shows whether a ball wasin or out on stadia big . Snooker: Hawk-Eyes most recent development has brought the company into the worldof snooker.Animated shots

Applications Cricket: HAWKEYE has had far-reaching consequences in many sports. Its major usein cricket broadcasting is in analysing leg before wicket decisions,where the likely path of the ball can be projected forward, through the batsman 's legs, see if it wouldhave hit the stumps .D u e t o i t s r e a l t i m e c o v e r a g e o f bowl ing sp eed, the s ys tems area l s o u s e d t o s h o w

d e l i v e r y patterns of bowler's behaviour such as line and length, or swing/turninformation. At the end of an over, all six deliveries are often shownsimultaneously to show a bowler's variations, such as slower deliveries, bouncers and leg-cutters. A complete record of a bowler can also be

s h c o m a

o u t

w r c

n s e h

v e o f

r a

Bats me n a ls o bene fi t fr om the anal ys is of Ha wk -Eye, as a reco rd can be brought up o f the deli ve ri es batsmen sco red f rom. The se are oftenshown as a 2-D silhouetted figure of a batter and colour-coded dots of th e b al ls fac ed by the batsman. Informat io n s uch as the exa ct spotwhere the ball pitches or speed of the ball from the bowler's hand (togauge batsman reaction time) can also help in post-match analysis.

Tennis

n tennis Hawk-Eye generates theimpact of the ball whether the ballis IN or OUT. A grea t d eal of s o f t w a r e e x p e r t i s e h a d b e e n expended on improving our VirtualR e a l i t y ' l o o k ' i n 2 0 0 7 , mea n i n g Ha w k -E ye can tell evenm o r e o f t h e s t a t i s t i c a l s t o r i e s relevant to the match in hand. Snooker: This technology is useful in casesw h e r e t h e c u e b a l l t o u c h e s t h e s p e c i f i e d b a l l f i r s t o r a n y o t h e r ball.The Hawk-Eye Snooker Softwareo ffers a wide ran ge of op ti ons

to e n h a n c e t h e T V s p e c t a t o r s viewing experience. Doubts Hawkeye is now familiar to sport fansaround the world for the views

it brings into sports like cricket and tennis. A l t h o u g h t h i s n e w technology has for the most part been embraced, it has been recentlycriticised by some, particularly some specific, high profile calls. Somecommentators have criticized the system's 3.6mm statistical margin of e r r o r a s t o o l a r g e . O t h e r s have noted that while 3.6mm i s extraordinarily accurate, this margin of error is only for the witnessedtrajectory of the ball. Its use in broadcasts to predict the trajectory of a bal l ha d it no t hi t a batsma n is l ess cer ta in, es pecia ll y in s itua t io ns where the conditions of the turf

would affect its future trajectory, i.e.where the ball is headed to the ground or has only a short hop beforehitting the batsman. Currently, the system is not used officially in suchcircumstances, though it is used in television broadcasts and analysis. Everyone thought that this LBW was NOT OUT despite it justhitting the stumps Further developments

On June 14, 2006, the Wisden Group bought the Hawk-Eye technology. Theacquisition is intended to strengthen Wisden's presence in cricket, andall ow it t o en ter ten n is and other i nt ernat ional s po rt s. Ha wk -E ye isalready working on implementing a system for basketball . The Football Association has declared the system as "ready for inspection by FIFA ", after tests suggested that the results of a goal-line incident could b e r ela ye d to t h e ma t c h r ef er e e wi t h i n ha l f -a -s ec o nd ( IFAB , t h e govern in g b od y for t he La ws o f t h e g am e

, i n s i s t s o n g o a l s b e i n g signalled immediately e.g. within five seconds).T h e u s e o f t h e H a w k - E y e b r a n d a n d sim ula tion has been licensed to Codemasters for use in the video gam e Brian Lara International Cricket 2005 to make the game appear more like television coverage,and subsequently in Brian Lara International Cricket 2007 , Ashes Cricket 2009 and International Cricket 2010 . A similar version of thes ys tem has sin ce been in corpo rated int o th e Xbo x 360 vers io n o f Smash Court Tennis 3 , but it is not present in the PSP version of thegam e, alt hough it d oes feat ur e a no rmal chal len ge o f t h e ba ll wh ichdoes not use the Hawk-Eye feature.

On June 14, 2006, the Wisden Group bought the Hawk-Eye technology. Theacquisition is intended to strengthen Wisden's presence in cricket, andall ow it t o en ter ten n is and other i nt ernat ional s po rt s. Ha wk -E ye isalready working on implementing a system for basketball

. The Football Association has declared the system as "ready for inspection by FIFA ", after tests suggested that the results of a goal-line incident could b e r ela ye d to t h e ma t c h r ef er e e wi t h i n ha l f -a -s ec o nd ( IFAB , t h e govern in g b od y for t he La ws o f t h e g am e , i n s i s t s o n g o a l s b e i n g signalled immediately e.g. within five seconds).T h e u s e o f t h e H a w k - E y e b r a n d a n d sim ula tion has been licensed to Codemasters for use in the video gam e Brian Lara International Cricket 2005 to make the game appear more like television coverage,and subsequently in Brian Lara International Cricket 2007 , Ashes Cricket 2009 and International Cricket 2010 . A similar version of thes ys tem has sin ce been in corpo rated int o th e Xbox 360 vers io n o f Smash Court Tennis 3 , but it is not present in the PSP version of thegam e, al thoug h it d oes feat ur e a no rmal chal len ge o f t h e ba ll wh ichdoes not use the Hawk-Eye feature.

Conclusion We have looked at various aspects of the HAWKEYE technology. Initially,we outlined the main problems which one could encounter while trying toimplem ent su ch a s ys t em for a s po rt like cricket. Then, we l oo k ed in to th ed e t a i l s o f each step of the process which finally gives us the w o n d e r f u l looking graphics that we see on TV during cricket analysis shows. We got afair understanding of the algorithms and mathematics which goes into thesystem. With the help of examples, we looked at the applications which thetechnology finds in modern day sport, with cricket being our main focus. Wegot an understanding of how the graphics can be produced, using the setup,which also was described in detail.We ha ve thus seen tha t the HA WKEY E is a grea t innova ti o n, wh ich puts technology to good use in the field of sports. The technology is used widelythese days, in sports such as Tennis and Cricket. The accuracy which can beachieved with the use of the system is making the authorities think seriouslyabout reducing the human error component involved in important decisions.As t h e s ys tem runs in real t ime, there is no ext ra time required t o s ee the visualizations and graphics.The system is also a great tool which can be used by players, statisticians,tacticians, coaches to analyze previous games and come up with strategies for subsequent ones.

Bibliography www.hawkeyeinnovations.co.uk www.therulesofcricket.co.uk How the hawk-eye works in cricket by Tim Harry

www.topendsports.com

Contents TITLE PAGE NOIntoduction 1Hawkeye-a general overview 23History 4How does hawkeye works? 5Principle 6Technology 79Hawkeye innovations 10-12Applications 13-14Doubts 15Further Developments 16Conclusion 17Bibliography 18

Acknowledgement Man y peop le have contributed to th e s uccess of t h i s . A l t h o u g h a s i n g l e sentence hardly suffices, I would like to thank Almighty God for blessing uswith H is g race. I ex tend m y s in cere an d h eart fel t tha nk s to Mr. ALOK BASU, H ead of D epartm ent, Comp ut er Scien ce and Engi neering, for providing us the right ambience for carrying out this work. I sincerely expressmy gratitude to Mr. Paul hawkins , without his tutorials and articles thisreport wouldnt have been completed .I express my immense pleasure and thankfulness to all the teachers and staff o f th e D epa rtmen t o f Com pu t er Sci ence an d Eng in eering, SIT for their cooperation and support.Last but not the least, I thank all others, and especially my friends who inone way or another helped me in the successful completion of this work.