'US009171209B2 2) United States Patent (10 Patent No: US 9,171,209 B2 Townend et a 4s) Date of Patent: Oct. 27, 2015 (54) OVERLAY-BASED ASSET LOCATION AND. 66) References Cited IDENTIFICATION SYSTEM US. PATENT DOCUMENTS (71) Applicants: TYCO ELECTRONICS UK LID. indon, Wilishie (GB). ADC uae erie tes Bee TELECOMMUNICATIONS, INC. Jooworssoo2 ALS 2008 Weert Ba eN Sy Soootae7se7 AL 112009 Blocbnam (72) Inventors: Kevin David Townend, Chester (GB) FOREIGN PATENT DOCUMENIS John Michael Hulse, Gwynedd (GB); Tan Butler, Cheadle (GB); David KR toa0100128441 122010 Thomas, Chester (GB) Wo Wo2oizoisa0 a2 33012 Eden Prairie, MN (US) Joo Polland, (OTHER PUBLICATIONS (73) Assignees: Tyco Eleetronles UK Infrastructure imited, Dorean, Swindon (GB; ADC Iagratonal Search Repot and Writen Opinion for PCT/US2013 ‘Telecommunications, Ine., Berwyn, PA 927654 mile Jn, 14. 2013. ws) European Search Repo for plisation No. 137522082 msi 30.2015, (4). Notice Subject to any diselaimer, the term of this patent is extendod or adjusted undor 35 * cited by examiner USC. 1S4(b) by 254 days, (21) Appl. Nos 13775798 Primary Examiner — Shelli Goradia (74) Attornes, Agent, or Firm — Merchant & Gould, PC Filed: Feb. 28,2013, Prior Publication Data on ABSTRACT US 2013022368441 Aug. 29,2013, A network asset location system and methods of is use and ‘operation are disclosed, In one aspect, the nctwork asset Related US. Application Data location system includes a mobile application component executable on a mobile device including a camera and a (60) Provisional application No. 61/602,414, fled on Feb. splay, the mobile application component configured 10 33,2012. receive image data from the eamera and display an image on oceee eee anasset management racking engine congue oreo i) theme dts and gence the over information inetd 2013.01) ore nctwork assets within the image. GO6K 9100624; GO6Q 10/08 See application file for complete search history. 23 Claims, 10 Drawing SI ttUS 9,171,209 B2 Sheet 1 of 10 Oct. 27, 2015 US. Patent Aaipes quowazeuew, someon T analy Ayes yessy OMENU.S. Patent Oct. 27, 2015 Sheet 2 of 10 US 9,171,209 B2 108 Network Asset Tracking Engine and Database Asset Identifier Database Image Analysis 204 Rack Code: 0001 Equipment: [list] Rack 1: Network Configuration Port 1: Location, Connections, 206 Attributes Overlay Generation 2 Rack 2 = 202 Figure 2U.S. Patent Oct. 27, 2015 Sheet 3 of 10 US 9,171,209 B2 306 — 302 302 }— 302 J 304 306 Figure 3U.S. Patent Oct. 27, 2015 Sheet 4 of 10 US 9,171,209 B2 Figure 4US. Patent 402a 4026 402¢ 402d 306 Oct. 27,2015 Sheet 5 of 10 Rack 1D: 0001 Device Type — — — — Port ID 24: Move Connection to Port ID 36 Figure 5 US 9,171,209 B2US 9,171,209 B2 Sheet 6 of 10 Oct. 27, 2015 U.S, Patent g aunsi4 ee: ee 7000 aueg Buryayms oe ees ee suuely ‘3BdAL aanag 908 pzov 2t0v qzov ezorUS 9,171,209 B2 Sheet 7 of 10 Oct. 27, 2015 U.S, Patent Z an3i4 2000 [aued 0} sj99UU0) Str-ry sadAL ST Mod zy oz0r qzov ezovUS. Patent — 302 -— 802 Oct. 27,2015 Sheet 8 of 10 304 es 3 Vv US 9,171,209 B2 Figure 8U.S. Patent Oct. 27, 2015 Sheet 9 of 10 US 9,171,209 B2 Capture Image Data p— 902 Yv ‘Transmit Image Data to Remote Asset Management| -— 904 ¥v -— 906 Receive Overlay Data v — 908 Display Image with Overlay Y Receive Technician Feedback y— 910 ——_—_1____ Transmit Technician y— 912 Feedback to Remote Asset a Management 300 Figure 9U.S. Patent Oct. 27, 2015 Sheet 10 of 10 US 9,171,209 B2 Receive Image Data | Identify Asset By Identifiers p— 1002 y— 1004 y Locate Portion of Asset of Interest y— 1006 y Determine Action to be Taken y— 1008 ¥ Generate Overlay Information y— 1010 ¥ Provide Overlay Information y— 1012 y Receive Action Confirmation p—1014 1000 Figure 10US 9,171,209 B2 1 (OVERLAY-BASED ASSET LOCATION AND IDENTIFICATION SYSTEM (CROSS-REFERENCE TO RELATED "APPLICATIONS, The prevent application claims priority from U.S. Provi- sional Patent Application No, 61/602,414, fled on Feb, 23, 2012, the disclosure of whieh is hereby incorporated by re ‘erence in its entirety ‘TECHNOLOGICAL FIELD ‘The present disclosure relates generally o a system for determining locations of network assets, such as network ‘connections. In particular, the present disclosure relates ‘overlay-hased asset location and identification system, BACKGROUND Large-scale networks and facilities typically nlude assess ‘ofa variety oftypes which are placed at a variety of locations. * For example, a network that is maintained by a telecommu- nations provider or facility may include networking equip- ment, such as patch panels, routers, or other networking ‘equipment, in single rack, in different racks, and across «different roms, buildings, o other locations. Fach ofthese network assets may in tun also inelude other assets, sch as available or occupied network jacks or other network connee= tions useable to route signals among network devices. Often, «technician is required t service network assets, for example by configuring network connections ata feld Jocation. Often, that servicing requires the technician to dis- ‘connect and reconnect networking cables, of o otherwise Jocate, identify and service specific network jack locations or other network assets, When a technician modifies a configu ration of equipment (ee, patch panels) in data centers or spliter nodes in outside environments, itis important 10 ‘ensure that the technician has located the correct piece of ‘equipment, IF the technician idenifles the wrong asset for ‘configuration, oF does not know howto modify the asset a5 needed, costly mistakes can happen. Currently, technicians are required to rely on labeling of network assets, and must comelate those networking loca- tions to chunge networking configurations, or 10 otherwise service network assets. When relying on such labeling, itis rot uncommon for the technician to incorrectly configure network assets, for example by inserting a plug into the ineor rect jack of patch panel, thereby providing erroneous route ‘ng, an! resulting in such costly mistakes. In other types of facilities or circumstances where loca tions of components of a system are geterally constant bi of ‘a high number, similar challenges apply. For example, when, servicing a vehicle o other types of electronic or mechanical ‘equipment having a lange number of possible components that are required to be accessed and adjusted itcan be diliclt to datermine which component are interconnected and what ‘elecizical components (¢.,fses, breakers, et.) ae aoc ‘ated with different electecal and/or mechanical subsystems. Accordingly, improvements in tracking of assets, includ ing racks, panels and even networking connections are dest= able 0 o 2 SUMMARY, Inaecordance withthe following disclosure, the above and oer issues are addressed by the folowing: Tina first aspect an asset location system includes a mobile application component exccviableon a mobile device include ing aeamera and a display the mobile application component configured to reesive image data from the eameraand display ‘an mage onthe display based on the image data and overlay nformation identifying one or more assets identifiable inthe mage data. The asset location system also includes an asset ‘management tacking engine configured to receive the image data and generate the overay information inchuding an iden- tilfcaion of location of at least one af theone or more assets within the image. In a second aspect, a network asset Jocation system includes mobile application component executable on mobile deviee including a camera and a display. The mobile application eomponeat is configured to receive image data ‘rom the camera and display an image on the display ident- ‘ving one or more network assets identifiable inthe image data. The nctwork asset location system includes a plurality of identifiers associated with the one or more network asels ‘each positioned ata known location relative each ofthe pli- rity of identifiers. The nework asset locaton system also includes an asset management tracking engine configured 10 receive the image data and generate the overlay information ‘including an identification ofa locaton of at least one ofthe fone or more network assets within the image TInatiedaspect, amethod of determining an asset location ‘sing an application executing on a mobile device having & ‘eamora and a display is dislosed. The method includes cap- ‘uring image dats of «network asset using the camera ofthe ‘mobile device, the image daa including information regard- ing a plurality of identifiers associated with the network asset and positioned at @ predetermined location relative to the network asset. The method also includes displaying an image including overlay information dentitying the network asset and location of the network asset within the image ‘Ina fourth aspect, method of determining an asset loca tion using a network asset management engine is disclosed ‘The method inchudes rociving image data including image datarelating toa network asst, the image data aso including information regarding plurality of identifiers associated with the network asset and positioned at a predetermined Jocation relative to the network asset, The method also includes determining an identity ofthe network asset based at Jeast in parton recognition of the plurality of identifiers and a relative postion of the network asset relative tothe plurality ‘of identifiers in the image data, The method further includes szenerating overiay information identifying a location and an ‘entity ofthe network assc in he image dat, BRIEF DESCRIPTION OP THE DRAWINGS. FIG. Lillustates an example network asset location system sed in conjunction witha distributed networking system in ‘aspects of the network asset location system oF the present disclosure can be irnplemented, FIG, 2 illustrates an example logical block diagram of 3 network asst tracking engine useable within a network asset locaton system, according to possible embodiment of the present disclosure; FIG. 3 is a schematic diagram illustating an example arrangement for tracking network assets, according toa pos sible embodiment ofthe present disclosure;US 9,171,209 B2 3 FIG. 4 isa schematie diagram illustrating an example dis play ona mobile device illustrating the tacked network asset, ‘aeconting o possible embodimentof the present disclosure! IG. Sis schematic diagram illstratng an example diss play ona mobile device illustrating the racked network asset and an overlay provided basedon identification ofthe racked network assel, according 10 @ possible embodiment of the present disclosure, TIG, 6a schematic diagram illustrating an example dis play ona mobile device illustrating the tracked network asset ‘and an overlay that provides asset ideatfiation information displayable to a ser. according ta possible embodiment of the present disclosure; TIG, Tis a schematic diagram illustrating an example dis: play on a mobile device illsiating asset detail information ‘ond possible embadiment of the present eisclosure: FIG. 9 flowchart of methods and systems for eacking network assets using a mobile device according toa possible ‘embodiment ofthe present disclosure: and IG. 10 flowchart of methods ad systems for trocking network assets using a mobile deve and/or a network assert trucking engine and database remote om the mobile device, acconting fo further possible embodiment of the present disclosure, DETAILED DESCRIPTION Various embodiments of the present invention will be described in detail with reference to the drawings, where like reference numerals represent like parts and assemblies throughout the sever views, Reference to various embodi- ments does not limit the scope of the invention, which is Jimited only by the scope ofthe claims attached hereto. Addi tionally, any examples set forth in this specification are not ‘intended o be limiting and merely st forth some of te many possible embosiments forthe claimed invention Tn general, the present disclosure relates toa network asst location system that can be used to identify asses 0 toch- ician user In certain embodiments, the present disclosure ‘describes a application operating on a mobile device having, ‘camera and a display, and ean capture image information (ea. video information), and overlay an identification of 2 particular aset of interest on that video data when displayed ‘onthe display. For example, i the asset of interest isa net work asset, the overlay information could be used to identify tothe technician a correct network aset (eg, a network jack cr other connectivity clement, panel, or portion of a panel network Switeh, subrack, network blade or rack) to be ser= vied. In other embodiments, any of a varity of dierent ‘lecrial or mechanical systems could be identified. In some ‘embosdiments, that user can se this overlay information using ‘realtime, overiay-augmented display Referring now to FIG. 4, an example network asset loca tion system 100 used in conjunetion witha distributed nel- working system is shown, in which aspects of the network ssa location syste o the present disclosure can be imple- ‘mented. The network asset lation system 100 can include, jin the embodiment shown a mobile device 102 on which @ mobile application component resides, and whieh can ‘execute the mobile application component, The mobile ‘device 102 can be, in various embodiments, aay mobile device inclding a camera 103 and a display 104, such as 3 ‘smartphone or tablet computing system, The mobile appli 0 o 4 ‘ion component includes program instretions executable on themobile device 102, ands configured to receive image data ‘rom the camera 103 and display am image on the display 104 of the captured image. In the embodiment showa, the mobile device 102 can be vwsed at a network asset facility 105, which is generally a location where networking equipment is. stored. In the embodiment shown, the network asset fixity 105 ean be a {ata center or other ouside plant application, and can inelude plurality ofpieces of networking equipment 106, which can, in various applications, include pateh panes, data center racks, servers, or other networking equipment. Inthe context ofthe present disclosure, any piece of networking equipment fr access point provided by such equipment (ep. telecom- ‘munications jacks made available on such patch panels oF routers, fiberoptic connections, or other physical newwork access connections) are considered “network assets” which can be configured and provide network data access to stb- seriber endpoints ina data network In the embodiment shown, a plurality of pateh panels 106.0-care shown, each of which has a plurality of telecom munications jacks. In accordance with the present disclosure each ofthe patch panels 106a-, or each telecommunications jack, or both, could comrespond toa network asset. The patch panels are, in the embodiment shown, inelided within aa ‘overall network 107, which isthe nonvork administered and ‘maintained by the techniian using the network asset location system 100 of the present disclosure Tn eran embodiments, and as discussed in further detail blow in connection with FIGS. 38, groups of assets (©. patch panels within a particular rack or other deviee) ean be ssocinted with plurality of identifiers. such that locations oF ‘assesthatmay/be dificult to correctly deat (eg, telecom ‘munications jacks) ca be located by triangulation or other relative location calculation procedures. In particular tembodiments, the various network assets ean include, for example, managed path panels, suchasare deseribed in US. Provisional Patent Application No. 61/706, 460, filed on Sep 27, 2012, and entitled “Mobile Application for Assisting a ‘Technician in Carrying Out an Flectronic Work Order” the isclosure of which is hereby incorporated by reference ints centre, ‘The network asset location system 100 also ineludes, inthe ‘embodiment shown, an asset management irocking engine 108. The asset management teacking engine ean, in eerain ‘embodiments, reside within a memory of the mobile device 102; in altemative embodiments, the asset management ‘rocking engine 108 can reside nt a remote location from the mobile device 102, such as on a server 110 at a network ‘management facility 112. In such embodiments, the mobile device 102 can be configured with a data connection to the server 10, or example via anetwork 114 (which ean include, the Internet, as well as any of a numberof different types of ‘wireless data networks, such as GSA, SMS, GPRS, EDGE, CDMA, WiFi, WiMax, or LTE nesworks). In some embod ments, data andor analysis components ofthe asset manage- ‘ment racking engine 18 (as illustrated inthe example shown in FIG. 2) ean be stored at one or both locations (i.e eter at a server 110 oron a mobile device 102). FIG. 2 illustrates an example logical block diagram of 3 network asset trucking engine 108 useable within a network asset location system, acconling toa possible embodiment of the present disclosure. The engine 108 generally analyzes ‘mage dita received from a camera, and generates display information that can identify network asses, identify a loca ‘ion of network assets Within an image, and generate aaUS 9,171,209 B2 5 ‘overlay indicating such information to a user by displaying ‘combined image data and overlay information onthe display ‘of the mobile device 102 In the embodiment shown, the network asset tracking ‘engine 108 includes an asst identifier database 202, a8 well, fs an image analysis modale 204, a network configuration madd 206, an overlay generation module 208, and option- ally an setion log 210, The asset identifier database 202 stores information regarding each nctwork asset to be tracked by the network asset location system 100. In the embodiment shown, ‘example records are illustrated in the asset identiller data base; specifically, each asset can have associated with it 9 particular location and properties. The location can be loca- tion relative to an identifier near that asset, as illustrated in Jarer detail below in connection with FIGS. 3-6. The loea- tion can also inciode information about a particular asset location at which the asset can be found. ‘The properties associated with the aset ean include, for example: an asset ‘enter, un asset description (e., telecommunications jack), associated assets (ea patch panel or rack in which the jek is found), and current connections through that asset (eg, whether a particular jack has a plug inserted into that Jack). Although the particular properties may vary by asset or type of asset (eg, a jack, a panel, a rack, a router, ec.) trenerally the records inthe database provide definition of theasset and how to dently tina imageof an overall group ‘ofone or more assets that nay be captured in an image taken, by a camera of a mobile deviee In certain embodiments, as discussed in further detail below, identification of the asset can correspond to an image recognition process relating to both the asset and toa location ‘denier associated with a group of one or more assets that “uniquely define those assets. Examples of such an identifier are discussed in further detail below in connection with FIGS. 38. “The image analysis module 204 analyres image data received from a camera of the mobile device 102, and socesses information in the asset identifier database 202 to ‘defect identifiers in the image data and determine a corre sponding aset identification. The image analysis module 204 ‘can also identify paticuae related asses that are required to be serviced ifthe asset identifiers are not uniquely associated with the asset to be serviced. For example, asset identifiers ay’be placed on a pareulurnesworking equipment rick, ut 4 specific telecommunications jack on a particular panel within hatrack may require service. Accordingly, this related asset othe asset diretly identified by theassetidentifersean be detected by comparison tothe asset idenilers, and based ‘on. Known relative location of that asset tothe asset ident fiers as included in the asset identifier database 202, For ‘example, if three or more identifiers are viewable within the ‘mage, the image analysis module could apply one or more triangulation algorithms to determine the location ofa par ticular network asset. In another embodiment, one or more ‘atures withinan identifier (eg. ifthe identifier inchudesone ‘or more images) can be use to determine relative distance, ‘orientation, and location, using the image analysis module, ‘Other location-based algorithms ae possible as wel, ‘The network configuration module 206 can eptonally be ‘included in the network asset racking engine 108, and i the ‘embodiment shown determines aetions required to be per- formed by a technician, The overlay generation module 208 generates overay information tobe displayed with the image data ona display ofthe mobile device, and can include, fo ‘example! information identifying a particular asset inform tion identifying related assets; information deatiying a pare 0 o 6 ticular action to be taken by a technician (ex. a8 determined by the network configuration module 206), aud other guid- ‘ance as needed for the technician to service the equipment st the network asst ficiiy (e.g, instrctions for configoring the asset) Such information can include, for example, spe- cific steps to be taken to configure a particular asset being identified. For example, infomation ean be generated for elivery to mobile device 102 to instruct a technician to connector disconnect panicular plugor wire froma specific socket or connection, or step-by-step instructions for pro- gramming a programmable panel, replacing a blown fuse or reciting a tipped circuit breaker or olher options. ‘Additionally, the overlay information ean inelude, for cxample, addtional details regarding operation of the par- ticular asset. In the case of network asset such as 9 rack system or stitch, information such as 2 traffic load, power ‘consimption, interal temperature, oF memiary usage eoukd bbe provided in the overlay information as wellasa display of memory usage, available services atthe device ora particular port of the device). Additionally, a numberof ports or jacks Actively in use, or system titlzation, could be displayed. A ‘zencmiized example of such overlay information is ills: trated in FIG. 5, The action log 210 tors received aetions a entered by the technician, based, for example, onthe technician following the guidance provided by the overlay information displayed ‘with the image on the mobile device. For example, the action Jog can store a technician-entered report indicating move- ‘ment ofa telocommunications plug froma first identitied jack toa second identified jack, based on idance grovided inthe ‘overlay. Alternatively, the notion log 210 can store informa- ‘ion basedon other feedback mechani, or example based fn confimation via the network itself that a cannctivity change has beea made (eg. by transaiitinga polling query to the newly-connected por, determining that addtional or dif ‘erent endpoints ean be reachod based on @ changed newwork configuration, or other mechanisms) Referring now to FIGS, 3, example schematic illustra tions of operation ofthe network asset location system 100 is shown, from the perspective of a technician ata particular retwork asset leation (€., ocation 108 of FIG. 1), FIG. 3 js a schematic diagram illustrating an example sarangement for tracking network assets, according toa pos- sible embodiment of the present disclosure, while FIG. 4 illystates an example display 400 of those network assets captured as shown in FIG. 3, as well asa depiction of wian- ulation to determine Toeations and identities of related asses, FIG, 5 llusrates the example display 400 ineluding addtional overlay information as determined using the asset ‘management tricking engine 108. ‘Referring now to FIGS. 34, ia the embodiment shown the ‘technician setivates a mobile application on a mobile device 102 to capture image data regarding w particular network asset. In this example, the technician seapring video image ‘ata oF a telocommunieations rack 300 including a plurality ‘of patch panels 302 and associated telecommunications jocks ‘304; however, in other embodiments, ether types of telecom: ‘munications equipment can be viewed As briefly discussed above, a set of ientifiers 306 are affixed to the telocommunications equipment, and uniquely identify the telecommunicatons equipment. in the embod ‘ment shown, the set of identifiers are placed at predetermined locations on the telecommunieations rack; however, a alte native embodiments, separate identifiers could be used for each of the pateh panels 302 or other network asses "Tn various embodiments, the se of identifiers can uniquely identify the telecommunications equipment that they areUS 9,171,209 B2 1 attached to or otherwise associated with i a number of ways, For example, the identifiers 306 ean be light emiting diodes associated with a switching controller such tht they ae con- figured to emit light representing «bit code that comesponds to an IDof the ack 300, Inaltemative embodiments, the identifiers 306 can be bar ‘odes, QR codes, or images that are unique and associated ‘with particular telecommunications equipment, For example, a paticolar image may have a known scale and orientation relative toan asset; as such, the recognized size and orienta- tion ofthe imsage can be sealed and relative position deter mined wo derive the relative location of an asset o that image. Insillother embodiments, oncormoreliguiderystal displays ‘could be used as an identifier; corresponding. tangeting arrangements could be used in that circumstance as wel Its noted that, in an application associated with elec ‘nunications equipment in datacenters it may be possible that low-light conditions make such image-based identification more difficult. Insuch applications, itmay’beadvisableto use the above-described flashing LED configuration, or an LCD 2 display with adjustable brightness levels. Altematively, 3 ‘constant LED flash light included with a camera of a mobile device cold be used to illuminate image-based identifiers As illustrated in particular in FIG. 4, it is noted that although te identifiers may be sssociated with one particular piece of equipment (ew. ack 300) it may be the case that a technician may need to identity and service a particular tele- ‘communications jack or ether subeomponent of that equip ment. In such cases, a network asset tracking engine 108 storesinformation regarding relative locations ofthe subcom- ponent to the identifiers allowing the nctwork asset tracking ‘engine 108, and in particnar the image analysis module 204, to tiangulate to the subcomponent, thereby identifying the subcomponent that isthe asset nthe embodiment shown, the display 400 of the telecom= ‘munications rack includes plurality of navigation buttons 420d, and additionally inckidesvariowstoseh-sereen fune- tionality useable to both view and provide information about the asset being reviewed. For example, in the embodiment shown, the navigation buttons 402a-d include a device type button 4022, an alarms button 402), a web interface button «402c, anda work orders button 402d. The navigation buttons 402o-d can, in some embodiments, be used in conjunction, With a user selecting a particular piece of identified equip- ment as discussed herein (eg. a ck, pane, or a parcular ‘connection on a panel) to identify. specific information regarding that oquipmest. For example, the device ype bul- ton 402¢ allows the user to obtain aldtional details about 9 scletedl asset, such as ils asset label, the type of equipmest, associated assets (eg, network in which the aset is one nected, oF routing information associated with the asset ‘capacity usage or other information. Ue alas button 4025 ‘ean be used to either display alarms associated withthe par- ticular asset that is selected, or to view al alarms within @ network. The web interface huton 402 can be used tallow the user to log in to a web interface that provides « control pane! forthe selected asset, particularly in the ease ofa panel ‘orrack, toll the wer to view operational parameters (et, ‘workload, temperature, logs te) of the asset, ‘Additionally, the work orders button 402d can be selected to display pending Work cnders, for example work orders sssociated With one of more assets recognized in the image ‘captured by the mobile device 102, of generally within 9 netwark configured tobe tracked by the mobile deve. Pach ‘lecironie work specifies one or more steps that are to be fetied out by a technician at a particlar location. For ‘example, an electronic work onder can indicate that one oF 0 o 8 more connections implemented on a patch panel (e.g, panels 1064a-¢ above)..A menu displayed fllowing selection of the work orders button 4024 eam also allow the user to crete @ ‘work order associated with one or more assets of interest and identified on the display 400, In such embodiments, the user ca, for example, select fist and second ports by captring ‘mages of the equipment including those pors, and tapping fn the ports to receive an idenifcaton therea from server 110. Theusercan then define one or more actions to take with respoct to the equipment (e.g, connecting a cable betwocn specified ports of specified panels, or other ations), which is confirmed atthe server 110, which ean be configured to verify thatthe speifiedconneetion has beenadded, removed, and/or changed comely based on communication withthe assoc ated asset An example work order definition process illus {rated in U.S. patent application Ser. No, 13/683,866, catitled “Intelligent Infrastractre Management User Device”, filed fon Nov. 21,2012, the disclosure of which is hereby incorpo- rated by reference in its entirety. ‘Now referring to FIGS. 8.7, various example user inter- {aces are shown, presented on display 400, for presenting asset and associated overlay information associated with a work order or device identification. As illustrated in FIG. 5 based on the image captured and analyzed, a display 400 of ‘mobile device 192 ean include not only the image ilstrated in FIG. 4, but also overly information $00 identif¥ing one or ‘more assets visible i the image, as well as information sbout those assets, such as service (o be provided: Inthe embeat ‘ment shown, the overiay information S00 identifies a fele- ‘communications jack to which a pug is connected, as well as ‘ second tlecommunications jack tt i intended to receive that plug. Because the identifies 306 are associated with the rack in which the jacks are found, eaci individal jack is ‘ound by triangulation o those locations, as discussed above In the embodiment shown, the overlay information $00 includes information about the asset associated with theiden- ‘ier 306 (i. the rack 300, as showen by “Rack ID: 0001"), and also includes identifying location anda abel for one oF more sub-assets (eg., the telecammunications jacks 304 labeled “Port ID 24° and *Port 1D 36” shown in FIG. 5). ‘These can include, for example, CPID codes foreach asset or subsasset that is tracked. In Some embodiments, the overlay information $00 includes instructions for providing service to the network asses, such as by disconnecting and reconnect- ing network assets. Other types of service or operational information could be desribod in the overay information as well, such as insertion counts, cable length, cable category (ea, Category 5, Category 6, ete) and other types informa tion such at those listed shove. Preferably; the display ofboth image data and overlay data is provided in realtime or acar realtime with captre of the video image data. This will llow the technician o move the mobile device, allow the locations of network assets 10 be ecomputed, and the display’ and overly information updated asthe mobile device changes positon. Inalterative embod- ‘mens, the overlay information and image data can be stil ‘mage data and static overlay information. Other arrange: iments are possible as well ‘Referritig to FIG, 6, inthis example, the display 400 pre- sents tothe user an interface including overlay information 600 that includes labels forthe various types of identified ‘equipment inchided in the illustration. In this example, an ‘overlay label 602 canbe included, ether upon seletion ofthe device type button 4024, or in response to tapping on the splay in a location where the device is displayed, 1o shows the identity ofthe device, including a device type, software version ifapplicable, suehas in the ease of managed panel),US 9,171,209 B2 9 manufactures, manufacture date, and any associated alarms. Ivedditioa, in some embodiments, other information associ- ated with te device can be displayed. For example, in FIG. 7, ‘overly information 700 can include a detailed information| ‘area 702 that displays routing and type information associ ted with the asset being identified. For example, the detailed information area 702 ean display information about routing fom pasel, such as an identifier of another panel to which the current panel is connected, which may not be depicted on the display 400, Additionally. various misconligured or error- state systems ean be highlighted by accessing error reports ‘ored atthe server 110 when generating the overlay infor mation 702, TInsomeexample embodiments the additional information associated with the asset in the detailed information area 702 ‘can include textual or graphical description ofa full outing arrangement inchading the particular asset (eg. connection ‘or panel), fomahost oa swite, froma switch to aswitch or router, or some other type of communicative connection. Tn accordance with the display 400 shown ia FIGS. 4-7 it jis noted that a variety of other types of information could be presented to a user who taps on an asset or one ofthe buttons 402a-d shown onthe display 400, For example, userean tap ‘on a particular asset that i a device to display Warranty {information associated with the device, oro get further infor ‘mation about the panel or blade, or port of sch a deviee, by ‘apping.on the deviceitsel. Adkitonaly, for tchnicians who wish to fulfill work orders, supplemental information can be presented to the user as well, sich as insinctional videos oF ‘diagrams that illostste how to accomplish various routing andor maintenance tasks, Itisalso noted that, although inthe embodiments described herein specific types of information are depicted, a user of 2 mobile device 102 in accordance with the present disclosure ‘can also provide feedback for storage in database 108, for ‘example Work order or asset identification information, For ‘example, a userof a mobile deviee 102 can, in some embod ‘ments, tap on the display to define interconnections between ‘equipment that shoul he made, thereby ereaing one or more ‘work orders for other technicians to execute. Additional, ‘options can exist fora user to select and reset one or more settings of a particular device vis remote control through server 110 athe network management facility Referring now to FIG, 8, an alternative embodiment of an ‘rangement 800 for tracking network asses is shown, The arrangement 800 could be used in place of arrangement 300, but includes different types and arrangements of identifies ‘sed in connection with specific network assets. In particular, ‘nthe embodiment shown, each pateh pane! 302 has anasso- ated set of identifies 802 placed on opposing sides of an aay of connectors 304, whieh can reduce complexity in twiangulating to calculate the position of a particular asset (ea. a jack) when generating overlay information 800, Ia ‘various embodiments, different images 802 can be wed on ‘each panel 302 (or different images can be used on oppewite sides of the same panel), to assist in uniquely identifying @ network aster, Is understood that analogous overlay infor ration to that illustrated in FIG. 5 could be generated for association with the arrangement 800 of FIG. 8, using the ‘mages 802 within the arrangement 800 to detemnine relative Positions of assets, Tn still farther embodiments, one or more adkiional mages could be placed on the pane! 302 or other assets, such that each tricked asset hasan associated unigue image. Por ‘example, separate, unique image eould be located on each panel associated with each connector 304, oF in combination with an LED or bar code arrangement, to enti an asset, 0 o 10 seh that reduced triangulation caleulations would. be required (ie, cach image could be placed ina predetermined ‘or known location relative othe ase), Referring now to FIGS. 9-10, methods of tracking and ‘dentifying network assets are deseribed, using the steveraees nd information descrined above in ennnection with FIGS. 1-6. FIG. 9 isa flowchart of a method 900, as may be pet= formed or implemented using software systems of a mobile device, for tracking network assets using mobile device, ‘cording toa possibleembodiment ofthe present disclosure ‘The methods and systems illustrated in FIG. 9 can be per- ormed using any of a mumber of embodiments ofa nework asset location system as discussed above in connection with FIGS. 16. In the embodiment shown, the method 900 begins with capture of image information (eg, sill or video information) using camera of'a mobile device, suchas mobile device 102 (step 902) The captured image data is then transferred to a network aset tricking engine 108 ethers the mobile device suchas device 102, ora server 110 ata remote location 112 (Gtep 904). The mobile device then receives overlay informa- tion, either generated locally on the mobile device or remotely at the server 110, but in either event generated ‘within the network asset tracking engine 108 (step 906). A splay operation generates a display’of the image including 4 network asset and overlay information highlighting the location and identity ofthe network ass, a6 well as option- ally other information, such as ienties and loeations of ‘other network assets, or actions to be taken by a technician to servi the network asset, sich as is shawn in FIG. 5 (Step 908), In certain embodiments, the method 900 can include scceiving feedback from the technician, for example to log. services or configurations performed by the technician, such embodimenls, a techaician may input into the mobile {device information regarding te specific services provided to the network asset (step 910). In embodiments in which a remote server is used to track such technician activity, the received input from the technician regarding services per ‘ormed ean be communicated tothe server to be logged (step 912), FIG. 10 sa lowichart of @ method 1900 for tracking net- work asses using a mobile device andlor a nctwork assct ‘rocking engine and database remote fom the mobile deve, ‘aocording lo a further posible embodiment of the present sisclosure, The methods in FIG. 10 may be performed oF implemented using software systems of a server, a mobile sevice, or both systems, Tn the embodiment shown, the network asset trucking engine 108 receives image information captured by a mobile evice (step 1002). Ths can oecur, for example, within the ‘mobile deviee, or based on transmission of that image data {rom « mobile device toa sever on which the network asset trocking engine resides. The image analysis module 204 of the netvork asset tracking engine 108 (as shown in FIG. 2) ‘an analyzethe received image data, and dently one or more network assets identifiable within the image data, for example by decoding information communicated by way ofthe asset identifiers associated with a particular asset (step 1004). This can include, for example, decoding abar code QR code, or ‘detecting a code communicated bya stobod LED, as well as recognizing a particular image or images placed in ass0cia- ‘ion withthe asset, Other configurations are possible as wel. ‘A network asset can then be located within the image data, {or example based on triangulation from the identifies that fare identified, and based on information regarding relative positionsof he asset and identifiers as maintained in databaseUS 9,171,209 B2 a 202 (step 1006). An aetion to be taken is determined (step 41008) for example based on pre-programmed indication of necessary service 10 be performed on a panicular network asset, or based on user definition of a new work order that is to be created associated wit the asset, as rceived from the ‘mobile device 102. Overlay information is then generated (step 1010) and provided to the display ofthe mobile device (step 1012), to communicate the identification and loeation oF the nenwork asset othe technician, or to commonicate vai- ‘ous other infomation tothe technician as required for inter- ‘tion with the asset (eg, wareamty, eer, sas, oF inst tional information, as explained above) In embodiments such a those discussed above i which eesack is receive Troma webnicin roaring service aetd- ally performed, the network asset tracking engine 108 can receive feedback information (step 1014), and ean store that Information, for example in action log 210, ‘As illustrated in both FIGS. 9-10, i is noted that once ‘overlay information is provided to 's mobile device, the mobile device may obtain additional image data (eg. duet ‘capture of video data, or a subsequent image). In such an ‘event, the user ofthe mobile device may have changed the location ofthe mobile device, such as by switching its focus moving the device closer to or further from the assets t0 be ‘denied, or other movements. In such instances, the present application provides for continual (or periodic) updating of ‘overlay dat as image data is received fom the mobile device. ‘Asseen in FIG. 9, that method eould restart with a subsequent mage capture (step 902) ater displaying image and overlay ‘data (sep 998). In FIG, 10, adltonal image data could Be received and processed (step 1002 ct seq, fllowing provide ‘ng overlay data from the server (step 1012). Thiscan include, for example, retargeting on adifferent nctwork asset, or eta retin on the same network asset in an image having a di- ferent focus (e., with one or both ofthe asset or identifiers ‘moving within the image). Referring now t0 FIGS. 9-10 generally, in adkiional ‘embodiments, other steps, or different orders of steps, can be Performed hy the mabile device andlor server. Additionally, Dither devices could he used as well for example multiple technicians can simultaneously access a server using differ ‘ent mobile devices, or multiple serves, each of which are configured to provide different services (eg, managing a network asset database, calculating triangulated positions of network assets based on receive ime dats, of other fea- tures), Purthermore and referring now to FIGS. 1-10 generally it Js recognized that although the terms “mobile device” and “server” are used herein, itis recognized that any ofa variety ‘of types of comiputing devices could be used. Generally, the network asl ticking engine is implemented as soltware modules executable on a programmable circuit, soot 3 & microprocessor. The logical operstions of the various ‘embodiments of the disclosure deseribed hercin are imple= mented as: (1) a sequence of computer implemented steps ‘operations, or prosedures running on a programmable circuit Within a computer, and/or 2) a sequence of computer imple- mented steps, operations, oF procedires running on a pro- tumummable circuit within a directory system, database, oF ‘compiler. ‘Through use ofthe systems and methods described herein, reliable identification of specific assets and ations required for configuration of network assets is provided, therehy reducing erronsous connections oF configurations of nel- ‘working equipment andattendant downtime dueto ational ‘maintenance aid correction of network asset configurations that might otherwise be required 0 o 12 The above specification, examples and data provide a com: plete description ofthe mannfacture and use ofthe compos tion ofthe invention. Since many embodiments ofthe inven- tion can be made without departing from the spirit and scope ‘of the invention, the invention resides in the claims hereinal- ter appended, The invention claimed is 1. An asset Jocation system comprising: 4 mobile application component executable on 3 mobile device including 2 camera and a display, the mobile application component configured to receive image dat from the camera and display an image on the display based on the image data and overay information iden llfing one or more network assets identifable in the image data, the one oF more network assets associated ‘with a plurality of ideniirs, the plurality of identifiers uniquely idemifyin the one or more network assets and positioned at predetermined locations relative wo the one for more network assets and ‘anasset management tracking engine confignred to receive the image data and generate the overlay information, the ‘overlay information including an identification of a location ofa least one ofthe one or more assets within the image: ‘wherein the location is determined at leat in part based on 4 predetermined relative position of the asset and the plurality of identifiers 2. The asset location system of claim 1, wherein the phi nity of identifiers inch ight emitting diodes configured to emit a code corresponding to an identification ofthe one or ‘3. Theassetocation system of eam 1, wherein the atleast ‘one of more assets comprise network assets 4. The aset locaton system of claim 3, wherein the iden sifiers uniquely identify a tlecommunications rack holding ‘the one oF more network assets, 'S. The asset location system of elaim 4, wherein theoncof more assots aro selected from the group consisting of: ‘a network connectivity clement patch panel ‘network switchs a subrack ‘network blade; and a rock syste, 6. The asset location system ofelaim 1, whereintheoverlay information further ineudes an identification of the at least ‘one of the one oF more assets. 7. The asset location system ofelaim 6, whereinthe overlay information further includes information describing astateof the at least one ofthe one or more assets 8, The asset location system of claim 7, wherein the infor- ‘mation deseribinga state ofthe atleast one ofthe one or more ‘asses includes information selected from the group consis ing of ‘malic load power consumption internal temperature: memory usage; available services atu particular port or device; ‘numberof ports actively in use: asset types ceror information; ‘warranty information; ‘connection information; and system utilization,US 9,171,209 B2 13 9, The asset location system of claim 1, wherein the asset management tricking engine resides in'a memory of the mobile device. 10. Theassot location system of elaim 1, wherein the assot ‘mangement racking engine esces at a network asset man- agement location emote frm the mobile device. 11. A network asset location system comprising: ‘4 mobile application component exceutable on a mobile device including a camera and a display, the mobile application component configured to receive image dita from the camera and display an image on the display identifying one oF more network assets identifiable in the image data; a plurality of identifiers associated with the one or more ‘network assets, the one oF more network assets each positioned at a known location relative each of the p= ‘ality of identifiers; and. ‘avast management tricking engine configured to receive ‘the image data and generate the overlay information, the ‘overlay information including an ieaification of location of at leastone ofthe one or morenetwark assets ‘within the image and instructions for configuring the at least one ofthe ane or more network acts. 12, The network asset location system of eam 11, wherein theimage onthe display includes overlay informationinchud- ing an identification ofthe one or more network asses. 13. A method of determining information about an asset using an application executing on a mobile device having a ‘camera and a display, the method comprising: ‘capturing image data of anetwork asset using the cameraot ‘the mobile device, the image data including information regarding a plurality of identifiers associated with the network asset and positioned at a predetermined loca tioa relative tothe network asset and lisplaying an image inchuding overlay information identi= fying the network asset and & location of the network asset within the images ‘wherein the overlay information includes instructions for ‘configuring the network asst 14, The method of claim 13, wherein displaying the image ‘occurs concurrently with capturing imagedata ofthe network set. 18. The method of claim 13, wherein the image data com- prises video data © receiving selec 14 16, The method of elsim 13, futher comprising ‘ransittng the image daa (oa network asset management ‘engine remote from the mobile devie: and receiving the overlay information from the nctwork asset ‘management engine 17. The method of claim 13, farther comprising receiving feedback from a user ofthe mobile device indicating 2 med ication to a configuration ofthe network asso 18, The method of claim 13, father comprising, upon ofthe asset by a user, displaying informa- sion deseribing the asset on the display, the information including asset identification information 19, The method of elsim 13, further comprising receiving atthe display instructions defining a work order associated with dae asst. 20. The method of laim 13, wherein the overlay informa- sion includes error information associated with the ase, 21, A method of determining an asset location using a network asset manaemeat engine, the method comprising receiving image data including image data relating to a ‘network set the image datas including information regarding a plurality of identifiers associated with the network asset and positioned at a predetermined loca tion relative to the network asset; dennining an identity of the network asset baked at leas in parton recognition ofthe plurality of identifiers anda relative position ofthe network asset relative othe p= ality of identifiers inthe image data; and generating overlay information ideatf¥ing a location and ‘an identity of the network asset i the image data ‘wherein the overlay information includes instructions for configuring the network asset. 22, The method of claim 21, further comprising transi ting the overlay information for display to @ user. 23, The method of claim 21, wherein the ploralityofiden- tiers are slected fom a group of identifiers consisting of Tight emitting diodes strobing at predetermined rate 0 ‘communicate an identification code, bar codes liquid crystal displays; QR codes: and ‘unique images.