US008615493B2

(12) United States Patent

Prahlad et a1.

(54)

US 8,615,493 B2

(10) Patent N0.:

(45) Date of Patent:

DATA MINING SYSTEMS AND METHODS

FOR HETEROGENEOUS DATA SOURCES

(56)

Dec. 24, 2013

References Cited
U.S. PATENT DOCUMENTS

(75)

Inventors: Anand Prahlad, East Brunswick, NJ

4,084,231 A

(US); Parag Gokhale, Marlboro, NJ

4,267,568 A
4,283,787 A

(US); Rajiv Kottomtharayil, Marlboro,

4,417,321 A
4,641,274 A

NJ (US); Jun Lu, Tinton Falls, NJ (US);

Rahul S. PaWar, Marlboro, NJ (US)

4/1978
5/1981
8/1981
11/1983
2/1987

CapoZZi et a1.
Dechant et al.
Chambers

Chang et al.
Swank

(Continued)

(73) Assignee: CommVault Systems, Inc., Oceanport,

FOREIGN PATENT DOCUMENTS

NJ (US)
Notice:

Subject to any disclaimer, the term of this

patent is extended or adjusted under 35

AU
CA

2004227949
2498174

10/2004
3/2004

(Continued)
OTHER PUBLICATIONS

USC 154(b) by 0 days.

Arneson, Mass Storage Archiving in Network Environments IEEE,

(21) Appl. N0.: 13/615,357

(22) Filed:

1998, pp. 45-50.

(Continued)

Sep. 13, 2012

(65)

Primary Examiner * Angelica Ruiz

(74) Attorney, Agent, or Firm * Knobbe Martens Olson &

Prior Publication Data

Bear LLP

US 2013/0006945 A1

Jan. 3, 2013

(57)
ABSTRACT
Systems and methods integrate disparate backup devices with
Related US. Application Data

(63)
(60)

a uni?ed interface. In certain examples, a management con

Continuation of application No. 12/750,009, ?led on

Mar. 30, 2010, now Pat. No. 8,315,981.
Provisional application No. 61/165,095, ?led on Mar.

31, 2009.

(51)
(52)

disparate client devices. The uni?ed single platform and inter

face reduces the need for multiple data management products

(2006.01)
(2006.01)

and/or customized data utilities for each individual client

device and provides a single pane of glass view into data

US. Cl.
USPC ......... .. 707/640; 707/641; 707/644; 707/652;

711/161; 711/162

(58)

can display a hierarchical view the client devices and/ or their

data and can further provide utilities for processing the vari
ous data formats. A data structure including ?elds for storing
both metadata common to the client device data and value
added metadata can be used to mine or process the data of the

Int. Cl.

G06F 7/00
G06F 17/00

sole manages data from various backup devices, while retain

ing such data in its native format. The management console

management operations. Integrating the various types of stor

age formats and media allows a user to retain existing storage

infrastructures and further facilitates scaling to meet long

term management needs.

Field of Classi?cation Search

None

See application ?le for complete search history.

12 Claims, 20 Drawing Sheets

I040

MED" '_'
DEVICE
V

//00
my

CLIENT A

CONNECTOR A

NORMALIZED DATA

smucrums)
[0;

I050

//Zb-\V

DEVICE

CLIENT E

H
I04:

A
IIZG\V

m
DEVICE

MANAGEMENT
DATABASE

CONNECTOR B \

CLIENT C

a
CONNECTOR C

INFORMATION
MANAGEMENT
CONSOLE

SECONDARY

STORAGE
I06
A

//Z/7\V
DEVICE ~
V

USER INTERFACE

CLIENT N

CONNECTOR N

US 8,615,493 B2
Page 2

(56)

References Cited

7,802,067
7,809,914
7,904,428
8,315,981
8,352,432

U.S. PATENT DOCUMENTS

4,654,819
4,686,620
4,912,637
4,995,035
5,005,122
5,093,912
5,133,065
5,193,154
5,212,772
5,226,157
5,239,647
5,241,668
5,241,670
5,276,860
5,276,867
5,287,500
5,301,286
5,321,816
5,347,653
5,410,700
5,420,996
5,454,099
5,559,991
5,642,496
6,418,478
6,542,972
6,658,436
6,721,767
6,760,723
6,792,466
6,901,403
7,003,641
7,035,880
7,130,970
7,162,496
7,174,433
7,209,972
7,246,207
7,315,923
7,315,924
7,380,072
7,389,311
7,395,282
7,401,154
7,409,509
7,412,518
7,440,982
7,447,692
7,454,569
7,484,054
7,490,207
7,500,053
7,526,202
7,536,291
7,543,125
7,546,323
7,546,324
7,581,077
7,603,386
7,606,844
7,613,748
7,613,752
7,617,253
7,617,262
7,620,710
7,636,743
7,651,593
7,657,550
7,660,807
7,739,459
7,747,579
7,757,043
7,769,961
7,801,864

>

3/1987
8/1987
3/1990
2/1991
4/1991
3/1992
7/1992
3/1993
5/1993
7/1993
8/1993
8/1993
8/1993
1/1994
1/1994
2/1994
4/1994
6/1994
9/1994
4/1995
5/1995
9/1995
9/1996
6/1997
7/2002
4/2003
12/2003
4/2004
7/2004
9/2004
5/2005
2/2006
4/2006
10/2006
1/2007
2/2007
4/2007
7/2007
1/2008
1/2008
5/2008
6/2008
7/2008
7/2008
8/2008
8/2008
10/2008
11/2008
11/2008
1/2009
2/2009
3/2009
4/2009
5/2009
6/2009
6/2009
6/2009
8/2009
10/2009
10/2009
11/2009
11/2009
11/2009
11/2009
11/2009
12/2009
1/2010
2/2010
2/2010
6/2010
6/2010
7/2010
8/2010
9/2010

Stif?er et al.

B2

B2
B2
B2
B2

9/2010
10/2010
3/2011
11/2012
1/2013

Ng

2002/0174098 A1

Sheedy et al.

2003/0046313 A1*

3/2003

Cole et al.
Grif?n et al.

2004/0002944 A1 *

1/2004

2004/0234263
2005/0066118
2006/0123189
2006/0230244
2006/ 0242489

Dong et al.
Cheffetz et al.

Kitajima et al.
Masters
Nakano et al.

A1
A1
A1
A1
A1

2007/ 0143371 A1
2007/0299828 A1*

Anglin et al.
Eastridge et al.
Eastridge et al.
Fortier et al.

Stoppani, Jr.
Raj ani
Fecteau et al.

Myers et al.

11/2004
3/2005
6/2006
10/2006
10/2006

Leung et al. ................ .. 707/204

Hauser et al. ................... .. 707/1

Ovadia et al.
Perry et al.
Bitner et al.
Amarendran et al.
Brockway et al.

6/2007 Kottomtharayil
12/2007

Lewis et al. ..................... .. 707/3

2008/0307000 A1

12/2008 Paterson et al.

2009/0282203
2010/0179940
2010/0274825
2010/0332561
2010/0332990

Aoyagi

11/2002 Wu et al.

6/2008 Phillips et al.

9/2008 Kavuri et al.

2009/0234823 A1 *

Rogan et al.
Flynn et al.

Kottomtharayil et al.
Perry et al.
Prahlad et al.
Prahlad et al.

2008/0133624 A1
2008/0228785 A1
2009/0019367 A1
2009/0031255 A1

Kenley et al.

Prahlad et al.

A1
A1
A1
A1
A1

1/2009 Cavagnari et al.

1/2009 Kidd
9/2009

11/2009
7/2010
10/2010
12/2010
12/2010

Wong .............................. .. 707/4

Haustein et al.
Gilder et al.
Nemoto et al.
Prahlad et al.
Prahlad et al.

FOREIGN PATENT DOCUMENTS

Ignatius et al.
Ignatius et al.
Oshinsky et al.
De Meno et al.

Oshinsky et al.
Saulpaugh et al.
Bataet al. ........................... ..

Prahlad et al.
Crescenti et al.

Devassy et al.
Amarendran et al.

Kottomtharayil et al.
Ignatius et al.
Kottomtharayil et al.
Retnamma et al.
Prahlad et al.

Kottomtharayil et al.
Crescenti et al.
Crescenti et al.

Ignatius et al.
Devassy et al.
Duigou et al.
Lu et al.

Oshinsky et al.
Kavuri et al.

Kottomtharayil et al.
Amarendran et al.
Kavuri et al.
Ovadia et al.
Retnamma et al.
Gokhale
Timmins et al.
Prahlad et al.

Ignatius et al.
Amarendran et al.

Kottomtharayil
Brockway et al.
Prahlad et al.
Prahlad et al.
Prahlad et al.

Kottomtharayil et al.

1/1

DE
DE
EP
EP
EP
EP
EP
EP
EP
EP
EP
EP
EP
EP
GB
GB
GB
GB
GB
IN
IN
IN
JP
JP
MX
W0
W0

69415115
60020978
0259912
0405926
0467546
0645709
0774715
0809184
541281
0899662
0981090
1393181
1204922
1384135
2409553
2410106
2425199
2435756
2447361
226655
234083
234518
4267443
4198050
254554
WO 95/13580
WO 99/12098

8/1999
4/2006
3/1988
1/1991
1/1992
3/1995
5/1997
11/1997
4/1998
3/1999
2/2000
1/2001
5/2002
7/2010
6/2005
7/2005
10/2006
9/2007
9/2008
6/2007
6/2007
7/2009
9/2004
10/2004
2/2008
5/1995
3/1999

OTHER PUBLICATIONS
Cabrera, et al. ADSM: A Multi-Platform, Scalable, Back-up and

Archive Mass Storage System, Digest of Papers, Compcon 95,

Proceedings of the 40th IEEE Computer Society International Con
ference, Mar. 5, 1995-Mar. 9, 1995, pp. 420-427, San Francisco, CA.
Eitel, Backup and Storage Management in Distributed Hetero gener
ous Environments, IEEE, 1994, pp. 124-126.
IBM Technical Disclosure Bulletin, vol. 24, No. 5, Oct. 1981 New

York, US, pp. 2404-2406, K.L. Huff, Data Set Usage Sequence
Number.

Erofeev
Prahlad et al.
Prahlad et al.
Prahlad et al.

Mendel Rosenblum Operating Systems Review (SIGOPS), vol. 25,

No. 5, May 1991, NewYork, US, The Design and Implementation of
a Log-Structured File System, p. 4, paragraph 3.3-p. 5.

Kottomtharayil et al.

029267.

Prahlad et al.
Kavuri et al.

029267 mailed on Oct. 4, 2011.

International Search Report dated Jan. 6, 2010, PCT/US2010/

International Preliminary Report on Patentability in PCT/US2010/

Kottomtharayil et al.
Prahlad et al.

* cited by examiner

US. Patent

Dec. 24, 2013

Sheet 2 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 3 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 4 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 5 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 6 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 7 0f 20

US 8,615,493 B2

2QNI%\QN

US. Patent

Dec. 24, 2013

Sheet 8 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 9 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 10 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 12 0f20

/400
430k

EXCHANGE 1

STORAGE GROUP 1
STORAGE GROUP 2

GALAXY 1

TAPE 1
TAPE 2
TAPE 3

VERITAS 1
TAPE 1

TAPE 2

SHAREPOINT

FIG 4A

US 8,615,493 B2

US. Patent

23H:092G20m232%

Dec. 24, 2013

Sheet 13 0f 20

US 8,615,493 B2

US. Patent

QQ

23H:22m20m232.?

Dec. 24, 2013

Sheet 14 0f 20

US 8,615,493 B2

U S. Patent

E0%@EQ

Dec. 24, 2013

Sheet 15 0f 20

US 8,615,493 B2

US. Patent

Dec. 24, 2013

Sheet 17 0f 20

US 8,615,493 B2

2|
BowG\\

Amv=5o2u.E6o5u %252 @731:2950m-985

583,:2;
n$25.6

US. Patent

Dec. 24, 2013

Sheet 18 0f 20

US 8,615,493 B2

//.500
RECEIVE CONFIGURATION /_505
INFORMATION FOR CLIENT

DEVICE(S)

INSTALL DATA CONNECTOR(S)

/.5/0

> DATA INGESTION

EXTRACT DATA AND/OR METADATA /5/5

FROM CLIENT DEV|CE(S)

I
STORE EXTRACTED INFORMATION /5Z0
IN DATA STRUCTURE

GENERATE AND STORE VALUE- /5Z.5

ADDED METADATA

I
PRESENT UNIFIED VIEW OF DATA /-5-70

ON CLIENT DEVICE(S)

> DATA PREPARATION

MANAGEMENT

RECEIVE INPUT REGARDING DATA /535

MANAGEMENT/MANIPULATION
OPERAT|ON(S)

I
PREPARE DATA FOR REQUESTED /-540
OPERATION

I
PERFORM DATA OPERATION /545
ON DATA

15/61 5