Professional Documents
Culture Documents
Outline of Talk
1. 2. 3. 4.
Motivation for Sensor Fingerprinting Review of Chens Method Independent Testing & Analysis Confidence Weighting to Handle Persistent Edges 5. Experimental Results 6. Future Work
HONEYWELL PROPRIETARY
Advantages/Disadvantages
Quick and easy Easily spoofed
Device-Level Identification
Dead pixels, dark noise Typically corrected in-camera
Photo-response non-uniformity Device specific (PRNU) of cameras sensor Signature space is large Difficult to correct in-camera
HONEYWELL PROPRIETARY
Algorithm proposed by: M. Chen, J. Fridrich, and M. Goljan in Source Digital Camcorder Identification Using Sensor PhotoResponse Non-Uniformity. Proc. of SPIE, January 2007.
HONEYWELL PROPRIETARY
Signature Extraction
Unlike other applications, where Computer Vision methods to abstract away differences between cameras to recognize scene objects (faces, etc.), we now need to abstract away differences between scenes and recognize camera-specific signatures. Input Given an input video, we remove scene content from each frame by applying a de-noising method and subtracting that result from the original. The maximum likelihood estimate of the PRNU signature is:
Noise Scene Content
where Ik is the raw frame, I^ is the de-noised frame, K is the number of k ^ frames, and P is the signature.
HONEYWELL PROPRIETARY
Signature Comparison
1. Compute cross-correlation of signatures at different scales.
Match
Mismatch
Videos from the same camera will have similar PRNU patterns, and their cross-correlation function will appear similar to a delta function. Mismatched videos will have dissimilar PRNU patterns, and the cross-correlation will be a random pattern. 2. Measure the magnitude of the peak using Peak-to-Secondary Ratio (PSR). This is simply the ratio of the heights of the largest and second largest peaks in the cross-correlation. Compare the PSR to a threshold that determines whether the two videos are said to match.
HONEYWELL PROPRIETARY
3.
When available, video data is acquired without compression. All test videos are 30f.p.s. for 40 seconds (K=1200). Test uncompressed video, as well as XVID-compressed derivatives.
HONEYWELL PROPRIETARY
Test Scenes:
Key
True Match True Non-match
False Match
False Non-match
A B C D E F G H I J X
outdoor, moving indoor, flat field indoor, tripod indoor, moving indoor, moving outdoor, stabilization indoor, moving indoor, zooming indoor, moving (night mode) flat field (night mode) indoor, moving
HONEYWELL PROPRIETARY
HONEYWELL PROPRIETARY
Extracted Signature
Edges in the signature can cause mis-classifications, particularly false negatives. False positives may also occur, if these spurious edges appear in similar locations in videos from different cameras.
HONEYWELL PROPRIETARY
Confidence Weighting
Chens method treats each pixel of each frame the same, regardless of its content. This conflicts with the intuition that flat regions of a scene are more useful for PRNU estimation. In light of the relative difficulty inherent in noise separation near edges, we should endeavor to avoid the inevitable errors contributing significantly to the estimated signature. Based on this reasoning, we propose confidence weighting for sensor fingerprinting. Specifically, we wish to prevent erroneous noise estimates near texture/edges from distorting the estimated signature. Within frames, we weight against regions likely to produce erroneous noise estimates.
HONEYWELL PROPRIETARY
Interview Video
Extracted Signature
Confidence Map
HONEYWELL PROPRIETARY
Experimental Results
New Method
Test Scenes:
outdoor, moving indoor, flat field indoor, tripod indoor, moving indoor, moving outdoor, stabilization indoor, moving indoor, zooming indoor, moving (night mode) flat field (night mode) indoor, moving
False Non-match
HONEYWELL PROPRIETARY
In addition to relative discrimination, confidence measures can be used to determine when the extracted signature is sufficient, or whether more/better frames are needed.
HONEYWELL PROPRIETARY