Digital Capture

Devices
High End Scanners

Agenda

The genesis of digital capture devices

Market forecasts, trends, and key conclusions
Digital capture basics
Digital capture devices
System analysis and block diagrams
Programmable logic in digital capture applications
Xilinx Solutions
Xilinx eSP

The Genesis of
Digital Capture

The Evolution of Digital

Capture
1960s

- Remote Sensing

Analog capture
Required film return
Slow

1970s

- CCD invented

Birth of digital capture

Enabled deep-space imaging
Instantaneous
Very expensive

The Evolution of Digital

Capture
1980s - The relentless advance of Moores Law
CCD devices become affordable

1990s - The advent of

Graphical computing
Digital communications
The Internet
Consumer capture devices emerge

Digital Capture Today

2000s - Digital Video Consumer Electronics Explodes
DVD, digital cameras, digital camcorders, ILink, HDTV, video phones, DVR,
Firewire, USB 2.0, motion JPEG, web cams, broadband Internet,
GPS, etc.

Digital Video Everywhere!

The New Generation

Digital Capture Technologies

Scanners
Digital
Cameras

Digital
Camcorders

Why Digital Capture?

Quality
Digital content enables superior display processing
Filtering, color correction, image enhancement

Convenience
Digital enables instantaneous interchange

Affordability
No photo processing fees
Ability to leverage semiconductor economies of scale

Market Forecasts,
Trends, and Key
Conclusions

Video Equipment Forecast

Color TV
Digital TV
VCR
Analog Camcorder
Digital Camcorder
DVD
Analog Set-Top-Box
Digital Set-Top-Box
Video Game Console
Digital Still Camera
Other Video
Total Video

2000
28,676
1,175
8,339
3,085
3,904
4,044
431
6,179
5,170
2,205
6,144
69,351

2001
29,218
2,469
7,683
2,512
5,426
6,254
229
7,488
6,927
2,393
6,841
77,438

2002
28,710
3,813
7,313
1,875
6,789
8,507
136
8,640
6,117
2,630
7,435
81,964

2003
28,856
6,358
6,549
1,186
8,503
10,791
103
9,728
5,502
2,818
7,828
88,223

2004 CAGR(%)
28,609
0.5
10,732
93.5
6,177
-6.7
924
-22.4
10,465
28.7
12,232
37.8
79
-34.2
10,331
16
5,458
7.8
3,383
17.8
8,286
7.5
96,677
9.2

Worldwide Video Equipment Production Revenue Forecast (Millions of US Dollars)

Source: Gartner Dataquest (Nov.2000)

Units (M)

Worldwide Scanner
Shipment Forecast
20
18
16
14
12
10
8
6
4
2
0

Scanner

2000

2001

2002
Year

Source: IDC (Nov. 1999)

2003

2004

Scanners - Two Categories

There are two broad classes of Scanners
SOHO and Office Scanners
Fairly inexpensive - $50 - $200
36 bit color (12 bit grayscale), Maximum resolution: 600 x 1200 optical
SCSI, Parallel port, USB

High-end Scanners

Expensive - $200 - $5000

8,000 element CCD
24 bit color to 48 bit color
Maximum resolution: 1200 x 3048 optical, 2400 x 1600 optical, 5,000 optical,
15,000 interpolated
Dynamic range: 3.9, DMax: 4.1
Largest reflective original: 13.8 x 18.5, largest film size: 13.8 x 17.9 (inches)
Interface(s): SCSI, USB, IEEE-1394
Feeder handles up to 200 sheets of 8.5x11
Scans at rates more than 40 pages per minute

Image Sensor Forecast by

Application (K Units)
Area Image Sensor Forecast by Application (K Units)

Analog Camcorder
Digital Camcorder
Security Cameras
Digital Still Cameras
PC Cameras
Toys
Cell Phones
PDAs/Handhelds
Automotive
Biometric

2000
8,685
6,107
9,600
12,700
9,000
2,700
100
40
20
50

Source: Cahners In-Stat (Oct. 2000)

2001
8,142
8,056
12,100
18,100
15,000
3,800
900
220
75
275

2002
7,990
9,751
15,300
23,350
22,000
5,500
3,100
1,100
225
730

2003
7,755
10,959
19,400
29,100
30,000
7,800
17,800
2,400
1,550
1,500

2004 CAGR (%)

4,157
-15.4
12,793
25.5
24,500
26.4
34,920
37.9
35,000
58.5
11,100
42.3
59,500
393.9
5,800
247
5,320
303.9
2,800
173.6

Digital Capture Devices

Key Conclusions
Digital video consumer electronics are growing
explosively
Digital capture segment is growing at 9.2% CAGR per
year (Gartner Dataquest)
$69,351 M in 2000 to $96,677 M in 2004

Consumer growth is fueling more affordable sensors for

industrial and non-consumer applications which of
themselves are large and substantial markets
For instance, biometrics growing from 50K to 2.8M in 2004
And these segments are even more attuned to the advantages
of programmable logic solutions

Digital Capture
Basics

The CCD Device

The CCD device acts as the eye of the digital capture device. It literally sees the object in focus

CCD (Eye)

The CCD Device

The CCD device acts as the eye of the digital capture device. It literally sees the object in focus

CCD (Eye)

The CCD Device

The CCD device acts as the eye of the digital capture device. It literally sees the object in focus

CCD (Eye)

The CCD Device

The CCD device acts as the eye of the digital capture device. It literally sees the object in focus

CCD (Eye)

The CCD Device

The CCD device acts as the eye of the digital capture device. It literally sees the object in focus

CCD (Eye)

The CCD Device

The CCD device acts as the eye of the digital capture device. It literally sees the object in focus

CCD (Eye)

The A/D Converter

The analog to digital or A to D converter acts as the optic nerve of
the eye in a digital capture device. It literally converts the object
in focus into digital signals that the digital capture system can
process.

R
G
B

CCD (Eye)

1010101
0010001

A/D
Converter

Dots Amazing!
The captured digital images are comprised of
many tiny colored dots

These Colored Dots are Called

Pixels
Pixel stands for Picture Element
Images are made
from captured
2D pixel maps
X pixels wide
Y pixels tall

These dimensions
define the resolution
of the image captured

e.g. 1024 X 768

Zooming In
Each pixel is comprised of three sub-pixel elements: one each for
Red, Green, and Blue, each respectively represented by separate
binary (digital) values

Digital Image
Processing

Image Processing Functions

Pixel processing

Color space conversion

Scaling
Color/Gamma correction
Brightness
More colors through dithering

Frame buffer processing

Contrast enhancement
Shadow enhancement
Sharpness enhancement
Chroma key compositing
Graphic overlay

Basic Image Processing

Color Space Conversion
To speed many processing tasks, an alternate color space is often
preferable to RGB. Many video and imaging standards use a
luminance and color difference color space such as YCrCb or LUV.
To support real-time image processing, high performance
conversion is necessary between the source and target formats

RGB2YCrCb: Converts RGB to Luma - Croma Red - Chroma Blue

YCrCb2RGB: Converts YCrCB to RGB
RGB2LUV: Converts RGB to Luma - U color diff. - V color diff.
LUV2RGB: Converts LUV to RGB

Basic Image Processing

Scaling
Fractionally enlarges the incoming data stream as
necessary to match the target display resolution

Basic Image Processing

Color/Gamma Correction
Adjusts RGB intensities through correction tables
Required to account for technology specific RGB
characteristics (CRT vs. LCD vs. PDP etc.)

Basic Image Processing

Brightness
Increases the RGB intensity to the viewers taste

Basic Image Processing

More Colors Through Dithering
Smooths out color transitions (banding) in bit-depth limited displays
Generates patterns of pixels which the eye blends together into
colors the display cannot generate

Advanced Image Processing

Contrast Enhancement
Adjusts RGB intensities to control the degree of
difference between light and dark image areas

Advanced Image Processing

Shadow Enhancement
Selectively adjusts RGB intensities in order to
lighten dark grayscale regions

Advanced Image Processing

Sharpness Enhancement
Adjusts RGB intensities to sharpen the transition
between adjacent color regions

Advanced Image Processing

Chroma Keyed Compositing
Composites 2 images together, replacing a specific RGB
value in one image (chroma) with the data pixel from the
other

Advanced Image Processing

Graphic Overlay

Advance Image Processing

DCT-IDCT
Wide range of signal and image processing applications
JPEG, JPEG2000, MPEG1, MPEG2, H.261, H.263
Video phone, video conferencing
Progressive image transmission (PIT) systems:
Teleconferencing
Medical diagnostic imaging
Security services

Implementation Examples

Digital Capture Technology

Side by Side Comparison

Digital Still Camera

Digital Camcorder
Flat Bed Scanner
Still Resolution
640x480 to > 2832x2128
640x480 to > 1360x1020
600x1200 to > 19200x19200
Video Resolution
N/A
500 Horizontal Lines or >
N/A
Pixel Count < 1Megapixel to > 4 Megapixels <1 Megapixel to > 4 Megapixels < 1 Megapixel - Linear Array
File Format
JPEG
JPEG, MPEG
JPEG

Image Sensor Types

CCD (Charge-Coupled Device)
Electronic pulses are applied which cause each pixel to
transfer its charge to the next pixel, in what is called a bucket
brigade transfer
Eventually each line of pixels transfers its collection of charges into an
output amplifier, where each charge is converted into a voltage

Uses MOS manufacturing process

CMOS
Are active devices that read out their charge via transistors
placed in each pixel
Uses CMOS manufacturing process

How an Image Sensor is Utilized

Scanner Example
A light source illuminates the piece of paper
placed on the scanners glass plate.
Blank or white areas reflect more light.

The scan head moves below the

paper and receives the light
reflected from the paper.

The light is reflected

by a series of mirrors.
The scanners lens passes the light onto
light-sensitive diodes which translate
it into electrical current.

Courtesy: www.pctechguide.com

Digital Scanner
System Analysis
and Block
Diagrams

Digital Scanner System Data

Flow
Image Source
Image
Processing

CCD through A/D conversion

- Captured raw digital RGB values of analog image from

CCD

Image Processing
- DCT/IDCT, color space conversion, compression, etc.
- Gamma/color correction, half-toning, brightness,
contrast, sharpness, etc.

System Controller

System
Control

- Hardware I/O & memory decoding, synchronization, status, interrupts, etc.

Microcontroller

- Scheduler, task mgr., resource allocator, menu mgr., etc.

System Transport
- DMA access to system memory resources, PCI, local bus, dual-port memories

High-speed
Transport

Fast Image Distribution

- USB 2.0, IEEE-1394, Ethernet MACs

PHY
- LVDS, BLVDS

Generic Digital Scanner

System
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

Digital

Memory

Mixed Signal

uP or uC

FLASH

DRAM

Programmable

SRAM

IP Block

Raw Analog Capture

Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

CCD
Creates analog RGB image
representation of object
in focus
Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

A/D Conversion
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

A/D Converter
Converts analog RGB values to
sampled digital values

Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

Digital Image Capture

Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

CCD Interface
Buffers and sorts sampled
digital RGB values

Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

System Control
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

System Controller
Provides system level hardware
interface between all functional
blocks
Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

Image Processing
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

Image Processing
Provides improved system level
performance via hardware
accelerated image processing
Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

Optional Digital Encoding

Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

Optional MPEG/JPEG Encoder

Encodes digital sampled and
streaming images into MPEG/
JPEG compliant format
Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

Supervision & Control

Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

Microcontroller
Orchestrates proper and timely
system interactions between
hardware and software
Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

Memory Control
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

Memory Controller
Provides system level interface
signals for accessing memory
devices and resources
Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

High-Speed Transport
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

Digital Transport MACs

USB 1.1/2.0,IEEE 1394, Ethernet

Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

High-Speed Transport
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

Digital Transport PHYs

USB1.1/2.0, IEEE-1394, Ethernet

Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

High-Speed Transport
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

LVDS/BLVDS I/O
Provides high-speed serial
transport of captured and or
streaming images
Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

Digital Image
Image
Processing

A
Digital
CCD /
RGB
D

CCD
I/F

Optional
Digital
Encoding

PHY

High
Speed
I/O

System
Controller

Digital

Memory
Controller

uC
ROM

Digital RGB
MPEG, JPEG, TIFF, etc

Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

FLASH

DRAM

SRAM

Digital Scanner System Diagram

Where FPGAs Can Add Value
Image
Processing

Lens

CCD

A
/
D

Digital
RGB

Optional
Digital
Encoding

High
Speed
I/O

System
Control

CCD I/F

PHY

Memory
Controller
ROM
FLASH

uC

DRAM
SRAM

Digital

Memory

Mixed Signal

uP or uC

Programmable

IP Block

Digital

Xilinx Solutions

The Xilinx Product Portfolio

High Performance
High Density

High Volume
Low Cost

Virtex, Virtex-E,
Virtex-EM, Virtex-II,
Virtex-II Platform FPGA

Spartan, Spartan XL,

Spartan-II, Spartan-IIE

Low Power
Low Cost

XC9500, XC9500XV,
XC9500XL, CoolRunner
XPLA3

Software and IP Core Solutions

Xilinx Spartan Series FPGAs

High Performance
System Features
Software and
Cores

Smallest Die Size

Lowest Possible
Cost

Low Cost Plastic Packages

Streamlined Testing

Port B

Differential I/O
400 Mbps
LVDS
Bus LVDS
LVPECL

Dual-Port
4Kbit
BRAM

Block RAM
Up to 64Kbits
200 MHz

CL DLL
I
O B
B R
I A
O M
B
I
O B
B R
I A
O M
B

IOB

IOB

IOB

IOB

IOB

IOB DLL CL
I
CLB CLB CLB CLB CLB CLB B O
R B
A I
CLB CLB CLB CLB CLB CLB M O
B
I
CLB CLB CLB CLB CLB CLB B O
R B
A I
CLB CLB CLB CLB CLB CLB M O
B

I
O B CLB CLB CLB CLB CLB CLB
B R
I A
O M CLB CLB CLB CLB CLB CLB
B
CL DLL IOB IOB IOB IOB IOB IOB

System I/O
19 signaling standards
Chip to Backplane
Chip to Memory
Chip to Chip

CLKIN
CLKFB
RST

I
O
B
I
O
B
DLL CL
B
R
A
M

CLK0
CLK90
CLK180
CLK270
CLK2X
CLKDV
LOCKED

2ns

Spartan-IIE Technology
2n

2ns

CLB Tiles
Fast, predictable
interconnect

Delay Lock Loops

200+ MHz performance
4 DLLs in every device
Deskew 4 system Clks
Zero-delay clock conv.

Standard System I/O

Features

LVDS, BLVDS (Spartan-IIE)

LVTTL
LVCMOS2
LVCMOS18
PCI 33/66
GTL, GTL+

HSTL I, III, & IV

SSTL3 I & II
SSTL2 I & II
CTT
AGP-2X
LVPECL (Spartan-IIE)

Memory Controller IP
Content Addressable
Memory (CAM)
DDR-SDRAM Controller
Quad-Data-Rate SRAM
Interface
Single-Port Block Memory
Registered single port
RAM

Registered ROM
Dual-port Block Memory
200MHz ZBT SRAM
Interface
SDRAM Controller

MicroBlaze
32-bit fully synthesized RISC processor
Fast
Twice the performance at half the logic area vs. competition

Supported by an integrated IP library

Timer/Counter Block
Watchdog Timer/Timebase
Interrupt Controller
16550/16450/Lite UART
ZBT Memory Controller
SRAM Controller
Flash Memory Controller
* Licensed for a fee

IIC*
SPI*
Ethernet 10/100 MAC*
More to come

Xtreme DSP
Industry first System Generator for Simulink bridges gap
between FPGA and conventional DSP design flows
Unique constraint-driven Filter Generator allows
optimization between performance and cost
Power estimator tool (Xpower) for power-sensitive DSP
implementations
Eleven optimized DSP algorithms (cores) that cut
development time by weeks
DSP features added to ChipScope ILA tool dramatically
accelerate hardware debugging time

Video/Image Processing IP
Inverse Discrete Cosine
Transform (IDCT)
1-D Discrete Cosine
Transform
2-D DCT/IDCT Forward &
Inverse Discrete Cosine
Transform
JPEG CODEC
FastJPEG Color Decoder
Fast JPEG B/W Decoder

logiCVC - Compact Video

Controller
RGB2YCrCb Color Space
Converter
YCrCb2RGB Color Space
Converter
RGB2YUV Color Space
Converter
YUV2RGB Color Space
Converter

High-Speed Transport MACs

IP
USB 2.0
IEEE-1394
Ethernet

FPGA Standard Features and IP

Accelerating Time-to-Market
Optional
Digital
Encoding

2D FIR Filter

2D FFT

RGB2YCrCb

YCrCb2RGB

RGB2YUV

YUV2RGB

System
I/O I/O
User
Designed

A
Digital
CCD / RGB
D

Dual
Port
Buffer
Block
RAM
Memory

Memory

FIFO
System
Control

ROM
Controller

Mixed Signal

uP or uC

FLASH

Distributed
Buffer
MemoryRAM

Programmable

uC

IP Block

DLL

DLL

Digital Display
Controller
Analog Display
Controller

Microcontroller

SRAM

DLL

High Speed
I/O

DES
3DES

FLASH
SRAM
Sub-System
Controller
Controller
Controller
System I/O
User Designed
I/O

DLL

PHY

Clock Mgmt

FPGA Capture System Utility

ROM
Digital

High
Speed
PCI
Bus

DCT
Encoder
&
IDCT
Encryption
JPEG

Storage
Nonvolatile
Controller
Storage

DRAM
Controller

I/O
User System
Designed
I/O

User
Syste
m I/O I/O
Designed

Image Processing

LVDS, BLVDS

LCD

DAC
Compact
FLASH
Hard Disk

DRAM

Digital

TV/CRT

Xilinx CPLDs
XL9500 Families
High Performance
Low Cost Solution

CoolRunner Family
Lowest Power
Highest Reliability

System Integration and Peripheral Interfaces

CPLD Solutions For Every

Need
XC9500 families

CoolRunner XPLA3 family

Voltage flexibility

9500 - 5v / 9500XL - 3.3v /

9500XV - 2.5v

36-288 macrocell densities

Ultra-high performance
Low cost
Superior pin-locking

Ultra-low power with high speed

3.3V
32-512 macrocell densities
Advanced architecture

Summary
Digital scanners are one of the more popular consumer
devices
Wide acceptance in all geographies

The scanner marketplace is growing at a significant pace

Expected to grow from 10M units in 2001 to 20M in 2004

Xilinx role in scanners

CCD interface, timing generation, memory controllers, hard
disk interface, display interface, and system control

Xilinx fit
Primarily used for interface between ASSP chips/chipsets
For external connectivity - Memory, USB, IEEE-1394