You are on page 1of 6

Performance Evaluation of 8-Channel ADC

ATCA Card for Direct Sampling of 1.3 GHz


Samer Bou Habib

AbstractNowadays LLRF control systems for linear accel- algorithms and digital processing for different feed-backs and
erators incorporate complex and expensive high-precision field feed-forwards to maintain the required stability. Other sub-
detection receivers with multichannel down-converters and low systems of the whole accelerator control including Klystrom-
noise LO generation systems. Increasing requirements for field
detection precision at most advanced machines reveal limitations Lifetime Management (KLM) [6] , High-Order Modes mea-
of classical LLRF system receivers. Recently developed technol- surements [7] and other systems also use the methodology of
ogy made it possible to design data acquisition cards allowing down-conversion to acquire information about high frequency
for direct sampling of cavity field without a need for down- signals.
converters. This paper describes the design and measurements Recent technology has allowed the possibility of using new
of an eight-channel ATCA card developed for the evaluation of
direct sampling techniques for 1.3 GHz signals at the FLASH very high speed (>400 MSPS) and bandwidth (>1.3 GHz)
and European XFEL accelerators. Two versions of the board ADCs for direct-sampling of the RF signals without the use
were tested, each holding a different set of analog-to-digital of down-converters with a high resolution (> 12bits). Systems
converters. One was equipped with 400 MSPS, 14-bit ADCs based on such an approach carry many advantages compared to
with an analog bandwidth of 1.4 GHz while the other held the older methodology in terms of size, cost, system delay and
500 MSPS, 12-bit ADCs with a bandwidth of 2.3 GHz. The
boards were tested in the laboratory and with "accelerator- complexity i.e. no complex high-performance LO generation
like" signals and revealed very good results. The paper shows is required and the smaller faster system contains much less
results of the measured sampling parameters, as well as results of sensitive analog RF circuits. It was demonstrated that such
different non-IQ sampling schemes with various bandwidths and very fast ADCs can be implemented in the control and syn-
reaction times for acquiring the amplitude and phase of the chronization systems for direct acquisition of RF signals[8].
analyzed signals and determining the precision of the analysis.
Drift measurements for determining the long-term stability are In the LLRF and other control systems of the XFEL accel-
also presented. Achieved results satisfy precision requirements erator [9] more than a 100 RF channels have to be sampled
for machines like The European XFEL main LINAC and ILC in each station for controlling 32 superconducting cavities in
accelerators. 4 cryomodules. This requires a very flexible, scalable and
redundant standard. It was decided to use the xTCA [10]
Index TermsLLRF, direct sampling, field detection, fast
ADC, ATCA format in the accelerator for fulfilling these requirements.
Simultaneously, development of a multichannel RF receiver
I. I NTRODUCTION was launched to test the feasibility of direct-sampling. The test
board was designed as an eight-channel ATCA card for inves-
The modern superconducting linear accelerators such as the
tigation of the new approach performance and parameters[11].
FLASH[1] and XFEL[2] at the DESY facility in Hamburg
provide very high performance electron beams for various II. U NDERSAMPLING AS A S IGNAL P ROCESSING
users and experiments. In order to acquire best performance T ECHNIQUE
parameters of the electron beam, very high requirements
are imposed on the beam and RF field stability and as a Although the used ultra-fast ADCs sample with very high
consequence on the control and synchronization systems of speeds, the frequency of the sampled RF analog signals
these accelerators. The main requirements are the stability exceeds several times the samples-per-second rate. Thus, in
of up to 0.01 degree in phase and 0.02% in amplitude [3]. order to measure signals in bandwidths from higher Nyquist
The system responsible for ensuring such precision is the bands, undersampling[12] is used as the technique allowing
Low Level Radio-Frequency system (LLRF) [4]. It is based the derivation of amplitude, phase and even shape of the input
mainly on the precision of the RF field measurements of the signals. The technique shows the sampled signals in a shifted
1.3 GHz signals at which the superconducting cavities work. position in the frequency domain i.e. in the first Nyquist band,
The current methodology is based on the process of down- but preserving all required parameters.
conversion i.e. to convert the high frequency signals to a lower, Moreover, for precise and efficient amplitude and phase
Intermediate Frequency (IF) which is then sampled by analog- measurement as well as synchronization with input RF signals,
to-digital converters using a specialized clock signal frequency the non-IQ sampling scheme was used [13] .The precise clock
[5]. The sampled data is then used for implementing various values can be determined by the formula below

S. Bou Habib is with the Insitute of Electronic Systems, Warsaw University


f0
fs = , k = 0, 1, 2, ... (1)
of Technology, Warsaw, Poland (email: S.BouHabib@elka.pw.edu.pl) k+ mn
The main circuits on the board are:
Fast ADC Circuits
The board allows testing two pin-compatible high
speed ADCs, a 12-bit 500 MSPS version with 2.3
GHz of analog bandwidth and a 14-bit 400 MSPS
chip with 1.4 GHz bandwidth. In order to achieve
maximum performance the RF input signals are dif-
ferentiated and carefully matched to the input of the
ADC. Additional mezzanines can be used to bypass
the input circuits, in order to provide additional gain,
filtration, DC-coupling or matching at different input
frequencies.
Figure 1. Shifting of spectrum using undersampling Timing and synchronization
A very low noise PLL synthesizer is used for gener-
ation of synchronous clocking signals for the ADCs
where f0 represents the RF frequency, and m and n the with sub 200fs jitter.1 The PLL has a sufficient
phase difference between two adjacent samples as given by amount of internal frequency dividers to obtain vari-
the formula ous frequencies used for different sampling schemes.
m FPGA, Memory and Interfaces
= 2 (2) Powerful XilinX Virtex5 SXT/LXT FPGA devices
n
are mounted on the boards respectively. Both devices
The methodology allows flexibility in the choice of the sam- can handle the very big amount of date from the
pling frequency, which has significant effect on the quality of eight ADCs simultaneously in addition to all config-
the measurement parameters. Various schemes were tested and uration, control, data acquisition and communication
the results will be shown in this paper. with both peripheral and external devices. The SXT
III. S YSTEM C ONCEPT AND D ESIGN version used on one of the boards is characterized
with additional DSP power and on-chip memory for
The project involved mainly the design of an eight channel more complicated data processing.
ATCA board for testing two different very high-speed ADCs. Diagnostics
Such a receiver would be sufficient for direct-sampling tests The main means of diagnostics on the board are
involving data processing from eight cavities, i.e. one cry- device motoring of the power supply and PLL units
omodule in the linear accelerators. The board can be upgraded and a temperature sensor for safety of operation and
with various mezzanine cards for additional data processing monitoring changes with respect to temperature.
and different ADC front-ends. It was foreseen that the receiver
can be used as a stand-alone system with no need for the
ATCA crate. The main system conception is illustrated in
figure 2.
Eight 1.3 GHz signals from the cavities are fed though
matching circuits to the eight high-speed ADCs. To ensure
proper processing, the converters are synchronized with re-
spect to one another and the input signals. This is done
using a 1.3GHz RF signal from the accelerator Master Os-
cillator unit as a reference for the on-board PLL for syn-
thesis and distribution of very low jitter clock signals to
the converters. The sampled data from all ADCs is then
received simultaneously by a powerful FPGA where detection
algorithms are implemented to derive the required amplitude
and phase information. Moreover, the FPGA is used as the
board controller, i.e. to configure all peripheral devices and
Figure 3. Fast ADC ATCA Printed Circuit Board
manage communication with external devices. A processor
daughter board can be added for very high processing power
and additional communication with the ATCA-LLRF system. IV. T ESTS AND M EASUREMENTS
Additionally, the board holds diagnostic circuits for monitoring In order to ensure highest performance and feasibility for
the board operation and temperature. Data acquisition can be the high energy machines, all the measurements were made
implemented in the available SRAM memory blocks. One of
the assembled boards is shown on figure 3. 1 Measured in a very wide bandwidth of 10Hz to 1 MHz
Figure 2. System general conception

in the DESY laboratories using very sophisticated hardware. raw format in the FPGA of the currently tested board. The
Reference, clock and RF input signals we provided by modules test setup was connected to a PC where data was transferred
used in the actual accelerator systems or ones almost identical. for data processing and precise analysis using Matlab software.
The signals were generated by a FLASH Master Oscillator unit Four major types of measurements were performed:
or a tunable synthesizer, both which provide ultra-low phase Standard ADC sampling parameters;
noise and drifts. This method guarantees the same parameters amplitude and phase detection;
of the designed circuits when used in the accelerator facility channel cross-talk;
and allows the proper characterization of the designed hard- phase drifts.
ware eliminating most inaccuracies coming from the external Description of the measurements as well as results and analysis
signals. One of the measurement setups is shown in figure 4. is described in the following parts.
A. ADC Sampling Parameters
The ADC sampling measurements were performed using
signal processing algorithms applied to the acquisited raw data.
The measurements were performed to evaluate the parameters
of the ADCs, i.e.:
Signal-to-Noise ratio (SNR) or more precisely the Signal-
to-Noise and Distortion ratio (SINAD);
ENOB resulting from the measured SINAD;
SNR/SINAD in a limited bandwidth;
clock jitter calculated from SNR.
Some of the obtained results for the 12-bit ADC board are
shown in table I.
sampling ENOB
SNR for
fre- SNR / clk jitter for
ENOB 1MHz
quency SINAD [fs] 1MHz
BW
[MHz] BW
416 4.41E+01 7.65E-13 7.03E+00 6.73E+01 1.09E+01
455 4.43E+01 7.44E-13 7.07E+00 6.79E+01 1.10E+01
487.5 4.78E+01 4.97E-13 7.65E+00 7.17E+01 1.16E+01
500 4.76E+01 5.08E-13 7.62E+00 7.16E+01 1.16E+01
365.625 5.01E+01 3.84E-13 8.02E+00 7.27E+01 1.18E+01
365.625 5.28E+01 2.79E-13 8.48E+00 7.55E+01 1.22E+01
365.625 5.30E+01 2.74E-13 8.51E+00 7.56E+01 1.23E+01
Table I
PARAMETERS FOR ADC

Figure 4. Laboratory measurement setup


An FFT of the gathered samples for the 12-bit ADC board
Each measurement involved saving all sampled data in a is shown in figure 5.
Fs m/n 10MHz BW 1MHz BW 100KHz BW

phase [degrees rms]

phase [degrees rms]

phase [degrees rms]


amp. [rms]

amp. [rms]

amp. [rms]
[MHz]

6.26E- 6.94E- 2.27E- 3.03E- 7.01E- 1.72E-


416 1/8
04 02 04 02 05 02
6.58E- 6.40E- 1.87E- 2.37E- 6.49E- 1.05E-
455 6/7
04 02 04 02 05 02
3.65E- 4.78E- 1.14E- 2.08E- 3.85E- 9.61E-
487.5 2/3
04 02 04 02 05 03
6.15E- 7.61E- 1.93E- 3.26E- 6.71E- 1.70E-
500 3/5
04 02 04 02 05 02
2.86E- 9.60E- 1.06E- 6.89E- 4.56E- 3.44E-
365.625 5/9
04 02 04 02 05 02
Table II
P HASE AND AMPLITUDE STABILITY ( PRECISION )
Figure 5. FFT from 32K samples for a channel of the 12-bit ADC board
working at 487.5MSPS

demodulation sampling scheme are shown in figure 7 and


An FFT of the gathered samples for the 12-bit ADC board figure 8.
is shown in figure 6.

Figure 7. Amplitude precision from demodulation (0.0114% [rms], 1MHz


Figure 6. FFT from 64K samples for a channel of the 14-bit ADC board BW)
working at 365.625MSPS
The amplitude and phase precision of the 14-bit ADC
B. Amplitude and Phase Detection working at a frequency of 365.625 MHz in the 5/9 non-IQ
demodulation sampling scheme are shown in figure 7 and
The precision of amplitude and phase measurements is the
figure 8.
most important parameter to be evaluated. Thus, a series of The precision obtained from the different demodulation
experiments was conducted using various clock signals for schemes show very good and promising results. The measured
testing different sampling schemes effects on the precision parameters prove this technique is fit for various applications
of the measurements as well as different loop bandwidths2 . in the accelerator control systems.
Some of the obtained results are shown in table II. The values
in the table refer to the precision of amplitude and phase C. Channel Cross-talk
detection. For very high precision measurement and signal analysis,
The amplitude and phase precision of the 12-bit ADC it is necessary to minimize cross-talk between channels since
working at a frequency of 487.5 MHz in the 2/3 non-IQ even small values of transferred power would alter the mea-
2 The loop bandwidth is proportional to the time of sampling i.e. the amount
surement. Thus, in this case some measurements were made
of sampled used for demodulation and calculation of the I and Q values and between various channels in order to find the worst case. This
from them the amplitude and phase. case was fount to be 76 dB from the first to the second channel.
Figure 8. Phase precision from demodulation (0.0208 [rms], 1MHz BW) Figure 10. Phase precision from demodulation (0.0689 [rms], 1MHz BW)

Figure 11. Amplitude difference change w.r.t. temperature and time (no
stabilization)

Figure 9. Amplitude precision from demodulation (0.0106% [rms], 1MHz 2) Temperature Control: In order to verify and characterize
BW)
more precisely the effect of temperature on amplitude and
phase drifts, another experiment was conducted with temper-
ature control of the whole setup. The signal sources ( input
D. Phase Drifts with Temperature and clock references) were put in a stabilized thermal chamber
Many of the accelerator control subsystems, are very sen- without any temperature change. The ATCA board was placed
sitive to drifts of the measured signals phase. For this reason, in a similar chamber with a predefined temperature-change
measurement of the drifts between two channels with respect profile. The profile consisted of five intervals. The first, third3
to temperature and time were conducted. The first measure- and fifth consisted of a stable temperature, while the second
ment was done without any temperature control while the other and fourth of a slow rise and fall respectively. This can be
was put in a temperature stabilized environment. seen in figure 13 and figure 14.
1) No Temperature Control: The temperature drifts, of both It was observed again that the phase drifts with temperature
amplitude and phase, were done inside a closed laboratory, are much more significant that the amplitude drifts. The values
with only ATCA crate fans. The experiment was interfered by are 0.8 degrees per degree Kelvin versus 0,0125 relative
an accidental change in temperature for around 200 minutes amplitude per degree Kelvin. It was later derived that the
which can be seen in figure 11 and 12. greater value of the phase drifts comes from the analog front-
It can be observed that both amplitude and phase drifts are end and for drift-sensitive applications the analog circuits have
very small without temperature change, while when the tem- to be replaced.
perature varied a much more significant change is observed. 3 The third interval can be seen to have unstable temperature variations, yet
Moreover, the phase drifts tend to be much bigger and more these are a result of the temperature readout and not the actual temperature
significant than the amplitude ones. in the chamber
Figure 14. Phase difference change w.r.t. temperature and time (with
temperature control) at 1.3GHz
Figure 12. Phase difference change w.r.t. temperature and time (no stabi-
lization) at 1.3GHz

R EFERENCES
[1] http://flash.desy.de/.
[2] http://www.xfel.eu.
[3] V. Ayvazyan et al. Requirements for rf control of ttf2 fel user facility.
PAC03, page 2342, 2003.
[4] S. Simrock et al. Digital low-level rf controls for future superconducting
linear colliders. PAC05, pages 515519.
[5] S. Simrock et al. Considerations for the choice of the intermediate
frequency and sampling rate for digital rf control. EPAC06, 2006.
[6] W. Koprek L. Butkowski. Klystron lifetime management system. 2009.
[7] Stephen Molloy, Josef Frisch, Douglas McCormick, Justin May, Marc
Ross, Tonee Smith, Nathan Eddy, Sergei Nagaitsev, Ron Rechenmacher,
Luciano Piccoli, Nicoleta Baboi, Olaf Hensler, Lyudvig Petrosyan,
Olivier Napoly, Rita Paparella, and Claire Simon. High precision sc
cavity alignment measurements with higher order modes. MEASURE-
Figure 13. Amplitude difference change w.r.t. temperature and time (with MENT SCIENCE AND TECHNOLOGY, 18 no. 8:23142319, 2007.
temperature control) [8] Z. Geng; S. N. Simrock. Evaluation of fast adcs for direct sampling rf
field detection for the european xfel and ilc. DESY, Hamburg, 2008.
[9] J. Branlard, G. Ayvazyan, V. Ayvazyan, M. Grecki, M. Hoffmann,
T. Jezynski, T. Lamb, F. Ludwig, U. Mavric, S. Pfeiffer, C. Schmidt,
Yet in both cases, it can be observed that in a stable B. Yang, H. Schlarb, P. Barmuta, S. Bou Habib, L. Butkowski, K. Czuba,
temperature environment, both amplitude and phase drifts M. Grzegrzolka, E. Janas, J. Piekarski, I. Rutkowski, D. Sikora, L. Zem-
bala, M. Zukocinski, W. Cichalewski, K. Gnidzinska, W. Jalmuzna,
are extremely low, thus leading to the deduction that along D. Makowski, A. Mielczarek, P. Perek, T. Pozniak, A. Piotrowski,
with temperature stabilization, the drifts can be eliminated K. Przygoda, A. Napieralski, DMCS, M. Kudla, S. Korolczuk, J. Szewin-
efficiently. ski, and W. Wierba. The european xfel llrf system. IPAC, 2012.
[10] S.N. Simrock, V. Ayvazyan, A. Brandt, M. Hning, W. Koprek, F. Lud-
V. S UMMARY wig, P. Pucyk, K. Rehlich, E. Vogel, H.C. Weddig, M. Grecki, T. Jezyn-
ski, and W. Jalmuzna. Conceptual llrf design for the european xfel -
The concept, design and measurements of the eight channel thp001. 2006.
ATCA receiver is described in the paper. The board holds [11] S. Bou Habib, K. Czuba, W. Jalmuzna, and T. Jezynski. Design of
eight-channel adc card for ghz signal conversion. Mixdes, 2010.
modern very fast ADCs used for direct sampling of RF signals [12] Walt Kester. Mixed-signal and DSP design techniques. ISBN 978-0-
as a test-bench for fast ADC applications in the DESY linear 7506-7611-3. Newnes, 2003.
accelerators control systems. The measurements proved the [13] M. Grecki, T. Jezynski, and A. Brandt. Estimation of iq vector
components of rf field - theory and implementation. 12th Int. Conf.
feasibility of the technique. The obtained results from the Mixed Design of Integrated Circuits and Systems, MIXDES, pages 783
extensive studies prove that the parameters are sufficient for 788, 2005.
many control systems such as the XFEL main LINAC and the
ILC LLRF units as well as different fast systems involving
characterization of high frequency signals, where precision
of RF detection is obligatory along with very short system
reaction times.
The successful tests have led to many projects involving
this technique among the many control subsystems of the
accelerators. Thus, a new design using the mTCA.4 standard
is launched for the required applications.
ACKNOWLEDGMENT
Research supported by FP7 EuCARD http://cern.ch/eucard

You might also like