Professional Documents
Culture Documents
EVERYTHING IS AWESOME!!
Our initial thoughts on SK Telecoms
LTE-A 225 Mbps network
www.signalsresearch.com
EXECUTIVE SUMMARY
Over a four day period in early August we conducted a benchmark study of SK Telecoms LTE-Advanced (LTE-A)
network. We used a Samsung Galaxy S5 Category 6 (225 Mbps) smartphone as well as a Galaxy S5 Category
4 (150 Mbps) smartphone. We logged all network performance data presented in this Signals Flash! with the
Accuver XCAL-Solo or the XCAL-Mobile data collection tool, which provided us with the flexibility to test with
the phone literally in the palm of our hand while also providing us with the same features and functionality of
the companys PC-based XCAL solution which we have historically used in the past.
In late August or early September we will be providing detailed analysis of the network performance, including
SK Telecoms Btv Mobile IPTV service (SD, HD, FHD and UHD video content) that the operator offers over its LTE
network. This pending report is included as part of a Signals Ahead subscription, although the report will also be
available for individual purchase. In the interim, we would like to share our initial thoughts.
KEY HIGHLIGHTS
We
transferred more than 450 GB of data on the LTE-A network, including more than 35 GB using Btv Mobile.
With a standard 2 GB plan this amount of data consumption translates into 18.75 years of data usage.
We
tested outdoors while driving more than 175 miles around Seoul. We also tested in subway stations, on
the subway between stations, in our hotel lobby, and while walking around the heavily congested areas of the
Namdaemun Market and Gangnam Station.
The median Physical Layer downlink data rate was a staggering 98.9 Mbps and we achieved a top speed of 221.11
Mbps (one second averaging). The data rate was higher than 150 Mbps for 19% of the time and it was less than
25 Mbps for only 4% of the time.
The
median Physical Layer uplink data rate was 23.1 Mbps (10 MHz channels) and we achieved a top speed of
25.1 Mbps (one second averaging). The data rate was higher than 20 Mbps for 88.7% of the time. Due to how
the licenses have been awarded in South Korea, SK Telecom only has a 10 MHz uplink channel that is paired
with its Band 3 allocation that has a 20 MHz downlink. There is an additional 10 MHz uplink channel in Band 5.
With uplink carrier aggregation it will eventually be possible to support a logically combined 20 MHz channel.
The
latency (RTT) measured to an external server was consistently within a range of 20-25 ms.
In the Test Methodology section we discuss what we have in store for our forthcoming report which we are
targeting for late August or early September.
CONTACT INFORMATION
You may call us at +1 (510) 273-2439 or email us at information@
signalsresearch.com and we will contact you for your billing
information or respond to any further inquiries that you may have.
Subscription information for our Signals Ahead research product,
which includes these reports, can be found on the last page of this
report. You can also visit our website at www.signalsresearch.com
or write us at
Signals Research Group
Unlike our more in-depth Signals Ahead research reports, there are not any restrictions associated with the redistribution of this document. Recipients of Signals Flash! may share this
document both internally within their organization and externally with reckless abandon. In
fact, we encourage it! Any figures, quotes or other information contained in this report can be
used in presentations or other documents. We simply ask that you contact us in advance so
that we make sure we are given proper credit for our work.
If you are not a subscriber to Signals Ahead and you would like to receive these complimentary
Signals Flash! reports when they are published, please contact us and we will add you to the
distribution list. In addition to providing near-real-time commentary and analysis of industry
noteworthy events, Signals Flash! provides readers with a summary of past and planned
research reports that we offer through our subscription-based Signals Ahead research product.
We approached SK Telecom earlier in the year and requested the opportunity to conduct an
independent analysis of the operators LTE-A 225 Mbps network after they launched it. We
followed up again after SK Telecom launched the network and they accepted our request. SK
Telecom loaned us two smartphones with unlimited data plans and they provided us with access
to a high-bandwidth FTP server that we could use for our tests. We had full autonomy when it
came to testing the network, including what, when, where, and how we tested it. This was an
entirely self-funded independent study that we intend to leverage for a forthcoming Signals
Ahead report that will be made available to our Signals Ahead subscribers. The information
presented in this report is just the tip of the iceberg when it comes to how we plan to leverage
the network performance data that we collected during our stay.
Over a four day period in early August we conducted a benchmark study of SK Telecoms
LTE-Advanced (LTE-A) network. Samsung Networks is the infrastructure supplier in the Seoul
market. We used a Samsung Galaxy S5 Category 6 (225 Mbps) smartphone as well as a Galaxy S5
Category 4 (150 Mbps) smartphone. The Cat 4 smartphone supported Carrier Aggregation, but
since the 10 MHz + 20 MHz network configuration is seemingly everywhere in Seoul the phone
defaults to the single 20 MHz channel in Band 3. The Cat 6 phone was powered by the Qualcomm
SnapdragonTM 805 processor and the GobiTM 9x35 LTE modem (discrete A/P + modem). The Cat
4 phone was powered by the Qualcomm SnapdragonTM 801 processor with an integrated LTE
modem.
We didnt spend our whole weekend testing the network and we had plenty of time to hit the
hotel gym a few times, finish up our VoLTE report, do some shopping, hang out in Gangnam,
and partake in what can only be described as Death by Korean Barbecue. Nonetheless, we
consumed more than 450 GB of data well have an exact tally on the amount of data consumed
once we finish analyzing the data.
We logged all network performance data with the Accuver XCAL-Solo or XCAL-Mobile data
collection tools, which provided us with the flexibility to test with the phone literally in the
palm of our hand while also providing us with the same features and functionality of Accuvers
PC-based XCAL solution which we have historically used in the past. We also used the Spirent
Quantum Battery Life Measurement System to measure the power consumption, current drain
and estimated battery life of the two smartphones for a number of different scenarios, including
streaming SD, HD and UHD video content with SK Telecoms Btv Mobile IPTV service that runs
&
T
N
U
O
O
I
T
OW EBRA s, NV
L
B
Y
L
ega
R
E
V
s
A
C
a
S
Y
R
an, L
i
T
t
E
e
R
n
V
A
I
e Ve
P
N
h
t
t
N
Y
H
a
T A
A
D
ppes
o
H
h
0
S
1 TH BIRT nd Canal M
50Rockhouse, G0r1a4, 5:00-7:30 P
10, 2
The
r
e
b
m
Septe
YAN
R
Y
DB
E
T
S
s by
HO
ance
r
a
e
pp
s by
ance
r
a
e
App
cal
Musi ohn
J
bert
Elton Dion
m Lam
a
d
e
A
n
Celi
ey
uest
h Car
cial G
Maria with Spe
n
Quee Hicks
r
o
l
hem)
Tay
atles is left of t
e
B
e
Th
er
hatev
(or w
RES
C
A
E
S
tA
Gues nd Teller
a
Penn ed & Roy
ld
ri
f
g
e
Si
perfie
p
o
C
David pade
S
David
from
ishes t
w
y
da
gh
Lama
Birth eine Albri 4th Dalai
l
1
Made liness the
o
c
i
H
aR e
His
leezz
o
d
n
Co
is
Franc
Pope Winfrey
h
Opra
S
U
N
O
G
S
N
I
K
T
L
N
U
S
I
N
D R FREE CO ERVICES
over the LTE network. We will publish the results and analysis from this portion of our testing in
the forthcoming Signals Ahead report. We also used Quantum in our recent VoLTE benchmark
study that we released last week.
In the Test Methodology section of this Signals Flash we describe how we collected the data,
the types of tests that we conducted, and how we plan to analyze the data in our forthcoming
Signals Ahead report.
EVERYTHING IS AWESOME!!!
Emmet Brickowoski had his over-priced coffee, Taco Tuesday, and the widely-popular Where
Are My Pants TV show. But if Emmet had his druthers, were sure he would have traded it all for
a mobile broadband network that rivals the fastest broadband wireline networks in the world.
He could have even traveled 195 kilometers north of Seoul and met up with a ruler whose size
and stature is remarkably comparable to the seemingly innocuous President/Lord Business who
would put you to sleep if you didnt take extra care to follow the instructions.
Generally, we are a bit careful when it comes to throwing out hyperbole, but when you are traveling in a subway train with standing room only and sustaining data rates well above 150 Mbps to a
smartphone that you are holding in your hand it is hard to do otherwise. Our normal experience
is riding a BART train in the San Francisco Bay area where in several places you cant buy a single
bar of 2G voice or 3G data coverage, let alone LTE coverage, if your life depended on it.
Figure 1 provides an overview of the downlink throughput at the Physical Layer. The unofficial
median throughput based on downloading 393.1 GB of data 16.4 years of usage based on a
standard 2 GB monthly plan was an impressive 98.9 Mbps and the peak data rate was 222.11
Mbps. The throughput also exceeded 150 Mbps for 19% of the time. We obtained the peak speed
during an early morning test, but we observed speeds well above 200 Mbps during the tests
that we conducted on Friday afternoon in and around the Gangnam district. For now, we have
only analyzed the throughput in one second time increments. Once we analyze the data in one
millisecond sub-frame time intervals, we are confident that the throughput will be higher and
that the incremental benefits of the Cat 6 device will be even more evident.
We are characterizing all results presented in this report as unofficial results because the results
may contain instances when the FTP transfer wasnt occurring or when an FTP transfer was just
starting or stopping, meaning that the TCP slow start-up was artificially limiting the speed. When
we filter out all of these instances in the coming weeks we suspect that the median throughput
will slightly exceed 100 Mbps. Put another way, it is likely that the absurdly low 4% of the results
which were below 25 Mbps will drop to an even lower percentage.
COMING SOON!
CONTACT INFORMATION
You may call us at +1 (510) 273-2439 or email us at information@
signalsresearch.com and we will contact you for your billing
information or respond to any further inquiries that you may have.
Subscription information for our Signals Ahead research product,
which includes these reports, can be found on the last page of this
report. You can also visit our website at www.signalsresearch.com
or write us at
49.5 Mbps
47.5 Mbps
50-75 Mbps
24.5%
175-200
Mbps
6.8%
25-50 Mbps
34.9%
100-125
Mbps
7.5%
75-100 Mbps
9.5%
<10 Mbps
8.4%
10-25 Mbps
18.0%
150-175 Mbps
10.1%
< 25
Mbps
4.0%
25 - 50 Mbps
14.7%
125-150 Mbps
12.9%
50-75 Mbps
16.8%
50-75 Mbps
23.8%
25-50 Mbps
29.1%
100-125 Mbps
15.3%
75-100 Mbps
17.3%
The bar chart and the pie charts which appear below the bar chart show the individual contributions of the primary and secondary carriers. SK Telecom has 20 MHz in Band 3 (1800 MHz) and
10 MHz in Band 5 (850 MHz), which translates into peak data rates of approximately 150 Mbps
and 75 Mbps, respectively. In our testing, we observed Band 3 or Band 5 serving as the primary
carrier (and vice-versa). For this reason, the primary and secondary carriers contributed roughly
equal amounts to the total throughput. In our forthcoming report we will base our analysis on
the frequency bands being used for each carrier since this level of detail is critical to the understanding of LTE network performance.
CO-LOCATED WITH:
AT:
Special Discount
from Signals
Research
REGISTER TODAY!
Save 10% with discount code
SIGNALSRG
@4GWorld
#4GWorld
www.4GWorld.com
Figure 2 provides probability distribution curves for the LTE-A Physical Layer downlink throughput.
We have included separate curves for several groupings of tests as well as a composite curve
that represents a weighted average of all test scenarios. There are a couple of points that are
worth making.
Figure 2 LTE-A Physical Layer Downlink Throughput probability distribution curves
TOTAL DATA TRANSFERRED = 393.1 GB
Maximum Physical Layer Throughput (1 second interval) = 221.11 Mbps
Median Physical Layer Throughput = 98.9 Mbps
Composite Throughput (Median) = 98.9 Mbps
Friday Afternoon (Median) = 87.9 Mbps
Saturday Early Morning (Median) = 110.0 Mbps
Probability
100%
PHY Layer Downlink Total Subway Testing (Mbps)
80%
60%
40%
20%
0%
0
25
50
75
100
125
150
175
200
225
Mbps
Source: Signals Research Group
First, the typical throughput observed during a 4 hour drive test on Friday afternoon was largely
in line with results obtained during the night. This result speaks to the impressive densification of
SK Telecoms network (~500 m inter-cell spacing in the metropolitan area) and the reality that the
city never sleeps. Second, thanks to the operators base station repeaters/DAS we observed the
highest sustained throughput while testing indoors, especially in the subway stations and while
riding in the subway between stations. The subway results are based on a total of 29.1 minutes of
continuous testing, including Gangnam Station on a Saturday night and another test on Saturday
afternoon that started at the entrance to Samseong station and finished 7 stops later at the
Sadang station, following a lengthy walk while we transferred from Line 2 to Line 4. In the test
methodology section we include two screen shots of the Galaxy S5 Cat 6 device that illustrate
what we observed during these tests. Lastly, we observed the lowest throughput in the heavily
congested areas of the Namdaemun Market on a Saturday afternoon and the Gangnam District
on an early Saturday night.
As we expected, testing the uplink proved to be quite boring since with the very close cell sites
the throughput was rarely outside of a very tight range between 22.5 and 25 Mbps. Figure 3 shows
probability distribution curves for each grouping of tests as well as a composite curve which
represents a weighted average of all uplink test results. With the exception of the Friday afternoon drive test, all uplink throughput results were collected with the Category 4 smartphone
i
la
C
%
50
no
R ! ence
TONTnfer
RA U eco
PE O .lt
O ISC ice
D at vo
Part of the
.c
om
#LTEVOICE
250+
ATTENDEES
OTT
VOICE
FORUM
20+
OPERATOR
CASE
STUDIES
PRECONFERENCE
FOCUS DAY
LIVE
DEMO ZONE
Live VoLTE
Case Studies
OTT
Voice
Technical
Implementation
of VoLTE
Monetising
LTE Voice
VoLTE
Roaming
Optimisation
of Voice
Services
Policy
Control for
VoLTE
Future of
VoLTE
Ingo Ehlen
Principal PM Voice Evolution
Vodafone Group
Matt Schlesener
Manager Radio Technologies,
CTOOffice, Sprint
Christian Menini
Project Director Wireless
& LTE Voice
Swisscom
Seunghyun Sung
General Manager
LG Uplus
Andreas Bernstrm
CEO
Rebtel
Joong-Gunn Park
Senior VoLTE Manager
SK Telecom
Jochen Doppelhamme
CEO & Founder
Upptalk
Michael Scopfer
CEO
Forfone
Gold Sponsors
Bronze Sponsors
Panel Sponsors
and obtained concurrently while testing the downlink. Based on 27.5 GB of transferred data the
median Physical Layer uplink data rate was 23.1 Mbps and the peak data rate was 25.1 Mbps.
Although all of the results are impressive there is a noticeable difference in the results obtained
early on a Sunday morning. After further review we discovered that the Cat 6 device, which was
doing a downlink throughput test at the same time, was using the same band for its primary
carrier as the Cat 4 device was using for its uplink tests. Therefore, the uplink ACKs from the Cat
6 device were taking away uplink resources from the Cat 4 device. In other words, the apparent
anomaly in the results was likely self-inflected and the actual network performance was better
than what we are showing in the figure. In hindsight it probably wasnt such a good idea to try to
kill two birds with a single stone.
Figure 3. LTE-A Physical Layer Uplink Throughput probability distribution curves and pie charts
TOTAL DATA TRANSFERRED = 27.5 GB
Maximum Physical Layer Throughput (1 second interval) = 25.1 Mbps
Composite Throughput (Median) = 23.1 Mbps
Friday Afternoon (Median) = 23.5 Mbps
Probability
100%
80%
>25 Mbps
10.1%
60%
PHY Layer - Sunday Morning (Mbps)
40%
15-20
Mbps
8.7%
20-22.5 Mbps
19.0%
22.5-25 Mbps
59.7%
0%
0
10
15
Mbps
20
22.5
25
MAX
Physical Layer
Uplink Throughput (Mbps)
Source: Signals Research Group
At the moment, SK Telecom has 10 MHz of spectrum for the uplink in Band 5 and 10 MHz of spectrum for the uplink in Band 3, even though in Band 3 it has 20 MHz in the downlink. This situation
really stems from how the spectrum was awarded but it does limit the uplink throughput relative
to what we would have obtained with a 20 MHz radio carrier. Once uplink carrier aggregation is
commercialized, we expect the network to deliver two times the data rates that we observed
during our tests.
TEST METHODOLOGY
We arrived in Seoul on Thursday afternoon. SK Telecom delivered the two Galaxy smartphones
to our hotel later that evening. Friday morning we went to the Accuver [Innowireless] facilities
outside of Seoul where their engineers loaded the test software on the two phones. We used
XCAL-Solo to collect network performance data with the Cat 6 smartphone and XCAL-Mobile
to collect network performance data with the Cat 4 smartphone. The two drive test solutions
are identical in terms of functionality and GUI. They differ in that XCAL-Solo uses a separate
box that is about the size of a cassette tape box, which connects to the test phone through
the USB port. With this external interface it is possible to test with a much larger mix of smartphones since there isnt any need for any additional customization of the smartphone and/or
the XCAL software.
From our perspective, both solutions worked flawlessly and it was a breeze to collect data in
a very non-obtrusive manner while navigating the city streets, riding the subway, shopping, or
nursing a pint in a Gangnam pub. We also found that the user interface was nearly identical to
the PC-based version of XCAL that we have typically used so we had absolutely no problem using
the solution. Further, the two solutions collected the same detailed information that we have
come to rely on in the past for our analysis. Figure 4 shows a picture of the test setup in our rental
car the Cat 6 smartphone is on the left, the XCAL-Solo external box is in the middle and the Cat
4 smartphone with XCAL-Mobile installed is on the right. We also used a GPS repeater that was
mounted on the roof of the car to amplify the satellitew signal since we were using the internal
GPS radios in the two smartphones to provide our GPS coordinates.
In total, we drove 175.8 miles throughout Seoul while testing the network (reference Figure 5).
We also tested while shopping in the Namdaemun Market on a Saturday afternoon and while
walking the streets near the Gangnam subway station on an early Saturday night. Additionally, we
tested indoors, including subway stations, on the train between subway stops, and in our hotel.
We tested during the heat of the day and during the midnight hours. Although the throughput
was somewhat higher between midnight and 6 AM there wasnt a major difference in the results.
We base this outcome on the densification of the operators network and the reality that the
city never sleeps especially Gangnam. It was, however easier to drive around town at night and
we had the FM radio to keep us company. All of our throughput testing was based on the FTP
application. SK Telecom provided us with access to a high bandwidth server.
Just to prove that we are not making up these results, we are including three screenshots that
we took with the Cat 6 smartphone (reference Figure 6). The figure on the left is from a FTP
downlink test that we did while driving in the Gangnam district on Friday afternoon. We took
the middle screenshot while riding on a subway midway between two stations. The figure on the
right was taken while walking/testing in Gangnam station on Saturday night. Each figure shows
the maximum, minimum, average, and the instantaneous throughput observed at the moment
we took the picture. We are almost confident that in all three pictures the minimum throughput
was due entirely to the start/stop of an FTP session.
To put things in perspective, the screenshot from Gangnam Station shows a maximum throughput
of 181 Mbps and an average throughput of 101.51 Mbps. The average is also based on more than
233 seconds, or nearly 4 minutes, of continuous downlink data transfers. We note that each log
file is based on multiple FTP tests with each FTP test lasting several minutes we generally limited
each log file to 45-50 minutes of testing.
Subway Ride
(Saturday @ 1300 hours)
Gangnam Station
(Saturday @ 2000 hours)
We also used the Spirent Quantum Battery Life Measurement System to measure the power
consumption, current drain and estimated battery life of the two smartphones for a number
of different scenarios. We plan to incorporate the results from this testing in our forthcoming report.
Our testing included the following applications:
FTP downlink multithread FTP sessions to a high bandwidth server with each test generally
lasting at least 30-45 minutes
FTP uplink - multithread FTP sessions to a high bandwidth server with each test generally lasting
at least 30-45 minutes
Web
browsing loading 5 locally popular web pages; each test involved each webpage loaded
100 times. In total we loaded approximately 3,000 web pages between the two smartphones
YouTube
Btv Mobile streaming SD, HD and UHD video content to both smartphones
Determine when and how 10 MHz + 20 MHz carrier aggregation is used as well as what incremental benefit it offers over a single 20 MHz carrier for the various applications that we tested
Calculate
Determine the incremental performance benefits of a Cat 6 device over a Cat 4 device and
under what conditions the benefits are realized
Analyze
network performance (primary + secondary carriers) as a function of numerous underlying KPIs, including
RSRP
SINR/CQI
Power Headroom
Cell handovers
MIMO utilization
Determine current drain, power consumption and the estimated battery life for both smartphones with a particular emphasis on Btv Mobile, the operators IPTV service that it offers over
its LTE network
Impact of backlight
YouTube HD content
FTP downloads
Web browsing
Etc.
LTE Advanced 10 MHz + 20 MHz Carrier Aggregation Drive Test (including other LTE Advanced features as they
become available)
Cloud RAN
Although forecasts vary dramatically, Public Safety LTE is a multibillion dollar market opportunity for infrastructure vendors,
chipset suppliers and device manufacturers. Unfortunately, it
is approaching 20 years in the making and it still seems as if not
very much has happened since the initiatives first began - in some
cases in the previous Century. In this report, we provide a history
lesson of where the Public Safety Communications sector has
been; we discuss where the industry is going on a global basis; we
identify the Public Safety Communications requirements and how
the industry standards bodies are [or are not] addressing these
needs; and we look to the future and discuss how we believe the
market will evolve, the vendors that are helping in the effort, and
the innumerable challenges that remain.
5/7/14
4/3/14
Anechoic For this study we continued our multi-year collaboration with Spirent Communications, who provided us with a
full suite of test equipment and engineering support to conduct
the tests. ETS-Lindgren joined us in the collaborative effort by
providing its anechoic chamber as well as providing access to
the companys facilities in Austin, Texas. We benchmarked five
commercially procured smartphone the LG G2, the Samsung
Galaxy S4, the Samsung Galaxy Note II, the HTC One, and the
Motorola Moto X. The top performing smartphone won by a
country mile, outperforming the second best performing smartphone by more than 35% across all tests. We include results from
some sensitivity studies that look at the incremental impact of
MIMO (TM3) versus transmit diversity (TM2) as well as the performance impact of introducing a protective cover.
11/27/13 SDN and NFV - Its not a single network
Visa MasterCard
Credit Card #
Check Number
PO Number
Exp Date / /
Title:
Phone: ( )
Mailing Address
Signals Research Group
10 Ormindale Court
Oakland, CA 94611
Our fax number is (510) 338-1284.
Alternatively, you may contact us at (510) 273-2439 or at information@signalsresearch.com and we will contact you for your billing information. We will not process your payment until after the trial subscription period is completed.
Terms and Conditions: Any copying, redistributing, or republishing of this material, including unauthorized
sharing of user accounts, is strictly prohibited without the written consent of SRG.
please note disclaimer: The views expressed in this newsletter reflect those of Signals Research Group and are based on our understanding of past and current events shaping the wireless industry.
This report is provided for informational purposes only and on the condition that it will not form a basis for any investment decision. The information has been obtained from sources believed to be
reliable, but Signals Research Group makes no representation as to the accuracy or completeness of such information. Opinions, estimates, projections or forecasts in this report constitute the current
judgment of the author(s) as of the date of this report. Signals Research Group has no obligation to update, modify or amend this report or to otherwise notify a reader thereof in the event that any matter
stated herein, or any opinion, projection, forecast or estimate set forth herein, changes or subsequently becomes inaccurate.
If you feel our opinions, analysis or interpretations of events are inaccurate, please fell free to contact Signals Research Group. We are always seeking a more accurate understanding of the topics
that influence the wireless industry. Reference in the newsletter to a company that is publicly traded is not a recommendation to buy or sell the shares of such company. Signals Research Group and/or
its affiliates/investors may hold securities positions in the companies discussed in this report and may frequently trade in such positions. Such investment activity may be inconsistent with the analysis
provided in this report. Signals Research Group seeks to do business and may currently be doing business with companies discussed in this report. Readers should be aware that Signals Research Group
might have a conflict of interest that could affect the objectivity of this report. Additional information and disclosures can be found at our website at www.signalsresearch.com. This report may not be
reproduced, copied, distributed or published without the prior written authorization of Signals Research Group (copyright 2014, all rights reserved by Signals Research Group).