HETEROGENEOUS SYSTEMS

ARCHITECTURE: COMING SOON TO A

PLATFORM NEAR YOU
JIM NICHOLAS, VP MIPS BUSINESS OPERATIONS
IMAGINATION TECHNOLOGIES
LINLEY PROCESSOR CONFERENCE 2015
Copyright 2015 HSA Foundation. All Rights Reserved.

WHATS THE PROBLEM?

Heterogeneous processors becoming widely available

Developers starting to discover the benefits of GPU compute augmenting CPU cluster-based compute

Coherency migrating from high-end servers to mainstream mobile and consumer

BUT

Software programming models for coherent heterogeneous processors not standardized

CPU+GPU applications difficult to optimize or scale, or to port from one SoC platform to another

Heterogeneous portable application developer ecosystems not gaining momentum

We need to bring compute app portability to heterogeneous platforms!

Copyright 2015 HSA Foundation. All Rights Reserved.

THE HSA VISION

MAKE HETEROGENEOUS PROGRAMMING MUCH EASIER
1

Single source programming

Enable the programming language of the developer

Eliminate data copies

Common address space

Standardized command submission to the GPU

Eliminate software layers between application and hardware

ISA agnostic for CPU and GPU

Open source software stack

High performance
Low power
Extensible to other accelerators on the SoC
Copyright 2015 HSA Foundation. All Rights Reserved.

HSA ADDS VALUE TO THE SOC AND THE SYSTEM

Improves the SoC and the programming paradigm for developers

Enables heterogeneous interoperability between blocks from different IP suppliers

Creates a consistent software architecture for heterogeneous acceleration: GPU and beyond

CPU

CPU

CPU

GPU

GPU

GPU

GPU

Unified Coherent Memory

Copyright 2015 HSA Foundation. All Rights Reserved.

DSP

NIC

Lower power, higher

performance, easier to
program
1.0 specs are released;
multiple companies set
to deliver products

END USERS BENEFIT FROM HSA WITH APPLICATIONS

THAT RUN FASTER AND AT LOWER POWER

Always on, visually

aware devices will offer
greater capability in a
lower power budget,
scaling with every
advance in app
processing

Mobile and tablet

devices will use the
CPU, GPU and DSP
working seamlessly
together for content
creation, gaming and
more

Intelligent cloud video

analytics will be more
efficient, and make
best use of every
server upgrade

Sophisticated ADAS
real-time analytics
will be easier to
develop, adapt to
any platform, and be
more robust

HSA architecturally integrates the accelerators in todays complex SoCs

to be easily and efficiently utilized by application developers
Copyright 2015 HSA Foundation. All Rights Reserved.

WHERE ARE WE NOW?

HSA 1.0 specifications are released

HSA conformance tests are complete and undergoing qualification

AMD is shipping the Carrizo APU with full HSA features

HSA products are imminent from other HSA Foundation members

HSA system software has been released in open source and

is on the HSA web site

Copyright 2015 HSA Foundation. All Rights Reserved.

MEMBERS DRIVING HSA

Founders

Promoters

Supporters

Contributors

Academic

Copyright 2015 HSA Foundation. All Rights Reserved.

GCC HSAIL OPEN SOURCE PROJECT

Sponsored by General Processor Technologies

gccbrig

An open source project

Allows use of GCC for finalization

Vendor independent

A BRIG language front-end to GCC

Benefits

BRIG: Binary Representation of HSAIL

Translated to GCCs tree intermediate
representation

Optimization by GCC

Including vectorization/SIMD optimizations

Copyright 2015 HSA Foundation. All Rights Reserved.

No need to know proprietary Instruction Set

Architecture

CPU/VLIW/MIMD HSA kernel agent support

Schedule

Public release 1Q2016

Developer access - TODAY

HSA PRODUCT UPDATES

FROM HSA FOUNDATION MEMBER COMPANIES

Copyright 2015 HSA Foundation. All Rights Reserved.

6TH GENERATION AMD A-SERIES PROCESSOR: CARRIZO

FULLY HSA ENABLED

Copyright 2015 HSA Foundation. All Rights Reserved.

10

CARRIZO IS AMDS SECOND APU PRODUCT WITH HSA FEATURES

Copyright 2015 HSA Foundation. All Rights Reserved.

11

ARM AND HSA

ARM, as a founder member, has been committed to the HSAF since launch

Actively contributes to the HSA specifications and working groups

Is committed to the continued development of this important standard

ARM customer base is showing increasing interest in HSA features for their next generation SoCs
ARM customers can already build real heterogeneous systems based on, for example:

ARM Cortex-A72 high performance application processor

ARM Mali-T880 compute enabled GPU

ARM CoreLink CCI-500 cache coherent interconnect

ARM CoreLink CCN cache coherent network family

ARM is actively developing next generation processor and interconnect IP to extend the system
capabilities aligned with HSA standards including:

Full memory coherency

Shared Virtual Memory

Copyright 2015 HSA Foundation. All Rights Reserved.

12

HSA ROADMAP AT MEDIATEK

CPU
CPU

CPU

BIG CPUs
LITTLE
CPUs

CPU
LITTLE CPUs

GPU

SMP

HMP 2013

HC 2015

Symmetric Multi -Processing

Heterogeneous Multi-Processing

Heterogeneous Computing

Copyright MediaTek Inc. All rights reserved.

Copyright 2015 HSA Foundation. All Rights Reserved.

Coherent Memory MMU

BIG CPUs

BIG CPUs

LITTLE
CPUs

GPU
Accelerator
s

HSA
Heterogeneous System
Architecture

10/5/2015
13

HSA PROGRESS AT MEDIATEK

Major application areas for HSA

Deep learning
Computer vision
Image processing
Cognitive computing

Face Detection Normalized Normalized

Benefits
Performance Energy
GPU
1.00
1.00
CPU
2.02
0.99
CPU/GPU
single
2.46
0.82
CPU/GPU
parallel
2.86
0.54

Copyright MediaTek Inc. All rights reserved.

Copyright 2015 HSA Foundation. All Rights Reserved.

10/5/2015
14

EFFICIENT EXECUTION OF WORKLOADS IN AN SOC

ENVIRONMENT
MIPS CPU
Heterogeneous System Architecture

Efficient execution on CPU, GPU and beyond

Consistent programming model

PowerVR GPU

Core

Scheduler

Core

SIMD

SIMD

SIMD

Small
Cache

Small
Cache

Small
Cache

Efficiency building blocks

Full cache coherency

Large Cache

User mode queues

Reduced bandwidth and improved efficiency

Significant reduction in work item latency

Signals

Efficient control over scheduling and synchronization

Unified Coherent Memory

Benefits for Compute and also Graphics

Staged roll-out from 2016 onwards

Copyright 2015 HSA Foundation. All Rights Reserved.

15

IMAGINATION HSA COMPLIANT IP COMING SOON

Imagination Smart Vision IP Platform
We will be rolling out:
PowerVR
MIPS
CPU
GX7200
HSA-compliant
Series6XT
2 cluster

AFE

Ensigma RPU

Customer
IP

PowerVRGX7200
GPU
PowerVR
Series6XT
HSA-compliant
2 cluster

DDR3/4

Coherent HSA-compliant SoC fabric

TE &
Clock & Crypto
Reset
Control

Display Pipeline

HSA across all

PowerVR GPUs

HSA compliant fabric

solutions

PowerVR JPEG
Encode
Customer
IP

eFuse

PSU &
Power
Control

JTAG
& Test

HSA across all

MIPS I-class and
P-class CPUs

PowerVR Video
Decode

L2 cache

DMAC

ROM

PowerVR Video
Encode

RAM

PowerVR Camera
ISP

OTP
Bridge

Peripheral Bus
Peripherals
GPIO; UART; I2C; I2S; SPI; SD

Copyright 2015 HSA Foundation. All Rights Reserved.

Customer IP
& interfaces

NAND

MIPI

USB3

HDMI
Tx & Rx

16

SUMMARY
HSA solves a real problem for developers and SoC designers

Creates a common architectural foundation for hardware design;

allows innovation where it matters

Ensures a pervasive deployed platform for software developers

Eases the problems of software development for multiple hardware platforms

Provides standardized tools and APIs for debugging and profiling

Supports multiple vendors of IP in the same SoC

Exciting times coming for HSA

Expect HSA product announcements from multiple companies

Phones, tablets, notebooks, workstations, supercomputers

Copyright 2015 HSA Foundation. All Rights Reserved.

17

THANK YOU

Copyright 2015 HSA Foundation. All Rights Reserved.

18