Kondalarao Polisetti
Senior Design Engineer , Xilinx
MIPI CSI-2SM
for Multi-camera,
Long Range Use Cases and
Implementation Methods Using
FPGAs
©	2017	MIPI	Alliance,	Inc.
Agenda
• MIPI CSI-2 Introduction & Features
• Camera Market & Projections
• Multi-camera & Long Distance Use Case(s)
• System Requirements
• Value of FPGA for MIPI CSI-2
• Q & A
2
Xilinx
©	2017	MIPI	Alliance,	Inc.
mipi.org
• MIPI	Alliance: Developing	the	world’s	most	comprehensive	set	
of	interface	specifications	for	mobile	and	mobile-influenced	
products.
3
Source:	mipi.org
Xilinx
©	2017	MIPI	Alliance,	Inc.
MIPI	CSI-2	Features
Note: MIPI	CSI-2SM 1.1,	MIPI	D-PHYSM 1.1	considered	in	this	presentation.
• Multi-lane	support	(1.5Gbps/Lane)
• Multiple	data	types	(RAW,RGB,YUV)
• Interleaving	(VC	,	Data	type)
4
Xilinx
©	2017	MIPI	Alliance,	Inc.
MIPI	CSI-2	Features
5
Xilinx
©	2017	MIPI	Alliance,	Inc.
MIPI	CSI-2	Features
6
Xilinx
©	2017	MIPI	Alliance,	Inc.
Camera	Projections
7
• Camera	market	by	application
Source:	grandviewresearch.com
Xilinx
©	2017	MIPI	Alliance,	Inc.
Automotive-ADAS	Projections
8
Source:	IHS
Xilinx
©	2017	MIPI	Alliance,	Inc.
Video	Surveillance	Projections
9
Source:	IHS
Xilinx
©	2017	MIPI	Alliance,	Inc.
Multi-camera	Systems
10
CSI-2Rx Video	
Processing
Visualization
Multiple	channels,	multiple	instances
Single	channel,	single	instance
How	many	cam’s	can	be	supported?	
System	level	aspects	in	such	designs
How	many	cam’s	can	be	supported?	
System	level	aspects	in	such	designsü Bandwidth
ü Protocol	support
ü Mux	Chip	support
ü Bandwidth
ü Protocol	support
ü Mux	Chip	support
ü IO	Support
CSI-2Rx
Video	
Processing
Visualization
CSI-2Rx
CSI-2Rx
Video	
Processing
Visualization
Mux	
Chip
CSI-2RxMux	
Chip
CSI-2Rx Video	
Processing
Visualization
Mux	
Chip
Type-1 Type-2Xilinx
©	2017	MIPI	Alliance,	Inc.
System	aspects-Type1
11
VC=0,RAW8
VC=1,RAW8
VC=2,RAW8
VC=3,RAW8
MIPI	CSI-2	
Mux	Chip
MIPI	Single	
Channel
VC=0,RAW10
VC=1,RAW10
VC=2,RAW10
VC=3,RAW10
VC=0,RAW12
VC=1,RAW12
VC=2,RAW12
VC=3,RAW12
üTotal	bandwidth	available
üInterleaving	as	supported	MIPI	CSI-2	Specification
üMaximum	input	channels	supported	by	mux	chip
CSI-2Rx Video	
Processing
Visualization
Mux	
Chip
How	many	cam’s	can	be	supported?	
System	level	aspects	in	such	designs
Xilinx
©	2017	MIPI	Alliance,	Inc.
System	aspects-Type2
12
üTotal	bandwidth	available
üInterleaving	as	supported	MIPI	CSI-2	Specification
üMaximum	input	channels	supported	by	mux	chip
üMaximum	CSI-2	Instances	that	can	be	implemented	on	the	chip
VC=0,RAW8
VC=1,RAW8
VC=2,RAW8
VC=3,RAW8
MIPI	CSI-2	
Mux	Chip
VC=0,RAW10
VC=1,RAW10
VC=2,RAW10
VC=3,RAW10
VC=0,RAW12
VC=1,RAW12
VC=2,RAW12
VC=3,RAW12
VC=0,RAW8
VC=1,RAW8
VC=2,RAW8
VC=3,RAW8
MIPI	CSI-2	
Mux	Chip
VC=0,RAW10
VC=1,RAW10
VC=2,RAW10
VC=3,RAW10
VC=0,RAW12
VC=1,RAW12
VC=2,RAW12
VC=3,RAW12
MIPI	CSI-2	Rx
Instances
CSI-2Rx
Video	
Processing
Visualization
Mux	
Chip
CSI-2RxMux	
Chip
How	many	cam’s	can	be	supported?	
System	level	aspects	in	such	designs
ü Protocol	support
ü Mux	Chip	support
ü IO	Support
Xilinx
©	2017	MIPI	Alliance,	Inc.
System	Requirements-Type1
13
• 1920x1080	@	30fps,	RAW8	->	Requires	~0.74Gbps
Bandwidth Interleaving Mux	Chip
6/0.74=8
1.5Gbps,
4L=6
4*1=	4
VC=4
DT=1(RAW8)
Lets	say	‘4’
Based	on	
Chip
min(8,4,4)=4
Xilinx
©	2017	MIPI	Alliance,	Inc.
System	Requirements-Type2
14
• 1920x1080	@	30fps,	RAW8	->	Requires	~0.74Gbps
Bandwidth Interleaving Mux	Chip
6/0.74=8
1.5Gbps,
4L=6
4*1=	4
VC=4
DT=1(RAW8)
Lets	say	‘4’
Based	on	
Chip
IO	Support
Based	on	
FPGA	IO
AutoGrade US+	
supports	8	
Instances	with	
Native	IO’s
min(8,4,4)=4
CSI-2	Instances=	8
Max	Cam’s	=	4*8	=	32
Xilinx
©	2017	MIPI	Alliance,	Inc. 15
Source:	mipi.org
Surround	View
Traffic	Sign	
Park	
Assistance
Lane	
Departure
Surround	View
Multi-camera	&	Long	Distance	Use	Case(s)
Xilinx
©	2017	MIPI	Alliance,	Inc. 16
Long	Distance	Using	Bridge	IC’s
CSI-2Rx Video	
Processing
Visualization
Mux	
Chip
Bridge	
IC
Converts	MIPI	D-PHYSM
to	LVDS
Converts	LVDS	to	
MIPI	D-PHYSM
MIPI	Interfaces	may	be	converted	to/from	these	high	
speed	transports	in	bridge	chips	when	length	exceed	MIPI	
Specification	lengths
Supported	cable	
length,data rate	
etc.,		determined	
by	Bridge	IC
Bridge	
IC
Xilinx
©	2017	MIPI	Alliance,	Inc. 17
Xilinx
Value	of	FPGA	for	MIPI	CSI-2
• Most	flexible	&	scalable	platform	for	maximum	reuse	and	best	
TTM		
ü Implement	End-to-End	systems	with	ease
• Latest	FPGAs	can	speak	MIPI	D-PHY
ü Single	Chip(PHY+Controller),	reduces	BOM.	More	D-PHY	interfaces	per	chip	(	>	16)
ü Flexible	interfaces:	Lanes	(1,2,3,4),	Data	rates,	VC	filtering	etc..
• Latest	FPGAs	built	on	a	common	real-time	processor and	
programmable	logic equipped	platform	enables	unlimited	
possibilities	for	next	generation	ADAS	applications	
ü Innovative	ARM®	+	FPGA	architecture	for	differentiation,	analytics	&	control
©	2017	MIPI	Alliance,	Inc.
Q	&	A
18
Xilinx
MIPI DevCon Bangalore 2017: MIPI CSI-2 for Multi-Camera, Long-Range Use Cases and Implementation Methods Using FPGAs

MIPI DevCon Bangalore 2017: MIPI CSI-2 for Multi-Camera, Long-Range Use Cases and Implementation Methods Using FPGAs