This implemented DSP system utilizes TCP socket communication. Upon message reception, it decides the appropriate process to be executed based on cases which can be categorized as follows: 1) image capture 2) image transfer 3) image processing 4) sensor calibration A user-friendly MATLAB GUI, named DIPeth, facilitates the system's control.

1. IMAGE CAPTURE, PROCESSING AND TRANSFER VIA
ETHERNET UNDER CONTROL OF MATLAB GUI, USING
TI TMS320C6713 DSP & ITS DSK_EYE DAUTERCARD
Christopher Diamantopoulos
Spiros Oikonomou
University of Patras, June 2015 || rev 1.2

2. > TI TMS320C6713 DSP_
The TMS320C6713 device belongs to the floating-point DSP
generation in the TMS320C6000™ DSP platform. The C6713
device is based on the high-performance, advanced very-
long-instruction-word (VLIW) architecture developed by
Texas Instruments (TI)
HARDWARE
SOFTWARE
GUI
TESTING
2

3. The TMS320C6713 device belongs to the floating-point DSP
generation in the TMS320C6000™ DSP platform. The C6713
device is based on the high-performance, advanced very-
long-instruction-word (VLIW) architecture developed by
Texas Instruments (TI)
 Feature highlights
 Eight 32-Bit Instructions/Cycle
 32/64-Bit Data Word
 225-, 200-MHz (GDP), and 200-, 167-MHz (PYP) Clock
Rates
 4.4-, 5-, 6-Instruction Cycle Times
 1800/1350, 1600/1200, and 1336/1000 MIPS /MFLOPS
 Highly Optimized C/C++ Compiler
 Two ALUs (Fixed-Point)
 Four ALUs (Floating- and Fixed-Point)
 Two Multipliers (Floating- and Fixed-Point)
 Load-Store Architecture With 32 32-Bit General-Purpose
Registers
 32-Bit External Memory Interface (EMIF)
• Glueless Interface to SRAM, EPROM, Flash, SBSRAM,
and SDRAM
• 512M-Byte Total Addressable External Memory Space
 Two Inter-Integrated Circuit Bus (I2C Bus™) Multi-Master
and Slave Interfaces
 Two Multichannel Buffered Serial Ports
• Serial-Peripheral-Interface (SPI)
> TI TMS320C6713 DSP_
HARDWARE
SOFTWARE
GUI
TESTING
3

4. > bitec dsk eye gigabit daughtercard_
The DSKeye gigabit from Bitec is a TI DSK daughterboard
gathering the latest FPGA technology, a 5.2 mega pixel
camera and user configurable interface options to deliver
a Smart Camera system for development and research at a
fraction of the cost normally associated with such
technology.
HARDWARE
SOFTWARE
GUI
TESTING
4

5. The DSKeye gigabit from Bitec is a TI DSK daughterboard
gathering the latest FPGA technology, a 5.2 mega pixel
camera and user configurable interface options to deliver
a Smart Camera system for development and research at a
fraction of the cost normally associated with such
technology.
 Feature highlights
 ASIXTM AX88180 + Marvell 88E1111
 Compatible with IEEE802.3, IEEE802.3u and 802.3ab
standards
 Support 10/100/1000Mbps data rate
 Support full duplex operation with 1000Mbps
 Support full and half duplex operations with 10/100
Mbps
 Support Wake-on-LAN function
 Cyclone II EP2C8
 8256 logic elements
 165888 RAM bits
 Large capacity for user defined signal processing logic
> bitec dsk eye gigabit daughtercard_
HARDWARE
SOFTWARE
GUI
TESTING
5

6. The DSKeye gigabit from Bitec is a TI DSK daughterboard
gathering the latest FPGA technology, a 5.2 mega pixel
camera and user configurable interface options to deliver
a Smart Camera system for development and research at a
fraction of the cost normally associated with such
technology.
 LWIP TCP/IP stack
• A port of the lwIP stack is included with the DSK-EYE
gigabit. This port allows users to write TCP compatible
applications using a set of APIs. At the highest level,
the user can choose to access the TCP stack using the
standard Berkley sockets interface.
• TCP/IP parameters such as the MAC and IP address etc.
can be modified in lwip_NetStart.c file. Default IP and
MAC parameters are the following:
IP4_ADDR(&gw, 192,168,11,1);
IP4_ADDR(&ipaddr, 192,168,11,33);
IP4_ADDR(&netmask, 255,255,255,0);
> bitec dsk eye gigabit daughtercard_
HARDWARE
SOFTWARE
GUI
TESTING
6

7. > Omnivision ov5610 cmos sensor_
The OV5610 (color) CAMERACHIPTM is a high performance 5.17
mega-pixel sensor for digital still image and video
camera products
HARDWARE
SOFTWARE
GUI
TESTING
7

8. The OV5610 (color) CAMERACHIPTM is a high performance 5.17
mega-pixel sensor for digital still image and video
camera products
 Feature highlights
 Array size:
• QSXGA (2592x1944)
• SXGA (1280x960)
• VGA (640x480)
• HF (320x200)
 Optical black level calibration
 Video or snapshot operations
 Programmable/Auto Exposure and Gain Control
 Programmable/Auto White Balance Control
 Horizontal and vertical sub-sampling (4:2 and 4:2)
 High frame rate output mode
 Programmable image windowing/zooming/panning
 Variable frame rate control
 On-chip R/G/B Channel and Luminance Average Counter
 Internal/External frame synchronization
 Serial bus interface
 Power-on reset and power-down modes
> Omnivision ov5610 cmos sensor_
HARDWARE
SOFTWARE
GUI
TESTING
8

9. The OV5610 (color) CAMERACHIPTM is a high performance 5.17
mega-pixel sensor for digital still image and video
camera products
 Image encoding
The camera image is encoded in a Bayer pattern.
 OV5610 API
A limited API exists for the OV5610 camera chip. This API
is used by the DSK-EYE API but is also accessible for
user applications. A series of MACROS are available which
allow easy access to the internal registers of the
camera.
> Omnivision ov5610 cmos sensor_
HARDWARE
SOFTWARE
GUI
TESTING
9

10. I²C (Inter-Integrated Circuit), is a multi-master, multi-
slave, single-ended, serial computer bus invented by
Philips Semiconductor (now NXP Semiconductors). It is
typically used for attaching lower-speed peripheral ICs
to processors and microcontrollers.
"I2C" by en:user:Cburnett - Own work made with. Inkscape Licensed under CC BY-SA
3.0 via Wikimedia Commons
 Main advantages
 uses only two bidirectional open-drain lines, Serial
Data Line (SDA) and Serial Clock Line (SCL)
 ACK (acknowledged) bit for an address, ensures that
data are sent
 Main disdvantages
 maximum number of nodes is limited by the address space
and by the total bus capacitance
 shared bus hanging for malfunctioning devices
> i2c protocol_
HARDWARE
SOFTWARE
GUI
TESTING
10

11. Code Composer Studio is an integrated development
environment (IDE) that supports TI's Processors. It
comprises a suite of tools used to develop and debug
embedded applications. It includes an optimizing C/C++
compiler, source code editor, project build environment,
debugger, profiler, and many other features.
HARDWARE
SOFTWARE
GUI
TESTING
> Code comporer studio_
11

12. Code Composer Studio is an integrated development
environment (IDE) that supports TI's Processors. It
comprises a suite of tools used to develop and debug
embedded applications. It includes an optimizing C/C++
compiler, source code editor, project build environment,
debugger, profiler, and many other features.
 Project migration & building process
 dsk6713_webview.pjt web server example project was used
as base. It is built for CCS 3.1 and it utilizes two
dependent projects:
• DSK6713_camera.pjt: generates the camera library file
DSK6713_camera.lib compiling three c programs (i2c.c,
ov5610.c & dskeye.c)
• DSK6713_LWIP.pjt: generates the communication library
file DSK6713_lwip.lib compiling a bunch of c programs
 DSP/BIOS configuration file was converted from .cdb
format to .tcf, using the provided tool
cdb2tcf.exe (the generated file replaced the old one
under DSP/BIOS Config project branch)
HARDWARE
SOFTWARE
GUI
TESTING
> Code comporer studio_
12

13. Code Composer Studio is an integrated development
environment (IDE) that supports TI's Processors. It
comprises a suite of tools used to develop and debug
embedded applications. It includes an optimizing C/C++
compiler, source code editor, project build environment,
debugger, profiler, and many other features.
 Project migration & building process
 C programming
> Code comporer studio_
HARDWARE
SOFTWARE
GUI
TESTING
DIPeth.c
This is the main program. It opens TCP connection & listens to
port 80 for incoming characters. An extensive case statement
triggers all the appropriate processes.
Image_Processing_API.c
Handles all Image Processing
functions, such as space
conversions, histogram
manipulation or image
filtering
System_Design_API.c
Handles OV5610 register R/W
functions & image transfers
13

14. Code Composer Studio is an integrated development
environment (IDE) that supports TI's Processors. It
comprises a suite of tools used to develop and debug
embedded applications. It includes an optimizing C/C++
compiler, source code editor, project build environment,
debugger, profiler, and many other features.
 Project migration & building process
 Build options of the main project were modified and
.out file was generated after project build process:
• compiler settings
• linker settings
• main program (DIPeth.c) optimization of execution
> Code comporer studio_
-o1 -
fr"C:CCStudio_v3.3MyProjectsDSK_EYEexampleswebviewDSK6713Deb
ug" -i"$(Proj_dir)......srclwipcommonarchC6xinclude" -
i"$(Proj_dir)......srclwipcommonlwipsrcincludeipv4" -
i"$(Proj_dir)......srclwipcommonlwipsrcinclude" -d"_DEBUG"
-d"CHIP_6713" -ml3 -mv6700
-c -m".Debugdsk6713_webview.map" -o".Debugdsk6713_webview.out" -
w -x
HARDWARE
SOFTWARE
GUI
TESTING
Project level options
And -o3
And Not -o1
14

15. Bayer colour filter array is a popular format for digital
acquisition of colour images. Half of the total number of
pixels are green (G), while a quarter of the total number
is assigned to both red (R) and blue (B).
 Four possible interpolating cases
 the value for the blue component on a shaded G pixel
 will be the average of the blue pixels, while the value
for the red component will be the average of the two
red pixels
 For the value of the blue component to be interpolated
for a R pixel. we take the average of the four nearest
blue pixels cornering the R pixel
 Similarly, to determine the value of the red component
on a B pixel we take the average of the four nearest
red pixels cornering the B pixel
> Bayer to rgb conversion_
HARDWARE
SOFTWARE
GUI
TESTING
15

16. Bayer colour filter array is a popular format for digital
acquisition of colour images. Half of the total number of
pixels are green (G), while a quarter of the total number
is assigned to both red (R) and blue (B).
 Two possible G component interpolating cases
* For faster execution, the third calculation could be used for
both cases
> Bayer to rgb conversion_
HARDWARE
SOFTWARE
GUI
TESTING
16

17. The Transmission Control Protocol provides a
communication service at an intermediate level between an
application program and the Internet Protocol. It
provides host-to-host connectivity at the Transport Layer
of the Internet model. At the transport layer, the
protocol handles all handshaking and transmission details
and presents an abstraction of the network connection to
the application.
"Tcp state diagram fixed new" by Scil100. Licensed under CC BY-SA 3.0 via Wikimedia Commons
> Tcp socket connection_
HARDWARE
SOFTWARE
GUI
TESTING
17

18. The Transmission Control Protocol provides a
communication service at an intermediate level between an
application program and the Internet Protocol. It
provides host-to-host connectivity at the Transport Layer
of the Internet model. At the transport layer, the
protocol handles all handshaking and transmission details
and presents an abstraction of the network connection to
the application.
 Sent bytestream
image from http://www.slideshare.net/aswinkartick/mk-ppt-chapter-5
302700 x 3 bytes
> Tcp socket connection_
HARDWARE
SOFTWARE
GUI
TESTING
18

19. Y′CbCr, is a family of color spaces used as a part of the
color image pipeline in video and digital photography
systems. Y′ is the luma component and Cb and Cr are the
blue-difference and red-difference chroma components.
Y′CbCr is not an absolute color space. Rather, it is a
way of encoding RGB information.
 Colour space for processing
"CCD" by LionDoc - Own work. Licensed under Public Domain via Wikimedia Commons
> Image processing_
HARDWARE
SOFTWARE
GUI
TESTING
19

20. GUIs provide point-and-click control of software
applications, eliminating the need to type commands in
order to run the application.
> Graphical user interface_
HARDWARE
SOFTWARE
GUI
TESTING
20

21. GUIs provide point-and-click control of software
applications, eliminating the need to type commands in
order to run the application.
 Feature highlights
 User-friendly interface
 Explanatory tooltips & dialogs
 Communication error handling ability
 Standalone executable application (no need for running
MATLAB instance)
> Graphical user interface_
HARDWARE
SOFTWARE
GUI
TESTING
21
1 2
5
8
6 7
3
4

22. GUIs provide point-and-click control of software
applications, eliminating the need to type commands in
order to run the application.
 GUI v.0.2.0 sections
 CAPTURED IMAGE  PROCESSED IMAGE
 INFORMATIVE CONSOLE  DSK CONTROL (CCS LINK)
 CAPTURE BUTTON  SENSOR ADJUSTMENTS
 IMAGE PROCESSING BUTTONS  SENSOR RESET
> Graphical user interface_
HARDWARE
SOFTWARE
GUI
TESTING
22

23. Regarding the captured image bytestream, the GUI handles
the image by splitting the colour components accordingly
in three 640x480 matrices. In case of a grayscale image,
the procedure simplified in a 640x480 matrix fill.
 Colour image construction
> Image composition_
HARDWARE
SOFTWARE
GUI
TESTING
23
480 px
640 px
480 px
640 px

24. System was tested in laboratory under various lighting
conditions. Captured frames satisfied several concepts
(places, low-light room, bright displays etc).
 System setup
 PC network adapter was set appropriately
 DSP board was connected to PC via CAT 5 Ethernet cable
> System testing_
HARDWARE
SOFTWARE
GUI
TESTING
24

25. System was tested in laboratory under various lighting
conditions. Captured frames satisfied several concepts
(places, low-light room, bright displays etc).
 Image processing samples
• RGB2Grayscale
• Edge detection
> System testing_
HARDWARE
SOFTWARE
GUI
TESTING
25

26. System was tested in laboratory under various lighting
conditions. Captured frames satisfied several concepts
(places, low-light room, bright displays etc).
 Image processing samples
• White balance
• Histogram inversion
> System testing_
HARDWARE
SOFTWARE
GUI
TESTING
26

27. System was tested in laboratory under various lighting
conditions. Captured frames satisfied several concepts
(places, low-light room, bright displays etc).
 Image processing samples
• Sharp image
• Blue channel adjustment
> System testing_
HARDWARE
SOFTWARE
GUI
TESTING
27