1. Team 4 Camera Interface Project Bryan Rice and Tom Smith

2. Video Demonstration Video Demonstration

3. Layout Slide Team Introduction Camera Interface – The Vision Project Management High Level Design Specifications Future Desired Features

4. Camera Interface – The Vision The plan for this device is to be able to recognize patterns and use it to convey information to a phone, GPS, or internet. The market would be targeted toward security businesses and people whom need surveillance for safety. Once application this would have would be to monitor a common area for different images, taking some still shots to show the customer.

5. Camera Interface – The Vision Design Intentions Constant streaming Picture storing/loading Simple GUI Alert system

6. Camera Interface – The Vision Design Intentions Corner mount Constant surveillance Internet communication

7. Camera Interface -Vision . Security Children Elderly Elevator speech – Envision a brighter future, where distance did not stop you from checking in on your loved ones.

8. Project Management Tools used for project management included Agile / Jira Scrum Methods Microsoft Project Majority of the project was managed through calls/texts. Jira was used to complement organization.

9. Project Management - Jira Pros Ability to see task and progress (insert chart) A variety of Data charts allowed you to see team progression Cons Success of using Jira is dependant on how much the team invest Task deletion and additions were confusing at times. Not all permissions to access Task were granted

10. Project Management – Traditional Pros Management time needed reduced Constant communication Team discussion increased Cons Miscommunications Organization Initial documentation

11. Project Management – Microsoft Project Pros Initially Provided a structured progression plan Tasks were divided between team members Provided a way to measure project progression Cons Up front planning Manually changing task deadlines and resources

12. High Level Design Spec

13. Video Chain This is the video processing chain that takes the input from the camera and outputs it on the touchscreen. This chain was designed to easily be expandable for future use

14. Video In Decoder Imports the signal from the camera into the Avalon Streaming Fabric used for the rest of the streaming process. The stream is imported at 2592 x 1944 and is in the Bayer format

15. Bayer Formatting Bayer formatting is the way in which camera’s capture data. It is made up of sections of mosaics as seen below. Obviously this is not helpful when trying to process the image so it must be converted.

16. Bayer Pattern Resampler The very first thing that must be done to the stream is convert all of the mosaics into something that we can understand. The Bayer resampler coverts the massive 2592 x 1944 image into 1296 x 972 and a standard RGB pattern.

17. Clipper The Clipper clips the image into a more standard resolution, cutting the sides and the top to a resolution of 800x960. It was important to find good even numbers so they could be scaled appropriately.

18. Scaler The scaler halves the height of the image, so we are left with a resolution of 800 x 480, the exact resolution of the touchscreen that we are outputting to. Causes some distortion but given the full frame nature of the camera this was the best option.

19. RGB Resampler Design uses 2 RGB Resamplers An unfortunate limitation of the RAW to Video Processing cores are the RGB limitations. Resampled from 3 plane 24 bit color to single plan 16 bit color and vice versa later on.

20. Converters and Timing Adapters The signal needs to be converted from the RAW format to a format that can be used by the frame buffer. Timing adapters added automatically. Timing mismatch of 1 clock cycle taken care of with adapters.

21. Frame Buffer Unlike the frame buffer we have used in the past, the Video Processing frame buffer is extremely customizable. Stores the full resolution 800x480 16 bit image in SDRAM. Can use any memory location.

22. Dual Clock FIFO Syncs the 50MHz processing chain with the 25MHz VGA clock.

23. LCD Screen Terasic 4.3" LCD Touch Panel Package 800x480 native resolution Integrated touch panel 40 pin GPIO connection

24. GUI Designed but not implemented

25. Tech Roadblocks Complexity of available IP Cores. Complexity of streaming bus architecture. Speed of device. Memory locations on DE2. Time.

26. Lessons Learned Communication is key Document early Ambition drives project Reality fights ambition