Video Streaming


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Video Streaming

  1. 1. Team 4 Camera Interface Project<br />Bryan Rice and Tom Smith<br />
  2. 2. Video Demonstration<br />Video Demonstration<br />
  3. 3. Layout Slide<br />Team Introduction<br />Camera Interface – The Vision<br />Project Management<br />High Level Design Specifications<br />Future Desired Features<br />
  4. 4. Camera Interface – The Vision<br />The plan for this device is to be able to recognize patterns and use it to convey information to a phone, GPS, or internet.<br />The market would be targeted toward security businesses and people whom need surveillance for safety. <br />Once application this would have would be to monitor a common area for different images, taking some still shots to show the customer. <br />
  5. 5. Camera Interface – The Vision<br />Design Intentions<br />Constant streaming<br />Picture storing/loading<br />Simple GUI<br />Alert system<br />
  6. 6. Camera Interface – The Vision<br />Design Intentions<br />Corner mount<br />Constant surveillance <br />Internet communication<br />
  7. 7. Camera Interface -Vision .<br />Security<br />Children <br />Elderly <br />Elevator speech – Envision a brighter future, where distance did not stop you from checking in on your loved ones.<br />
  8. 8. Project Management<br />Tools used for project management included<br />Agile / Jira<br />Scrum Methods<br />Microsoft Project<br />Majority of the project was managed through calls/texts. Jira was used to complement organization.<br />
  9. 9. Project Management - Jira<br />Pros<br />Ability to see task and progress (insert chart)<br />A variety of Data charts allowed you to see team progression<br />Cons<br />Success of using Jira is dependant on how much the team invest <br />Task deletion and additions were confusing at times. <br />Not all permissions to access Task were granted<br />
  10. 10. Project Management – Traditional <br />Pros <br />Management time needed reduced<br />Constant communication<br />Team discussion increased<br />Cons<br />Miscommunications<br />Organization<br />Initial documentation<br />
  11. 11. Project Management – Microsoft Project<br />Pros<br />Initially Provided a structured progression plan<br />Tasks were divided between team members<br />Provided a way to measure project progression<br />Cons<br />Up front planning<br />Manually changing task deadlines and resources<br />
  12. 12. High Level Design Spec<br />
  13. 13. Video Chain<br />This is the video processing chain that takes the input from the camera and outputs it on the touchscreen.<br />This chain was designed to easily be expandable for future use <br />
  14. 14. Video In Decoder<br />Imports the signal from the camera into the Avalon Streaming Fabric used for the rest of the streaming process. The stream is imported at 2592 x 1944 and is in the Bayer format<br />
  15. 15. Bayer Formatting<br />Bayer formatting is the way in which camera’s capture data.<br />It is made up of sections of mosaics as seen below.<br />Obviously this is not helpful when trying to process the image so it must be converted.<br />
  16. 16. Bayer Pattern Resampler<br />The very first thing that must be done to the stream is convert all of the mosaics into something that we can understand.<br />The Bayer resampler coverts the massive 2592 x 1944 image into 1296 x 972 and a standard RGB pattern.<br />
  17. 17. Clipper<br />The Clipper clips the image into a more standard resolution, cutting the sides and the top to a resolution of 800x960.<br />It was important to find good even numbers so they could be scaled appropriately.<br />
  18. 18. Scaler<br />The scaler halves the height of the image, so we are left with a resolution of 800 x 480, the exact resolution of the touchscreen that we are outputting to.<br />Causes some distortion but given the full frame nature of the camera this was the best option.<br />
  19. 19. RGB Resampler<br />Design uses 2 RGB Resamplers<br />An unfortunate limitation of the RAW to Video Processing cores are the RGB limitations.<br />Resampled from 3 plane 24 bit color to single plan 16 bit color and vice versa later on.<br />
  20. 20. Converters and Timing Adapters<br />The signal needs to be converted from the RAW format to a format that can be used by the frame buffer.<br />Timing adapters added automatically.<br />Timing mismatch of 1 clock cycle taken care of with adapters.<br />
  21. 21. Frame Buffer<br />Unlike the frame buffer we have used in the past, the Video Processing frame buffer is extremely customizable.<br />Stores the full resolution 800x480 16 bit image in SDRAM.<br />Can use any memory location.<br />
  22. 22. Dual Clock FIFO<br />Syncs the 50MHz processing chain with the 25MHz VGA clock.<br />
  23. 23. LCD Screen<br />Terasic 4.3" LCD Touch Panel Package<br />800x480 native resolution<br />Integrated touch panel<br />40 pin GPIO connection<br />
  24. 24. GUI<br />Designed but not implemented<br />
  25. 25. Tech Roadblocks<br />Complexity of available IP Cores.<br />Complexity of streaming bus architecture.<br />Speed of device.<br />Memory locations on DE2.<br />Time.<br />
  26. 26. Lessons Learned <br />Communication is key<br />Document early<br />Ambition drives project<br />Reality fights ambition<br />