The document summarizes a seminar presentation on the development of machine vision and laser radar based autonomous vehicle guidance systems for navigating citrus groves. The key points are:
1) The system was developed to automate citrus harvesting in Florida as GPS is unreliable under citrus tree canopies. It uses machine vision and laser radar sensors along with a PID controller to autonomously steer a tractor down citrus alleyways.
2) Experiments were conducted using artificial paths made of hay bales to evaluate the performance of the machine vision and laser radar guidance systems. The laser radar based system showed better guidance at speeds up to 3.1 m/s.
3) Testing in actual citrus
Demonstration in Sioux Falls, SD to showcase the unpaved road assessment equipment . Accurately and quickly assess road condition. Low cost, highly accurate, rapid asset management for improving unpaved road infrastructure. For more information visit: http://unpavedroadsremotesensing.com/
Demonstration in Sioux Falls, SD to showcase the unpaved road assessment equipment . Accurately and quickly assess road condition. Low cost, highly accurate, rapid asset management for improving unpaved road infrastructure. For more information visit: http://unpavedroadsremotesensing.com/
GPS World wide navigation and tracking systemarafyghazali
completer description about the historu and invention,developmental stages,architecture,working,advantages,errors,signals,functionality,aims,advancements and future prospects and remedies of solution about global positioning system.GPS
The EASY INSPECTRA network survey vehicle is perfectly adapted for the constraints of leak detection in densely urbanized areas, providing access to city centers and pedestrian areas. It revolutionizes the very concept of network survey by combining detection from a vehicle with detection on foot.
LIDAR is an acronym for LIght Detection And Ranging. It is an optical remote sensing technology that can measure the distance to or other properties of a target by illuminating the target with light pulse to form an image.
The presentation explains the basics of LiDAR Technology with its applications and case studies. This is presented by the Second Year Instrumentation and Control Engineering students of Vishwakarma Institute of Technology, Pune.
This presentation highlights the application of "5-Phase Project Management" implemented by Weiss and Wysocki, towards an automated traffic control system.
GPS World wide navigation and tracking systemarafyghazali
completer description about the historu and invention,developmental stages,architecture,working,advantages,errors,signals,functionality,aims,advancements and future prospects and remedies of solution about global positioning system.GPS
The EASY INSPECTRA network survey vehicle is perfectly adapted for the constraints of leak detection in densely urbanized areas, providing access to city centers and pedestrian areas. It revolutionizes the very concept of network survey by combining detection from a vehicle with detection on foot.
LIDAR is an acronym for LIght Detection And Ranging. It is an optical remote sensing technology that can measure the distance to or other properties of a target by illuminating the target with light pulse to form an image.
The presentation explains the basics of LiDAR Technology with its applications and case studies. This is presented by the Second Year Instrumentation and Control Engineering students of Vishwakarma Institute of Technology, Pune.
This presentation highlights the application of "5-Phase Project Management" implemented by Weiss and Wysocki, towards an automated traffic control system.
Autonomous Vehicles: Technologies, Economics, and OpportunitiesJeffrey Funk
These slides use concepts from my (Jeff Funk) course entitled analyzing hi-tech opportunities to show how the cost and performance of autonomous vehicles are improving rapidly. LIDAR, other sensors, ICs, and wireless are experiencing rapid improvements that are enabling the overall cost of AVs to fall. For example, the latency of wireless systems is improving rapidly thus enabling vehicles to be controlled with wireless systems. This is also creating many new opportunities in the vehicle industry in the Internet of Things, data analytics, and logistics. The slides include a detailed discussion of AVs in Singapore, a likely early adopter.
Cadee is helping golfer understand and improve their game. Just by taking a photo of their scorecard, we digitize their data and help them track their stats over time. We also connect them with other golfers and courses to help them get even more out of their game.
The main goal of this presentation is how to do research in particular field of engineering. For an example this presentation describes design of Vehicle tracking and monitoring system. So how to do research in particular field by referring standard IEEE papers is described in this presentation.
Autonomous car based on artificial intelligence which is used by google for replacing drivers in car. Which will leads to the driving into the next phase
This research addresses the longstanding challenges surrounding underground lighting on curved highways, which have led to significant safety concerns and high crash rates (Adnan et al., 2020; Friesen et al., 2014). Underground lighting for curved highways poses longstanding issues for driver safety and high crash rates due to poor visibility conditions (Raj et al., 2016; Alsayaydeh et al.). Conventional vehicle detection methods are limited by poor lighting, obstructed sight lines, and radar interference in curved tunnels (Adnan et al., 2020; Raj et al., 2016). An Arduino-powered system for real-time vehicle detection and instant tunnel lighting activation shows promise to enhance visibility and safety by recognizing emergency vehicles and controlling traffic signals accordingly (Gowtham et al., 2021).
Lidar is an acronym for light detection and ranging. It is an optical remote sensing technology that can measure the distance to, or other properties of a target by illuminating the target with light, often using pulses from a laser.
The VSR INSPECTRA® is a natural gas distribution network survey vehicle with the exclusive laser spectroscopy analyzer and an integrated GPS system. It meets all productivity, reliability and traceability requirements of gas operators and its performance in leak detection is below 1 ppm sensitivity and ensures total methane selectivity.
Methane high sensitivity, below 1 ppm
Similar to Development of machine vision and laser radar based autonomous vehicle guidance system (20)
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Development of machine vision and laser radar based autonomous vehicle guidance system
1. SEMINAR TOPIC:
Development of Machine Vision and Laser
Radar Based Autonomous Vehicle Guidance
System for Citrus Grove Navigation
Author:
Thomos F. Burks & V. Subramainan
(Computer and Electronics in Agriculture, June 2006)
Speaker
:Ghotekar Ravikant Sainath (M.Tech 1st year)
Roll No.
:13AG61R16
3. • INTRODUCTION
Florida: 80 % citrus supply to United States
Citrus harvesting: lack of manpower
Citrus Industry: facing increased competition from overseas markets
Need of automation & robotics in agriculture for citrus grove
Current advanced navigation system in agricultural operation :GPS
GPS Limitations in citrus orchard: tree canopy blocks the satellite signals
Alley width is about 2.1-2.4m
Tree heights vary from 4.5m-6m depending on their age (Brown, 2002)
3
4. • INTRODUCTION
Potential
applications of
autonomous vehicle
guidance
•
•
•
•
•
•
Other applications •
of autonomous
•
vehicle guidance in
orchards
......continued
Relieve operator from steering responsibility
Relieve operator from speed control responsibilities
reduce operator fatigue
Improve cycle rate by reducing re-positioning efficiencies
Harvesting
Spraying
Mowing
Disease or nutritional deficiency monitoring
4
5. • Objectives
Modify the hydraulic steering circuit of the vehicle to control
the vehicle
Develop a PID ( proportional integral derivative) control
system for steering control
Develop two algorithms for path finding, one using machine
vision and another using laser radar
Evaluate the performance of the machine vision guidance
and the ladar guidance systems in a test path
5
6. • Material & Methods
Vehicle: John Deere 6410
Machine Vision Hardware
Laser Radar
Computer
Microcontroller
Encoder
Servo Valve
GPS Receiver
Power Supply (Inverter)
RS 232 Protocol
To send error info from PC to
6
microcontroller
7. • Material & Methods
….Continued
Tractor with all additional attachment for autonomous guidance
7
8. • Material & Methods
….Continued
System overall working
8
9. • Material & Methods
….Continued
Machine Vision
Ability of a computer to "see”
Includes one or more video cameras
for obtaining images for the computer
to interpret
With computer vision, there is always
a need of physical feature like colour
difference for the vision system to be
able to sense effectively
Vision involves many complicated
algorithms for image processing and
recognition
Camera mounted at the front
Threshold image
9
10. • Material & Methods
….Continued
Laser Radar (Ladar)
Principle: Time-of-flight Measurement
Remote sensing technology that measures distance by illuminating a
target with a laser and analysing the reflected light
Distance = (Speed of Light x Time of Flight) / 2
used for ranging and obstacle avoidance
Ladar Mounted on top of the
tractor
10
11. • Material & Methods
….Continued
EXPERIMENTAL PROCEDURE
An artificial testing path of hay bales was made
Algorithms for processing the image and ladar information
had developed for citrus orchard environment & hay bales
environment
Experiment were conducted on both testing path & Citrus
orchard environment by both below guidance system
A) Vehicle Guidance System by Machine Vision
B) Autonomous Guidance System by Laser Radar
System
11
12. • Material & Methods
….Continued
EXPERIMENTAL PROCEDURE ON ARTIFICIAL TESTING PATH
•Two types of paths: Straight path & Curved path
•The hay bale width was 45 cm, length of the straight path was 70
feet & an extension of 30 feet was given to form a curved path
•The path width was 3.5 m throughout the length.
•Experiments conducted for three different speeds i.e. 1.8m/s,
3.1m/s, 4.4m/s
•A rotating blade was attached to drawbar, which marked a line
on the ground as the vehicle moved (path center traveled by the
tractor)
•Manually error was measured
•Above procedure repeated to calculate the path root mean
square error, standard deviation, maximum error and average
error
12
13. • Material & Methods
….Continued
VEHICLE GUIDANCE SYSTEM BY MACHINE VISION
•Color: discriminator for segmenting the path
•Camera calibration: To convert pixel distance to true distance
•To account for the varying weather conditions: images collected
over a period of 6 days in 2 months from morning to evening at
half an hour intervals
•Three types of conditions observed
Cloudy days: trees are darker than the path
Bright sunny days: trees are darker than the path but all
pixel intensity values are elevated
Early morning and evening: when the sunlight causes the
trees on one side of the row to be brighter than the path
and the trees on the other side to be darker than the path
• Based on this database of images, a segmentation algorithm was
developed
13
14. Flowchart : Algorithm for path finding for
adaptive RGB threshold value using
machine vision
14
15. Fig. Machine vision results for citrus grove alleyway
Fig : Raw image
Fig : Tree canopy segmentation
Fig : Path boundary
15
16. • Material & Methods
….Continued
VEHICLE GUIDANCE BY Laser Radar Guidance System
The radial distance measured by the laser radar for different
angles, when driving through the test path was plotted.
The discontinuities in the plot indicate the location of the
hay bales
The path center was determined as the center of the path,
between the hay bales on either side
The laser radar navigation algorithm employed a threshold
distance based detection of hay bales
16
17. • Material & Methods
….Continued
DESIGN OF PID CONTROL FOR STEERING CONTROL
PID: Proportional integral derivative controller:
attempts to minimise the error by adjusting the process control inputs
17
18. • Material & Methods
….Continued
FORMULAE USED
Line fitting: Least square method
Pixel Distance to actual Distance
Conversion
100 cm = 177 pixels
Error Calculation
Desired position = (Right side tree boundary + Left side tree boundary) / 2
Error = Desired position – current position
Distance of the tractor centre from the hay bales
Distance = Radial Distance at the hay bale * cosine (Angle at that point)
18
20. • Results & Discussion
….Continued
Performance of machine vision guidance in the straight path
@ 1.8 m/s
@ 3.1 m/s
@ 4.4 m/s
20
21. • Results & Discussion
….Continued
Performance of laser radar guidance in the straight path
@ 1.8 m/s
@ 3.1 m/s
@ 4.4 m/s
21
22. • Results & Discussion
….Continued
Performance of machine vision guidance in the curved path
@ 3.1 m/s
Performance of laser radar guidance in the curved path
@ 3.1 m/s
22
23. • Conclusions
•Machine vision and laser radar based guidance systems were
developed to navigate a tractor through the alleyway of a citrus grove
•A PID controller was developed and tested to control the tractor
using the information from the machine vision system and laser radar
•It was found that the ladar-based guidance was the better guidance
sensor for straight and curved paths at speeds of up to 3.1 m/s
•Machine vision-based guidance showed acceptable performance at
all speeds and conditions
•The average errors were below 3 cm in most cases. The maximum
error was not more than 6 cm in any test run
•Experiments demonstrated the accuracy of the guidance system
under test path conditions and successful guidance of the tractor in a
citrus orchard alleyway
• Additional testing is needed to improve the performance in the
citrus orchard
23
24. • References
• Subramanian, V., Burks, T.F., Singh, S., 2004. Autonomous greenhouse
sprayer vehicle using machine vision and ladar for steering control.
Appl.Eng. Agric. 21 (5), 935–943.
• Bell, T., Bevly, D., Biddinger, E., Parkinson, B.W., Rekow, A., 1998.
Automatic tractor row and contour control on sloped terrain using
Carrier-Phase Differential GPS. In: Proceedings of the Fourth
International Conference on Precision Agriculture.
• Misao, Y., 2001. An image processing based automatic steering power
system. In: Proceedings of the ASAE Meeting, California, USA.
• http://www.deere.com/en_US/careers/midcareer_jobs/field_robotics.html
• www.wikipaedia.com
• Gordon, G.P., Holmes, R.G., 1988. Laser positioning system for off-road
vehicles.
24
27. Camera
• Specification: Sony FCBEX780S CCD camera with analog video output format
in NTSC (National Television System Committee standard)
• Camera was mounted at an angle
of 45 degree to the horizontal
Camera and its mount
Camera mounted on the tractor
27
29. Laser Radar (Ladar)
• Sick LMS-200 ladar sensor
• It is a 180 degree one-dimensional
sweeping laser which can measure at
1.0/0.5/0.25 degree increments with
maximum range of up to 80 m
• Mounted on top of the tractor cab just
below the camera positioned at 45
degree to the horizontal
Laser radar
Laser mounted on
top of the tractor
29
30. Computer
• 4 GHz Pentium4 processor
running Windows 2000 pro
operating system
• Software (to develop
algorithms): Microsoft Visual
C++
Computer
Computer, monitor and keyboard
mounted in the cabin
30
31. Microcontroller
• 586 Engine controller board with a P50 expansion board from TERN
Inc.
• It is a C++ programmable controller board based on a 32-bit system
• Function: For executing Real time-time control of the Servo valve &
Encoder feedback loop.
Amplifier:
• To scale the control
voltage from the
microcontroller to the
servo valve
31
32. Encoder
• Stegmann Heavy Duty HD20 encoder
• Function: Feeding back the wheel
angle to the control system
•Encoder Calibration
•Tractor was positioned at a place in the lab
•Angular positions were marked on the
ground
•From the centre position, the steering wheel
was rotated to get different angles of front
wheel
•The number of pulses to reach different
angles was noted
(*…wheel centre was calibrated by trial
and error)
32
34. GPS Receiver
• A GPS receiver was used to measure the vehicle displacement
while conducting tests to determine the dynamics of the vehicle
• John Deere Starfire SF2000R Differential GPS receiver was used
GPS mounted at the top of
the tractor
34
35. Power Supply
• Inverter:
It supply required voltage to PC, the
monitor and the laser radar
• Cigarette lighter power source
The supply for the microcontroller and
the hydraulic valve is taken from it
Provided in tractor cabin
35
37. EXPERIMENTAL PROCEDURE ON ARTIFICIAL TESTING PATH
Guidance system test path
(a)
Fig. Straight path
(b)
Fig. Curved path
37
38. EXPERIMENTAL PROCEDURE ON ARTIFICIAL TESTING PATH
Path traced by the rotating blade
Fig. Device used to mark the tractor route on Fig. Marks on the ground
indicating the path
the ground
traversed
38