The document describes the development of an automatic teaching method using a stereo camera for SCARA robots. The method involves building a camera-robot system with hardware including a stereo camera and SCARA robot. Software algorithms are designed for position calculation, end-effector angle updating, and communication between the PC and robot controller. Experiments are conducted to evaluate repeatability, distance correlation, feedback position accuracy, and overall system operability. The automatic teaching method shows potential but could be improved with marker redesign and synchronization optimization.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/whats-next-in-on-device-generative-ai-a-presentation-from-qualcomm/
Jilei Hou, Vice President of Engineering and Head of AI Research at Qualcomm Technologies, presents the “What’s Next in On-device Generative AI” tutorial at the May 2024 Embedded Vision Summit.
The generative AI era has begun! Large multimodal models are bringing the power of language understanding to machine perception, and transformer models are expanding to allow machines to understand using multiple types of sensors. This new wave of approaches is poised to revolutionize user experiences, disrupt industries and enable powerful new capabilities. For generative AI to reach its full potential, however, we must deploy it on edge devices, providing improved latency, pervasive interaction and enhanced privacy.
In this talk, Hou shares Qualcomm’s vision of the compelling opportunities enabled by efficient generative AI at the edge. He also identifies the key challenges that the industry must overcome to realize the massive potential of these technologies. And he highlights research and product development work that Qualcomm is doing to lead the way via an end-to-end system approach—including techniques for efficient on-device execution of LLMs, LVMs and LMMs, methods for orchestration of large models at the edge and approaches for adaptation and personalization.
IRJET- Collision Avoidance based on Obstacle Detection using OpenCVIRJET Journal
This document describes a system for collision avoidance in autonomous vehicles using object detection and distance measurement. The system uses a Raspberry Pi with a camera module to perform object detection with a Caffe deep learning model. An ultrasonic sensor measures the distance to detected obstacles. If an obstacle is within 30cm, the motors are stopped. If within 100cm, motor speed is reduced based on distance. By controlling motor speed based on obstacle distance, the system aims to avoid collisions. The system was able to accurately detect and classify objects like people and cars in real-time video.
Digital Intelligence, a walkway to Chirologyjgd2121
This document is a project report on developing a digital intelligence system to predict palmistry details. It was prepared by four students and guided by Mr. Vishwesh A. Patel of BITS edu Campus. The report includes sections on project management, system analysis, system design, implementation, and testing of the palmistry prediction software. It aims to develop a web-based system that takes an uploaded palm image as input and applies image processing and artificial intelligence techniques to analyze the image and generate an automated palmistry report.
MCHE 484 Senior Design Final Report Rev_8Daniel Newman
This document is a design report for a cable-driven parallel robot created by students for a class project. It summarizes the design process and final prototype, which uses a single motor to move a Versaball end effector in 2D planar motion within a 10ft by 8ft workspace. The design uses an 80-20 aluminum frame, NEMA 34 stepper motor, and pneumatic valves to control the Versaball. Design criteria included safety, transportation of various objects, and a user interface. The report details the background research, design process including concept selection, mechanical and electrical designs, testing plans, costs, and conclusions. The objective is to eventually apply the 2D planar design to a more versatile 3D application.
1) The document describes a collision avoidance system for autonomous vehicles that uses a Raspberry Pi, ultrasonic sensor, camera, GPS module, LCD display, and motor driver.
2) The system is able to detect objects using the ultrasonic sensor and camera, determine the distance to objects using vision processing techniques on images from the camera, and control the vehicle's motors using the motor driver to avoid collisions based on object distances.
3) Experimental results showed the system successfully detecting obstacles, measuring distances, and simulating avoidance maneuvers in response to obstacles getting too close. The goal is to reduce accidents caused by human errors by allowing vehicles to autonomously sense and avoid collisions.
This document describes a proposed self-driving radio controlled car model that uses computer vision and deep learning techniques. The model was trained in a virtual environment using a convolutional neural network to detect lanes, obstacles, and traffic signs. The physical model uses a Raspberry Pi, camera, ultrasonic sensor, and other hardware to capture images and detect its environment, sending the outputs to an Arduino microcontroller to control the car. The document outlines the proposed system, reviews related work, discusses the implementation including algorithms and testing, and presents the results, concluding the model provides a cost-effective way to demonstrate basic autonomous driving functions.
The document describes the development of a traffic sign recognition system using machine learning techniques. It involves building a convolutional neural network (CNN) model to classify images of traffic signs into different categories. The front-end will utilize libraries like Pandas, NumPy, Matplotlib and OpenCV for data processing and visualization. Tkinter will be used for the graphical user interface. The back-end will use TensorFlow and Keras deep learning frameworks to develop the CNN model for traffic sign classification. The system aims to accurately detect and recognize traffic signs to help with autonomous driving.
This slide deck contains Six Sigma Green Belt ( Product Track ) project done at Motorola, India. Project resulted in successful award of Green Belt to me. Please feel free to shoot any product or process related queries.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/whats-next-in-on-device-generative-ai-a-presentation-from-qualcomm/
Jilei Hou, Vice President of Engineering and Head of AI Research at Qualcomm Technologies, presents the “What’s Next in On-device Generative AI” tutorial at the May 2024 Embedded Vision Summit.
The generative AI era has begun! Large multimodal models are bringing the power of language understanding to machine perception, and transformer models are expanding to allow machines to understand using multiple types of sensors. This new wave of approaches is poised to revolutionize user experiences, disrupt industries and enable powerful new capabilities. For generative AI to reach its full potential, however, we must deploy it on edge devices, providing improved latency, pervasive interaction and enhanced privacy.
In this talk, Hou shares Qualcomm’s vision of the compelling opportunities enabled by efficient generative AI at the edge. He also identifies the key challenges that the industry must overcome to realize the massive potential of these technologies. And he highlights research and product development work that Qualcomm is doing to lead the way via an end-to-end system approach—including techniques for efficient on-device execution of LLMs, LVMs and LMMs, methods for orchestration of large models at the edge and approaches for adaptation and personalization.
IRJET- Collision Avoidance based on Obstacle Detection using OpenCVIRJET Journal
This document describes a system for collision avoidance in autonomous vehicles using object detection and distance measurement. The system uses a Raspberry Pi with a camera module to perform object detection with a Caffe deep learning model. An ultrasonic sensor measures the distance to detected obstacles. If an obstacle is within 30cm, the motors are stopped. If within 100cm, motor speed is reduced based on distance. By controlling motor speed based on obstacle distance, the system aims to avoid collisions. The system was able to accurately detect and classify objects like people and cars in real-time video.
Digital Intelligence, a walkway to Chirologyjgd2121
This document is a project report on developing a digital intelligence system to predict palmistry details. It was prepared by four students and guided by Mr. Vishwesh A. Patel of BITS edu Campus. The report includes sections on project management, system analysis, system design, implementation, and testing of the palmistry prediction software. It aims to develop a web-based system that takes an uploaded palm image as input and applies image processing and artificial intelligence techniques to analyze the image and generate an automated palmistry report.
MCHE 484 Senior Design Final Report Rev_8Daniel Newman
This document is a design report for a cable-driven parallel robot created by students for a class project. It summarizes the design process and final prototype, which uses a single motor to move a Versaball end effector in 2D planar motion within a 10ft by 8ft workspace. The design uses an 80-20 aluminum frame, NEMA 34 stepper motor, and pneumatic valves to control the Versaball. Design criteria included safety, transportation of various objects, and a user interface. The report details the background research, design process including concept selection, mechanical and electrical designs, testing plans, costs, and conclusions. The objective is to eventually apply the 2D planar design to a more versatile 3D application.
1) The document describes a collision avoidance system for autonomous vehicles that uses a Raspberry Pi, ultrasonic sensor, camera, GPS module, LCD display, and motor driver.
2) The system is able to detect objects using the ultrasonic sensor and camera, determine the distance to objects using vision processing techniques on images from the camera, and control the vehicle's motors using the motor driver to avoid collisions based on object distances.
3) Experimental results showed the system successfully detecting obstacles, measuring distances, and simulating avoidance maneuvers in response to obstacles getting too close. The goal is to reduce accidents caused by human errors by allowing vehicles to autonomously sense and avoid collisions.
This document describes a proposed self-driving radio controlled car model that uses computer vision and deep learning techniques. The model was trained in a virtual environment using a convolutional neural network to detect lanes, obstacles, and traffic signs. The physical model uses a Raspberry Pi, camera, ultrasonic sensor, and other hardware to capture images and detect its environment, sending the outputs to an Arduino microcontroller to control the car. The document outlines the proposed system, reviews related work, discusses the implementation including algorithms and testing, and presents the results, concluding the model provides a cost-effective way to demonstrate basic autonomous driving functions.
The document describes the development of a traffic sign recognition system using machine learning techniques. It involves building a convolutional neural network (CNN) model to classify images of traffic signs into different categories. The front-end will utilize libraries like Pandas, NumPy, Matplotlib and OpenCV for data processing and visualization. Tkinter will be used for the graphical user interface. The back-end will use TensorFlow and Keras deep learning frameworks to develop the CNN model for traffic sign classification. The system aims to accurately detect and recognize traffic signs to help with autonomous driving.
This slide deck contains Six Sigma Green Belt ( Product Track ) project done at Motorola, India. Project resulted in successful award of Green Belt to me. Please feel free to shoot any product or process related queries.
This slide deck contains Green Belt ( Product Track ) project done at Motorola, India. Project resulted in successful award of Green Belt to me. Please feel free to shoot any product or process related queries.
This document describes Eren Okur's capstone project on a voice controlled car. It discusses using speech recognition software on a computer to process voice commands and send them wirelessly to a microcontroller. The microcontroller would then control motors on a toy car to move in the commanded directions. The project aims to understand speech recognition, wireless data transmission between devices, and using a microcontroller to control motors in real-time. It provides background on these topics and outlines a work plan to develop a system integrating these elements in a voice-controlled toy car.
IRJET- Front View Identification of Vehicles by using Machine Learning Te...IRJET Journal
This document describes a system for identifying vehicles from front view images using machine learning techniques. The system first detects moving vehicles using background subtraction, then classifies vehicle type. It discusses using Gaussian mixture models for background subtraction and DBSCAN clustering to identify vehicle regions. The methodology section outlines the full proposed system, including preprocessing, object detection using background subtraction and clustering, object tracking with optical flow, and speed estimation using a Kalman filter. It aims to provide an alternative to radar-based vehicle detection and classification systems.
[Tutorial] building machine learning models for predictive maintenance applic...PAPIs.io
The document discusses using machine learning for predictive maintenance in IoT applications compared to traditional approaches. It describes using publicly available aircraft engine data to build models in Azure ML to predict remaining useful life. Models tested include regression, binary classification, and multi-class classification. An end-to-end pipeline is demonstrated, from data preparation through deploying web services with different machine learning models.
IRJET- Proposed Design for 3D Map Generation using UAVIRJET Journal
The document proposes a design for 3D map generation using an unmanned aerial vehicle (UAV). Images collected by the UAV would undergo processing using techniques like photogrammetry and videogrammetry to generate point clouds and convert the 2D images into 3D models. Pix4Dmapper software would be used to analyze control points within images, overlap similar images, filter out noise, and generate the 3D point cloud which forms the basic building block for 3D map creation. The vSLAM algorithm would also be used to determine the sensor orientation and reconstruct the environment. The proposed system would use tools like the Tower app and databases like MySQL and HBase to control the UAV, process and store the image data,
Underground Cable Fault Detection Using ArduinoIRJET Journal
This document describes a project to detect faults in underground cables using an Arduino board. The system works by measuring the resistance at different points along the cable run, which will change if there is a fault. It uses a series of resistors to represent the cable length and can detect three types of faults - short circuits, open circuits, and earth faults. When a fault is detected, the Arduino triggers a buzzer and sends an alert to field workers via GSM. It displays the fault location on an LCD screen in kilometers. The document includes block diagrams of the system components and simulations of it detecting errors at different cable distances.
AUTO LANDING PROCESS FOR AUTONOMOUS FLYING ROBOT BY USING IMAGE PROCESSING BA...csandit
In today’s technological life, everyone is quite familiar with the importance of security
measures in our lives. So in this regard, many attempts have been made by researchers and one
of them is flying robots technology. One well-known usage of flying robot, perhaps, is its
capability in security and care measurements which made this device extremely practical, not
only for its unmanned movement, but also for the unique manoeuvre during flight over the
arbitrary areas. In this research, the automatic landing of a flying robot is discussed. The
system is based on the frequent interruptions that is sent from main microcontroller to camera
module in order to take images; these images have been distinguished by image processing
system based on edge detection, after analysing the image the system can tell whether or not to
land on the ground. This method shows better performance in terms of precision as well as
experimentally.
Bluetooth Controlled Garbage Collection Robot ArmIRJET Journal
We've designed a semi-autonomous robotic arm that can collect scrap materials. The robotic arm has 5 degrees of freedom and is controlled via an Arduino board and Bluetooth module. It uses servo motors and stepper motors to manipulate the arm and a claw to pick up scrap. The arm was 3D printed using PLA plastic. An Android app was created to send commands to the Arduino via Bluetooth to control the arm's movement and allow remote operation. The goal was to develop an affordable robotic system to assist with scrap collection in a safe and efficient manner.
This document presents a project report for a Cell Phone Oriented Robotic Vehicle. It includes sections on certificates, acknowledgements, declarations, and an abstract. The project aims to design a robot that can be controlled via SMS messages from a cell phone. The robot will receive commands from a GSM module connected to the phone and a microcontroller will process the signals to operate motors and control the robot's movement. The report outlines the design process to be followed, including defining customer needs, decomposing functions, developing engineering specifications, generating and selecting concepts, embodiment design, and testing. It presents timelines and distribution of tasks among team members to complete the project.
Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...Intland Software GmbH
This talk was presented by Andreas Pabinger and Benjamin Engele (Intland Software) at Intland Connect: Annual User Conference 2020 on 22 Oct 2020. To learn more, visit: https://intland.com/intland-connect-annual-user-conference-2020/
IRJET- Pick and Place Robot for Color based SortingIRJET Journal
This document describes the design and implementation of a pick and place robot system for color-based sorting. The system uses a webcam to capture images of objects on a conveyor belt. MATLAB image processing techniques are applied to the images to detect color. The color detection information is sent to a microcontroller which controls servo motors to pick and place the objects into the appropriate sorting bins based on color. The system is intended to improve production quality and reduce errors compared to manual sorting. Key aspects include image acquisition, preprocessing, color detection algorithms in MATLAB, microcontroller control of servo motors, and a sorting mechanism.
Density Based Traffic signal system using microcontrollerkrity kumari
This document describes a density based traffic signal system using a microcontroller. It uses IR sensors to measure traffic density on each road and the microcontroller controls the traffic lights accordingly. The microcontroller receives input from the IR sensors and determines which path has traffic, providing a green light to that path while giving red lights to other paths. This allows the traffic light timing to dynamically adjust based on real-time traffic conditions to reduce congestion compared to traditional fixed-time traffic lights. The goal is to minimize traffic jams and delays by prioritizing paths with higher vehicle density.
Anpr based licence plate detection reportsomchaturvedi
This document provides a report on developing an automatic number plate recognition (ANPR) system using an automatic line tracking robot (ALR). The system aims to recognize vehicle number plates for security purposes like access control. It uses image processing techniques in MATLAB to detect, extract, and identify number plates from images captured by a webcam. The identified numbers are then saved to a database. An ALR is used to simulate a vehicle moving along a guided track. It contains circuitry to detect open and closed doors, and can park in designated areas. A microcontroller controls the robot's movements and door detection. The parallel port of the computer is used to interface with the robot's control circuitry to open doors based on number plate recognition.
FACE COUNTING USING OPEN CV & PYTHON FOR ANALYZING UNUSUAL EVENTS IN CROWDSIRJET Journal
The document discusses face counting using OpenCV and Python by analyzing unusual events in crowds. It proposes using the Haar cascade algorithm for face detection and counting. Feature extraction is performed using gray-level co-occurrence matrix (GLCM) to extract texture and edge features. Discriminant analysis is then used to differentiate between samples accurately. The system aims to correctly detect and count faces in images using Python tools like OpenCV for digital image processing tasks and feature extraction algorithms like GLCM and discrete wavelet transform (DWT). It is intended to have good recognition accuracy compared to previous methods.
- The document contains the resume of Swapnil Ashok Misal providing details of his professional experience as a Systems Engineer and R&D Engineer working with embedded systems and industrial process control. It summarizes his technical skills in hardware platforms, programming languages, connectivity protocols and projects involving digital readouts, linear encoders, motor controllers, lithium ion battery systems and more. His academic qualifications including a Bachelor's degree in Electronics and Telecommunication with distinctions are also mentioned along with extracurricular activities and availability of references.
EE323 Mini-Project - Line tracing robotPraneel Chand
This document outlines a mini-project assignment to design a controller for a LEGO robotic guided vehicle. Students are asked to: 1) Develop a mathematical model of the vehicle; 2) Design a digital controller using control theory; 3) Implement the controller on the LEGO NXT brick using RobotC software. The controller must meet performance requirements for guiding the vehicle in a straight line and along curved paths. Students will submit a report and presentation on their work.
DROWSINESS DETECTION MODEL USING PYTHONIRJET Journal
This document describes a drowsiness detection model built using Python. The model uses computer vision and a pre-trained facial landmark detection model to identify a driver's eyes in video from a webcam. It calculates the eye aspect ratio over time to determine if the driver's eyes are closed, indicating drowsiness. If drowsiness is detected by the eyes being closed for a certain period, an alarm sound is triggered using pygame to alert the driver. The goal is to create an affordable and effective drowsiness detection system to help reduce accidents caused by tired drivers. The model was tested and successfully detected open and closed eyes and triggered alarms appropriately.
Microcontroller based automatic engine locking system for drunken driversVinny Chweety
This document describes a mini project report on a microcontroller-based automatic engine locking system for drunken drivers. The system uses an AT89S52 microcontroller and various hardware components like an alcohol detection sensor, buzzer, LCD display, motors/engine, and other supporting circuitry. If the alcohol detection sensor detects alcohol levels above a set limit from the driver's breath, the microcontroller will lock the engine by activating a relay to prevent drunken driving and accidents. The project aims to increase road safety by preventing intoxicated individuals from operating vehicles.
Review Paper on Attendance Capturing System using Face RecognitionIRJET Journal
This document summarizes research on various attendance capturing systems using face recognition. It reviews 9 research papers describing different approaches using techniques like convolutional neural networks, MTCNN algorithm, Haar cascade classifier, and PCA. These systems are able to automate attendance marking by detecting faces in images and videos and recognizing students in real-time with accuracy rates ranging from 56% to 99.86%. The reviewed systems provide benefits over manual attendance methods by saving time while also being more accurate in some cases.
Charging Fueling & Infrastructure (CFI) Program by Kevin MillerForth
Kevin Miller, Senior Advisor, Business Models of the Joint Office of Energy and Transportation gave this presentation at the Forth and Electrification Coalition CFI Grant Program - Overview and Technical Assistance webinar on June 12, 2024.
This slide deck contains Green Belt ( Product Track ) project done at Motorola, India. Project resulted in successful award of Green Belt to me. Please feel free to shoot any product or process related queries.
This document describes Eren Okur's capstone project on a voice controlled car. It discusses using speech recognition software on a computer to process voice commands and send them wirelessly to a microcontroller. The microcontroller would then control motors on a toy car to move in the commanded directions. The project aims to understand speech recognition, wireless data transmission between devices, and using a microcontroller to control motors in real-time. It provides background on these topics and outlines a work plan to develop a system integrating these elements in a voice-controlled toy car.
IRJET- Front View Identification of Vehicles by using Machine Learning Te...IRJET Journal
This document describes a system for identifying vehicles from front view images using machine learning techniques. The system first detects moving vehicles using background subtraction, then classifies vehicle type. It discusses using Gaussian mixture models for background subtraction and DBSCAN clustering to identify vehicle regions. The methodology section outlines the full proposed system, including preprocessing, object detection using background subtraction and clustering, object tracking with optical flow, and speed estimation using a Kalman filter. It aims to provide an alternative to radar-based vehicle detection and classification systems.
[Tutorial] building machine learning models for predictive maintenance applic...PAPIs.io
The document discusses using machine learning for predictive maintenance in IoT applications compared to traditional approaches. It describes using publicly available aircraft engine data to build models in Azure ML to predict remaining useful life. Models tested include regression, binary classification, and multi-class classification. An end-to-end pipeline is demonstrated, from data preparation through deploying web services with different machine learning models.
IRJET- Proposed Design for 3D Map Generation using UAVIRJET Journal
The document proposes a design for 3D map generation using an unmanned aerial vehicle (UAV). Images collected by the UAV would undergo processing using techniques like photogrammetry and videogrammetry to generate point clouds and convert the 2D images into 3D models. Pix4Dmapper software would be used to analyze control points within images, overlap similar images, filter out noise, and generate the 3D point cloud which forms the basic building block for 3D map creation. The vSLAM algorithm would also be used to determine the sensor orientation and reconstruct the environment. The proposed system would use tools like the Tower app and databases like MySQL and HBase to control the UAV, process and store the image data,
Underground Cable Fault Detection Using ArduinoIRJET Journal
This document describes a project to detect faults in underground cables using an Arduino board. The system works by measuring the resistance at different points along the cable run, which will change if there is a fault. It uses a series of resistors to represent the cable length and can detect three types of faults - short circuits, open circuits, and earth faults. When a fault is detected, the Arduino triggers a buzzer and sends an alert to field workers via GSM. It displays the fault location on an LCD screen in kilometers. The document includes block diagrams of the system components and simulations of it detecting errors at different cable distances.
AUTO LANDING PROCESS FOR AUTONOMOUS FLYING ROBOT BY USING IMAGE PROCESSING BA...csandit
In today’s technological life, everyone is quite familiar with the importance of security
measures in our lives. So in this regard, many attempts have been made by researchers and one
of them is flying robots technology. One well-known usage of flying robot, perhaps, is its
capability in security and care measurements which made this device extremely practical, not
only for its unmanned movement, but also for the unique manoeuvre during flight over the
arbitrary areas. In this research, the automatic landing of a flying robot is discussed. The
system is based on the frequent interruptions that is sent from main microcontroller to camera
module in order to take images; these images have been distinguished by image processing
system based on edge detection, after analysing the image the system can tell whether or not to
land on the ground. This method shows better performance in terms of precision as well as
experimentally.
Bluetooth Controlled Garbage Collection Robot ArmIRJET Journal
We've designed a semi-autonomous robotic arm that can collect scrap materials. The robotic arm has 5 degrees of freedom and is controlled via an Arduino board and Bluetooth module. It uses servo motors and stepper motors to manipulate the arm and a claw to pick up scrap. The arm was 3D printed using PLA plastic. An Android app was created to send commands to the Arduino via Bluetooth to control the arm's movement and allow remote operation. The goal was to develop an affordable robotic system to assist with scrap collection in a safe and efficient manner.
This document presents a project report for a Cell Phone Oriented Robotic Vehicle. It includes sections on certificates, acknowledgements, declarations, and an abstract. The project aims to design a robot that can be controlled via SMS messages from a cell phone. The robot will receive commands from a GSM module connected to the phone and a microcontroller will process the signals to operate motors and control the robot's movement. The report outlines the design process to be followed, including defining customer needs, decomposing functions, developing engineering specifications, generating and selecting concepts, embodiment design, and testing. It presents timelines and distribution of tasks among team members to complete the project.
Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...Intland Software GmbH
This talk was presented by Andreas Pabinger and Benjamin Engele (Intland Software) at Intland Connect: Annual User Conference 2020 on 22 Oct 2020. To learn more, visit: https://intland.com/intland-connect-annual-user-conference-2020/
IRJET- Pick and Place Robot for Color based SortingIRJET Journal
This document describes the design and implementation of a pick and place robot system for color-based sorting. The system uses a webcam to capture images of objects on a conveyor belt. MATLAB image processing techniques are applied to the images to detect color. The color detection information is sent to a microcontroller which controls servo motors to pick and place the objects into the appropriate sorting bins based on color. The system is intended to improve production quality and reduce errors compared to manual sorting. Key aspects include image acquisition, preprocessing, color detection algorithms in MATLAB, microcontroller control of servo motors, and a sorting mechanism.
Density Based Traffic signal system using microcontrollerkrity kumari
This document describes a density based traffic signal system using a microcontroller. It uses IR sensors to measure traffic density on each road and the microcontroller controls the traffic lights accordingly. The microcontroller receives input from the IR sensors and determines which path has traffic, providing a green light to that path while giving red lights to other paths. This allows the traffic light timing to dynamically adjust based on real-time traffic conditions to reduce congestion compared to traditional fixed-time traffic lights. The goal is to minimize traffic jams and delays by prioritizing paths with higher vehicle density.
Anpr based licence plate detection reportsomchaturvedi
This document provides a report on developing an automatic number plate recognition (ANPR) system using an automatic line tracking robot (ALR). The system aims to recognize vehicle number plates for security purposes like access control. It uses image processing techniques in MATLAB to detect, extract, and identify number plates from images captured by a webcam. The identified numbers are then saved to a database. An ALR is used to simulate a vehicle moving along a guided track. It contains circuitry to detect open and closed doors, and can park in designated areas. A microcontroller controls the robot's movements and door detection. The parallel port of the computer is used to interface with the robot's control circuitry to open doors based on number plate recognition.
FACE COUNTING USING OPEN CV & PYTHON FOR ANALYZING UNUSUAL EVENTS IN CROWDSIRJET Journal
The document discusses face counting using OpenCV and Python by analyzing unusual events in crowds. It proposes using the Haar cascade algorithm for face detection and counting. Feature extraction is performed using gray-level co-occurrence matrix (GLCM) to extract texture and edge features. Discriminant analysis is then used to differentiate between samples accurately. The system aims to correctly detect and count faces in images using Python tools like OpenCV for digital image processing tasks and feature extraction algorithms like GLCM and discrete wavelet transform (DWT). It is intended to have good recognition accuracy compared to previous methods.
- The document contains the resume of Swapnil Ashok Misal providing details of his professional experience as a Systems Engineer and R&D Engineer working with embedded systems and industrial process control. It summarizes his technical skills in hardware platforms, programming languages, connectivity protocols and projects involving digital readouts, linear encoders, motor controllers, lithium ion battery systems and more. His academic qualifications including a Bachelor's degree in Electronics and Telecommunication with distinctions are also mentioned along with extracurricular activities and availability of references.
EE323 Mini-Project - Line tracing robotPraneel Chand
This document outlines a mini-project assignment to design a controller for a LEGO robotic guided vehicle. Students are asked to: 1) Develop a mathematical model of the vehicle; 2) Design a digital controller using control theory; 3) Implement the controller on the LEGO NXT brick using RobotC software. The controller must meet performance requirements for guiding the vehicle in a straight line and along curved paths. Students will submit a report and presentation on their work.
DROWSINESS DETECTION MODEL USING PYTHONIRJET Journal
This document describes a drowsiness detection model built using Python. The model uses computer vision and a pre-trained facial landmark detection model to identify a driver's eyes in video from a webcam. It calculates the eye aspect ratio over time to determine if the driver's eyes are closed, indicating drowsiness. If drowsiness is detected by the eyes being closed for a certain period, an alarm sound is triggered using pygame to alert the driver. The goal is to create an affordable and effective drowsiness detection system to help reduce accidents caused by tired drivers. The model was tested and successfully detected open and closed eyes and triggered alarms appropriately.
Microcontroller based automatic engine locking system for drunken driversVinny Chweety
This document describes a mini project report on a microcontroller-based automatic engine locking system for drunken drivers. The system uses an AT89S52 microcontroller and various hardware components like an alcohol detection sensor, buzzer, LCD display, motors/engine, and other supporting circuitry. If the alcohol detection sensor detects alcohol levels above a set limit from the driver's breath, the microcontroller will lock the engine by activating a relay to prevent drunken driving and accidents. The project aims to increase road safety by preventing intoxicated individuals from operating vehicles.
Review Paper on Attendance Capturing System using Face RecognitionIRJET Journal
This document summarizes research on various attendance capturing systems using face recognition. It reviews 9 research papers describing different approaches using techniques like convolutional neural networks, MTCNN algorithm, Haar cascade classifier, and PCA. These systems are able to automate attendance marking by detecting faces in images and videos and recognizing students in real-time with accuracy rates ranging from 56% to 99.86%. The reviewed systems provide benefits over manual attendance methods by saving time while also being more accurate in some cases.
Similar to DEVELOPMENT OF AUTOMATIC TEACHING METHOD USING STEREO CAMERA FOR SCARA ROBOTS (20)
Charging Fueling & Infrastructure (CFI) Program by Kevin MillerForth
Kevin Miller, Senior Advisor, Business Models of the Joint Office of Energy and Transportation gave this presentation at the Forth and Electrification Coalition CFI Grant Program - Overview and Technical Assistance webinar on June 12, 2024.
Expanding Access to Affordable At-Home EV Charging by Vanessa WarheitForth
Vanessa Warheit, Co-Founder of EV Charging for All, gave this presentation at the Forth Addressing The Challenges of Charging at Multi-Family Housing webinar on June 11, 2024.
EV Charging at MFH Properties by Whitaker JamiesonForth
Whitaker Jamieson, Senior Specialist at Forth, gave this presentation at the Forth Addressing The Challenges of Charging at Multi-Family Housing webinar on June 11, 2024.
Charging and Fueling Infrastructure Grant: Round 2 by Brandt HertensteinForth
Brandt Hertenstein, Program Manager of the Electrification Coalition gave this presentation at the Forth and Electrification Coalition CFI Grant Program - Overview and Technical Assistance webinar on June 12, 2024.
Charging Fueling & Infrastructure (CFI) Program Resources by Cat PleinForth
Cat Plein, Development & Communications Director of Forth, gave this presentation at the Forth and Electrification Coalition CFI Grant Program - Overview and Technical Assistance webinar on June 12, 2024.
Understanding Catalytic Converter Theft:
What is a Catalytic Converter?: Learn about the function of catalytic converters in vehicles and why they are targeted by thieves.
Why are They Stolen?: Discover the valuable metals inside catalytic converters (such as platinum, palladium, and rhodium) that make them attractive to criminals.
Steps to Prevent Catalytic Converter Theft:
Parking Strategies: Tips on where and how to park your vehicle to reduce the risk of theft, such as parking in well-lit areas or secure garages.
Protective Devices: Overview of various anti-theft devices available, including catalytic converter locks, shields, and alarms.
Etching and Marking: The benefits of etching your vehicle’s VIN on the catalytic converter or using a catalytic converter marking kit to make it traceable and less appealing to thieves.
Surveillance and Monitoring: Recommendations for using security cameras and motion-sensor lights to deter thieves.
Statistics and Insights:
Theft Rates by Borough: Analysis of data to determine which borough in NYC experiences the highest rate of catalytic converter thefts.
Recent Trends: Current trends and patterns in catalytic converter thefts to help you stay aware of emerging hotspots and tactics used by thieves.
Benefits of This Presentation:
Awareness: Increase your awareness about catalytic converter theft and its impact on vehicle owners.
Practical Tips: Gain actionable insights and tips to effectively prevent catalytic converter theft.
Local Insights: Understand the specific risks in different NYC boroughs, helping you take targeted preventive measures.
This presentation aims to equip you with the knowledge and tools needed to protect your vehicle from catalytic converter theft, ensuring you are prepared and proactive in safeguarding your property.
Dahua provides a comprehensive guide on how to install their security camera systems. Learn about the different types of cameras and system components, as well as the installation process.
Implementing ELDs or Electronic Logging Devices is slowly but surely becoming the norm in fleet management. Why? Well, integrating ELDs and associated connected vehicle solutions like fleet tracking devices lets businesses and their in-house fleet managers reap several benefits. Check out the post below to learn more.
DEVELOPMENT OF AUTOMATIC TEACHING METHOD USING STEREO CAMERA FOR SCARA ROBOTS
1. VIETNAM NATIONAL UNIVERSITY HO CHI MINH CITY
HO CHI MINH UNIVERSITY OF TECHNOLOGY
FACULTY OF ELECTRICAL AND ELECTRONICS ENGINEERING
DEPT OF CONTROL ENGINEERING AND AUTOMATION
GRADUATION ESSAY
DEVELOPMENT OF AUTOMATIC TEACHING METHOD
USING STEREO CAMERA FOR SCARA ROBOTS
SVTH:
Phạm Phước Dũng 1710875
GVHD:
TS. Nguyễn Hoàng Giáp
26/12/2022
6. 1.1. Reasons for choosing the topic
26/12/2022 6
The teaching-less method for robots is being strongly developed in the world because
of the advantages compared to the traditional teaching ones.
The successful development of this topic will increase the diversity of robot applications
by solving problems that cannot be solved by traditional teaching methods.
Remote robot-assisted surgery
Robot welding
8. 1.2. Thesis objectives
Develop a teaching-less method using stereo camera for SCARA robot to perform the
pick-and-place feature with high precision.
Build a camera - robot system which can operate based on designed algorithms and
principles.
26/12/2022 8
Pick-and-place feature with high precision Force Torque Sensor required
22. 03 Software Design
Algorithm design
Thread for position calculating
Thread for end-effector's angle
updating
Thread for communication
between PC and robot controller
Convert distance
User interface design
Main program
Error evaluation experimental
program
Communicate with PC
using robot controller
Setup communication protocol
on robot controller
26/12/2022 22
26. 3.1. Algorithm design
Thread for end-effector's angle updating
26/12/2022 26
Rotation matrix obtained from Homogeneous matrix𝑐𝑎𝑚𝑒𝑟𝑎
𝑟𝑜𝑏𝑜𝑡𝑇𝑋𝑌𝑍 :
𝑐𝑎𝑚𝑒𝑟𝑎
𝑟𝑜𝑏𝑜𝑡
𝑅𝑋𝑌𝑍(, , ) =
𝑟11 𝑟12 𝑟13
𝑟21 𝑟22 𝑟23
𝑟31 𝑟23 𝑟33
So the pitch angle is:
= arctan(−𝑟31, 𝑟32
2
+ 𝑟33
2
) (rad)
Calculation of rotation angle difference between two markers:
𝛥𝐴𝑛𝑔𝑙𝑒 =
180 ∗ (𝐻𝑜𝑚𝑒− 𝑆𝑒𝑡𝑝𝑜𝑖𝑛𝑡)
𝜋
(degree)
27. 3.1. Algorithm design
Thread for communication between PC and robot controller
26/12/2022 27
28. 3.1. Algorithm design
Thread for communication between PC and robot controller
26/12/2022 28
Time delay for robot moving to Setpoint position:
∆𝑇𝑀𝑜𝑣𝑖𝑛𝑔 𝑚𝑠 =
∆𝐷𝑖𝑠𝑡𝑎𝑛𝑐𝑒 𝑚𝑚
𝑆𝑝𝑒𝑒𝑑
100
∗ 𝑅𝑜𝑏𝑜𝑡 𝑚𝑎𝑥𝑖𝑚𝑢𝑚 𝑚𝑜𝑣𝑖𝑛𝑔 𝑠𝑝𝑒𝑒𝑑
𝑚𝑚
𝑠
∗ 1000 + 500
- Robot maximum moving speed is set in robot controller to 1000 (mm/s).
- Speed entered by the user, default will be 10 (%).
- Since the robot has time to accelerate and decelerate in each movement and this value cannot
be interfered with or measured, so in this project, I will use 500 (ms) to characterize this time
value.
29. 3.1. Algorithm design
Convert distance using equivalent coordinate system
26/12/2022 29
Incremental value xRobot = - Incremental value xCamera
Incremental value yRobot = - Incremental value zCamera
Incremental value zRobot = Incremental value yCamera
34. 3.3. Communicate with PC using robot controller
Config IP Address and Port on robot controller
26/12/2022 34
Programing on robot controller
Config IP Address
36. 04 Experiments and Evaluation
26/12/2022 36
Setup camera
Setup robot and experimental platform
37. 04 Experiments and Evaluation
26/12/2022 37
Setup experimental environment
38. 04 Experiments and Evaluation
Determining
repeatability
Checking
distance
correlation
Comparing
feedback
position
Evaluating the
operability of
model
26/12/2022 38
39. 04 Experiments and Evaluation
4.1. Determining repeatability
26/12/2022 39
42. 4.1. Determining repeatability
Deviation from the standard position (mm) Repeatability
(mm)
Min Max
1 0.012 0.088 0.045
2 0.016 0.273 0.078
3 0.022 0.116 0.051
Experiment results
26/12/2022 42
44. 4.2. Checking distance correlation
26/12/2022 44
Fixed marker to robot end-effector Get end-effector’s position
from robot controller Get marker’s position
from software
46. 04 Experiments and Evaluation
4.3. Comparing feedback position
26/12/2022 46
47. 4.3. Comparing feedback position
Compare Setpoint’s position sent and Robot’s position received
26/12/2022 47
Graphing and calculating errors
48. 4.3. Comparing feedback position
Experiment results
With 4 Setpoint unchanged position
26/12/2022 48
49. 4.3. Comparing feedback position
Experiment results
With 4 Setpoint unchanged position
26/12/2022 49
50. 4.3. Comparing feedback position
Experiment results
With 4 Setpoint unchanged position
26/12/2022 50
51. 4.3. Comparing feedback position
Experiment results
With 4 Setpoint unchanged position
26/12/2022 51
52. 04 Experiments and Evaluation
4.4. Evaluating the operability of model
26/12/2022 52
53. 4.4. Evaluating the operability of model
Video to demo the operability of model
26/12/2022 53
54. Conclusion and Development direction
Evaluate the completeness and feasibility of the model
05
26/12/2022 54
55. 05 Conclusion and Development direction
Conclusion Development direction
26/12/2022 55
56. 05 Conclusion and Development direction
5.1. Conclusion
26/12/2022 56
57. 5.1. Conclusion
Achievements
Complete the algorithm to calculate the displacement distance and update the rotation
angle of SCARA robot.
Complete the system with Master and Slave stations to perform the pick-and-place
feature with SCARA robot.
Complete the communication protocol between PC and SCARA robot controller.
Complete user interface.
Complete experiments to verify the operability of model.
26/12/2022 57
58. 5.1. Conclusion
Difficulties
Due to limitation on the marker’s surface which can reflect IR (3 out of 4), in case
SCARA robot rotate Robot Marker with the blind surface (the surface have no reflecting
point) toward camera, sorfware will unable to calculate and update the end-effector’s
rotation angle.
Haven’t optimized the synchronization solution between the robot's moving time and
the camera’s capture time to update the robot's rotation angle.
26/12/2022 58
59. 05 Conclusion and Development direction
5.2. Development direction
26/12/2022 59
60. 5.2. Development direction
Optimize the synchronization solution between the robot's moving time and the
camera’s capture time.
Replace the other marker with no blind surface.
Upgrade the robot system (controller, driver, robot) to minimize the mechanical error.
Build a response system from Slave to Master to inform the current status of robot
(position, velocity, rotation,…).
Build a controller mounted directly to camera in order to reduce system’s size.
26/12/2022 60
61. Thank you so much
for your interest and attention!
62. Principle of marker recognition
26/12/2022 62
3D reconstruction of
balls in DRB
: Comparing geometry consists of balls in
DRB
-> Center position, distance between
closer balls, etc.
Rom file data of
balls in DRB
(DRB)