Detecting Successful Throws

Abstract: This project aims to create a robot system that can accurately figure out if the throws are successful. This can help make various industrial tasks more efficient. The system uses implemented methods to process data from fisheye camera data and depth sensor data, to check the quality of the throws. The main goal is to find out if the thrown object reaches its target or not, with more advanced tasks including predicting its path when frames are lost or not tracked properly.To put the system together the Robot Operating System (ROS) was used for handling data and processing, as well as different tools and techniques, like bag files and OpenCV. A variety of methods and algorithms were used to apply background subtraction, clustering, curve fitting, marking objects and drawing the path they take in the air. The depth sensor data processing is included to make up for the limitations of 2D camera data, providing more accurate and reliable tracking of thrown objects.