[Discourse.ros.org] [Aerial Vehicles] Autonomous Selfie Drone by Crazyflie using Deep Learning Models
Our team has been working with Crazyflie platform to demonstrate how deep learning algorithms can be applied to robotics especially a nano aerial vehicles; thanks to Bitcraze development team~ :) To verify the reliability of our approach, our team has also applied the same approach to Petrone, made by Byrobot Co., one of the drone manufacturing companies in Korea
As rapid growth of deep learning algorithms has been made, we sincerely believe that autonomous drone tracking system using deep learning techniques will be generally designed and implemented in robotics community in short period of time. We hope that our project can be thought of as a first step towards the Robotics applied with AI
Here are some of the video clips of our demos; please enjoy it.
- Face Detection
Using pre-trained data set using deep learning, it detects human face and calculates out the 3d vectors with unit of meter
For the initial flight triggering, the drone must detects human face for 3 seconds.
Be careful if you are wearing a photo necklace, it will detect your photo and rotates motors :)
- Human Body Detection
Using Openpose libraries from CMU (please refer to the link above), a drone is able to detect human body structures such as right/left shoulder, wrist, ankle, elbow, neck, etc
Using this technique, the drone can recognize human body and behave accordingly based on the defined flight motion
- Special Flight Movements
When a drone detects certain patterns of human body, it delivers special flight motion listed below:
- Fade-away: when a person waves either left/right hand,
- Landing / Flip Motion: when a person raises both hands up
If you have any comment or suggestion, please email us at [hidden email].
P.S. Our team is eagerly looking for passionate drone engineers and AI researchers who would like to enjoy flying a smart-S drone, For more details regarding to the job description, please refer to the link below.