Things in the Air: Tagging Wearable IoT Informationon Drone Videos

Drones have been applied to a wide range of security and surveillance applications recently. With drones, Internet of Things are extending to3D space. An interesting question is: Can we conduct person identification(PID) in a drone view? Traditional PID technologies such as RFID and fingerprint/iris/face recognition have their limitations or require close contactto specific devices. Hence, these traditional technologies can not be easily deployed to drones due to dynamic change of view angle and height. In this work,we demonstrate how to retrieve IoT data from users’ and correctly tag themon the human objects captured by a drone camera to identify and track groundhuman objects. First, we retrieve human objects from videos and conduct coordination transformation to handle the change of drone positions. Second,a fusion algorithm is applied to measure the correlation of video data andinertial data based on the extracted human motion features. Finally, we cancouple human objects with their wearable IoT devices, achieving our goal oftagging wearable device data such as personal profiles) on human objects ina drone view. Our experimental evaluation shows a recognition rate of 98.9%.To the best of our knowledge, this is the first work integrating videos fromdrone cameras and IoT data from inertial sensors.