Volume 24, Number 4, 435-449, DOI: 10.1007/s10514-008-9089-4

Systems, control models, and codec for collaborative observation of remote environments with an autonomous networked robotic camera

Dezhen Song, Ni Qin and Ken Goldberg

View Related Documents

Abstract

Networked robotic cameras are becoming popular in remote observation applications such as natural observation, surveillance, and distance learning. Equipped with a high optical zoom lens and agile pan-tilt mechanisms, a networked robotic camera can cover a large region with various resolutions. The optimal selection of camera control parameters for competing observation requests and the on-demand delivery of video content for various spatiotemporal queries are two challenges in the design of such autonomous systems. For camera control, we introduce memoryless and temporal frame selection models that effectively enable collaborative control of the camera based on the competing inputs from in-situ sensors and users. For content delivery, we design a patch-based motion panorama representation and coding/decoding algorithms (codec) to allow efficient storage and computation. We present system architecture, frame selection models, user interface, and codec algorithms. We have implemented the system and extensively tested our design in real world applications including natural observation, public surveillance, distance learning, and building construction monitoring. Experiment results show that our frame selection models are robust and effective and our on-demand content delivery codec can satisfy a variety of spatiotemporal queries efficiently in terms of computation time communications bandwidth.

Keywords  Frame selection - Panorama video - Networked cameras - Tele-robot

This work was supported in part by the National Science Foundation under IIS-0643298, IIS-0534848/0535218, by Panasonic Research, by Intel Corporation, and by UC Berkeley’s Center for Information Technology Research in the Interest of Society (CITRIS), and the Berkeley Center for New Media (BCNM).

Fulltext Preview

Image of the first page of the fulltext document