Smart devices that wake up with voice commands have gained popularity in recent years, and now researchers at Georgia Institute of Technology have taken it one step further: an always-on camera.
Designed with a combination of low-power hardware and energy efficient image processing software, the always-on camera is capable of watching for specific types of movement without draining batteries or running up electricity bills.
“Right now cameras are very hard to run on passive power just because they burn so much power themselves,” said Justin Romberg, a professor in Georgia Tech’s School of Electrical and Computer Engineering.
“This combination of efficient signal processing and a novel hardware design lowers the power requirement and means that some of these other options to power it might be open.”
While reducing the frame rate of a camera plays a role in lowering power demands, to achieve the power savings needed for this project, the researchers programmed the camera to track motion in a more generalised way that still preserved crucial details about what was being tracked. This requires significantly less power to process than tracking individual pixels throughout the entire field of view.
“What this camera is actually looking at is not pixel values, but pixels added together in all different ways and a dramatically smaller number of measurements than if you had it in a standard mode,” said Romberg.
The always-on camera was primarily designed as a way to wake up devices. However, its ability to recognise specific gestures expands the possibilities – such as a camera that wakes up with a specific pattern or movement almost like a secret handshake.
“We wanted to devise a camera that was capturing images all of the time, and then once you have a particular gesture – like you write a ‘Z’ in the air – it’s going to wake up,” said Arijit Raychowdhury, an associate professor in the School of Electrical and Computer Engineering.
“To make it work without affecting the battery life, we wanted it to be so low power that you can power it with harvested ambient energy.
“Simple motion detection is a well-studied area of research, and there are commercial products that support motion detection. But the problem is that a camera that can just detect motion – and not specific patterns in motion or gestures – is going to wake up more often, even when it doesn’t need to.”
Such a low-power camera could be useful in a range of applications, especially for camera systems in remote locations where efficiency is crucial.
“If you have a camera in the field, you want them to use as little energy as possible and only record events when necessary,” said Romberg.
Other applications include specialised surveillance, robotics and consumer electronics with hands-free operation, and the researchers are already working on adding wireless functionality to transmit images and data with an antenna.
“Cameras are being added to more and more devices these days, but they don’t have much interactivity,” said Raychowdury.
“What we are studying are smart cameras that can look at something specific in the environment at extreme energy-efficiencies and process the data for us.”