Seeing and understanding — that is the working principle behind intelligent security cameras such as the FLEXIDOME IP starlight 8000i. In this interview, the video analytics expert André-Luis Tournoux talks about why teaching a device is child’s play and what new possibilities this presents.
Intelligent software, sharp eye
How do you teach a child what a car looks like? Simple — show the kid a car. Courtesy of Bosch image-processing software, this proven method of early education is just as effective for security cameras. Called Camera Trainer, the software enables these cameras to learn. Embedded in devices such as the new FLEXIDOME IP starlight 8000i, the software opens the door to unprecedented applications. The latest-generation camera comes with some major upgrades — higher-definition images, optimized light sensitivity, remote setup via smartphone or tablet — but the most innovative feature of this camera generation is certainly Camera Trainer. André-Luis Tournoux helped develop the software at the Bosch location in Eindhoven, Netherlands.
Mr. Tournoux, what is Camera Trainer?
It’s a machine learning software embedded in high-end Bosch IP cameras for intelligent video surveillance systems and security systems. It teaches the camera to detect objects and states. If the camera recognizes a predefined scenario, it executes a predefined action, such as counting or triggering an alert in real time.
How do you train a camera?
Much like with many other types of machine learning software, you need sample images of objects. You have to show the camera which objects or situations are relevant. When using Camera Trainer, depending on the situation, between 25 and 250 samples will be enough for it to have learned what something looks like — a car, say.
sample images may be enough to teach a camera to recognize an object.
What roles do people and technology play here?
A computer program allows users to mark relevant things on images by simply dragging a box around them with a mouse. The system memorizes the objects’ outlines and can then recognize them on its own. This is what we call a positive sample. Negative samples are generated in an analogous way. These are any objects or backgrounds that are not the object in question.
Can you give us an example of an application?
This technology’s capabilities can be applied to various monitoring situations. For example, the camera can be trained to automatically detect if a parking space is occupied. For this purpose, vehicles are marked on images as positive samples, and free parking spaces as negative samples. This way, the camera learns what a car looks like and what an empty parking space looks like, and can subsequently distinguish between the two. The video camera can then automatically determine how many vacant parking spaces are available in a given area.
Parking-lot surveillance in three easy steps: how to train a camera
What is so special about this video security system?
Two things. For one, intelligent video analytics tools are already very good at detecting moving objects. Gone are the days when people had to stare constantly at screens, concentrating hard on spotting any activity. Camera Trainer makes that job even easier and more efficient. Thanks to this new software, objects can now be detected and tracked even when they are not in motion. That’s new. This means cameras can now determine how long a car has occupied a parking space.
You said there were two things that were special
There isn’t very much computing power installed in security cameras. To be able to run machine learning algorithms in a camera is an outstanding achievement. Our technology can do it because users can run the Camera Trainer configurator on a standard computer to handle the relatively complex task of object and background detection, and then deploy this capability by uploading a slimmed-down version of the program to the camera. This is where we benefited from the extensive know-how within the company. Units such as Connected Mobility and Computer Vision from Bosch corporate research helped develop Camera Trainer. And product management in the Building Technologies division ensured that Camera Trainer could be integrated into the camera.
What will the next evolutionary step in smart security cameras be?
The safety and security industry will have to think differently about the way it develops solutions. With our new open camera platform, we are leading by example. It combines built-in intelligent video analytics with superb performance and the ability to freely add software apps. And as it runs on a commonly used operating system based on Android Open Source Project, it is accessible to anyone who wants to create and deploy customer-specific apps and services.
Video analytics and BI business developer at Bosch Building Technologies
I’m constantly learning new things about IT and technical innovations.
For André-Luis Tournoux, the world is a village. The Frenchman studied applied mathematics, computational physics, and finance in Brazil and France, and joined Bosch in the Netherlands in 2017 after working in management and IT development. And when he isn’t working, he indulges in water sports or travels the world — the globetrotter has already visited 60 countries.