These days, a massive amount video is being recorded, but never watched or reviewed, due to lack of time. As a result, events and activities are missed, and suspicious behavior is not noticed in time to prevent incidents. This has led to the development of Intelligent Video (IV).
Intelligent video comprises any solution where the video surveillance system automatically performs an analysis of the captured video. Applications range from analytics such as video motion detection and audio detection, to more advanced systems including camera tampering detection, people counting, virtual fences, and vehicle license plate recognition. The applications performing these analyses are also referred to as Video Content Analysis
(VCA) or Video Analytics (VA).
What is intelligent video?
Intelligent Video is about reducing the vast amount of information contained in video, making it more manageable for systems and persons.
Learn how Active Tampering Alarm helps operators when cameras are under attack.
Building this sort of analytics into network cameras has major advantages such as a more reliable and versatile video surveillance system, and drastically reduced workload for the staff.
The intelligent network camera is never idle and supports the operator 24 hours a day, seven days a week. It is constantly on guard, waiting for an impulse to start recording or sending an alarm to the operator.
Additionally, intelligent video systems can extract video and data from surveillance video streams and integrate that information with other applications, such as retail management systems or access control systems, creating new benefits and opening up new business possibilities.
Benefits
The "intelligence" in intelligent video applications describes the analysis of video images and the automated use of the resulting data. The benefits from intelligent video systems are numerous, and include:
More efficient use of manpower
Large-scale video surveillance systems are limited in their effectiveness because it is difficult for operators to watch numerous monitors and keep track of every incident. With intelligent video solutions, fewer operators can monitor even very large installations, since staff will not be required to attentively watch many monitors for hours to notice undesired activity. Instead, the intelligent video system supports and informs operators about, for example, people moving about in restricted areas, cars driving the wrong way, or attempts to tamper with the video surveillance cameras.
Faster retrieval of stored video
Finding incidents in stored video is extremely time-consuming since the operator has to watch the recorded video. Given the difficulty of searching through stored video, most of it is simply archived and deleted. Video analytics – such as video motion detection – ensures that only relevant video footage is stored, so that when the need arises to search through old recordings, only video that could potentially include the event in question is retrieved. In addition, intelligent video systems that, for example, have tagged the video stream with appropriate labels during recording, can automatically search through days of stored video to find the right video footage in a matter of seconds.
Reduced network load and storage needs
Intelligent video systems that include video motion detection and audio detection minimize the need for storage space by recording only video that contains activity. Furthermore, by placing intelligent video ‘at the edge’, that is, processing as much as possible of the video in the network cameras themselves, the load on the network is significantly reduced as only relevant video is streamed from the cameras. Intelligent video applications help build video surveillance systems that are more cost-effective.
New business opportunities
Intelligent video also makes it possible to use video for applications outside of security. For example, in retail stores it can be used for analyzing consumer behavior, such as the number of people stopping by a particular merchandising shelf, or the popular routes through the shop. In airports, an intelligent video system could measure the queue time between entering and exiting a check-in point, helping direct staff and minimizing waiting time for travelers. In these and other ways, intelligent video makes it possible to extract greater benefit out of the video surveillance infrastructure, enabling a higher return-on-investment.
System design
There are two broad categories of systems for implementing intelligent video: centralized and distributed. In centralized architectures, video and other information is collected by cameras and sensors and brought to a centralized server for analysis. In distributed architectures, the edge devices (network cameras and video encoders) are ‘intelligent’ and are capable of processing the video and extracting relevant information. A further consideration is whether the system should allow for integration of applications from different vendors.
Considerations Reliability and system availability – minimizing the risk of system failure and associated down-time
Scalability and flexibility – the ability to effortlessly scale the system from a few to many cameras, as well as intelligently distribute processing across the network
Interoperability – the ability to use system components from different vendors
Security – making sure that only authorized personnel are allowed to access the system
Total cost of ownership (TCO) – this includes capital costs for the system components and operational expenses
DVRs and centralized intelligence
To enable central monitoring of traditional CCTV systems surveillance video can be fed directly from the analog cameras into an intelligent video-enabled DVR. The DVR will perform the video analytics (people counting or car license plate extraction for example) before taking the remaining data, digitizing, compressing, and recording it; and distributing the resulting alarms and video output to authorized operators.
In this architecture, each analog camera is connected by a coax cable to the DVR. While this approach works adequately for small installations with a limited number of cameras, it is not scalable or flexible. Each DVR comes with a specific number of inputs and adding even one additional camera entails the addition of another DVR, which is a costly proposition. Also, since DVRs are proprietary embedded devices, they cannot be easily networked, or use intelligent video applications from different vendors, and do not support general network utilities, such as for security.
Network video systems and distributed intelligence
Network video allows for completely different strategy - distributed intelligence. Distributed architectures are designed to overcome the limitations of centralized architectures by distributing the processing to different elements in the network. The most scalable, cost-effective and flexible architecture is based on ‘intelligence at the edge’, that is, processing as much of the video as possible in the network cameras, or video encoders themselves. This architecture entails the least amount of bandwidth usage since the cameras can send out data and intelligently figure out what video needs to be sent. This significantly reduces the cost and complexity of the network centric processing model, and completely eliminates the drawbacks of centralized architectures.
If cameras for example have motion detection, then rather than streaming all the video, only interesting video that has motion in it can be sent to the monitoring station for further action and analysis. The load on the infrastructure and people involved falls dramatically. For specialized video analytics, where only the data is needed and not the video, such as, people counting, or automatic number plate recognition – running the applications in the camera has a dramatic impact since the cameras can extract the required data and send just that information, with perhaps a few snapshots.
Furthermore, processing video at the edge – or partly at the edge – significantly reduces the cost of the servers needed to run the intelligent video applications. Servers that typically process only a few video streams when doing the entire video processing, can handle hundreds of video streams if some of the processing is done in the cameras.
By integrating intelligent edge devices with video management systems, and dividing the load between the different parts of the network, intelligent video solutions can be created that scale effortlessly, are more flexible, and cost-effective than centralized solutions.
Integrating intelligent video from different vendors
Many manufacturers of video surveillance equipment supply intelligent video applications with their products. Often these are applications that enhance camera functionality with video motion detection. Occasionally equipment manufacturers provide other, more advanced video applications with functionality such as tamper detection, and people counting.
However, building robust and commercially viable applications for video analytics requires expertise in image analysis and, sometimes, specialized knowledge in a certain application area, such as retail or transportation. For this reason, a number of software vendors have chosen to focus on supplying intelligent video applications that solve specific needs. Together with network cameras, video encoders and/or video management software systems, these intelligent video applications form complete solutions, tailored to specific market requirements.
While this creates great freedom of choice for the end user, it also calls for compatibility and easy integration between the cameras/encoders, video management software, and the intelligent video applications. In order to be commercially attractive and to optimize compatibility, devices, software, and intelligent video applications need to be built on open interfaces (APIs) and platforms. This creates flexibility for users and enables them to design intelligent video surveillance systems that fit their needs perfectly.
Products
Axis offers a number of intelligent video applications that support security operators in their daily work by solving real-world video surveillance challenges. Furthermore, a broad range of intelligent video applications that work with Axis network video products are available from Axis Application Development Partners.
Active Tampering Alarm
Active Tampering Alarm is an intelligent video analytics application available in selected Axis network cameras. The Active Tampering Alarm functionality enables security staff to detect disrupted camera operation, by automatically alerting the operator when a camera is manipulated in any way. The product is especially useful in applications where there is potential for vandalism – such as in schools, prisons, public transportation, and in harsh environments where weather, vibration, or dirt can disturb the camera’s performance. Active Tampering Alarm detects incidents such as accidental redirection, blocking or defocusing of cameras, and reacts when the camera is attacked, spray-painted, or intentionally covered.
Products including Active Tampering Alarm
Without Active Tampering Alarm, it can take a long time before tampering is noticed. This is especially true for applications where one operator monitors multiple cameras. If not detected right away, significant incidents may go undetected and completely unusable video is stored. However with Active Tampering Alarm, there is an immediate notification when normal camera operation is disturbed.