FPGA-Based Smart Camera System for Real-Time Automated Video Surveillance
29 Jun 2017-pp 533-544
TL;DR: The design and implementation of an FPGA-based smart camera system for automated video surveillance that meets the real-time requirements of video surveillance applications while aiming atFPGA resource reduction is presented.
Abstract: Automated video surveillance is a rapidly evolving area and has been gaining importance in the research community in recent years due to its capabilities of performing more efficient and effective surveillance by employing smart cameras. In this article, we present the design and implementation of an FPGA-based smart camera system for automated video surveillance. The complete system is prototyped on Xilinx ML510 FPGA platform and meets the real-time requirements of video surveillance applications while aiming at FPGA resource reduction. The implemented smart camera system is capable of automatically performing real-time motion detection, real-time video history generation, real-time focused region extraction, real-time filtering of frames of interest, and real-time object tracking of identified target with automatic purposive camera movement. The system is designed to work in real-time for live color video streams of standard PAL (720 × 576) resolution, which is the most commonly used video resolution for current generation surveillance systems. The implemented smart camera system is also capable of processing HD resolution video streams in real-time.
Citations
More filters
TL;DR: The focal point of this work is to develop an intelligent camera surveillance system which englobes the key functionalities of existing surveillance systems and integrates a novel and advanced object displacement detection feature to provide more security by determining if an object has been displaced by an intruder.
Abstract: The focal point of this work is to develop an intelligent camera surveillance system which englobes the key functionalities of existing surveillance systems. Other than regular functionalities such as motion detection, object detection, face recognition and counting people, it also integrates a novel and advanced object displacement detection feature to provide more security by determining if an object has been displaced by an intruder. When people are detected, a counting module displays the number of persons present in the surveillance area. A face recognition module distinguishes between authorised and unauthorised users. This biometric functionality reduces false alarms which makes the system more robust. An object detection module detects certain valuable objects such as handbags, laptops and smartphones. Also, images and short video recordings are stored on the cloud. Furthermore, the system introduces innovative real-time notification approaches for surveillance systems such as WhatsApp messages and phone calls, in addition to SMS and emails. Thus, this system is reliable and meets the aim of a modern intelligent surveillance system by combining multiple approaches to detect intrusions and to inform users effectively.
6 citations
Cites background from "FPGA-Based Smart Camera System for ..."
...The authors state that their work meets the requirements of surveillance systems [32]....
[...]
TL;DR: A global vision of the issues published in the Electronic magazine and their importance, advances and developments that have been particularly relevant for subsequent research are established.
Abstract: The contributions of researchers at a global level in the journal Electronics in the period 2012–2020 are analyzed. The objective of this work is to establish a global vision of the issues published in the Electronic magazine and their importance, advances and developments that have been particularly relevant for subsequent research. The magazine has 15 thematic sections and a general one, with the programming of 385 special issues for 2020–2021. Using the Scopus database and bibliometric techniques, 2310 documents are obtained and distributed in 14 thematic communities. The communities that contribute to the greatest number of works are Power Electronics (20.13%), Embedded Computer Systems (13.59%) and Internet of Things and Machine Learning Systems (8.11%). A study of the publications by authors, affiliations, countries as well as the H index was undertaken. The 7561 authors analyzed are distributed in 87 countries, with China being the country of the majority (2407 authors), followed by South Korea (763 authors). The H-index of most authors (75.89%) ranges from 0 to 9, where the authors with the highest H-Index are from the United States, Denmark, Italy and India. The main publication format is the article (92.16%) and the review (5.84%). The magazine publishes topics in continuous development that will be further investigated and published in the near future in fields as varied as the transport sector, energy systems, the development of new broadband semiconductors, new modulation and control techniques, and more.
1 citations
01 Jan 2023
TL;DR: In this paper , a survey on 3D hand detection and tracking and their applications as a natural user interface to control the computer with hand movements and gestures is presented. But the focus is on the 3D mouse and keyboard.
Abstract: 3D hand detection and tracking algorithms has increased research interests in computer vision, pattern recognition, and human-computer interfacing. It is greatly inspired by the emerging technologies like RGBD camera, depth sensors and processing architecture. Therefore, this paper presents a survey on recent works on 3D hand detection and tracking and their applications as a natural user interface to control the computer with hand movements and gestures. It examines the literature in terms of 1) 3D hand capturing techniques used like RGBD cameras, depth sensors, 2) processing with different image processing and computer vision algorithms and their hardware implementation 3) and applications in human computer interfacing for realization of the system. While the emphasis is on 3D mouse and keyboard, the related findings and future challenges are also discussed for practitioners.
TL;DR: A novel and systematic approach for dynamic allocation of tasks in a video surveillance system using smart cameras and based on Cloud/Fog architecture is proposed, guaranteeing the best solution optimizing power consumption and communication cost over the system.
Abstract: In this paper we propose a novel and systematic approach for dynamic allocation of tasks in a video surveillance system using smart cameras and based on Cloud/Fog architecture. Tracking tasks arrive in the system in a random way and must be assigned to the available devices (cameras, Fog nodes and the Cloud). Our approach guarantees the best solution optimizing power consumption and communication cost over the system. The proposed methods uses an integer programming model and its effectiveness is shown on an application example.
Cites background from "FPGA-Based Smart Camera System for ..."
...For example, [1] describes the design and the...
[...]
...However, these requirements are becoming increasingly difficult to satisfy in the case of multimedia applications such as video surveillance one in smart environment, for instance, such as buildings or cities is a recent trend [1]....
[...]
References
More filters
01 Oct 2011
TL;DR: The SIMD approach based hardware accelerator designed for real-time tracking of objects in a scene is presented and designed and simulated using VHDL and implemented on Xilinx XUP Virtex-IIPro FPGA.
Abstract: Smart Cameras are important components in video analysis. For video analysis, smart cameras needs to detect
interesting moving objects, track such objects from frame to frame, and perform analysis of object track in real time.
Therefore, the use of real-time tracking is prominent in smart cameras. The software implementation of tracking
algorithm on a general purpose processor (like PowerPC) could achieve low frame rate far from real-time requirements.
This paper presents the SIMD approach based hardware accelerator designed for real-time tracking of objects in a scene.
The system is designed and simulated using VHDL and implemented on Xilinx XUP Virtex-IIPro FPGA. Resulted
frame rate is 30 frames per second for 250x200 resolution video in gray scale.
2 citations
TL;DR: An embedded platform based framework for implementing summary generation scheme using HW-SW Co-Design based methodology is proposed and the complete system is implemented on Xilinx XUP Virtex-II Pro FPGA board.
Abstract: In any remote surveillance scenario, smart cameras have to take intelligent decisions to generate summary frames to minimize communication and processing overhead. Video summary generation, in the context of smart camera, is the process of merging the information from multiple frames. A summary generation scheme based on clustering based change detection algorithm has been implemented in our smart camera system for generating frames to deliver requisite information. In this paper we propose an embedded platform based framework for implementing summary generation scheme using HW-SW Co-Design based methodology. The complete system is implemented on Xilinx XUP Virtex-II Pro FPGA board. The overall algorithm is running on PowerPC405 and some of the blocks which are computationally intensive and more frequently called are implemented in hardware using VHDL. The system is designed using Xilinx Embedded Design Kit (EDK).
2 citations
16 Jul 2014
TL;DR: The proposed architecture is designed to meet the real-time requirements of video surveillance applications and is capable of robustly extracting the focused regions in a live video stream in real- time for standard PAL size color video.
Abstract: This paper presents the design of a dedicated VLSI architecture for focused region extraction in a video sequence and its implementation on Virtex-5 (ML510) FPGA platform. Edge width based scheme is used for focused region extraction. The proposed architecture is designed to meet the real-time requirements of video surveillance applications. It is capable of robustly extracting the focused regions in a live video stream in real-time for standard PAL size color video.
1 citations