Smart cities (SCs) are becoming highly sophisticated ecosystems at which innovative solutions and smart services are being deployed. These ecosystems consider SCs as data production and sharing engines, setting new challenges for building effective SC architectures and novel services. The aim of this article is to “connect the pieces” among Data Science and SC domains, with a systematic literature review which identifies the core topics, services, and methods applied in SC data monitoring. The survey focuses on data harvesting and data mining processes over repeated SC data cycles. A survey protocol is followed to reach both quantitative and semantically important entities. The review results generate useful taxonomies for data scientists in the SC context, which offers clear guidelines for corresponding future works. In particular, a taxonomy is proposed for each of the main SC data entities, namely, the “D Taxonomy” for the data production, the “M Taxonomy” for data analytics methods, and the “S Taxonomy” for smart services. Each of these taxonomies clearly places entities in a classification which is beneficial for multiple stakeholders and for multiple domains in urban smartness targeting. Such indicative scenarios are outlined and conclusions are quite promising for systemizing.

A Systematic Review for Smart City Data Analytics

Hajj, the annual pilgrimage to Makkah, is one of the most massive gathering events in the world. It is a mandatory religious activity, once in a lifetime for every sane well-off Muslim. Every year around 3 million Muslims across the globe visit Makkah to perform this spatiotemporally constrained set of religious activities, like circumambulation around the Kaaba and the encampment at Mina, Arafat and Muzdalifah. The key ritual at Rami-al-Jamarat (the stoning-of-the-pillars) is a place seen particularly crowded. The diversified nature of the crowd in terms of race, age, language and culture brings several administrative challenges for local organizers whose responsibility is to ensure the smooth organization of the event. The advent of digital technologies has helped researchers to explore and propose modern methods for better crowd management and devise control strategies to organize such a mass gathering. In this paper, we present a taxonomy that summarizes our survey on the utilization of technology areas for providing needful services and improving crowd management during the Hajj season. These technologies are Wireless, Computer Vision, Spatial Computing, Data Analytics, Mobile Applications, Immersive Technologies, and Crowd Modelling and Simulation. We have also included the current research work and its implementation plan for Hajj 2020. One dimension of the taxonomy is to understand different possible technologies for Crowd management. Another dimension is to understand the impact of technologies to handle such a massive crowd. The discussion section covers a comparison of technologies with multiple aspects that may help researchers to contribute more towards dealing with future mass gathering events.

/pdf/digital-revolution-for-hajj-crowd-management-a-technology-2ci0elwvru.pdf

Digital Revolution for Hajj Crowd Management: A Technology Survey

With the advancement of social sensing technologies, digital maps have recently witnessed a tremendous evolution with the aim of integrating enriched semantic layers from heterogeneous and diverse data sources. Current generations of digital maps are often crowd-sourced, allow interactive route planning, and may contain live updates, such as traffic congestion states. Within this context, we believe that the next generation of maps will introduce the concept of extracting Events of Interest (EoI) from crowdsourced data, and displaying them at different spatial scales based on their significance. This paper introduces Hadath1, a scalable and efficient system that extracts social events from unstructured data streams, e.g. Twitter. Hadath applies natural language processing and multi-dimensional clustering techniques to extract relevant events of interest at different map scales, and to infer the spatio-temporal scope of detected events. Hadath also implements a hierarchical in-memory spatio-temporal indexing scheme to allow efficient and scalable access to raw data, as well as to extracted clusters of events. Initially, data packets are processed to discover events at a local scale, then, the proper spatio-temporal scope and the significance of detected events at a global scale is determined. As a result, live events can be displayed at different spatio-temporal resolutions, thus allowing a smooth and unique browsing experience. Finally, to validate our proposed system, we conducted experiments on real-time and historical social media streams.

Building socially-enabled event-enriched maps

Analyzing and visualizing large datasets generated by real-time spatio-temporal activities (e.g. vehicle mobility or large crowd movement) are a very challenging task. Recursive delays both at middleware and front end applications limit the of usefulness of the real-time analysis. In this paper, we present a framework “Spatial-Crowd” that first handles spatial-temporal data acquisition and processing by scaling up the middleware components and its infrastructure. Then, it enables filtering, fixing, enriching and summarising the acquired dataset, readily available for client interfaces which usually are not scalable or built to manage such large datasets. This framework follows published subscriber model and allows users to subscribe to aggregated data streams instead of requesting data in real time. The framework is tested with data generated by a very large simulated dataset and performance showed a significant data reduction on the client side to enhance data visualisation.

Spatial-crowd: A big data framework for efficient data visualization

Geospatial Big Data analytics are changing the way that businesses operate in many industries Although a good number of research works have reported in the literature on geospatial data analytics and real-time data processing of large spatial data streams, only a few have addressed the full geospatial big data analytics project lifecycle and geospatial data science project lifecycle Big data analysis differs from traditional data analysis primarily due to the volume, velocity and variety characteristics of the data being processed One of a motivation of introducing new framework is to address these big data analysis challenges Geospatial data science projects differ from most traditional data analysis projects because they could be complex and in need of advanced technologies in comparison to the traditional data analysis projects For this reason, it is essential to have a process to govern the project and ensure that the project participants are competent enough to carry on the process To this end, this paper presents, new geospatial big data mining and machine learning framework for geospatial data acquisition, data fusion, data storing, managing, processing, analysing, visualising and modelling and evaluation Having a good process for data analysis and clear guidelines for comprehensive analysis is always a plus point for any data science project It also helps to predict required time and resources early in the process to get a clear idea of the business problem to be solved

A new data science framework for analysing and mining geospatial big data

To manage large crowded events is a very challenging task nowadays. People are looking for solutions in which they can easily monitor the crowd, trace individuals, study formation and deformation patterns of the crowd. Millions of Muslims from around the world gather and perform Hajj in Makkah, Saudi Arabia in the 12th month of every lunar year. To monitor the crowd during Hajj is a great challenge. In this paper, we are proposing an identifiable crowd monitoring framework named iCrowd. This framework collect, identify, infer, analyze, store and retrieve the real-time location information of each of the pre-registered participants (pilgrims), and provides a digital view of crowd in near real-time. iCrowd framework is designed on a three-layer approach, device layer, middleware layer, and the application layer. We demonstrate our proposed framework with simulated data in the context of the event of Hajj.

iCrowd — A framework for monitoring of identifiable crowd

Intelligent Transport Systems (ITS) are vital to increase safety and reduce congestion problems. ITS can support several applications such as emergency management, automatic road enforcement, variable speed limits, collision avoidance systems, dynamic traffic light sequence and many more. These applications use heterogeneous technologies for sensing, communications, and computation. A number of sensing technologies have been used for the ITS applications such as cameras, sensors, inductive loop detection to know the contextual information of the given environment. These technologies are measuring almost the same information but in various formats. Similarly, several technologies are widely used for short and long range communications within ITS. Future, ITS will require wireless communication among vehicles and the road side infrastructure. Furthermore, ITS applications require realtime computation due to critical functions that need to provide realtime feedback to the end-users. In this paper, we proposed and developed a software platform to solve the challenging issues that came from sensing, communication and computation within ITS applications. The platform can process data from heterogeneous sources and makes sure that data availability and quality are maintained. Moreover, the proposed software platform is able to analyze data from heterogeneous sources to find valuable insights accordingly. Finally, we designed and developed a visualization layer to communicate valuable insights from the collected data to the end-users by exploiting various visualization techniques.

Sheikh N. Saeed

Papers

Spatial-crowd: A big data framework for efficient data visualization

iCrowd — A framework for monitoring of identifiable crowd

A software platform for smart data-driven intelligent transport applications