LPG-model: A novel model for throughput prediction in stream processing, using a light gradient boosting machine, incremental principal component analysis, and deep gated recurrent unit network

Estimation of future power consumption level in smart grid: Application of fuzzy logic and genetic algorithm on big data platform

With the availability of smart devices and affordable data plans, social media platforms have become the primary source of information dissemination across geographically dispersed users/locations. It has shown great potential across different application domains including event detection, opinion analysis, recommendation, and prediction. However, the process of extracting useful information from the collected voluminous social media data during natural hazards is a standing problem that needs significant attention from the research community. The fine-grained knowledge detailing users' participation in information spreading could be advantageous in developing a reliable social network for the adverse events (Natural Hazards, Man-made attacks etc.). However, there has been no such findings related to identification of leader and their leadership characteristics associated with natural hazards in previous studies. We have collected 20.6 million tweets which were posted by 5.3 million users, during distinct devastating hazards namely - Floods, Hurricane, Earthquake and Typhoons. To achieve the goal, we divided our work in to three parts. Firstly, classify the collected crises data into four domains i.e resource, causality, news, and sympathy by employing deeper recurrent neural network model. Secondly, we used statistical physics of complex network to recognize local as well as global prominent leaders. At last, we curate leadership characteristics in terms of their big five personality traits and emotional traits. Our experimental, results find evidence that local leadership behaviour characteristics are significantly different from global potentials. Where as we also finds that some behaviour traits were certain to classified domains (resource, causality, news, and sympathy) and some were certain to hazard divisions, though emotional characteristics remained consistent. Later, we conclude that local potentials leaders have comparatively higher emotional strength. Furthermore, when the complete local network structure is unavailable, we find that the dynamic rank is reliable indexing proxy for local potentials. The current study, provide useful insight to understand how leadership characteristics are influenced to hazards, domains and centrality of users.

/pdf/identifying-leadership-characteristics-from-social-media-3k49eeontw.pdf

Identifying Leadership Characteristics from Social Media Data during Natural Hazards using Personality Traits.

Data stream processing (DSP) is an interesting computation paradigm in geo-distributed infrastructures such as Fog computing because it allows one to decentralize the processing operations and move them close to the sources of data. However, any decomposition of DSP operators onto a geo-distributed environment with large and heterogeneous network latencies among its nodes can have significant impact on DSP performance. In this paper, we present a mathematical performance model for geo-distributed stream processing applications derived and validated by extensive experimental measurements. Using this model, we systematically investigate how different topological changes affect the performance of DSP applications running in a geo-distributed environment. In our experiments, the performance predictions derived from this model are correct within ±2% even in complex scenarios with heterogeneous network delays between every pair of nodes.

/pdf/an-experiment-driven-performance-model-of-stream-processing-267knlk35u.pdf

An experiment-driven performance model of stream processing operators in fog computing environments

Social Network Data Analytics || An Introduction to Social Network Data Analytics

Worldwide sensor streams are expanding continuously with unbounded velocity in volume, and for this acceleration, there is an adaptation of large stream data processing system from the homogeneous to rack-scale architecture which makes serious concern in the domain of workload optimization, scheduling, and resource management algorithms. Our proposed framework is based on providing architecture independent performance prediction model to enable resource adaptive distributed stream data processing platform. It is comprised of seven pre-defined domain for dynamic data stream metrics including a self-driven model which tries to fit these metrics using ridge regularization regression algorithm. Another significant contribution lies in fully-automated performance prediction model inherited from the state-of-the-art distributed data management system for distributed stream processing systems using Gaussian processes regression that cluster metrics with the help of dimensionality reduction algorithm. We implemented its base on Apache Heron and evaluated with proposed Benchmark Suite comprising of five domain-specific topologies. To assess the proposed methodologies, we forcefully ingest tuple skewness among the benchmarking topologies to set up the ground truth for predictions and found that accuracy of predicting the performance of data streams increased up to 80.62% from 66.36% along with the reduction of error from 37.14 to 16.06%.

/pdf/performance-prediction-of-data-streams-on-high-performance-51v4u0qn9j.pdf

Performance prediction of data streams on high-performance architecture

Matching user's profile over multiple Online Social Network (OSN) brings many new insights. Considering the fact of user's disambiguation over different OSN, Existing user profile matching are highly computationally expensive. In this paper, we propose a novel e-identity Architecture using Infrastructure as a service (IaaS) of Cloud to reduce the computational cost of the profile matching algorithm. Profile equivalent through proposed architecture are based on the public attributes available in overall social network and lastly, profiles are mapped to the Aadhaar Unique Identification Number (UID).

Profile Matching of Online Social Network with Aadhaar Unique Identification Number

In this paper we have proposed the clustering approach to classify the random walk trajectories from the synthetic bus station video. Bus station one of the most crowded locations that consist of more than thousands of passengers or travelers waiting for the buses to travel to the destination point. These crowded locations can be highly prone to accidents or terrorist activities. Work is classified into two steps i.e Firstly we find out the trajectories from the image by using the machine learning approach after that we apply the agglomerative clustering algorithm which is used to group the abnormal trajectories with the similar spatial patterns and normal trajectories with similar spatial patterns. Keywords—Path detection, Anomaly Detection, Trajectories,

/pdf/passenger-abnormal-behaviour-detection-using-machine-yr26u1g3cd.pdf

Passenger Abnormal Behaviour Detection using Machine Learning Approach

Online social microblogging platforms including Twitter are increasingly used for aiding relief operations during disaster events. During most of the calamities that can be natural disasters or even armed attacks, non-governmental organizations look for critical information about resources to support effected people. Despite the recent advancement of natural language processing with deep neural networks, retrieval and ranking of short text becomes a challenging task because a lot of conversational and sympathy content merged with the critical information. In this paper, we address the problem of categorical information retrieval and ranking of most relevance information while considering the presence of short-text and multilingual languages that arise during such events. Our proposed model is based on the formation of embedding vector with the help of textual and statistical preprocessing, and finally, entire training 2,100,000 vectors were normalized using feed-forward neural network for need and availability tweets. Another important contribution of this paper lies in novel weighted Ranking Key algorithm based on top five general terms to rank the classified tweets in most relevance with classification. Lastly, we test our model on Nepal Earthquake dataset (contains short text and multilingual language tweets) and achieved 6.81% of mean average precision on 5,250,000 unlabeled embedding vectors of disaster relief tweets.

Automatic Identification and Ranking of Emergency Aids in Social Media Macro Community

The proliferation of smartphones and wearable devices has increased the availability of large amounts of geospatial streams to provide significant automated discovery of knowledge in pervasive environments, but most prominent information related to altering interests have not yet adequately capitalized. In this paper, we provide a novel algorithm to exploit the dynamic fluctuations in user's point-of-interest while forecasting the future place of visit with fine granularity. Our proposed algorithm is based on the dynamic formation of collective personality communities using different languages, opinions, geographical and temporal distributions for finding out optimized equivalent content. We performed extensive empirical experiments involving, real-time streams derived from 0.6 million stream tuples of micro-blog comprising 1945 social person fusion with graph algorithm and feed-forward neural network model as a predictive classification model. Lastly, The framework achieves 62.10% mean average precision on 1,20,000 embeddings on unlabeled users and surprisingly 85.92% increment on the state-of-the-art approach.

Bhaskar Gautam

Papers

Performance prediction of data streams on high-performance architecture

Profile Matching of Online Social Network with Aadhaar Unique Identification Number

Passenger Abnormal Behaviour Detection using Machine Learning Approach

Automatic Identification and Ranking of Emergency Aids in Social Media Macro Community

When and Where?: Behavior Dominant Location Forecasting with Micro-Blog Streams