Sentiment analysis and opinion mining is the field of study that analyzes people's opinions, sentiments, evaluations, attitudes, and emotions from written language. It is one of the most active research areas in natural language processing and is also widely studied in data mining, Web mining, and text mining. In fact, this research has spread outside of computer science to the management sciences and social sciences due to its importance to business and society as a whole. The growing importance of sentiment analysis coincides with the growth of social media such as reviews, forum discussions, blogs, micro-blogs, Twitter, and social networks. For the first time in human history, we now have a huge volume of opinionated data recorded in digital form for analysis. Sentiment analysis systems are being applied in almost every business and social domain because opinions are central to almost all human activities and are key influencers of our behaviors. Our beliefs and perceptions of reality, and the choices we make, are largely conditioned on how others see and evaluate the world. For this reason, when we need to make a decision we often seek out the opinions of others. This is true not only for individuals but also for organizations. This book is a comprehensive introductory and survey text. It covers all important topics and the latest developments in the field with over 400 references. It is suitable for students, researchers and practitioners who are interested in social media analysis in general and sentiment analysis in particular. Lecturers can readily use it in class for courses on natural language processing, social media analysis, text mining, and data mining. Lecture slides are also available online.

/pdf/sentiment-analysis-and-opinion-mining-8314pykwrf.pdf

Sentiment Analysis and Opinion Mining

We present a method that learns word embedding for Twitter sentiment classification in this paper. Most existing algorithms for learning continuous word representations typically only model the syntactic context of words but ignore the sentiment of text. This is problematic for sentiment analysis as they usually map words with similar syntactic context but opposite sentiment polarity, such as good and bad, to neighboring word vectors. We address this issue by learning sentimentspecific word embedding (SSWE), which encodes sentiment information in the continuous representation of words. Specifically, we develop three neural networks to effectively incorporate the supervision from sentiment polarity of text (e.g. sentences or tweets) in their loss functions. To obtain large scale training corpora, we learn the sentiment-specific word embedding from massive distant-supervised tweets collected by positive and negative emoticons. Experiments on applying SSWE to a benchmark Twitter sentiment classification dataset in SemEval 2013 show that (1) the SSWE feature performs comparably with hand-crafted features in the top-performed system; (2) the performance is further improved by concatenating SSWE with existing feature set.

/pdf/learning-sentiment-specific-word-embedding-for-twitter-4nzb8q6cq5.pdf

Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification

Deep learning has emerged as a powerful machine learning technique that learns multiple layers of representations or features of the data and produces state-of-the-art prediction results. Along with the success of deep learning in many other application domains, deep learning is also popularly used in sentiment analysis in recent years. This paper first gives an overview of deep learning and then provides a comprehensive survey of its current applications in sentiment analysis.

Deep learning for sentiment analysis: A survey

Recent developments in techniques for modeling, digitizing and visualizing 3D shapes has led to an explosion in the number of available 3D models on the Internet and in domain-specific databases. This has led to the development of 3D shape retrieval systems that, given a query object, retrieve similar 3D objects. For visualization, 3D shapes are often represented as a surface, in particular polygonal meshes, for example in VRML format. Often these models contain holes, intersecting polygons, are not manifold, and do not enclose a volume unambiguously. On the contrary, 3D volume models, such as solid models produced by CAD systems, or voxels models, enclose a volume properly. This paper surveys the literature on methods for content based 3D retrieval, taking into account the applicability to surface models as well as to volume models. The methods are evaluated with respect to several requirements of content based 3D shape retrieval, such as: (1) shape representation requirements, (2) properties of dissimilarity measures, (3) efficiency, (4) discrimination abilities, (5) ability to perform partial matching, (6) robustness, and (7) necessity of pose normalization. Finally, the advantages and limitations of the several approaches in content based 3D shape retrieval are discussed.

/pdf/a-survey-of-content-based-3d-shape-retrieval-methods-1p1e9hurpn.pdf

A survey of content based 3D shape retrieval methods

This paper introduces a method to extract 'Shape-DNA', a numerical fingerprint or signature, of any 2d or 3d manifold (surface or solid) by taking the eigenvalues (i.e. the spectrum) of its Laplace-Beltrami operator. Employing the Laplace-Beltrami spectra (not the spectra of the mesh Laplacian) as fingerprints of surfaces and solids is a novel approach. Since the spectrum is an isometry invariant, it is independent of the object's representation including parametrization and spatial position. Additionally, the eigenvalues can be normalized so that uniform scaling factors for the geometric objects can be obtained easily. Therefore, checking if two objects are isometric needs no prior alignment (registration/localization) of the objects but only a comparison of their spectra. In this paper, we describe the computation of the spectra and their comparison for objects represented by NURBS or other parametrized surfaces (possibly glued to each other), polygonal meshes as well as solid polyhedra. Exploiting the isometry invariance of the Laplace-Beltrami operator we succeed in computing eigenvalues for smoothly bounded objects without discretization errors caused by approximation of the boundary. Furthermore, we present two non-isometric but isospectral solids that cannot be distinguished by the spectra of their bodies and present evidence that the spectra of their boundary shells can tell them apart. Moreover, we show the rapid convergence of the heat trace series and demonstrate that it is computationally feasible to extract geometrical data such as the volume, the boundary length and even the Euler characteristic from the numerically calculated eigenvalues. This fact not only confirms the accuracy of our computed eigenvalues, but also underlines the geometrical importance of the spectrum. With the help of this Shape-DNA, it is possible to support copyright protection, database retrieval and quality assessment of digital data representing surfaces and solids. A patent application based on ideas presented in this paper is pending.

/pdf/laplace-beltrami-spectra-as-shape-dna-of-surfaces-and-solids-5djzm2hwdp.pdf

Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids

In this paper, we propose an efficient embedding for modeling higher-order (n-gram) phrases that projects the n-grams to low-dimensional latent semantic space, where a classification function can be defined We utilize a deep neural network to build a unified discriminative framework that allows for estimating the parameters of the latent space as well as the classification function with a bias for the target classification task at hand We apply the framework to large-scale sentimental classification task We present comparative evaluation of the proposed method on two (large) benchmark data sets for online product reviews The proposed method achieves superior performance in comparison to the state of the art

/pdf/sentiment-classification-based-on-supervised-latent-n-gram-2e3ps95mxa.pdf

Sentiment classification based on supervised latent n-gram analysis

Our recent work has described a framework for matching solid of mechanical artifacts models based on scale-space feature decomposition. In this work we adopt a method of comparing solid models based on Multiresolutional Reeb Graphs (MRG) similarity computations. This method was originally proposed by Hilaga et al. in [1]. Reeb Graph technique applies MRG structure to comparisons of approximate models found in the graphics community, such as polygonal meshes, faceted representation and Virtual Reality Modeling Language (VRML) models. First, we provide a brief review of shape matching using Multiresolutional Reeb Graphs and present an approach to matching solid models. Second, we show the performance of the Reeb Graph technique when handling primitive CAD models, such as cubes and spheres; then we perform experiments with more complex models, such as LEGO models and mechanical parts, and we discuss Reeb Graph technique’s performance on complex CAD models. Third, we emphasize several problems with the existing technique. Finally, we conclude with discussion of future work.

Reeb graph based shape retrieval for cad

A primary shortcoming of existing techniques for hree-dimensional (3D) model matching is the reliance on global information of the model’s structure. Models are matched in their entirety, depending on overall topology and geometry information. A currently open challenge is how to perform partial matching. Partial matching is important for finding similarities across part models with different global shape properties and for the segmentation and matching of data acquired from 3D scanners. This paper presents a Scale–Space feature extraction technique based on recursive decomposition of polyhedral surfaces into surface patches. The experimental results presented in this paper suggest that this technique can potentially be used to perform matching based on local model structure. In our previous work, Scale–Space decomposition has been used successfully to extract features from mechanical artifacts. Scale–Space techniques can be parameterized to generate decompositions that correspond to manufacturing, assembly or surface features relevant to mechanical design. One application of these technique is to support matching and content-based retrieval of solid models. This paper shows how a Scale–Space technique can extract features that are invariant with respect to the global structure of the model as well as small perturbations that 3D laser scanning process introduce. In order to accomplish this, we introduce a new distance function defined on triangles instead of points. We believe this technique offers a new way to control the feature decomposition process, which results in the extraction of features that are more meaningful from an engineering viewpoint. The new technique is computationally practical for use in indexing large models. Examples are provided that demonstrate effective feature extraction on 3D laser scanned models. In addition, a simple sub-graph isomorphism algorithm was used to show that the feature adjacency graphs, obtained through feature extraction, are meaningful descriptors of 3D CAD objects. All of the data used in the experiments for this work is freely available at: http://www.designrepository.org/datasets/ .

Local feature extraction and matching partial objects

Reeb graphs have been shown to be effective for topology matching of 3D objects. Their effectiveness breaks down, however, when the individual models become very geometrically and topologically detailed---as is the case for complex machined parts. The result is that Reeb graph techniques, as developed for matching general shape and computer graphics models, produce poor results when directly applied to create engineering databases.This paper presents a framework for shape matching through scale-space decomposition of 3D models. The algorithm is based on recent developments in efficient hierarchical decomposition of metric data using its spectral properties. Through spectral decomposition, we reduce the problem of matching to that of computing a mapping and distance measure between vertex-labeled rooted trees. We use a dynamic programming scheme to compute distances between trees corresponding to solid models. Empirical evaluation of the algorithm on an extensive set of 3D matching trials demonstrates both robustness and efficiency of the overall approach.

Scale-space representation of 3D models and topological matching

While benchmark datasets have been proposed for testing computer vision and 3D shape retrieval algorithms, no such datasets have yet been put forward to assess the relevance of these techniques for engineering problems. This paper presents several distinctive benchmark datasets for evaluating techniques for automated classification and retrieval of CAD objects. These datasets include (1) a dataset of CAD primitives (such as those common in constructive solid geometry modeling); (2) two datasets consisting of classes generated by minor topological variation; (3) two datasets of industrial CAD models classified based on object function and manufacturing process, respectively; (4) and a dataset of LEGO© models from the Mindstorms© robotics kits. Each model in the datasets is available in three formats - ACIS SAT, ISO STEP, and as a VRML mesh (some models are available under several different fidelity settings). These are all available through the National Design Repository.Using these datasets, we present comprehensive empirical results for nine (9) different shape and solid model matching and retrieval techniques. These experiments show, as expected, that the quality of precision-recall performance can significantly vary on different datasets. These experiments reveal that for certain object classes and classifications, such as those based on manufacturing processes, all existing techniques perform poorly. This study reveals the strengths and weaknesses of existing research in these areas, introduces open challenge problems, and provides meaningful datasets and metrics against which the success of current and future work can be measured.

/pdf/benchmarking-cad-search-techniques-11w4f6apn2.pdf

Dmitriy Bespalov

Papers

Sentiment classification based on supervised latent n-gram analysis

Reeb graph based shape retrieval for cad

Local feature extraction and matching partial objects

Scale-space representation of 3D models and topological matching

Benchmarking CAD search techniques