Topic
Spark (mathematics)
About: Spark (mathematics) is a research topic. Over the lifetime, 7304 publications have been published within this topic receiving 63322 citations.
Papers published on a yearly basis
Papers
More filters
••
TL;DR: A semisupervised prediction model is proposed, which exploits the improved unsupervised clustering algorithm to establish the fuzzy partition function, and then utilize the neural network model to build the information prediction function.
Abstract: The continuous development of industry big data technology requires better computing methods to discover the data value. Information forecast, as an important part of data mining technology, has achieved excellent applications in some industries. However, the existing deviation and redundancy in the data collected by the sensors make it difficult for some methods to accurately predict future information. This article proposes a semisupervised prediction model, which exploits the improved unsupervised clustering algorithm to establish the fuzzy partition function, and then utilize the neural network model to build the information prediction function. The main purpose of this article is to effectively solve the time analysis of massive industry data. In the experimental part, we built a data platform on Spark, and used some marine environmental factor datasets and UCI public datasets as analysis objects. Meanwhile, we analyzed the results of the proposed method compared with other traditional methods, and the running performance on the Spark platform. The results show that the proposed method achieved satisfactory prediction effect.
104 citations
••
01 Aug 2015TL;DR: The main challenges and requirements that appeared in taking Spark to a wide set of users, and usability and performance improvements made to the engine in response are described.
Abstract: Apache Spark is one of the most widely used open source processing engines for big data, with rich language-integrated APIs and a wide range of libraries. Over the past two years, our group has worked to deploy Spark to a wide range of organizations through consulting relationships as well as our hosted service, Databricks. We describe the main challenges and requirements that appeared in taking Spark to a wide set of users, and usability and performance improvements we have made to the engine in response.
101 citations
••
TL;DR: In this article, a four-stroke free-piston engine equipped with a linear electric generator (namely internal combustion linear generator integrated power system) is proposed to achieve efficient energy conversion from fuel to electricity.
101 citations
••
TL;DR: In this article, a physically-based spark channel ignition monitoring model, SparkCIMM, is proposed to predict localized ignition spots along the spark plasma channel, and a formulation of early flame kernel propagation based on the G-equation theory.
101 citations