Data Mining Practical Machine Learning Tools and Techniques

We will review some of the major results in random graphs and some of the more challenging open problems. We will cover algorithmic and structural questions. We will touch on newer models, including those related to the WWW.

Random graphs

Twitter, a microblogging service less than three years old, commands more than 41 million users as of July 2009 and is growing fast. Twitter users tweet about any topic within the 140-character limit and follow others to receive their tweets. The goal of this paper is to study the topological characteristics of Twitter and its power as a new medium of information sharing.We have crawled the entire Twitter site and obtained 41.7 million user profiles, 1.47 billion social relations, 4,262 trending topics, and 106 million tweets. In its follower-following topology analysis we have found a non-power-law follower distribution, a short effective diameter, and low reciprocity, which all mark a deviation from known characteristics of human social networks [28]. In order to identify influentials on Twitter, we have ranked users by the number of followers and by PageRank and found two rankings to be similar. Ranking by retweets differs from the previous two rankings, indicating a gap in influence inferred from the number of followers and that from the popularity of one's tweets. We have analyzed the tweets of top trending topics and reported on their temporal behavior and user participation. We have classified the trending topics based on the active period and the tweets and show that the majority (over 85%) of topics are headline news or persistent news in nature. A closer look at retweets reveals that any retweeted tweet is to reach an average of 1,000 users no matter what the number of followers is of the original tweet. Once retweeted, a tweet gets retweeted almost instantly on next hops, signifying fast diffusion of information after the 1st retweet.To the best of our knowledge this work is the first quantitative study on the entire Twittersphere and information diffusion on it.

https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?article=7104&context=sis_research

What is Twitter, a social network or a news media?

The term “Linked Data” refers to a set of best practices for publishing and connecting structured data on the Web. These best practices have been adopted by an increasing number of data providers over the last three years, leading to the creation of a global data space containing billions of assertions— the Web of Data. In this article, the authors present the concept and technical principles of Linked Data, and situate these within the broader context of related technological developments. They describe progress to date in publishing Linked Data on the Web, review applications that have been developed to exploit the Web of Data, and map out a research agenda for the Linked Data community as it moves forward.

/pdf/linked-data-the-story-so-far-2a9zvmaysa.pdf

Linked Data - the story so far

Obesity now affects one in five children in the United States. Discrimination against overweight children begins early in childhood and becomes progressively institutionalized. Because obese children tend to be taller than their nonoverweight peers, they are apt to be viewed as more mature. The inappropriate expectations that result may have an adverse effect on their socialization. Many of the cardiovascular consequences that characterize adult-onset obesity are preceded by abnormalities that begin in childhood. Hyperlipidemia, hypertension, and abnormal glucose tolerance occur with increased frequency in obese children and adolescents. The relationship of cardiovascular risk factors to visceral fat independent of total body fat remains unclear. Sleep apnea, pseudotumor cerebri, and Blount's disease represent major sources of morbidity for which rapid and sustained weight reduction is essential. Although several periods of increased risk appear in childhood, it is not clear whether obesity with onset early in childhood carries a greater risk of adult morbidity and mortality. Obesity is now the most prevalent nutritional disease of children and adolescents in the United States. Although obesity-associated morbidities occur more frequently in adults, significant consequences of obesity as well as the antecedents of adult disease occur in obese children and adolescents. In this review, I consider the adverse effects of obesity in children and adolescents and attempt to outline areas for future research. I refer to obesity as a body mass index greater than the 95th percentile for children of the same age and gender.

Health Consequences of Obesity in Youth: Childhood Predictors of Adult Disease

Web applications frequently leverage resources made available by remote web servers. As resources are created, updated, deleted, or moved, these applications face challenges to remain in lockstep with changes on the server. Several approaches exist to help meet this challenge for use cases where "good enough" synchronization is acceptable. But when strict resource coverage or low synchronization latency is required, commonly accepted Web-based solutions remain illusive. This paper provides a perspective on the resource synchronization problem that results from inspiration gained from prior work, and initial insights resulting from the recently launched NISO/OAI ResourceSync effort.

A Perspective on Resource Synchronization

The Open Video Project is an on-going effort to develop an open source digital video collection that can be used by the information retrieval, digital library, and digital video research communities and ultimately serve an even broader audience. The collection currently contains about 350 video segments from 40 different titles, with a range of characteristics. We believe developing and using this collection as a shared video testbed can help advance progress in video retrieval research by fostering a collaborative research environment. In this paper we first discuss the underlying challenges of compiling and maintaining an open source digital video collection, and then describe the user interface strategies we are developing to enable people to explore and retrieve video from the collection effectively and efficiently.

https://ggeisler.com/publications/asist01_geisler.pdf

Interface Concepts for the Open Video Project.

The web is today's primary publication medium, making web archiving an important activity for historical and analytical purposes. Web pages are increasingly interactive, resulting in pages that are correspondingly difficult to archive. JavaScript enables interactions that can potentially change the client-side state of a representation. We refer to representations that load embedded resources via JavaScript as deferred representations. It is difficult to discover and crawl all of the resources in deferred representations and the result of archiving deferred representations is archived web pages that are either incomplete or erroneously load embedded resources from the live web. We propose a method of discovering and archiving deferred representations and their descendants (representation states) that are only reachable through client- side events. Our approach identified an average of 38.5 descendants per seed URI crawled, 70.9% of which are reached through an onclick event. This approach also added 15.6 times more embedded resources than Heritrix to the crawl frontier, but at a crawl rate that was 38.9 times slower than simply using Heritrix. If our method was applied to the July 2015 Common Crawl dataset, a web-scale archival crawler will discover an additional 7.17 PB (5.12 times more) of information per year. This illustrates the significant increase in resources necessary for more thorough archival crawls.

Archival crawlers and JavaScript: discover more stuff but crawl more slowly

Conventional Web archives are created by periodically crawling a Web site and archiving the responses from the Web server. Although easy to implement and commonly deployed, this form of archiving typically misses updates and may not be suitable for all preservation scenarios, for example a site that is required (perhaps for records compliance) to keep a copy of all pages it has served. In contrast, transactional archives work in conjunction with a Web server to record all content that has been served. Los Alamos National Laboratory has developed SiteStory, an open-source transactional archive written in Java that runs on Apache Web servers, provides a Memento compatible access interface, and WARC file export features. We used Apache’s ApacheBench utility on a pre-release version of SiteStory to measure response time and content delivery time in different environments. The performance tests were designed to determine the feasibility of SiteStory as a production-level solution for high fidelity automatic Web archiving. We found that SiteStory does not significantly affect content server performance when it is performing transactional archiving. Content server performance slows from 0.076 seconds to 0.086 seconds per Web page access when the content server is under load, and from 0.15 seconds to 0.21 seconds when the resource has many embedded and changing resources.

/pdf/evaluating-the-sitestory-transactional-web-archive-with-the-1thfrccmrc.pdf

Evaluating the SiteStory Transactional Web Archive with the ApacheBench Tool

Strike Up the Score: Deriving Searchable and Playable Digital Formats from Sheet Music; Smart Objects and Open Archives; Building the Archives of the Future: Advanced in Preserving Electronic Records at the National Archives and Records Administration; From the Digitized to the Digital Library.

Michael L. Nelson

Papers

A Perspective on Resource Synchronization

Interface Concepts for the Open Video Project.

Archival crawlers and JavaScript: discover more stuff but crawl more slowly

Evaluating the SiteStory Transactional Web Archive with the ApacheBench Tool

Strike Up the Score: Deriving Searchable and Playable Digital Formats from Sheet Music; Smart Objects and Open Archives; Building the Archives of the Future: Advanced in Preserving Electronic Records at the National Archives and Records Administration; From the Digitized to the Digital Library.