Data Mining Practical Machine Learning Tools and Techniques

We will review some of the major results in random graphs and some of the more challenging open problems. We will cover algorithmic and structural questions. We will touch on newer models, including those related to the WWW.

Random graphs

Twitter, a microblogging service less than three years old, commands more than 41 million users as of July 2009 and is growing fast. Twitter users tweet about any topic within the 140-character limit and follow others to receive their tweets. The goal of this paper is to study the topological characteristics of Twitter and its power as a new medium of information sharing.We have crawled the entire Twitter site and obtained 41.7 million user profiles, 1.47 billion social relations, 4,262 trending topics, and 106 million tweets. In its follower-following topology analysis we have found a non-power-law follower distribution, a short effective diameter, and low reciprocity, which all mark a deviation from known characteristics of human social networks [28]. In order to identify influentials on Twitter, we have ranked users by the number of followers and by PageRank and found two rankings to be similar. Ranking by retweets differs from the previous two rankings, indicating a gap in influence inferred from the number of followers and that from the popularity of one's tweets. We have analyzed the tweets of top trending topics and reported on their temporal behavior and user participation. We have classified the trending topics based on the active period and the tweets and show that the majority (over 85%) of topics are headline news or persistent news in nature. A closer look at retweets reveals that any retweeted tweet is to reach an average of 1,000 users no matter what the number of followers is of the original tweet. Once retweeted, a tweet gets retweeted almost instantly on next hops, signifying fast diffusion of information after the 1st retweet.To the best of our knowledge this work is the first quantitative study on the entire Twittersphere and information diffusion on it.

https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?article=7104&context=sis_research

What is Twitter, a social network or a news media?

The term “Linked Data” refers to a set of best practices for publishing and connecting structured data on the Web. These best practices have been adopted by an increasing number of data providers over the last three years, leading to the creation of a global data space containing billions of assertions— the Web of Data. In this article, the authors present the concept and technical principles of Linked Data, and situate these within the broader context of related technological developments. They describe progress to date in publishing Linked Data on the Web, review applications that have been developed to exploit the Web of Data, and map out a research agenda for the Linked Data community as it moves forward.

/pdf/linked-data-the-story-so-far-2a9zvmaysa.pdf

Linked Data - the story so far

Obesity now affects one in five children in the United States. Discrimination against overweight children begins early in childhood and becomes progressively institutionalized. Because obese children tend to be taller than their nonoverweight peers, they are apt to be viewed as more mature. The inappropriate expectations that result may have an adverse effect on their socialization. Many of the cardiovascular consequences that characterize adult-onset obesity are preceded by abnormalities that begin in childhood. Hyperlipidemia, hypertension, and abnormal glucose tolerance occur with increased frequency in obese children and adolescents. The relationship of cardiovascular risk factors to visceral fat independent of total body fat remains unclear. Sleep apnea, pseudotumor cerebri, and Blount's disease represent major sources of morbidity for which rapid and sustained weight reduction is essential. Although several periods of increased risk appear in childhood, it is not clear whether obesity with onset early in childhood carries a greater risk of adult morbidity and mortality. Obesity is now the most prevalent nutritional disease of children and adolescents in the United States. Although obesity-associated morbidities occur more frequently in adults, significant consequences of obesity as well as the antecedents of adult disease occur in obese children and adolescents. In this review, I consider the adverse effects of obesity in children and adolescents and attempt to outline areas for future research. I refer to obesity as a body mass index greater than the 95th percentile for children of the same age and gender.

Health Consequences of Obesity in Youth: Childhood Predictors of Adult Disease

When an individual loses their website and a backup cannot be found, they can download and run Warrick, a webrepository crawler which will recover their lost website by crawling the holdings of the Internet Archive and several search engine caches. Running Warrick locally requires some technical know-how, so we have created an on-line queueing system called Brass which simplifies the task of recovering lost websites. We discuss the technical aspects of reconstructing websites and the implementation of Brass. Our newly developed system allows anyone to recover a lost website with a few mouse clicks and allows us to track which websites the public is most interested in saving.

/pdf/brass-a-queueing-manager-for-warrick-2g20iuj6x7.pdf

Brass: A queueing manager for Warrick

We investigated the performance of the collective intelligence of NFL fans predicting the outcome of games as realized through the Vegas betting lines. Using data from 2560 games (all post-expansion, regular- and post-season games from 2002-2011), we investigated the opening and closing lines, and the margin of victory. We found that the line difference (the difference between the opening and closing line) could be used to retroactively predict divisional winners with no less accuracy than 75% accuracy (i.e., "straight up" predictions). We also found that although home teams only beat the spread 47% of the time, a strategy of betting the home team underdogs (from 2002-2011) would have produced a cumulative winning strategy of 53.5%, above the threshold of 52.38% needed to break even.

The Performance of Betting Lines for Predicting the Outcome of NFL Games

One of many challenges facing web preservation efforts is the lack of metadata available for web resources. In prior work, we proposed a model that takes advantage of a site's own web server to prepare its resources for preservation. When responding to a request from an archiving repository, the server applies a series of metadata utilities, such as Jhove and Exif, to the requested resource. The output from each utility is included in the HTTP response along with the resource itself. This paper addresses the question of feasibility: Is it in fact practical to use the site's web server as a just-in-time metadata generator, or does the extra processing create an unacceptable deterioration in server responsiveness to quotidian events? Our tests indicate that (a) this approach can work effectively for both the crawler and the server; and that (b) utility selection is an important factor in overall performance.

/pdf/a-quantitative-evaluation-of-dissemination-time-preservation-2mhsputzyh.pdf

A Quantitative Evaluation of Dissemination-Time Preservation Metadata

How to Live Longer and Feel Better. By Linus Pauling W.H. Freeman:1986. Pp.322. Hbk 15.95, 15.95; pbk 7.95, 5.95.

Taking the tablets

Though the Open Archive Initiative Protocol for Metadata Harvesting (OAI-PMH) is becoming the de facto standard for digital libraries, some of its predecessors are still in use. Although a limited number of Dienst repositories continue to be populated, others are precariously unsupported. The Dienst Open Archive Gateway (DOG) is a gateway between the OAI-PMH and the Dienst (version 4.1) protocol. DOG allows OAI-PMH harvesters to extract metadata records (in RFC-1807 or Dublin Core) from Dienst servers.

/pdf/the-dienst-oai-gateway-1i6no31o4o.pdf

Michael L. Nelson

Papers

Brass: A queueing manager for Warrick

The Performance of Betting Lines for Predicting the Outcome of NFL Games

A Quantitative Evaluation of Dissemination-Time Preservation Metadata

Taking the tablets

The Dienst-OAI Gateway