Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging. Training is computationally expensive, often done on private datasets of different sizes, and, as we will show, hyperparameter choices have significant impact on the final results. We present a replication study of BERT pretraining (Devlin et al., 2019) that carefully measures the impact of many key hyperparameters and training data size. We find that BERT was significantly undertrained, and can match or exceed the performance of every model published after it. Our best model achieves state-of-the-art results on GLUE, RACE and SQuAD. These results highlight the importance of previously overlooked design choices, and raise questions about the source of recently reported improvements. We release our models and code.

/pdf/roberta-a-robustly-optimized-bert-pretraining-approach-2rj0bdyhim.pdf

RoBERTa: A Robustly Optimized BERT Pretraining Approach

行銷硏究 : Marketing research

How have changes in media affected our everyday experience, behavior, and sense of identity? Such questions have generated endless arguments and speculations, but no thinker has addressed the issue with such force and originality as Joshua Meyrowitz in No Sense of Place. Advancing a daring and sophisticated theory, Meyrowitz shows how television and other electronic media have created new social situations that are no longer shaped by where we are or who is "with" us. While other media experts have limited the debate to message content, Meyrowitz focuses on the ways in which changes in media rearrange "who knows what about whom" and "who knows what compared to whom," making it impossible for us to behave with each other in traditional ways. No Sense of Place explains how the electronic landscape has encouraged the development of: -More adultlike children and more childlike adults; -More career-oriented women and more family-oriented men; and -Leaders who try to act more like the "person next door" and real neighbors who want to have a greater say in local, national, and international affairs. The dramatic changes fostered by electronic media, notes Meyrowitz, are neither entirely good nor entirely bad. In some ways, we are returning to older, pre-literate forms of social behavior, becoming "hunters and gatherers of an information age." In other ways, we are rushing forward into a new social world. New media have helped to liberate many people from restrictive, place-defined roles, but the resulting heightened expectations have also led to new social tensions and frustrations. Once taken-for-granted behaviors are now subject to constant debate and negotiation. The book richly explicates the quadruple pun in its title: Changes in media transform how we sense information and how we make sense of our physical and social places in the world.

No sense of place : the impact of electronic media on socialbehavior

A systematic literature review of blockchain-based applications: Current status, classification and open issues

A review of Internet of Things for smart home: Challenges and solutions

Traditional media outlets are known to report political news in a biased way, potentially affecting the political beliefs of the audience and even altering their voting behaviors. Many researchers focus on automatically detecting and identifying media bias in the news, but only very few studies exist that systematically analyze how theses biases can be best visualized and communicated. We create three manually annotated datasets and test varying visualization strategies. The results show no strong effects of becoming aware of the bias of the treatment groups compared to the control group, although a visualization of hand-annotated bias communicated bias instances more effectively than a framing visualization. Showing participants an overview page, which opposes different viewpoints on the same topic, does not yield differences in respondents' bias perception. Using a multilevel model, we find that perceived journalist bias is significantly related to perceived political extremeness and impartiality of the article.

/pdf/enabling-news-consumers-to-view-and-understand-biased-news-2kpjaotdgo.pdf

Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Bias

The licensing of creative work is of broad and current interest. The European Commission proposes that when uploading a licensed digital work, the uploader should be checked by the system that one has the necessary rights. Technically this law is difficult to implement, as images with different intentions are shared, and even small changes like watermarks make it difficult to reveal similarities. The characteristics of distributed ledger technology could provide excellent support for the licensing and management of the rights of use. In this work, non-technical and technical criteria are defined to achieve an overview of the state-of-the-art solutions in the field of blockchain-based licensing platforms. Based on the criteria, different licensing platforms are reviewed, and the results are presented in a comparison matrix.

/pdf/overview-of-licensing-platforms-based-on-distributed-ledger-5b0kq8zqck.pdf

Overview of Licensing Platforms based on Distributed Ledger Technology.

Considering the current trends of the development of mobile devices (e.g. mobile phones or embedded hardware) we note that these devices become smaller but provide more functions. Today, it is not unusual to combine a GPS controller with laptops or personal digital assistants. Even mobile phones with integrated GPS chips are available. Therefore, we can use the exact coordinates of mobile devices in order to realize novel applications. In this paper we present a system that is able to localize mobile devices from other mobile devices as well as from a standard desktop computer.

https://wwwiti.cs.uni-magdeburg.de/iti_db/publikationen/ps/04/wpnc04.pdf

UbiLoc : A System for Locating Mobile Devices using Mobile Devices

News is a central source of information for individuals to inform themselves on current topics. Knowing a news article's slant and authenticity is of crucial importance in times of "fake news," news bots, and centralization of media ownership. We introduce Newsalyze, a bias-aware news reader focusing on a subtle, yet powerful form of media bias, named bias by word choice and labeling (WCL). WCL bias can alter the assessment of entities reported in the news, e.g., "freedom fighters" vs. "terrorists." At the core of the analysis is a neural model that uses a news-adapted BERT language model to determine target-dependent sentiment, a high-level effect of WCL bias. While the analysis currently focuses on only this form of bias, the visualizations already reveal patterns of bias when contrasting articles (overview) and in-text instances of bias (article view).

/pdf/newsalyze-enabling-news-consumers-to-understand-media-bias-3kdnz18w6o.pdf

Newsalyze: Enabling News Consumers to Understand Media Bias

Mathematical information retrieval (MathIR) applications such as semantic formula search and question answering systems rely on knowledge-bases that link mathematical expressions to their natural language names. For database population, mathematical formulae need to be annotated and linked to semantic concepts, which is very time-consuming. In this paper, we present our approach to structure and speed up this process by using an application-driven strategy and AI-aided system. We evaluate the quality and time-savings of AI-generated formula and identifier annotation recommendations on a test selection of Wikipedia articles from the physics domain. Moreover, we evaluate the community acceptance of Wikipedia formula entity links and Wikidata item creation and population to ground the formula semantics. Our evaluation shows that the AI guidance was able to significantly speed up the annotation process by a factor of 1.4 for formulae and 2.4 for identifiers. Our contributions were accepted in 88% of the edited Wikipedia articles and 67% of the Wikidata items. The >>AnnoMathTeX

Bela Gipp

Papers

Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Bias

Overview of Licensing Platforms based on Distributed Ledger Technology.

UbiLoc : A System for Locating Mobile Devices using Mobile Devices

Newsalyze: Enabling News Consumers to Understand Media Bias

Fast Linking of Mathematical Wikidata Entities in Wikipedia Articles Using Annotation Recommendation