The past 3 years of work in NLP have been characterized by the development and deployment of ever larger language models, especially for English. BERT, its variants, GPT-2/3, and others, most recently Switch-C, have pushed the boundaries of the possible both through architectural innovations and through sheer size. Using these pretrained models and the methodology of fine-tuning them for specific tasks, researchers have extended the state of the art on a wide array of tasks as measured by leaderboards on specific benchmarks for English. In this paper, we take a step back and ask: How big is too big? What are the possible risks associated with this technology and what paths are available for mitigating those risks? We provide recommendations including weighing the environmental and financial costs first, investing resources into curating and carefully documenting datasets rather than ingesting everything on the web, carrying out pre-development exercises evaluating how the planned approach fits into research and development goals and supports stakeholder values, and encouraging research directions beyond ever larger language models.

https://dl.acm.org/doi/pdf/10.1145/3442188.3445922

On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? &#x1f99c;

Starting around 1999, a great many graphical password schemes have been proposed as alternatives to text-based password authentication. We provide a comprehensive overview of published research in the area, covering both usability and security aspects as well as system evaluation. The article first catalogues existing approaches, highlighting novel features of selected schemes and identifying key usability or security advantages. We then review usability requirements for knowledge-based authentication as they apply to graphical passwords, identify security threats that such systems must address and review known attacks, discuss methodological issues related to empirical evaluation, and identify areas for further research and improved methodology.

/pdf/graphical-passwords-learning-from-the-first-twelve-years-1h8jsqlrwr.pdf

Graphical passwords: Learning from the first twelve years

Each copy of a text document can be made different in a nearly invisible way by repositioning or modifying the appearance of different elements of text, i.e., lines, words, or characters. A unique copy can be registered with its recipient, so that subsequent unauthorized copies that are retrieved can be traced back to the original owner. In this paper we describe and compare several mechanisms for marking documents and several other mechanisms for decoding the marks after documents have been subjected to common types of distortion. The marks are intended to protect documents of limited value that are owned by individuals who would rather possess a legal than an illegal copy if they can be distinguished. We will describe attacks that remove the marks and countermeasures to those attacks. An architecture is described for distributing a large number of copies without burdening the publisher with creating and transmitting the unique documents. The architecture also allows the publisher to determine the identity of a recipient who has illegally redistributed the document, without compromising the privacy of individuals who are not operating illegally. Two experimental systems are described. One was used to distribute an issue of the IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, and the second was used to mark copies of company private memoranda.

Copyright protection for the electronic distribution of text documents : Identification and protection of multimedia information

Smart multi-step deep learning model for wind speed forecasting based on variational mode decomposition, singular spectrum analysis, LSTM network and ELM

Ein Decision Support System umfast die Komponenten Daten, Dialog und Modell, weshalb in diesem Kontext auch von DDM-Paradigma gesprochen wird.1 Die Komponente Daten sollte derart gestaltet sein, das die benotigten Informationen adaquat bereitgehalten werden. Durch die Komponente Dialog ist sicherzustellen, das die Interaktion des Anwenders mit dem Decision Support System und damit auch der Zugriff auf die Daten einfach und leicht verstandlich gestaltet ist. Die Komponente Modell sollte der Aufgabenstellung angemessene Modellierungs- und Analysemoglichkeiten zur Verfugung stellen. Ein Decision Support System, welches dem DDM-Paradigma Rechnung tragt, fugt die beschriebenen Komponenten geeignet zusammen.

Decision Support System

Sending encrypted messages frequently will draw the attention of third parties, i.e. crackers and hackers, perhaps causing attempts to break and reveal the original messages. In a digital world, steganography is introduced to hide the existence of the communication by concealing a secret message inside another unsuspicious message. Steganography is often being used together with cryptography and offers an acceptable amount of privacy and security over the communication channel. This paper presents an overview of text steganography and a brief history of steganography along with various existing text-based steganography techniques. Highlighted are some of the problems inherent in text steganography as well as issues with existing solutions. A new approach is proposed in information hiding using inter-word spacing and inter-paragraph spacing as a hybrid method. Our method offers dynamic generated stego-text with six options of maximum capacity according to the length of the secret message. This paper also analyzed the significant drawbacks of each existing method and how our new approach could be recommended as a solution.

http://www.wseas.us/e-library/conferences/2008/hangzhou/acacos/116-586-634.pdf

Information Hiding: A New Approach in Text Steganography

http://rageuniversity.com/PRISONESCAPE/COMMUNICATION%20CODES%20AND%20INKS/text-based%20data%20hiding%20method%20using%20Unicode%20space%20characters.pdf

UniSpaCh: A text-based data hiding method using Unicode space characters

During the recent years, the issue of preserving the integrity of digital text has become a focus of interest in the transmission of online content on the Internet. Watermarking has a useful tool in the protection of digital text content as it solves the problem of tampering, duplicating, unauthorized access, and security breaches. The rapid development currently observable in information transfer and access is the consequences of the widespread usage of the Internet. When it comes to the different types of digital data, text constitutes the most complex and challenging type to which the method of text watermarking can be applied. Text watermarking constitutes a highly complex task, most of all, since only limited research has been done in this field. In order to ensure the successful evaluation, analysis, and implementation, a comprehensive research needs to be performed. This paper studies the theory, methods, and applications of text watermarking, which includes the discussion on the definition, embedding and extracting processes, requirements, approaches, and language applications of the established text watermarking methods. This paper reviews in detail the new classification of text watermarking, which is through embedding process and its related issues of attacks and language applicability. Open research challenges and future directions are also investigated, with a focus on its information integrity, information availability, originality preservation, information confidentiality, protection of sensitive information, document transformation, cryptography application, and language flexibility.

A Review of Text Watermarking: Theory, Methods, and Applications

Sending encrypted messages frequently will draw the attention of third parties, i.e. crackers and hackers, perhaps causing attempts to break and reveal the original messages. In this digital world, steganography is introduced to hide the existence of the communication by concealing a secret message inside another unsuspicious message. The hidden message maybe plaintext, or any data that can be represented as a stream of bits. Steganography is often being used together with cryptography and offers an acceptable amount of privacy and security over the communication channel. This paper presents an overview of text steganography and a brief history of steganography along with various existing techniques of text steganography. Highlighted are some of the problems inherent in text steganography as well as issues with existing solutions. A new approach, named WhiteSteg is proposed in information hiding using interword spacing and inter-paragraph spacing as a hybrid method to reduce the visible detection of the embedded messages. WhiteSteg offers dynamic generated cover-text with six options of maximum capacity according to the length of the secret message. Besides, the advantage of exploiting whitespaces in information hiding is discussed. This paper also analyzes the significant drawbacks of each existing method and how WhiteSteg could be recommended as a solution.

/pdf/whitesteg-a-new-scheme-in-information-hiding-using-text-2wu7zzjpwc.pdf

WhiteSteg: a new scheme in information hiding using text steganography

Wind energy using increased dramatically in the last years. Because of that wind turbine design should be improved to increase efficiency. To make wind turbine with the best characteristics and with the highest efficiency it is suitable to analyze factors that are truly relevant to the converted wind energy. Wind turbine innovative design is investigated in this paper by the theory of inventive problem solution (TRIZ) as a systematic methodology for innovation. TRIZ methodology should provide creative conceptual design ideas of wind turbine. The main aim of this work is to show a systematic methodology for innovation as an effective procedure to enhance the capability of developing innovative products and to overcome the main design problems. The TRIZ method will be used in order to eliminate the technical contradictions which appear in the wind turbine systems.

Lip Yee Por

Papers

Information Hiding: A New Approach in Text Steganography

UniSpaCh: A text-based data hiding method using Unicode space characters

A Review of Text Watermarking: Theory, Methods, and Applications

WhiteSteg: a new scheme in information hiding using text steganography

Design and state of art of innovative wind turbine systems