Distribution shifts -- where the training distribution differs from the test distribution -- can substantially degrade the accuracy of machine learning (ML) systems deployed in the wild. Despite their ubiquity, these real-world distribution shifts are under-represented in the datasets widely used in the ML community today. To address this gap, we present WILDS, a curated collection of 8 benchmark datasets that reflect a diverse range of distribution shifts which naturally arise in real-world applications, such as shifts across hospitals for tumor identification; across camera traps for wildlife monitoring; and across time and location in satellite imaging and poverty mapping. On each dataset, we show that standard training results in substantially lower out-of-distribution than in-distribution performance, and that this gap remains even with models trained by existing methods for handling distribution shifts. This underscores the need for new training methods that produce models which are more robust to the types of distribution shifts that arise in practice. To facilitate method development, we provide an open-source package that automates dataset loading, contains default model architectures and hyperparameters, and standardizes evaluations. Code and leaderboards are available at this https URL.

WILDS: A Benchmark of in-the-Wild Distribution Shifts

We present PROB, an animation and model checking tool for the B method PROB's animation facilities allow users to gain confidence in their specifications, and unlike the animator provided by the B-Toolkit, the user does not have to guess the right values for the operation arguments or choice variables PROB contains a model checker and a constraint-based checker, both of which can be used to detect various errors in B specifications We present our first experiences in using PROB on several case studies, highlighting that PROB enables users to uncover errors that are not easily discovered by existing tools

ProB: A model checker for B

It has become common to publish large (billion parameter) language models that have been trained on private datasets. This paper demonstrates that in such settings, an adversary can perform a training data extraction attack to recover individual training examples by querying the language model. 
We demonstrate our attack on GPT-2, a language model trained on scrapes of the public Internet, and are able to extract hundreds of verbatim text sequences from the model's training data. These extracted examples include (public) personally identifiable information (names, phone numbers, and email addresses), IRC conversations, code, and 128-bit UUIDs. Our attack is possible even though each of the above sequences are included in just one document in the training data. 
We comprehensively evaluate our extraction attack to understand the factors that contribute to its success. Worryingly, we find that larger models are more vulnerable than smaller models. We conclude by drawing lessons and discussing possible safeguards for training large language models.

Extracting Training Data from Large Language Models

Internet of Things (IoT) related applications have emerged as an important field for both engineers and researchers, reflecting the magnitude and impact of data-related problems to be solved in contemporary business organizations especially in cloud computing. This paper first provides a functional framework that identifies the acquisition, management, processing and mining areas of IoT big data, and several associated technical modules are defined and described in terms of their key characteristics and capabilities. Then current research in IoT application is analyzed, moreover, the challenges and opportunities associated with IoT big data research are identified. We also report a study of critical IoT application publications and research topics based on related academic and industry publications. Finally, some open issues and some typical examples are given under the proposed IoT-related research framework.

IoT-Based Big Data Storage Systems in Cloud Computing: Perspectives and Challenges

Learning visual representations of medical images is core to medical image understanding but its progress has been held back by the small size of hand-labeled datasets. Existing work commonly relies on transferring weights from ImageNet pretraining, which is suboptimal due to drastically different image characteristics, or rule-based label extraction from the textual report data paired with medical images, which is inaccurate and hard to generalize. We propose an alternative unsupervised strategy to learn medical visual representations directly from the naturally occurring pairing of images and textual data. Our method of pretraining medical image encoders with the paired text data via a bidirectional contrastive objective between the two modalities is domain-agnostic, and requires no additional expert input. We test our method by transferring our pretrained weights to 4 medical image classification tasks and 2 zero-shot retrieval tasks, and show that our method leads to image representations that considerably outperform strong baselines in most settings. Notably, in all 4 classification tasks, our method requires only 10% as much labeled training data as an ImageNet initialized counterpart to achieve better or comparable performance, demonstrating superior data efficiency.

/pdf/contrastive-learning-of-medical-visual-representations-from-15x0tzocxw.pdf

Contrastive Learning of Medical Visual Representations from Paired Images and Text

Skin cancer is caused due to unusual development of skin cells and deadly type cancer. Early diagnosis is very significant and can avoid some categories of skin cancers, such as melanoma and focal cell carcinoma. The recognition and the classification of skin malignant growth in the beginning time is expensive and challenging. The deep learning architectures such as recurrent networks and convolutional neural networks (ConvNets) are developed in the past, which are proven appropriate for non-handcrafted extraction of complex features. To additional expand the efficiency of the ConvNet models, a cascaded ensembled network that uses an integration of ConvNet and handcrafted features based multi-layer perceptron is proposed in this work. This offered model utilizes the convolutional neural network model to mine non-handcrafted image features and colour moments and texture features as handcrafted features. It is demonstrated that accuracy of ensembled deep learning model is improved to 98.3% from 85.3% of convolutional neural network model.

https://ieeexplore.ieee.org/ielx7/6287639/9668973/09706441.pdf

Dermatologist-Level Classification of Skin Cancer Using Cascaded Ensembling of Convolutional Neural Network and Handcrafted Features Based Deep Neural Network

MANET-Performance Optimization And Issues Akhilesh K. Sharma Mobile Ad-hoc networks are used in many places, especially for the military and flood affected areas are having major concern with the mobile adhoc networks, for establishing the connection with the affected areas. There are several issues are explained and discussed in this book to establish the connection in optimized way. 	Several routing protocols have been proposed for MANET which can be classified as proactive, reactive and hybrid routing protocols. All of these protocols use blind flooding mechanism for the purpose of broadcasting of route request and route reply messages. This Blind flooding leads to a severe broadcast redundancy causing contention and collision in the network. This book will highlight all the points related to these issues. Key Features : 1. Use of NS-2 Simulator for better understanding of the moving environment of moving Nodes. 2. GUI programming & Sample code to build and simulate the nodes protocols and to change the performance related variables. 3. Topics to cover different topological and network study. 4. Techniques like DSDV, CGSR, AODV etc. for demonstration with examples.

Mobile Ad-Hoc Networks (MANET)

Music is a heavenly way of expressing feelings about the world. The language of music has vast diversity. For centuries, people have indulged in debates to stratisfy between Western and Indian Classical Music. But through this paper, an understanding can be fabricated while differentiating the types of Indian Classical Music. Classical music is one of the essential characteristics of Indian Cultural Heritage. Indian Classical Music is divided into two major parts, i.e. Hindustani and Carnatic. Models have been sculptured and trained to classify between Hindustani and Carnatic Music. In this paper, two approaches are used to implement classification models. MFCCs are used as features and implemented models like DNN (1 Layer, 2 Layers, 3 Layers), CNN (1 Layer, 2 Layers, 3 Layers), RNN-LSTM, SVM (Sigmoid, Polynomial & Gaussian Kernel) as one approach. A 3 channels input is created by merging features like MFCC, Spectrogram and Scalogram and implemented models like VGG-16, CNN (1 Layer, 2 Layers, 3 Layers), ResNet-50 as another approach. 3 Layered CNN and RNN-LSTM model performed best among all the approaches.

/pdf/classification-of-indian-classical-music-with-time-series-4xzpm5xvp9.pdf

Classification of Indian Classical Music With Time-Series Matching Deep Learning Approach

This paper aims at collecting and analysing temperature, rainfall, soil, seed, crop production, humidity and wind speed data (in a few regions), which will help the farmers improve the produce of their crops. Firstly, we pre-process the data in a Python environment and then apply the MapReduce framework, which further analyses and processes the large volume of data. Secondly, k-means clustering is employed on results gained from MapReduce and provides a mean result on the data in terms of accuracy. After that, we use bar graphs and scatter plots to study the relationship between the crop, rainfall, temperature, soil and seed type of two regions (Ahmednagar, Maharashtra and, Andaman and Nicobar Islands). Further, a self-designed recommender system has been used to predict the crops and display them on a Graphic User Interface designed in a Flask environment. The system design is scalable and can be used to find the recommended crops of other states in a similar manner in the future.

/pdf/wb-cpi-weather-based-crop-prediction-in-india-using-big-data-52yf7rb6ny.pdf

WB-CPI: Weather Based Crop Prediction in India Using Big Data Analytics

A Phonocardiogram (PCG) signal represents murmurs and sounds signals made by vibrations caused for the period of a cardiac cycle. Acoustic wave generated through the beat of the cardiac cycle propagates through the chest wall. It can be easily recorded by a low-cost small handheld digital device called a stethoscope. It provides information like heart rate, intensity, tone, quality, frequency, and location of various components of cardiac sound. Due to these characteristics, phonocardiogram signals can be used to detect heart status at an early stage in a non-invasive manner. In previous studies, the Convolutional Neural Network (ConvNet) is the most studied architecture, which was fed by features, namely Mel Frequency Cepstral (MFC), Chroma Energy Normalized Statistics (CENS), and Constant-Q Transform (CQT). This work has proposed a ConvNet model trained by Hybrid Constant-Q Transform (HCQT) for heart sound beat classification. CQT, Variable-Q Transform (VQT), and HCQT are extracted from each phonocardiogram signal as the acoustic features, including the dominant MFCC features, feed into five-layer regularized ConvNets. After analyzing the literature in the same domain, it can be stated that this is the first time HCQT is being utilized for PCG signals. The findings of the experiments demonstrate that HCQT is more effective than standard CQT and other variants. Also, the accuracies of the system proposed in this work on the validation datasets are 96% in multi-class classification, which outperforms the proposed work relative to other models significantly. The source code is available on the Github repository https://github.com/shamiktiwari/ PCG-signal-Classification-using-Hybrid-Constant-Q-Transform to support the research community.

/pdf/phonocardiogram-signal-based-multi-class-cardiac-diagnostic-4uo859ce7q.pdf

Akhilesh Kumar Sharma

Papers

Dermatologist-Level Classification of Skin Cancer Using Cascaded Ensembling of Convolutional Neural Network and Handcrafted Features Based Deep Neural Network

Mobile Ad-Hoc Networks (MANET)

Classification of Indian Classical Music With Time-Series Matching Deep Learning Approach

WB-CPI: Weather Based Crop Prediction in India Using Big Data Analytics

Phonocardiogram Signal Based Multi-Class Cardiac Diagnostic Decision Support System