Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

/pdf/convex-analysisnoer-san-nojin-zhan-nituite-5dl2rbmoyr.pdf

Convex Analysisの二,三の進展について

The reference human genome sequence set the stage for studies of genetic variation and its association with human disease, but epigenomic studies lack a similar reference. To address this need, the NIH Roadmap Epigenomics Consortium generated the largest collection so far of human epigenomes for primary cells and tissues. Here we describe the integrative analysis of 111 reference human epigenomes generated as part of the programme, profiled for histone modification patterns, DNA accessibility, DNA methylation and RNA expression. We establish global maps of regulatory elements, define regulatory modules of coordinated activity, and their likely activators and repressors. We show that disease- and trait-associated genetic variants are enriched in tissue-specific epigenomic marks, revealing biologically relevant cell types for diverse human traits, and providing a resource for interpreting the molecular basis of human disease. Our results demonstrate the central role of epigenomic information for understanding gene regulation, cellular differentiation and human disease.

Integrative analysis of 111 reference human epigenomes

Macrophage Development Rewritten Macrophages provide protection against a wide variety of infections and critically shape the inflammatory environment in many tissues. These cells come in many flavors, as determined by differences in gene expression, cell surface phenotype and specific function. Schulz et al. (p. 86, published online 22 March) investigated whether adult macrophages all share a common developmental origin. Immune cells, including most macrophages, are widely thought to arise from hematopoietic stem cells (HSCs), which require the transcription factor Myb for their development. Analysis of Myb-deficient mice revealed that a population of yolk-sac–derived, tissue-resident macrophages was able to develop and persist in adult mice in the absence of HSCs. Importantly, yolk sac–derived macrophages also contributed substantially to the tissue macrophage pool even when HSCs were present. In mice, a population of tissue-resident macrophages arises independently of bone marrow–derived stem cells. Macrophages and dendritic cells (DCs) are key components of cellular immunity and are thought to originate and renew from hematopoietic stem cells (HSCs). However, some macrophages develop in the embryo before the appearance of definitive HSCs. We thus reinvestigated macrophage development. We found that the transcription factor Myb was required for development of HSCs and all CD11bhigh monocytes and macrophages, but was dispensable for yolk sac (YS) macrophages and for the development of YS-derived F4/80bright macrophages in several tissues, such as liver Kupffer cells, epidermal Langerhans cells, and microglia—cell populations that all can persist in adult mice independently of HSCs. These results define a lineage of tissue macrophages that derive from the YS and are genetically distinct from HSC progeny.

A lineage of myeloid cells independent of Myb and hematopoietic stem cells

Single-cell expression profiles of melanoma Tumors harbor multiple cell types that are thought to play a role in the development of resistance to drug treatments. Tirosh et al. used single-cell sequencing to investigate the distribution of these differing genetic profiles within melanomas. Many cells harbored heterogeneous genetic programs that reflected two different states of genetic expression, one of which was linked to resistance development. Following drug treatment, the resistance-linked expression state was found at a much higher level. Furthermore, the environment of the melanoma cells affected their gene expression programs. Science, this issue p. 189 Melanoma cells show transcriptional heterogeneity. To explore the distinct genotypic and phenotypic states of melanoma tumors, we applied single-cell RNA sequencing (RNA-seq) to 4645 single cells isolated from 19 patients, profiling malignant, immune, stromal, and endothelial cells. Malignant cells within the same tumor displayed transcriptional heterogeneity associated with the cell cycle, spatial context, and a drug-resistance program. In particular, all tumors harbored malignant cells from two distinct transcriptional cell states, such that tumors characterized by high levels of the MITF transcription factor also contained cells with low MITF and elevated levels of the AXL kinase. Single-cell analyses suggested distinct tumor microenvironmental patterns, including cell-to-cell interactions. Analysis of tumor-infiltrating T cells revealed exhaustion programs, their connection to T cell activation and clonal expansion, and their variability across patients. Overall, we begin to unravel the cellular ecosystem of tumors and how single-cell genomics offers insights with implications for both targeted and immune therapies.

Dissecting the multicellular ecosystem of metastatic melanoma by single-cell RNA-seq

This paper describes the Tencent AI Lab’s submission of the WMT 2020 shared task on chat translation in English-German. Our neural machine translation (NMT) systems are built on sentence-level, document-level, non-autoregressive (NAT) and pretrained models. We integrate a number of advanced techniques into our systems, including data selection, back/forward translation, larger batch learning, model ensemble, finetuning as well as system combination. Specifically, we proposed a hybrid data selection method to select high-quality and in-domain sentences from out-of-domain data. To better capture the source contexts, we exploit to augment NAT models with evolved cross-attention. Furthermore, we explore to transfer general knowledge from four different pre-training language models to the downstream translation task. In general, we present extensive experimental results for this new translation task. Among all the participants, our German-to-English primary system is ranked the second in terms of BLEU scores.

Tencent AI Lab Machine Translation Systems for WMT20 Chat Translation Task

Al nanocrystals (nc-Al) embedded in AlN thin films have been synthesized by rf magnetron sputtering. The influence of ultraviolet (UV) illumination on electrical characteristics of the nc-Al∕AlN thin film system has been investigated. It is shown that the UV illumination could lead to a random change in the conductance of the thin film system. The change in the conductance is attributed to the charge trapping and detrapping in the nc-Al due to the UV illumination.

/pdf/light-induced-instability-in-current-conduction-of-aluminum-1o9tbxmvhg.pdf

Light-induced instability in current conduction of aluminum nitride thin films embedded with Al nanocrystals

In this brief, the electrical characteristics of MOS structures with specially designed distributions of Si nanocrystals (nc-Si) embedded in the oxides were investigated, and very different behaviors in the electrical characteristics are observed as a result of the difference in the nc-Si distribution. For the case of nc-Si being confined in a layer in the oxide close to the gate, charging and discharging the nc-Si lead to a shift in the flat-band voltage, and a small difference in the location of the peak concentration of nc-Si can yield a large difference in the memory programming characteristics. However, for the case of nc-Si distributed throughout the oxide with a high concentration, charging and discharging the nc-Si cause a modulation in the capacitance magnitude instead of the flat-band voltage shift. The difference between the two cases highlights the importance of the nc-Si distribution in the memory device applications of the nc-Si.

/pdf/influence-of-si-nanocrystal-distribution-in-the-oxide-on-the-2iq7ec4bch.pdf

Influence of Si-nanocrystal distribution in the oxide on the charging behavior of MOS structures

Syntax-incorporated machine translation models have been proven successful in improving the model's reasoning and meaning preservation ability. In this paper, we propose a simple yet effective graph-structured encoder, the Recurrent Graph Syntax Encoder, dubbed \textbf{RGSE}, which enhances the ability to capture useful syntactic information. The RGSE is done over a standard encoder (recurrent or self-attention encoder), regarding recurrent network units as graph nodes and injects syntactic dependencies as edges, such that RGSE models syntactic dependencies and sequential information (\textit{i.e.}, word order) simultaneously. Our approach achieves considerable improvements over several syntax-aware NMT models in English$\Rightarrow$German and English$\Rightarrow$Czech translation tasks. And RGSE-equipped big model obtains competitive result compared with the state-of-the-art model in WMT14 En-De task. Extensive analysis further verifies that RGSE could benefit long sentence modeling, and produces better translations.

Recurrent Graph Syntax Encoder for Neural Machine Translation.

The cost is always an important parameter for the new technical application. Through Si Via (TSV) technology becomes hot topic since image sensor application. We setup cost model according to our process flow and throughput for the cost study and reduction of 300mm TSI interposer. High cost area was calculated through the cost model. Full TSI process flow was separated as TSV, BEOL, Top UBM, TDDB, BSR, BS RDL& Bump sub-process flow. Top three high cost sub-process flow for 2.5D TSI with BEOL interconnect were identified from TSI process flow. Top three processes modules were isolated for each high cost subprocess flow. The high cost process modules were analyzed and explained in the paper. Two approaches were proposed for the cost reduction base on cost model analysis.

http://ieeexplore.ieee.org/iel7/6732180/6745670/06745802.pdf

Liang Ding

Papers

Tencent AI Lab Machine Translation Systems for WMT20 Chat Translation Task

Light-induced instability in current conduction of aluminum nitride thin films embedded with Al nanocrystals

Influence of Si-nanocrystal distribution in the oxide on the charging behavior of MOS structures

Recurrent Graph Syntax Encoder for Neural Machine Translation.

The cost study of 300mm through silicon interposer (TSI) with BEOL interconnect