Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives when interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the key ideas and algorithms of reinforcement learning. Their discussion ranges from the history of the field's intellectual foundations to the most recent developments and applications. The only necessary mathematical background is familiarity with elementary concepts of probability. The book is divided into three parts. Part I defines the reinforcement learning problem in terms of Markov decision processes. Part II provides basic solution methods: dynamic programming, Monte Carlo methods, and temporal-difference learning. Part III presents a unified view of the solution methods and incorporates artificial neural networks, eligibility traces, and planning; the two final chapters present case studies and consider the future of reinforcement learning.

/pdf/reinforcement-learning-an-introduction-rzxgej9p17.pdf

Reinforcement Learning: An Introduction

Although genomewide RNA expression analysis has become a routine tool in biomedical research, extracting biological insight from such information remains a major challenge. Here, we describe a powerful analytical method called Gene Set Enrichment Analysis (GSEA) for interpreting gene expression data. The method derives its power by focusing on gene sets, that is, groups of genes that share common biological function, chromosomal location, or regulation. We demonstrate how GSEA yields insights into several cancer-related data sets, including leukemia and lung cancer. Notably, where single-gene analysis finds little similarity between two independent studies of patient survival in lung cancer, GSEA reveals many biological pathways in common. The GSEA method is embodied in a freely available software package, together with an initial database of 1,325 biologically defined gene sets.

/pdf/gene-set-enrichment-analysis-a-knowledge-based-approach-for-mbpti6qljw.pdf

Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles

There is, I think, something ethereal about i —the square root of minus one. I remember first hearing about it at school. It seemed an odd beast at that time—an intruder hovering on the edge of reality.

Usually familiarity dulls this sense of the bizarre, but in the case of i it was the reverse: over the years the sense of its surreal nature intensified. It seemed that it was impossible to write mathematics that described the real world in …

I and i

抗原变异可使得多种致病微生物易于逃避宿主免疫应答。表达在感染红细胞表面的恶性疟原虫红细胞表面蛋白1（PfPMP1）与感染红细胞、内皮细胞、树突状细胞以及胎盘的单个或多个受体作用，在黏附及免疫逃避中起关键的作用。每个单倍体基因组var基因家族编码约60种成员，通过启动转录不同的var基因变异体为抗原变异提供了分子基础。

疟原虫var基因转换速率变化导致抗原变异[英]／Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A

http://bartellab.wi.mit.edu/publication_reprints/Bartel_Cell09.pdf

MicroRNAs: Target Recognition and Regulatory Functions

The emergence of cooling technology has brought about huge social benefits to society, but it is also accompanied by the serious problem of energy consumption. In countries close to the equator, intense solar radiation is accompanied by unbearable high temperatures and strong ultraviolet radiation. Therefore, we prepared a simple hydrogel with good evaporative cooling, which can work continuously and has good UV absorption, to solve the indoor cooling and UV radiation problems. Polyacrylamide (PAM) in the hydrogel provides a mechanically strong backbone, and polyethylene glycol (PEG) slows water loss and provides the hydrogel with the ability to reflect infrared light. Lithium bromide (LiBr) is a highly efficient water vapor absorbent, which can provide the hydrogel with water regeneration capability. Carbon dots (CDs) can provide excellent UV absorption for hydrogels, and CDs (4.28 kJ kg−1 K−1) have a higher specific heat capacity than water (4.20 kJ kg−1 K−1), which can store more heat for a better indoor cooling effect. The composite hydrogel has a good prospect of application in the windows of residential and high-rise buildings.

/pdf/an-intelligent-cooling-material-modified-with-carbon-dots-24q3ezdu.pdf

An intelligent cooling material modified with carbon dots for evaporative cooling and UV absorption

Silica gel, octadecyl-silica(ODS), Sephadex LH-20, and semi-preparative high performance liquid chromatography(HPLC) was performed to isolate nine cephalotaxine-type alkaloids from Cephalotaxus sinensis: 8-oxodeoxyharringtonine(1), 8-oxonordeoxyharringtonine(2), cephafortunine A(3), 8-oxocephalotaxine(4), deoxyharringtonine(5), acetylcephalotaxine(6), cephalotaxine(7), epicephalotaxine(8), and cephalotaxinone(9). Compounds 1 and 2 were identified for the first time and their structures were determined by high-resolution-electrospray ionization-mass spectrometry(HR-ESI-MS), nuclear magnetic resonance(NMR), and electronic circular dichroism(ECD). Compounds 1-3 and 5 significantly inhibited the transcription of nuclear factor kappa B(NF-κB), with the half-maximal inhibitory concentration(IC_(50)) of(3.91±0.70),(2.99±0.45),(7.84±0.51), and(1.46±0.17) μmol·L~(-1), respectively.

[Two novel cephalotaxine-type alkaloids from Cephalotaxus sinensis].

Chronic obstructive pulmonary diseases (COPD) is a kind of age-related, airflow-obstruction disease mostly caused by cigarette smoke. However, the relationship between COPD and lung cellular senescence is still not fully understood. Here, we found silencing Pellino-1 could inhibit the protein level of P21. Then, through constructing cell lines expressed ubiquitin-HA, we found that the E3 ubiquitin ligase Pellino-1 could bind to senescence marker p21 and modify p21 by K63-site ubiquitination by co-IP assays. Furthermore, we found that p21-mediated lung cellular senescence could be inhibited by silencing Pellino-1 in a D-galactose senescence mice model. Moreover, by constructing a COPD mouse model with shPellino-1 adenovirus, we found that silencing Pellino-1 could inhibit COPD and inflammation via reduction of SASPs regulated by p21. Taken together, our study findings elucidated that silencing E3 ligase Pellino-1 exhibits therapeutic potential for treatment to attenuate the progression of lung cellular senescence and COPD.

/pdf/k63-ubiquitination-of-p21-can-facilitate-pellino-1-in-the-25yblk9r.pdf

K63 Ubiquitination of P21 Can Facilitate Pellino-1 in the Context of Chronic Obstructive Pulmonary Disease and Lung Cellular Senescence

What is already known about this topic? Previous studies on electronic cigarette (e-cigarette) use in China among secondary school students have provided information on the awareness and usage of e-cigarettes. What is added by this report? This study not only described e-cigarette usage rates, but also explored the characteristics of e-cigarette users’ behavior and factors associated with the current use of e-cigarettes among secondary school students. What are the implications for public health practice? E-cigarette use among secondary school students, especially among vocational senior high school students, requires more attention. Although some policies have been developed to protect youths from the harmful effects of e-cigarettes, enforcement of these policies needs to be strengthened.

Characteristics and Associated Factors of E-cigarette Use Among Secondary School Students — 6 PLADs in China, 2021

BackgroundHigh-throughput sequencing (HTS) technologies play important roles in the life sciences by allowing the rapid parallel sequencing of very large numbers of relatively short nucleotide sequences, in applications ranging from genome sequencing and resequencing to digital microarrays and ChIP-Seq experiments. As experiments scale up, HTS technologies create new bioinformatics challenges for the storage and sharing of HTS data.ResultsWe develop data structures and compression algorithms for HTS data. A processing stage maps short sequences to a reference genome or a large table of sequences. Then the integers representing the short sequence absolute or relative addresses, their length, and the substitutions they may contain are compressed and stored using various entropy coding algorithms, including both old and new fixed codes (e.g Golomb, Elias Gamma, MOV) and variable codes (e.g. Huffman). The general methodology is illustrated and applied to several HTS data sets. Results show that the information contained in HTS files can be compressed by a factor of 10 or more, depending on the statistical properties of the data sets and various other choices and constraints. Our algorithms fair well against general purpose compression programs such as gzip, bzip2 and 7zip; timing results show that our algorithms are consistently faster than the best general purpose compression programs.ConclusionsIt is not likely that exactly one encoding strategy will be optimal for all types of HTS data. Different experimental conditions are going to generate various data distributions whereby one encoding strategy can be more effective than another. We have implemented some of our encoding algorithms into the software package GenCompress which is available upon request from the authors. With the advent of HTS technology and increasingly new experimental protocols for using the technology, sequence databases are expected to continue rising in size. The methodology we have proposed is general, and these advanced compression techniques should allow researchers to manage and share their HTS data in a more timely fashion.

/pdf/data-structures-and-compression-algorithms-for-high-5b1z5n8zlz.pdf

Xiaohui Xie

Papers

An intelligent cooling material modified with carbon dots for evaporative cooling and UV absorption

[Two novel cephalotaxine-type alkaloids from Cephalotaxus sinensis].

K63 Ubiquitination of P21 Can Facilitate Pellino-1 in the Context of Chronic Obstructive Pulmonary Disease and Lung Cellular Senescence

Characteristics and Associated Factors of E-cigarette Use Among Secondary School Students — 6 PLADs in China, 2021

Data structures and compression algorithms for high-throughput sequencing technologies - eScholarship