LIVIVO - Search results -

Search results

Result 1 - 10 of total 173

Search options

Book ; Online: A Review for Deep Reinforcement Learning in Atari:Benchmarks, Challenges, and Solutions

Fan, Jiajun

2021

Abstract: The Arcade Learning Environment (ALE) is proposed as an evaluation platform for empirically assessing the generality of agents across dozens of Atari 2600 games. ALE offers various challenging problems and has drawn significant attention from the deep ... ...

Abstract	The Arcade Learning Environment (ALE) is proposed as an evaluation platform for empirically assessing the generality of agents across dozens of Atari 2600 games. ALE offers various challenging problems and has drawn significant attention from the deep reinforcement learning (RL) community. From Deep Q-Networks (DQN) to Agent57, RL agents seem to achieve superhuman performance in ALE. However, is this the case? In this paper, to explore this problem, we first review the current evaluation metrics in the Atari benchmarks and then reveal that the current evaluation criteria of achieving superhuman performance are inappropriate, which underestimated the human performance relative to what is possible. To handle those problems and promote the development of RL research, we propose a novel Atari benchmark based on human world records (HWR), which puts forward higher requirements for RL agents on both final performance and learning efficiency. Furthermore, we summarize the state-of-the-art (SOTA) methods in Atari benchmarks and provide benchmark results over new evaluation metrics based on human world records. We concluded that at least four open challenges hinder RL agents from achieving superhuman performance from those new benchmark results. Finally, we also discuss some promising ways to handle those problems. Comment: preliminary work, preprint
Keywords	Computer Science - Artificial Intelligence
Subject code	006
Publishing date	2021-12-08
Publishing country	us
Document type	Book ; Online
Database	BASE - Bielefeld Academic Search Engine (life sciences selection)

Full text online

Full text

Inter-library loan at ZB MED

Your chosen title can be delivered directly to ZB MED Cologne location if you are registered as a user at ZB MED Cologne.

Article: Editorial: Novel biomaterials to improve the biological effects of electromagnetic and particle radiation.

Sun, Yun / Luan, Xin / Liu, Rui / Gulzar, Arif / Fan, Jiajun

Frontiers in bioengineering and biotechnology

2024 Volume 11, Page(s) 1357668

Language	English
Publishing date	2024-01-05
Publishing country	Switzerland
Document type	Editorial
ZDB-ID	2719493-0
ISSN	2296-4185
ISSN	2296-4185
DOI	10.3389/fbioe.2023.1357668
Database	MEDical Literature Analysis and Retrieval System OnLINE

Order via subito

This service is chargeable due to the Delivery terms set by subito. Orders including an article and supplementary material will be classified as separate orders. In these cases, fees will be demanded for each order.

Article ; Online: Fundamental properties and phosphorus transformation mechanism of soybean straw during microwave hydrothermal conversion process.

Shi, Yan / Luo, Gang / Fan, Jiajun / Clark, James H / Zhang, Shicheng

Waste management (New York, N.Y.)

2024 Volume 175, Page(s) 265–275

Abstract: Microwave hydrothermal (MHT) conversion is emerging as a promising technology for the disposal and reutilization of biowastes. This study investigated the fundamental properties and phosphorus transformation mechanism of soybean straw during the MHT ... ...

Abstract	Microwave hydrothermal (MHT) conversion is emerging as a promising technology for the disposal and reutilization of biowastes. This study investigated the fundamental properties and phosphorus transformation mechanism of soybean straw during the MHT conversion process. The oxygen-containing functional groups in soybean straw were stripped, and a trend of dehydration was observed as the temperature increased during the MHT process. Cellulose was identified as the major component of the MHT solid products at high temperature. Glucose and glucuronic acid in the MHT liquid products were gradually converted to formic acid and acetic acid with increasing temperature and holding time. The characteristics of the MHT products directly affected the changes in P speciation and transformation. Most of the P was distributed in liquid products and the impact of holding time was not significant on P distribution at low MHT temperature. With the increase in temperature and holding time, P gradually transferred into the solid products. The proportion of organic phosphorus and soluble inorganic phosphorus in soybean straw was high, and it decreased noticeably after the MHT process. The increase in MHT temperature promoted the conversion of OP and AP into IP and NAIP respectively. P K-edge X-ray absorption near edge structure analysis reveals that Ca
MeSH term(s)	Phosphorus ; Glycine max ; Microwaves ; Temperature ; Acetic Acid
Chemical Substances	Phosphorus (27YLU75U4W) ; Acetic Acid (Q40Q9N063P)
Language	English
Publishing date	2024-01-16
Publishing country	United States
Document type	Journal Article
ZDB-ID	2001471-5
ISSN	1879-2456 ; 0956-053X
ISSN (online)	1879-2456
ISSN	0956-053X
DOI	10.1016/j.wasman.2024.01.007
Database	MEDical Literature Analysis and Retrieval System OnLINE

Order via subito

Article ; Online: Study on the impact of COVID-19 pandemic on the mental health of Chinese college students: a cross-sectional analysis.

Song, Xiaodong / Han, Demin / Zhang, Jiaqi / Fan, Jiajun / Ning, Peishan / Peng, Yong

Frontiers in public health

2024 Volume 12, Page(s) 1340642

Abstract: Background: The COVID-19 pandemic has significantly impacted the mental health of college students, prompting the need for universities to implement measures to mitigate these adverse effects. This study aims to assess the mental health status and ... ...

Abstract	Background: The COVID-19 pandemic has significantly impacted the mental health of college students, prompting the need for universities to implement measures to mitigate these adverse effects. This study aims to assess the mental health status and mitigation measures of college students, identify the primary factors contributing to their mental health challenges, and provide suggestions for educational institutions to reduce negative psychological impacts. Methods: In February 2023, a questionnaire survey was conducted among 1,445 college students. Statistical analysis was performed on the survey results, and multiple regression models were used to identify significant influencing factors and optimize the model. Results: The study revealed correlations between factors affecting mental health during the pandemic, with interactions observed among some factors. Significant differences in mental health status were found among different groups of college students based on their information-sharing habits through apps and engagement in thesis research. Multiple regression analysis indicated that conducting academic research related to COVID-19 significantly increased the psychological stress of college students during the pandemic ( Conclusion: Our research identifies crucial factors influencing the mental health of college students and investigates the mental health status of various student groups. We recommend that educational institutions adopt proactive strategies and a multifaceted approach to support the mental health of college students and address potential issues that may arise.
MeSH term(s)	Humans ; COVID-19/epidemiology ; COVID-19/psychology ; Students/psychology ; Students/statistics & numerical data ; Cross-Sectional Studies ; Universities ; Female ; Male ; Mental Health/statistics & numerical data ; China/epidemiology ; Surveys and Questionnaires ; Young Adult ; Stress, Psychological/psychology ; Adult ; Adolescent ; SARS-CoV-2 ; Pandemics
Language	English
Publishing date	2024-04-15
Publishing country	Switzerland
Document type	Journal Article ; Research Support, Non-U.S. Gov't
ZDB-ID	2711781-9
ISSN	2296-2565 ; 2296-2565
ISSN (online)	2296-2565
ISSN	2296-2565
DOI	10.3389/fpubh.2024.1340642
Database	MEDical Literature Analysis and Retrieval System OnLINE

Order via subito

Article: Establishing a nomogram to predict refracture after percutaneous kyphoplasty by logistic regression.

Zhang, Aiqi / Fu, Hongye / Wang, Junjie / Chen, Zhe / Fan, Jiajun

Frontiers in neuroinformatics

2023 Volume 17, Page(s) 1304248

Abstract: Introduction: Several studies have examined the risk factors for post-percutaneous kyphoplasty (PKP) refractures and developed many clinical prognostic models. However, no prior research exists using the Random Forest (RF) model, a favored tool for ... ...

Abstract	Introduction: Several studies have examined the risk factors for post-percutaneous kyphoplasty (PKP) refractures and developed many clinical prognostic models. However, no prior research exists using the Random Forest (RF) model, a favored tool for model development, to predict the occurrence of new vertebral compression fractures (NVCFs). Therefore, this study aimed to investigate the risk factors for the occurrence of post-PKP fractures, compare the predictive performance of logistic regression and RF models in forecasting post-PKP fractures, and visualize the logistic regression model. Methods: We collected clinical data from 349 patients who underwent PKP treatment at our institution from January 2018 to December 2021. Lasso regression was employed to select risk factors associated with the occurrence of NVCFs. Subsequently, logistic regression and RF models were established, and their predictive capabilities were compared. Finally, a nomogram was created. Results: The variables selected using Lasso regression, including bone density, cement distribution, vertebral fracture location, preoperative vertebral height, and vertebral height restoration rate, were included in both the logistic regression and RF models. The area under the curves of the logistic regression and RF models were 0.868 and 0.786, respectively, in the training set and 0.786 and 0.599, respectively, in the validation set. Furthermore, the calibration curve of the logistic regression model also outperformed that of the RF model. Conclusion: The logistic regression model provided better predictive capabilities for identifying patients at risk for post-PKP vertebral fractures than the RF model.
Language	English
Publishing date	2023-12-21
Publishing country	Switzerland
Document type	Journal Article
ZDB-ID	2452979-5
ISSN	1662-5196
ISSN	1662-5196
DOI	10.3389/fninf.2023.1304248
Database	MEDical Literature Analysis and Retrieval System OnLINE

Order via subito

Book ; Online: Generalized Data Distribution Iteration

Fan, Jiajun / Xiao, Changnan

2022

Abstract: To obtain higher sample efficiency and superior final performance simultaneously has been one of the major challenges for deep reinforcement learning (DRL). Previous work could handle one of these challenges but typically failed to address them ... ...

Abstract	To obtain higher sample efficiency and superior final performance simultaneously has been one of the major challenges for deep reinforcement learning (DRL). Previous work could handle one of these challenges but typically failed to address them concurrently. In this paper, we try to tackle these two challenges simultaneously. To achieve this, we firstly decouple these challenges into two classic RL problems: data richness and exploration-exploitation trade-off. Then, we cast these two problems into the training data distribution optimization problem, namely to obtain desired training data within limited interactions, and address them concurrently via i) explicit modeling and control of the capacity and diversity of behavior policy and ii) more fine-grained and adaptive control of selective/sampling distribution of the behavior policy using a monotonic data distribution optimization. Finally, we integrate this process into Generalized Policy Iteration (GPI) and obtain a more general framework called Generalized Data Distribution Iteration (GDI). We use the GDI framework to introduce operator-based versions of well-known RL methods from DQN to Agent57. Theoretical guarantee of the superiority of GDI compared with GPI is concluded. We also demonstrate our state-of-the-art (SOTA) performance on Arcade Learning Environment (ALE), wherein our algorithm has achieved 9620.33% mean human normalized score (HNS), 1146.39% median HNS and surpassed 22 human world records using only 200M training frames. Our performance is comparable to Agent57's while we consume 500 times less data. We argue that there is still a long way to go before obtaining real superhuman agents in ALE. Comment: 82 pages. This article is an extended work of arXiv:2112.04145 and arXiv:2106.06232. This article draws heavily from arXiv:2112.04145 and arXiv:2106.06232. We hope that adding some of the views from arXiv:2112.04145 and arXiv:2106.06232 into the appendix could greatly improve the readability
Keywords	Computer Science - Machine Learning ; Computer Science - Artificial Intelligence ; Computer Science - Neural and Evolutionary Computing
Subject code	006
Publishing date	2022-06-07
Publishing country	us
Document type	Book ; Online
Database	BASE - Bielefeld Academic Search Engine (life sciences selection)

Full text online

Full text

Inter-library loan at ZB MED

Your chosen title can be delivered directly to ZB MED Cologne location if you are registered as a user at ZB MED Cologne.

Article ; Online: Low-Complexity Hyperbolic Embedding Schemes for Temporal Complex Networks.

Jiang, Hao / Li, Lixia / Zeng, Yuanyuan / Fan, Jiajun / Shen, Lijuan

Sensors (Basel, Switzerland)

2022 Volume 22, Issue 23

Abstract: Hyperbolic embedding can effectively preserve the property of complex networks. Though some state-of-the-art hyperbolic node embedding approaches are proposed, most of them are still not well suited for the dynamic evolution process of temporal complex ... ...

Abstract	Hyperbolic embedding can effectively preserve the property of complex networks. Though some state-of-the-art hyperbolic node embedding approaches are proposed, most of them are still not well suited for the dynamic evolution process of temporal complex networks. The complexities of the adaptability and embedding update to the scale of complex networks with moderate variation are still challenging problems. To tackle the challenges, we propose hyperbolic embedding schemes for the temporal complex network within two dynamic evolution processes. First, we propose a low-complexity hyperbolic embedding scheme by using matrix perturbation, which is well-suitable for medium-scale complex networks with evolving temporal characteristics. Next, we construct the geometric initialization by merging nodes within the hyperbolic circular domain. To realize fast initialization for a large-scale network, an R tree is used to search the nodes to narrow down the search range. Our evaluations are implemented for both synthetic networks and realistic networks within different downstream applications. The results show that our hyperbolic embedding schemes have low complexity and are adaptable to networks with different scales for different downstream tasks.
Language	English
Publishing date	2022-11-29
Publishing country	Switzerland
Document type	Journal Article
ZDB-ID	2052857-7
ISSN	1424-8220 ; 1424-8220
ISSN (online)	1424-8220
ISSN	1424-8220
DOI	10.3390/s22239306
Database	MEDical Literature Analysis and Retrieval System OnLINE

Order via subito

Article ; Online: Different iron sources affected haemoglobin and myoglobin synthesis, and gene expression related to iron metabolism in skeletal muscle in piglets

Kang, Ping / Fan, Jiajun / Xu, Qilong / Gu, Dianchao / Shi, Bingzhao / Wang, Dan / Zhu, Huiling / Zhao, Jiangchao / Liu, Yulan

Food and Agricultural Immunology. 2023 Dec. 31, v. 34, no. 1 p.2247182-

2023

Abstract: This study was carried out to investigate the effect of different iron sources on haemoglobin and myoglobin (Mb) synthesis, and the mRNA expression of the key genes related to iron metabolism in the skeletal muscle of piglets. Forty-eight piglets were ... ...

Abstract	This study was carried out to investigate the effect of different iron sources on haemoglobin and myoglobin (Mb) synthesis, and the mRNA expression of the key genes related to iron metabolism in the skeletal muscle of piglets. Forty-eight piglets were assigned into four treatments including control group, ferrous sulphate (FeSO₄) group, ferrous glycinate (Fe-Gly) group and amino acid-Fe(II)-chelator complexes group. The results showed that iron supplementation increased Mb concentration in muscles (P < 0.05). In addition, iron supplementation increased hephaestin (HEPH) expression in the longissimus dorsi muscle (P < 0.1), decreased transferrin receptor 1 (TFR1) expression in the longissimus dorsi muscle (P < 0.05) and increased lipocalin 2 (Lcn2) expression in gastrocnemius muscle, respectively (P < 0.05). In summary, compared with high-dose inorganic iron, low-dose organic iron supplements have the same effects in haemoglobin and myoglobin biosynthesis, and mobilize iron in muscles into circulation.
Keywords	biosynthesis ; ferrous sulfate ; gene expression ; hemoglobin ; immunology ; iron ; iron absorption ; longissimus muscle ; myoglobin ; skeletal muscle ; transferrin receptors ; haemoglobin ; weanling piglets
Language	English
Dates of publication	2023-1231
Publishing place	Taylor & Francis
Document type	Article ; Online
ZDB-ID	1015019-5
ISSN	1465-3443 ; 0954-0105
ISSN (online)	1465-3443
ISSN	0954-0105
DOI	10.1080/09540105.2023.2247182
Database	NAL-Catalogue (AGRICOLA)

In stock of ZB MED Bonn / Germany

Z 5001: Show issues

Order via subito

Inter-library loan at ZB MED

Your chosen title can be delivered directly to ZB MED Cologne location if you are registered as a user at ZB MED Cologne.

Details ▾
- See ZB MED holdings
- Order with fees

Article ; Online: Production of antifungal iturins from vegetable straw: A combined chemical-bacterial process

Yuanyuan / Chu, Depeng / Fan, Jiajun / Cui, Zhenzhen / Wang, Rui / Zhang, Han / You, Xiangwei / Li, Yiqiang / Wang, Xiaoqiang

Bioresource Technology. 2023 June, v. 378 p.129010-

2023

Abstract: A combined chemical-bacterial process was developed to convert vegetable straw waste to high value antifungal iturins. Straws from three widely cultivated vegetable (cucumber, tomato and pepper) were evaluated as feedstocks for iturin production. ... ...

Abstract	A combined chemical-bacterial process was developed to convert vegetable straw waste to high value antifungal iturins. Straws from three widely cultivated vegetable (cucumber, tomato and pepper) were evaluated as feedstocks for iturin production. Microwave assisted hydrolysis with very dilute acid (0.2% w/w H₂SO₄) achieved efficient reducing sugar recovery. The high glucose concentration in non-detoxified hydrolysate from pepper straw facilitated the optimal growth of Bacillus amyloliquefaciens strain Cas02 and stimulated the production of iturin. The fermentation parameters were optimised to enhance the iturin production efficiency. The obtained fermentation extract was further purified using macroporous adsorption resin, resulting in an iturin-rich extract that exhibited strong antifungal activity against Alternaria alternata with an IC50 of 176.44 μg/mL. Each iturin homologue was identified using NMR. Overall, 1.58 g iturin-rich extract containing 164.06 mg/g iturins was obtained from 100 g pepper straw, illustrating the great potential of valorising pepper straw via this process.
Keywords	Alternaria alternata ; Bacillus amyloliquefaciens ; adsorption ; antifungal properties ; cucumbers ; feedstocks ; fermentation ; glucose ; hydrolysates ; hydrolysis ; inhibitory concentration 50 ; iturin ; pepper ; porous media ; straw ; tomatoes ; wastes ; Pepper straw ; B. amyloliquefaciens
Language	English
Dates of publication	2023-06
Publishing place	Elsevier Ltd
Document type	Article ; Online
ZDB-ID	1065195-0
ISSN	1873-2976 ; 0960-8524
ISSN (online)	1873-2976
ISSN	0960-8524
DOI	10.1016/j.biortech.2023.129010
Database	NAL-Catalogue (AGRICOLA)

In stock of ZB MED Bonn / Germany

Z 3258: Show issues

Order via subito

Inter-library loan at ZB MED

Your chosen title can be delivered directly to ZB MED Cologne location if you are registered as a user at ZB MED Cologne.

Details ▾
- See ZB MED holdings
- Order with fees

Article ; Online: Electrical conductivity of beech sawdust using graphite catalytic coating: unlocking the microwave-assisted thermolysis efficiency of lignocellulosic biomass.

Bouxin, Florent P / Fan, Jiajun / Budarin, Vitaliy L / Clark, James H

Sustainable energy & fuels

2021 Volume 5, Issue 15, Page(s) 3895–3905

Abstract: The coating of the beech sawdust using a catalytic amount of graphite (as low as 0.25 wt%) allowed a step improvement in the microwave-assisted thermolysis. Results demonstrated that the pyrolysis performance was linked to an electrical conductivity ... ...

Abstract	The coating of the beech sawdust using a catalytic amount of graphite (as low as 0.25 wt%) allowed a step improvement in the microwave-assisted thermolysis. Results demonstrated that the pyrolysis performance was linked to an electrical conductivity threshold of the coated samples rather than a gradual increase. With as low as 0.13 mS m
Language	English
Publishing date	2021-06-28
Publishing country	United States
Document type	Journal Article
ISSN	2398-4902
ISSN (online)	2398-4902
DOI	10.1039/d1se00610j
Database	MEDical Literature Analysis and Retrieval System OnLINE

Order via subito

Inter-library loan at ZB MED

Your chosen title can be delivered directly to ZB MED Cologne location if you are registered as a user at ZB MED Cologne.

To top

Full text online

More links

Kategorien

Inter-library loan at ZB MED

More links

Kategorien

Order via subito

More links

Kategorien

Order via subito

More links

Kategorien

Order via subito

More links

Kategorien

Order via subito

Full text online

More links

Kategorien

Inter-library loan at ZB MED

More links

Kategorien

Order via subito

More links

Kategorien

In stock of ZB MED Bonn / Germany

Order via subito

Inter-library loan at ZB MED

More links

Kategorien

In stock of ZB MED Bonn / Germany

Order via subito

Inter-library loan at ZB MED

More links

Kategorien

Order via subito

Inter-library loan at ZB MED