LIVIVO - The Search Portal for Life Sciences

zur deutschen Oberfläche wechseln
Advanced search

Search results

Result 1 - 10 of total 194

Search options

  1. Book ; Online: Compositional ADAM

    Tutunov, Rasul / Li, Minne / Cowen-Rivers, Alexander I. / Wang, Jun / Bou-Ammar, Haitham

    An Adaptive Compositional Solver

    2020  

    Abstract: In this paper, we present C-ADAM, the first adaptive solver for compositional problems involving ... a non-linear functional nesting of expected values. We proof that C-ADAM converges to a stationary point ...

    Abstract In this paper, we present C-ADAM, the first adaptive solver for compositional problems involving a non-linear functional nesting of expected values. We proof that C-ADAM converges to a stationary point in $\mathcal{O}(\delta^{-2.25})$ with $\delta$ being a precision parameter. Moreover, we demonstrate the importance of our results by bridging, for the first time, model-agnostic meta-learning (MAML) and compositional optimisation showing fastest known rates for deep network adaptation to-date. Finally, we validate our findings in a set of experiments from portfolio optimisation and meta-learning. Our results manifest significant sample complexity reductions compared to both standard and compositional solvers.
    Keywords Computer Science - Machine Learning ; Mathematics - Optimization and Control ; Statistics - Machine Learning
    Publishing date 2020-02-10
    Publishing country us
    Document type Book ; Online
    Database BASE - Bielefeld Academic Search Engine (life sciences selection)

    More links

    Kategorien

  2. Book ; Online: 1-bit Adam

    Tang, Hanlin / Gan, Shaoduo / Awan, Ammar Ahmad / Rajbhandari, Samyam / Li, Conglong / Lian, Xiangru / Liu, Ji / Zhang, Ce / He, Yuxiong

    Communication Efficient Large-Scale Training with Adam's Convergence Speed

    2021  

    Abstract: ... They do not work with non-linear gradient-based optimizers like Adam, which offer state-of-the-art ... convergence efficiency and accuracy for models like BERT. In this paper, we propose 1-bit Adam that reduces ... as uncompressed Adam. Our key finding is that Adam's variance (non-linear term) becomes stable (after a warmup ...

    Abstract Scalable training of large models (like BERT and GPT-3) requires careful optimization rooted in model design, architecture, and system capabilities. From a system standpoint, communication has become a major bottleneck, especially on commodity systems with standard TCP interconnects that offer limited network bandwidth. Communication compression is an important technique to reduce training time on such systems. One of the most effective methods is error-compensated compression, which offers robust convergence speed even under 1-bit compression. However, state-of-the-art error compensation techniques only work with basic optimizers like SGD and momentum SGD, which are linearly dependent on the gradients. They do not work with non-linear gradient-based optimizers like Adam, which offer state-of-the-art convergence efficiency and accuracy for models like BERT. In this paper, we propose 1-bit Adam that reduces the communication volume by up to $5\times$, offers much better scalability, and provides the same convergence speed as uncompressed Adam. Our key finding is that Adam's variance (non-linear term) becomes stable (after a warmup phase) and can be used as a fixed precondition for the rest of the training (compression phase). Experiments on up to 256 GPUs show that 1-bit Adam enables up to $3.3\times$ higher throughput for BERT-Large pre-training and up to $2.9\times$ higher throughput for SQuAD fine-tuning. In addition, we provide theoretical analysis for our proposed work.

    Comment: arXiv admin note: text overlap with arXiv:2008.11343
    Keywords Computer Science - Machine Learning ; Computer Science - Distributed ; Parallel ; and Cluster Computing
    Subject code 006
    Publishing date 2021-02-04
    Publishing country us
    Document type Book ; Online
    Database BASE - Bielefeld Academic Search Engine (life sciences selection)

    More links

    Kategorien

  3. Article ; Online: Sustainability Indicators of Surface Public Transportation

    Ammar Al-lami / Adam Torok

    Sustainability, Vol 15, Iss 21, p

    2023  Volume 15289

    Abstract: Historically, roads and transportation have been critical and essential factors in the development and prosperity of cities and societies. The well-being of cities and their expansion were measured by the road networks that linked them to the rest of the ...

    Abstract Historically, roads and transportation have been critical and essential factors in the development and prosperity of cities and societies. The well-being of cities and their expansion were measured by the road networks that linked them to the rest of the world, especially the land roads, which were the biggest challenges for communities. With time, the transportation sector has become an integral part of human life. However, this contribution to the development of cities has come to collide with the challenges arising from the means of transportation, which include large-scale environmental, economic, and social impacts on the communities benefiting from them. Therefore, it has become necessary to make transportation, especially public transportation, sustainable to address environmental challenges such as climate change. To achieve this, more than two thousand research papers published between 2002 and 2022 and retrieved from scientific databases using specific and connected keywords were preliminarily investigated based on the year and number of citations. It was necessary to identify the important sustainability indicators for each sector and study them closely in a detailed manner. We concluded that the sustainability of public transportation is directly affected by environmental, economic, technical, and social factors which can be expressed as follows: 1—emissions, pollution, and the consumption of energy resources as environmental indicators related to sustainability; 2—travel time, cost, travel distance, and operation cost as economic indicators; 3—social demographics, accessibility, and travel behaviours and time as social indicators; and 4—traffic flow, speed, and availability of infrastructures as technical indicators that affect transport sustainability.
    Keywords sustainability indicators ; public transport ; sustainable development ; systematic review ; Environmental effects of industries and plants ; TD194-195 ; Renewable energy sources ; TJ807-830 ; Environmental sciences ; GE1-350
    Subject code 380
    Language English
    Publishing date 2023-10-01T00:00:00Z
    Publisher MDPI AG
    Document type Article ; Online
    Database BASE - Bielefeld Academic Search Engine (life sciences selection)

    More links

    Kategorien

  4. Article ; Online: Ten simple rules for principled simulation modelling.

    Fogarty, Laurel / Ammar, Madeleine / Holding, Thomas / Powell, Adam / Kandler, Anne

    PLoS computational biology

    2022  Volume 18, Issue 3, Page(s) e1009917

    MeSH term(s) Algorithms ; Computer Simulation
    Language English
    Publishing date 2022-03-31
    Publishing country United States
    Document type Journal Article ; Research Support, Non-U.S. Gov't
    ZDB-ID 2193340-6
    ISSN 1553-7358 ; 1553-734X
    ISSN (online) 1553-7358
    ISSN 1553-734X
    DOI 10.1371/journal.pcbi.1009917
    Database MEDical Literature Analysis and Retrieval System OnLINE

    More links

    Kategorien

  5. Article ; Online: H3 K27-altered diffuse midline glioma presenting as massive cerebellopontine hemorrhage.

    Azad, Tej D / Kalluri, Anita L / Hansen, Landon J / Ammar, Adam / Cohen, Alan R

    Child's nervous system : ChNS : official journal of the International Society for Pediatric Neurosurgery

    2023  Volume 39, Issue 8, Page(s) 2229–2232

    Abstract: We report the case of a 14-year-old boy who presented with extensive cerebellar and brainstem hemorrhage. Our presumptive diagnosis was a ruptured arteriovenous malformation (AVM), but two cerebral angiograms showed no significant vascular abnormalities. ...

    Abstract We report the case of a 14-year-old boy who presented with extensive cerebellar and brainstem hemorrhage. Our presumptive diagnosis was a ruptured arteriovenous malformation (AVM), but two cerebral angiograms showed no significant vascular abnormalities. The patient underwent posterior fossa craniotomy and microsurgical evacuation of the hematoma. Pathological analysis of the hemorrhagic tissue made the diagnosis of diffuse midline glioma, H3 K27-altered (WHO grade 4), based on immunohistochemistry. He subsequently developed diffuse craniospinal leptomeningeal disease and progressed rapidly, with respiratory failure followed by severe neurologic decline without further hemorrhage. He was compassionately extubated at the request of the family and died before initiation of adjuvant therapy. This unusual case of a diffuse midline glioma presenting with massive hemorrhage underscores the importance of searching for an underlying etiology of hemorrhage in a child when a vascular lesion cannot be identified.
    MeSH term(s) Male ; Child ; Humans ; Adolescent ; Glioma/complications ; Glioma/diagnostic imaging ; Glioma/pathology ; Cerebellum ; Hematoma ; Cerebral Hemorrhage/diagnostic imaging ; Cerebral Hemorrhage/etiology ; Cerebral Hemorrhage/surgery ; Mutation
    Language English
    Publishing date 2023-03-03
    Publishing country Germany
    Document type Case Reports ; Journal Article
    ZDB-ID 605988-0
    ISSN 1433-0350 ; 0302-2803 ; 0256-7040
    ISSN (online) 1433-0350
    ISSN 0302-2803 ; 0256-7040
    DOI 10.1007/s00381-023-05904-5
    Database MEDical Literature Analysis and Retrieval System OnLINE

    More links

    Kategorien

  6. Article ; Online: The landscape of current research on pediatric diffuse midline glioma: a quantitative analysis of shifts, leaders, and future avenues.

    Fu, Allen Y / Gutha, Alaya / Ammar, Adam / Collins, John J / Mazzola, Catherine A

    Child's nervous system : ChNS : official journal of the International Society for Pediatric Neurosurgery

    2023  Volume 40, Issue 1, Page(s) 57–63

    Abstract: Purpose: Diffuse midline glioma (DMG) has seen a surge of research interest in recent years with the growth in knowledge of new avenues for potential treatments. However, no bibliometric review of the field has been conducted to visualize the current ... ...

    Abstract Purpose: Diffuse midline glioma (DMG) has seen a surge of research interest in recent years with the growth in knowledge of new avenues for potential treatments. However, no bibliometric review of the field has been conducted to visualize the current state of the field. Here, we use bibliometric mapping to visualize the knowledge structure, collaborations, and trends in the field.
    Methods: A total of 1079 original and review articles from 1996 to 2023 on diffuse midline glioma were extracted from the Web of Science Core Collection on June 3, 2023. These files were analyzed with R and VOSviewer to construct bibliometric visualizations.
    Results: Research interest in DMG has continued to grow, driven by publications of original research. Molecular characterization of DMG has been a key focus of recent literature, and terms relating to novel small molecules, mutations, immunotherapy, the blood-brain barrier, and liquid biopsy may be areas for future growth in the literature. Collaborating nations have generally been the North American and European nations, but other nations have begun to make their mark in the field. Leading and rising institutions and journals are described.
    Conclusion: Research in DMG may continue to focus on molecular characterization and new therapeutics based on this knowledge. Novel collaborations between rising nations and institutions in the field may aid in accelerating this research.
    MeSH term(s) Humans ; Child ; Bibliometrics ; Blood-Brain Barrier ; Immunotherapy ; Mutation ; Glioma/therapy
    Language English
    Publishing date 2023-10-19
    Publishing country Germany
    Document type Journal Article ; Review
    ZDB-ID 605988-0
    ISSN 1433-0350 ; 0302-2803 ; 0256-7040
    ISSN (online) 1433-0350
    ISSN 0302-2803 ; 0256-7040
    DOI 10.1007/s00381-023-06178-7
    Database MEDical Literature Analysis and Retrieval System OnLINE

    More links

    Kategorien

  7. Article ; Online: Nephrogenic rest vs immature teratoma associated with lumbosacral lipomyelomeningocele: a case report and review of the literature.

    Bhimreddy, Meghana / Abu-Bonsrah, Nancy / Xia, Yuanxuan / Ammar, Adam / Argani, Pedram / Cohen, Alan R

    Child's nervous system : ChNS : official journal of the International Society for Pediatric Neurosurgery

    2023  Volume 39, Issue 6, Page(s) 1685–1689

    Abstract: Background: Lipomyelomeningoceles (LMMs) are subcutaneous lipomas with dural penetration that often present with spinal cord tethering and may lead to neurological deterioration if untreated. This report describes a rare case of an LMM associated with ... ...

    Abstract Background: Lipomyelomeningoceles (LMMs) are subcutaneous lipomas with dural penetration that often present with spinal cord tethering and may lead to neurological deterioration if untreated. This report describes a rare case of an LMM associated with immature nephroblastic tissue, representing a nephrogenic rest (NR) or, less likely, an immature teratoma.
    Clinical presentation: An 8-day-old infant girl presented to the clinic with a sacral dimple. Imaging demonstrated a tethered spinal cord with low-lying conus medullaris and an LMM. A firm mass was noted in the subcutaneous lipoma. Detethering surgery and removal of the lipoma and mass were performed at the age of 6 months. Pathological examination identified the mass as cartilage, fat, and immature nephroblastic tissue consistent with NR tissue or, less likely, a teratoma with renal differentiation.
    Conclusion: This presentation of an LMM associated with an immature teratoma or NR poses a risk of malignant transformation in patients. As a result, careful surgical dissection, resection, and close clinical follow-up are recommended for these patients.
    MeSH term(s) Infant ; Female ; Humans ; Meningomyelocele/complications ; Meningomyelocele/surgery ; Neural Tube Defects/surgery ; Teratoma/complications ; Teratoma/diagnostic imaging ; Teratoma/surgery ; Lipoma/complications ; Lipoma/diagnostic imaging ; Lipoma/surgery
    Language English
    Publishing date 2023-02-06
    Publishing country Germany
    Document type Review ; Case Reports ; Journal Article
    ZDB-ID 605988-0
    ISSN 1433-0350 ; 0302-2803 ; 0256-7040
    ISSN (online) 1433-0350
    ISSN 0302-2803 ; 0256-7040
    DOI 10.1007/s00381-023-05867-7
    Database MEDical Literature Analysis and Retrieval System OnLINE

    More links

    Kategorien

  8. Article ; Online: Prophylactic removal of a migratory missile from the cerebral ventricles: case report.

    Materi, Joshua / Ahmed, A Karim / Kalluri, Anita L / Ammar, Adam / Cohen, Alan R

    Child's nervous system : ChNS : official journal of the International Society for Pediatric Neurosurgery

    2023  Volume 40, Issue 4, Page(s) 1307–1310

    Abstract: Background and importance: Nonpowder firearm injuries to the head pose major health risks, with retained fragments potentially causing harmful sequelae that require neurosurgical intervention.: Clinical presentation: We report the case of 2-year-old ... ...

    Abstract Background and importance: Nonpowder firearm injuries to the head pose major health risks, with retained fragments potentially causing harmful sequelae that require neurosurgical intervention.
    Clinical presentation: We report the case of 2-year-old girl who sustained an accidental gunshot wound to the head. She sustained a penetrating ballistic intracranial injury caused by a BB shot from a rifle. At presentation, she was neurologically intact with a punctate laceration on her left forehead. Head CT demonstrated a small depressed left frontal skull fracture, a small intracerebral hematoma, and a 5-mm metallic bullet fragment in the deep left frontal lobe near the frontal horn of the left lateral ventricle. She was admitted to the hospital and managed nonoperatively with levetiracetam and intravenous antibiotics, and discharged home in good condition. Follow-up CT in 1 week showed slight migration of the metallic bullet fragment to the left, placing it at the anterior horn of the lateral ventricle. Six weeks later, follow-up CT showed migration of the bullet to the temporal horn of the left lateral ventricle. Intraventricular migration of the bullet raised concern that it could move further to obstruct the foramen of Monro or cerebral aqueduct. Therefore, we removed the bullet through a small left temporal craniotomy with image guidance using a microsurgical approach through a translucent tube.
    Conclusion: The authors discuss the rationale and technique for removing a nonpowder firearm bullet that has migrated within the cerebral ventricles.
    MeSH term(s) Humans ; Female ; Child, Preschool ; Wounds, Gunshot/surgery ; Firearms ; Cerebral Ventricles ; Neurosurgical Procedures ; Craniocerebral Trauma/surgery
    Language English
    Publishing date 2023-12-07
    Publishing country Germany
    Document type Case Reports ; Journal Article
    ZDB-ID 605988-0
    ISSN 1433-0350 ; 0302-2803 ; 0256-7040
    ISSN (online) 1433-0350
    ISSN 0302-2803 ; 0256-7040
    DOI 10.1007/s00381-023-06248-w
    Database MEDical Literature Analysis and Retrieval System OnLINE

    More links

    Kategorien

  9. Article ; Online: Ten simple rules for principled simulation modelling.

    Laurel Fogarty / Madeleine Ammar / Thomas Holding / Adam Powell / Anne Kandler

    PLoS Computational Biology, Vol 18, Iss 3, p e

    2022  Volume 1009917

    Keywords Biology (General) ; QH301-705.5
    Language English
    Publishing date 2022-03-01T00:00:00Z
    Publisher Public Library of Science (PLoS)
    Document type Article ; Online
    Database BASE - Bielefeld Academic Search Engine (life sciences selection)

    More links

    Kategorien

  10. Article ; Online: Letter to the Editor Regarding "What's in a Name? 'Global Neurosurgery' in the 21st Century".

    Ammar, Adam / Rolle, Myron / Park, Kee B

    World neurosurgery

    2020  Volume 145, Page(s) 542

    MeSH term(s) Humans ; Neurosurgery ; Neurosurgical Procedures
    Language English
    Publishing date 2020-12-17
    Publishing country United States
    Document type Letter ; Comment
    ZDB-ID 2534351-8
    ISSN 1878-8769 ; 1878-8750
    ISSN (online) 1878-8769
    ISSN 1878-8750
    DOI 10.1016/j.wneu.2020.09.139
    Database MEDical Literature Analysis and Retrieval System OnLINE

    More links

    Kategorien

To top