Artikel ; Online: GPT-4 passes the bar exam.
Philosophical transactions. Series A, Mathematical, physical, and engineering sciences
2024 Band 382, Heft 2270, Seite(n) 20230254
Abstract: In this paper, we experimentally evaluate the zero-shot performance of GPT-4 against prior generations of GPT on the entire uniform bar examination (UBE), including not only the multiple-choice multistate bar examination (MBE), but also the open-ended ... ...
| Abstract | In this paper, we experimentally evaluate the zero-shot performance of GPT-4 against prior generations of GPT on the entire uniform bar examination (UBE), including not only the multiple-choice multistate bar examination (MBE), but also the open-ended multistate essay exam (MEE) and multistate performance test (MPT) components. On the MBE, GPT-4 significantly outperforms both human test-takers and prior models, demonstrating a 26% increase over ChatGPT and beating humans in five of seven subject areas. On the MEE and MPT, which have not previously been evaluated by scholars, GPT-4 scores an average of 4.2/6.0 when compared with much lower scores for ChatGPT. Graded across the UBE components, in the manner in which a human test-taker would be, GPT-4 scores approximately 297 points, significantly in excess of the passing threshold for all UBE jurisdictions. These findings document not just the rapid and remarkable advance of large language model performance generally, but also the potential for such models to support the delivery of legal services in society. This article is part of the theme issue 'A complexity science approach to law and governance'. |
||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Sprache | Englisch | ||||||||||
| Erscheinungsdatum | 2024-02-26 | ||||||||||
| Erscheinungsland | England | ||||||||||
| Dokumenttyp | Journal Article | ||||||||||
| ZDB-ID | 208381-4 | ||||||||||
| ISSN | 1471-2962 ; 0080-4614 ; 0264-3820 ; 0264-3952 ; 1364-503X | ||||||||||
| ISSN (online) | 1471-2962 | ||||||||||
| ISSN | 0080-4614 ; 0264-3820 ; 0264-3952 ; 1364-503X | ||||||||||
| DOI | 10.1098/rsta.2023.0254 | ||||||||||
| Signatur |
|
||||||||||
| Datenquelle | MEDical Literature Analysis and Retrieval System OnLINE |
Zusatzmaterialien
Kategorien
Verfügbar in ZB MED Bonn
| Z 4' 46/25: Hefte anzeigen | ||||
| Z PHI 2: Hefte anzeigen |
Über subito bestellen
Dieser Service ist kostenpflichtig (siehe Lieferbedingungen von subito). Bestellungen, die einen Artikel nebst Supplementary Material umfassen, werden grundsätzlich wie mehrfache Bestellungen bearbeitet. Gebühren fallen in diesen Fällen für jede einzelne Bestellung an.
Fernleihe an ZB MED
Sie können sich den gewünschten Titel als lokale Nutzerin oder lokaler Nutzer von ZB MED direkt an den Standort Köln schicken lassen.