Preprint
Large Language Models

Chatting about ChatGPT: how may AI and GPT impact academia and libraries?

Brady Lund(University of North Texas), Ting Wang
February 12, 2023Library Hi Tech News1,120 citations

1.1k

Citations

0

Influential Citations

Library Hi Tech News

Venue

2023

Year

Abstract

Purpose This paper aims to provide an overview of key definitions related to ChatGPT, a public tool developed by OpenAI, and its underlying technology, Generative Pretrained Transformer (GPT). Design/methodology/approach This paper includes an interview with ChatGPT on its potential impact on academia and libraries. The interview discusses the benefits of ChatGPT such as improving search and discovery, reference and information services; cataloging and metadata generation; and content creation, as well as the ethical considerations that need to be taken into account, such as privacy and bias. Findings ChatGPT has considerable power to advance academia and librarianship in both anxiety-provoking and exciting new ways. However, it is important to consider how to use this technology responsibly and ethically, and to uncover how we, as professionals, can work alongside this technology to improve our work, rather than to abuse it or allow it to abuse us in the race to create new scholarly knowledge and educate future professionals. Originality/value This paper discusses the history and technology of GPT, including its generative pretrained transformer model, its ability to perform a wide range of language-based tasks and how ChatGPT uses this technology to function as a sophisticated chatbot.

Analysis

Why This Paper Matters

This paper is significant because it was one of the early academic responses to the public release of ChatGPT, addressing its implications for two knowledge-intensive fields: academia and libraries. Published in February 2023, it captures the initial wave of excitement and anxiety that accompanied the arrival of accessible large language models. The paper's interview format with ChatGPT itself is a novel methodological choice that demonstrates the technology's conversational capabilities while also highlighting its limitations. For practitioners, the paper serves as a concise primer on GPT technology and a call to action for ethical adoption.

Technical Contributions

The paper's main technical contribution is its clear explanation of the Generative Pretrained Transformer (GPT) architecture and how ChatGPT leverages it for conversational tasks. Key points include:

  • GPT is a transformer-based model trained on vast text corpora using unsupervised learning.
  • The model generates human-like text by predicting the next token in a sequence.
  • ChatGPT fine-tunes GPT with reinforcement learning from human feedback (RLHF) to align with conversational norms.
  • The paper outlines specific library applications: improving search and discovery, automating reference services, generating metadata, and creating content.

Results

The paper does not present quantitative results or benchmarks. Instead, it reports qualitative findings from the interview with ChatGPT, which demonstrates the model's ability to articulate its own potential uses and ethical concerns. The key result is the identification of both opportunities (e.g., enhanced information services) and risks (e.g., bias, privacy) that professionals must navigate. The paper's value lies in its framing of these issues rather than in empirical evidence.

Significance

This paper has broader significance as an early signal of how the AI community and adjacent fields began to grapple with the societal impact of large language models. It has accumulated over 1,100 citations, indicating its influence as a reference point for discussions on AI in libraries and education. The paper's emphasis on ethical use and professional responsibility remains highly relevant as ChatGPT and similar tools become integrated into everyday workflows. For AI practitioners, it underscores the importance of considering domain-specific implications when deploying general-purpose models.