Preprint
Large Language Models

Unleashing the potential of prompt engineering for large language models

B.‐C. CHEN(Beijing Normal-Hong Kong Baptist University), Zhaofeng Zhang(Beijing Normal-Hong Kong Baptist University), Nicolas Langrené(Beijing Normal-Hong Kong Baptist University), Shengxin Zhu(Beijing Normal-Hong Kong Baptist University)
May 8, 2025Patterns506 citations

506

Citations

0

Influential Citations

Patterns

Venue

2025

Year

Abstract

This review explores the role of prompt engineering in unleashing the capabilities of large language models (LLMs). Prompt engineering is the process of structuring inputs, and it has emerged as a crucial technique for maximizing the utility and accuracy of these models. Both foundational and advanced prompt engineering methodologies-including techniques such as self-consistency, chain of thought, and generated knowledge, which can significantly enhance the performance of models-are explored in this paper. Additionally, the prompt methods for vision language models (VLMs) are examined in detail. Prompt methods are evaluated with subjective and objective metrics, ensuring a robust analysis of their efficacy. Critical to this discussion is the role of prompt engineering in artificial intelligence (AI) security, particularly in terms of defending against adversarial attacks that exploit vulnerabilities in LLMs. Strategies for minimizing these risks and improving the robustness of models are thoroughly reviewed. Finally, we provide a perspective for future research and applications.

Analysis

Why This Paper Matters

Prompt engineering has become the primary interface between practitioners and large language models, yet the field's rapid growth has produced a fragmented literature spanning simple instruction design, multi-step reasoning scaffolds, and multimodal prompting. This review, published in Patterns and already cited over 500 times, addresses that fragmentation by consolidating foundational and advanced prompt engineering methodologies into a single reference. For AI practitioners, it offers a structured map of techniques that can materially change model behavior without retraining.

The paper's timing is significant. As LLMs are deployed in high-stakes settings, the ability to reliably elicit accurate, safe outputs through input design is as important as model selection itself. By covering both LLMs and vision language models (VLMs), the review acknowledges that prompting is no longer a text-only concern. Its explicit treatment of AI security—specifically adversarial attacks that exploit prompt-level vulnerabilities—elevates prompt engineering from a performance-tuning trick to a robustness and safety discipline.

Technical Contributions

  • Taxonomy of prompt methods: The review organizes foundational and advanced techniques, including self-consistency, chain of thought, and generated knowledge, which the authors note can significantly enhance model performance.
  • Multimodal coverage: It examines prompt methods for vision language models in detail, extending the discussion beyond text-only LLMs.
  • Dual evaluation lens: Prompt methods are assessed with both subjective and objective metrics, providing a more robust analysis of efficacy than a single-metric survey.
  • Security focus: The paper reviews prompt engineering's role in defending against adversarial attacks that exploit LLM vulnerabilities, and surveys strategies for minimizing risks and improving robustness.
  • Research agenda: It concludes with a perspective on future research and applications, identifying open directions for the field.

Results

As a review article, the paper does not report original experimental metrics or head-to-head benchmark comparisons of its own. Its results are synthesized findings from the literature: namely, that techniques such as self-consistency, chain of thought, and generated knowledge can significantly enhance model performance, and that prompt-level defenses are critical to AI security. The authors' use of subjective and objective metrics to evaluate prompt methods is presented as a framework for robust analysis rather than as a new empirical result.

Significance

The review's broad significance lies in giving practitioners and researchers a shared vocabulary and reference point for prompt engineering across text and vision modalities. Its security discussion is particularly consequential: framing prompt engineering as a defense surface against adversarial attacks encourages the field to treat input design as part of the safety stack, not an afterthought. With over 500 citations, the paper is positioned as a foundational survey that can guide both applied deployment and future research on robust, effective prompting.