ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
38
Citations
0
Influential Citations
IEEE Access
Venue
2025
Year
Rapid developments in large language models (LLMs) have created new opportunities for their use in the energy sector, from forecasting renewable energy to power system operation and energy market analysis. These models help improve decision-making, anomaly detection, and optimization procedures in intricate energy systems by using vast amounts of structured and unstructured data. This study provides a comprehensive review of the LLM origins, evaluation, and fine-tuning techniques as well as their integration into energy systems, including their application in fault detection and diagnosis, energy forecasting, document automation, energy management, defect detection, and power system operation. Their performance in terms of explainability, generalization ability, and scalability for energy-related applications is critically examined in this paper. The report also emphasizes significant challenges to the adoption of LLMs, such as the need for computing power, the lack of data, and ethical issues like bias and false information. Power-efficient models, hybrid artificial intelligence (AI) platforms, and domain-specific fine-tuning are some of the solutions discussed. Future areas of interest include multi-modality to obtain maximal forecasting and operational intelligence, real-time adaptability, and explainable. This paper summarizes current developments and provides information on LLM-driven innovation in energy systems while maintaining transparency and dependability. Compared with prior LLM–energy surveys that either remain general-purpose or focus on a single subdomain, this review fills three concrete gaps: (i) a cross-domain synthesis of energy-specific LLM applications spanning power systems, buildings, and forecasting; (ii) a methods-oriented consolidation of evaluation and parameter-efficient fine-tuning practices tailored to energy tasks; and (iii) a deployment-centric analysis of real-time and edge constraints (energy, latency, hardware) with a practical reporting checklist for operational adoption.
This review arrives at a critical juncture where large language models are rapidly expanding beyond natural language processing into domain-specific applications like energy systems. The energy sector generates vast amounts of structured and unstructured data, from sensor readings to maintenance logs, and LLMs offer a promising way to harness this data for improved forecasting, fault detection, and operational decision-making. However, prior surveys have either remained general-purpose or focused on a single subdomain, leaving a gap in cross-domain synthesis. This paper fills that gap by providing a comprehensive overview that spans power systems, buildings, and forecasting, making it a valuable resource for researchers and practitioners seeking to understand the full landscape of LLM applications in energy.
Moreover, the paper goes beyond a simple catalog of applications by addressing practical deployment concerns. It emphasizes real-time and edge constraints, such as energy consumption, latency, and hardware limitations, which are often overlooked in academic reviews. By offering a reporting checklist for operational adoption, it bridges the gap between research and real-world implementation, which is crucial for the industry's move toward more intelligent and responsive energy systems.
The paper makes several key technical contributions:
As a review paper, the results are qualitative rather than quantitative. The paper does not present new experimental metrics but synthesizes findings from existing literature. It highlights that LLMs have been successfully applied to fault detection and diagnosis, energy forecasting, document automation, energy management, defect detection, and power system operation. The critical examination reveals that while LLMs show promise, their performance is often limited by explainability and generalization issues. The paper also underscores the need for power-efficient models and domain-specific fine-tuning to overcome computational and data challenges. The proposed reporting checklist is a practical outcome that can help standardize deployment practices.
The broader impact of this review lies in its potential to guide future research and development in LLM-driven energy systems. By identifying gaps and proposing solutions, it sets a research agenda that includes multi-modality for maximal forecasting and operational intelligence, real-time adaptability, and explainable AI. This is particularly important as the energy sector moves toward decarbonization and digitalization, where intelligent systems are needed to manage complex, distributed, and renewable energy sources. The paper's emphasis on transparency and dependability also addresses ethical concerns, which is crucial for gaining stakeholder trust. For AI practitioners, this review offers a comprehensive starting point for exploring LLM applications in energy, and its deployment-focused insights are directly actionable for those working on edge and real-time systems.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba