ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
1.5k
Citations
0
Influential Citations
IEEE Communications Surveys & Tutorials
Venue
2018
Year
In the era of the Internet of Things (IoT), an enormous amount of sensing devices collect and/or generate various sensory data over time for a wide range of fields and applications. Based on the nature of the application, these devices will result in big or fast/real-time data streams. Applying analytics over such data streams to discover new information, predict future insights, and make control decisions is a crucial process that makes IoT a worthy paradigm for businesses and a quality-of-life improving technology. In this paper, we provide a thorough overview on using a class of advanced machine learning techniques, namely deep learning (DL), to facilitate the analytics and learning in the IoT domain. We start by articulating IoT data characteristics and identifying two major treatments for IoT data from a machine learning perspective, namely IoT big data analytics and IoT streaming data analytics. We also discuss why DL is a promising approach to achieve the desired analytics in these types of data and applications. The potential of using emerging DL techniques for IoT data analytics are then discussed, and its promises and challenges are introduced. We present a comprehensive background on different DL architectures and algorithms. We also analyze and summarize major reported research attempts that leveraged DL in the IoT domain. The smart IoT devices that have incorporated DL in their intelligence background are also discussed. DL implementation approaches on the fog and cloud centers in support of IoT applications are also surveyed. Finally, we shed light on some challenges and potential directions for future research. At the end of each section, we highlight the lessons learned based on our experiments and review of the recent literature.
The Internet of Things (IoT) generates massive volumes of sensory data, ranging from big data batches to real-time streams. Extracting actionable insights from such data is critical for businesses and quality-of-life applications. Deep learning (DL), with its ability to automatically learn hierarchical representations, has emerged as a powerful tool for IoT analytics. This survey, published in IEEE Communications Surveys & Tutorials in 2018, provides a timely and comprehensive overview of how DL can facilitate analytics and learning in the IoT domain. With over 1400 citations, it has become a key reference for researchers and practitioners navigating this interdisciplinary area.
The paper distinguishes between IoT big data analytics and IoT streaming data analytics, two paradigms that impose different requirements on machine learning models. By articulating these distinctions and explaining why DL is promising for each, the authors lay a conceptual foundation that helps structure subsequent research. The survey also covers practical aspects such as deploying DL on fog and cloud centers, which is essential for real-world IoT systems with latency and bandwidth constraints.
As a survey paper, it does not present new experimental results or quantitative benchmarks. Instead, it synthesizes findings from the literature, highlighting the potential of DL for IoT analytics and the challenges that remain. The paper's "results" are therefore qualitative: it demonstrates the breadth of DL applications in IoT, from smart homes to industrial IoT, and underscores the need for lightweight models, distributed learning, and efficient deployment. The lessons learned sections distill insights from the reviewed literature, which can guide future work.
This survey has had a substantial impact on the AI and IoT communities. By providing a clear framework for understanding DL in IoT, it has helped researchers position their work and identify gaps. Its discussion of fog and cloud implementation anticipates the edge computing trend, influencing subsequent research on efficient DL for resource-constrained devices. The paper's high citation count attests to its role as a foundational reference. Moreover, by highlighting challenges such as data privacy, model interpretability, and real-time processing, it has shaped the research agenda for years to come. Overall, it bridges the fields of deep learning and IoT, fostering cross-disciplinary innovation.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba