Loading...
News reporting focused on AI and machine learning, covering the companies behind these technologies, their real-world applications, and the ethical concerns they raise. This includes areas like generative AI (large language models, text-to-image and video), speech tech, and predictive analytics.
A developer has released tiny-vllm, a high-performance LLM inference engine written in C++ and CUDA, alongside a comprehensive course that walks through implementing the engine from scratch. The project covers loading models from Safetensors, running prefill and decode, building CUDA kernels, KV cache, and more. It is intended as a learning resource for engineers and educators.
A vulnerability in the Starlette open source framework, which gets 325 million weekly downloads, puts millions of AI agents at risk. Tracked as CVE-2026-48710 and named BadHost, the flaw lets attackers bypass path-based authorization via a single character in the HTTP Host header. Affected packages include FastAPI, vLLM, and LiteLLM, and exploitation can expose sensitive data like clinical trial databases, email credentials, and cloud infrastructure details.