Neura News

AI News

News reporting focused on AI and machine learning, covering the companies behind these technologies, their real-world applications, and the ethical concerns they raise. This includes areas like generative AI (large language models, text-to-image and video), speech tech, and predictive analytics.

Latest News

18 articles
Industry

Data center electricity use could quadruple by 2035

A new report from BloombergNEF predicts that U.S. data centers will consume four times more electricity by 2035, accounting for one-fifth of the nation's total power generation. The surge is driven by AI compute demand, with nearly half of new capacity going to training and inference. The forecast is 83% higher than BloombergNEF's previous estimate, reflecting rapid data center development and strained electrical grids.

Jul 213 minNeura News
AI Tools

Disaggregated Prefill and Decode for LLM Inference on SageMaker HyperPod

AWS has introduced a method to separate the prefill and decode phases of large language model inference on SageMaker HyperPod. By running each phase on dedicated GPU pools connected via Elastic Fabric Adapter with RDMA, the approach eliminates interference that occurs when the phases share a single GPU. This results in more consistent per-token latency and independent scaling for long-context, high-concurrency workloads.

Jul 106 minNeura News
Funding

SambaNova raises $1B at $11B valuation five months after last round

SambaNova Systems has raised $1 billion at an $11 billion valuation in the first close of its Series F round, led by General Atlantic. The round comes roughly five months after the company's $350 million Series E and launch of its SN50 chip. CEO Rodrigo Liang said additional investors are expected in a second close soon. The company also announced that JPMorganChase has selected SambaNova as an inference infrastructure partner, deepening its ties with Intel through a co-development partnership.

Jul 84 minNeura News
AI Models

NVIDIA Confidential Computing Powers Apple Private Cloud Compute Expansion

NVIDIA announced that its GPUs with Confidential Computing are now used for confidential inference in Apple's Private Cloud Compute (PCC) as Apple expands PCC beyond its own data centers to Google Cloud. The integration, unveiled at Apple's WWDC 2026, uses NVIDIA Blackwell GPUs to support server-side inference for Apple Foundation Models, built by Apple and Google using technologies behind the Gemini family of models. The hardware-based security layer ensures that no one, including system builders, can access user data during processing.

Jun 93 minNeura News
Research

Study Tests Whether Transformers Need All Three QKV Projections

A new paper systematically evaluates three variants of projection sharing in transformer attention: shared key-value, shared query-key, and a single projection. The authors found that sharing key and value projections performs on par with standard QKV attention while reducing KV cache by 50% with only 3.1% perplexity degradation. Combining this with grouped-query or multi-query attention can cut cache by up to 96.9%, enabling practical on-device inference.

Jun 53 minNeura News
AI Models

Bonsai Image 4B Brings Image Generation to Local Devices

PrismML has released Bonsai Image 4B, a family of compact image-generation models that run on local devices like laptops and phones. The models use binary and ternary weight representations to shrink the diffusion transformer to under 1 GB, enabling on-device inference on iPhone 17 Pro Max and other Apple Silicon hardware. Two variants offer different trade-offs between footprint and quality, retaining up to 95% of the accuracy of the full-precision FLUX.2 Klein 4B base model.

May 314 minNeura News
AI Tools

AWS details observability strategy for SageMaker AI LLM inference

AWS published a technical guide on comprehensive observability for large language models deployed on Amazon SageMaker AI. The approach separates monitoring into infrastructure quantity and LLM quality dimensions, using CloudWatch and Amazon Managed Grafana to visualize GPU utilization, cost, and response quality signals. The solution includes alert thresholds for metrics such as safety scores and composite quality scores, evaluated by an LLM-as-judge setup.

May 304 minNeura News
Research

Google Deepmind AI Solves Decades-Old Math Problems Cheaply

Google Deepmind's AlphaProof Nexus framework autonomously solved nine of 353 open Erdős problems, including two unanswered for 56 years, at an inference cost of a few hundred dollars each. The system uses Gemini 3.1 Pro to generate proof steps in Lean's formal language, with compiler feedback grounding the language model's reasoning. It also tackled 44 OEIS conjectures and settled a 15-year-old algebraic geometry question.

May 254 minNeura News
AI Models

NVIDIA Nemotron-Labs Diffusion Models Speed Up Text Generation

NVIDIA has released Nemotron-Labs Diffusion, a family of diffusion language models (DLM) that generate multiple tokens in parallel and iteratively refine them. Available in 3B, 8B, and 14B scales, the models support three inference modes: autoregressive, diffusion, and self-speculation. The 8B model achieves up to 6.4x higher tokens per forward pass compared to autoregressive models while improving average accuracy by 1.2% over Qwen3 8B.

May 234 minNeura News