Neura News

AI News

News reporting focused on AI and machine learning, covering the companies behind these technologies, their real-world applications, and the ethical concerns they raise. This includes areas like generative AI (large language models, text-to-image and video), speech tech, and predictive analytics.

Latest News

3 articles
Industry

Enterprises buy AI compute faster than they can measure costs

A new VentureBeat Pulse Research survey of 107 enterprises reveals a significant gap between AI infrastructure spending and the ability to track its economics. Most organizations run AI on hyperscalers and model APIs, but the next dollar is aimed at specialized compute they rarely use today. GPU utilization is at 50% or less for 83% of respondents, and fewer than half rigorously track compute costs. A majority plan to switch or add providers within the year.

Jul 166 minNeura News
AI Tools

AWS details observability strategy for SageMaker AI LLM inference

AWS published a technical guide on comprehensive observability for large language models deployed on Amazon SageMaker AI. The approach separates monitoring into infrastructure quantity and LLM quality dimensions, using CloudWatch and Amazon Managed Grafana to visualize GPU utilization, cost, and response quality signals. The solution includes alert thresholds for metrics such as safety scores and composite quality scores, evaluated by an LLM-as-judge setup.

May 304 minNeura News
Product Launch

NVIDIA Spectrum-X Ethernet Adds Open MRC Protocol for AI

NVIDIA has opened Multipath Reliable Connection (MRC), a new RDMA transport protocol optimized for Spectrum-X Ethernet hardware, to the industry via the Open Compute Project. Deployed by OpenAI, Microsoft, and Oracle in major AI factories, MRC improves throughput, load balancing, and availability for large-scale AI training. It enables high GPU utilization by distributing traffic across multiple paths and handles failures in microseconds.

May 64 minNeura News