Loading...
News reporting focused on AI and machine learning, covering the companies behind these technologies, their real-world applications, and the ethical concerns they raise. This includes areas like generative AI (large language models, text-to-image and video), speech tech, and predictive analytics.
Google and NVIDIA announced new hardware at Google Cloud Next to reduce AI inference costs at scale. A5X instances on Vera Rubin NVL72 systems deliver 10 times lower cost per token and higher throughput. Features include confidential computing, agent platforms, and manufacturing tools used by OpenAI, CrowdStrike, and others.
Amazon Web Services has released G7e instances powered by NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs on Amazon SageMaker AI. These instances offer up to 96 GB of GDDR7 memory per GPU and support for large models like GPT-OSS-120B on a single node. They provide up to 2.3x better inference performance than G6e instances, with doubled GPU memory and higher networking speeds.