AI news

AI news, first-hand

Short notes on model releases, tools and regulation — from official blogs, changelogs and GitHub releases. No retelling: every note links to its primary source.

30-day median: a note shows up here 11 h 21 min after the source publishes it

Today

InfrastructureAWS Machine Learning

Amazon SageMaker Inference: 2026 launches in review, part 2

This second installment reviews 13 more Amazon SageMaker AI inference launches from 2026, spanning configuration recommendations, fitting more models onto each GPU, serving models too large for one instance, cross-Region routing, and post-launch tuning, bringing the year's…

Primary sourcecaught 5 h 27 min after publication

Yesterday

InfrastructureAWS Machine Learning

Run your whole selling business in AWS Quick

Most sellers do not need another AI product to learn. They need the tools and information they already use brought together, so they can see what is happening in their business and act on it.

Primary sourcecaught 7 h 45 min after publication

November 18, 2026

November 17, 2026

InfrastructureAWS Machine Learning

Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference

Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes without building the orchestration layer yourself.

Primary sourcecaught 6 h 27 min after publication

November 16, 2026

November 13, 2026

November 12, 2026

InfrastructureAWS Machine Learning

Deploy frontier AI models on AWS Trainium with SGLang-Neuron

SGLang-Neuron is now publicly available through an AWS Deep Learning Container. With SGLang-Neuron, you can serve models and generate reinforcement learning rollouts with SGLang on AWS Trainium using the same SGLang interface you already know, all running on native PyTorch.

Primary sourcecaught 7 h 57 min after publication
InfrastructureAWS Machine Learning

Four Amazon Bedrock inference choices that affect cost

Your Amazon Bedrock inference bill can keep climbing even after you tune prompts and application logic. Four request-level choices (cache duration, service tier, reasoning effort, and maxTokens) change how many tokens the service processes and the rate applied.

Primary sourcecaught 9 h 9 min after publication

November 11, 2026

InfrastructureAWS Machine Learning

Introducing Kimi K3.1 Pro on Amazon Bedrock

Kimi K3.1 Pro from Moonshot AI is now available on Amazon Bedrock. Learn how to get started through the OpenAI-compatible Chat Completions, Responses, and Converse APIs, optimize inference with explicit prompt caching, and use the model as a coding assistant in OpenCode.

Primary sourcecaught 4 h 54 min after publication

November 3, 2026

InfrastructureAWS Machine Learning

Building ultra-low-latency voice AI applications on AWS

Learn how Cartesia, an AWS Partner, uses purpose-built State Space Models and AWS infrastructure to deliver sub-100ms text-to-speech and speech-to-text at global scale, and how to deploy its Sonic model on Amazon SageMaker AI or self-managed Amazon EC2 GPU instances.

Primary sourcecaught 13 h 20 min after publication

October 29, 2026

October 28, 2026

October 27, 2026

InfrastructureAWS Machine Learning

Announcing SOCI-indexed images for faster SageMaker AI jobs

Seekable OCI (SOCI) indexing for Amazon SageMaker AI training and processing jobs takes full container image download off the critical path. SageMaker AI lazy-loads your image to start containers in seconds instead of minutes, with no changes to your job definition.

Primary sourcecaught 13 h 0 min after publication

October 23, 2026