Ad

Agendator

Free online booking for your barbershop or salon.

A booking page, a calendar and email reminders. No cookies or ads for your clients.

Create your free page

Integrating TorchTPU into TorchTitan and Optimizing Models for TPU

14d

Age

Collected

TorchTPU integrates a native torch.device("tpu") backend directly into PyTorch, allowing developers to train large-scale models on Google Cloud TPUs without rewriting code in JAX. The TorchTitan TPU fork enhances this with production-grade scaling primitives like SimpleFSDP, Graph Trainer, and custom Pallas kernels that achieve high Model Flops Utilization (MFU) across dense and MoE architectures. Developers can leverage these battle-tested optimization…

overfeed.news indexes and links. We publish a short excerpt — the full article stays at Google Developers Blog.

Log in to follow this source

How Agent Anomaly Detection scores on benchmarks we didn't write

Agent Anomaly Detection (AAD) provides asynchronous, low-latency monitoring for AI agents by analyzing OpenTelemetry traces and logs to flag goal hijacks and tool misuse. Tested across five public security benchmarks, AAD successfully caught 87% of harmful instructions carried out by agents without adding runtime latency. Developers can integrate AAD alongside semantic governance and strict tool limits as part of a…

A2UI 1.0: Build delightful, fast, reliable, agentic experiences

A2UI 1.0 is an open protocol for generative UI that enables AI agents to render interactive, native screens across web, mobile, and desktop applications. Developers can leverage open-source renderer SDKs—including React, Angular, Lit, Flutter, SwiftUI, and Jetpack Compose—alongside agent SDKs for Python, TypeScript, and Dart. The release introduces bidirectional function calls, swappable inference formats, and secure data binding to help…

On-Device Speech Recognition and Text-to-Speech in Google AI Edge Gallery

Google AI Edge Gallery now supports on-device, offline Automatic Speech Recognition (ASR) and Text-to-Speech (TTS) capabilities for building developer-friendly voice applications. Developers can leverage ML Kit for optimized Android performance, or use MediaPipe Tasks and LiteRT for cross-platform open-weight model integration. This local pipeline seamlessly pairs lightweight speech models with on-device small language models like Gemini Nano and Gemma 4…

Integrating TorchTPU into TorchTitan and Optimizing Models for…