overfeed.news

Seção

Notícias

Manchetes das redações e blogs que acompanhamos.

3.503documentos

Anúncio

Assine o Pro, sem anúncios

Faça upgrade para uma leitura sem interrupções e acesso prioritário a novas fontes.

Ver preços

Model-agnostic PII detection with LLMs

A configurable, model-agnostic detector that turns any large language model on Amazon Bedrock into a PII detector. Because the entities to detect live in a prompt rather than in code, one detector adapts to new entity types without retraining, and it outperforms an off-the-shelf tool across five public corpora and nine LLM-based detectors.

en

Agent Evaluation Metric for multi-turn conversations

Multi-turn agents fail in ways single-turn evaluation misses: one early mistake corrupts every later turn. This post introduces the Agent Evaluation Metric (AEM), a decomposable, turn-level way to measure agent quality, applied to its first dimension, correctness, to pinpoint the turn that caused a failure and separate it from the turns that inherited it.

en