Reduced AI Latency

firetail:ai-latency-ms-reduced

Type:

Detection

Rule Severity:

Info

AI response times have decreased significantly. Monitor logs for errors that could indicate failures.

While this is generally positive, sudden latency reductions could indicate incomplete processing, errors, or reduced response complexity.

‍

Remediation

Verify that responses are complete and correct.

Example Attack Scenario

How to Identify with Example Scenario

How to Resolve with Example Scenario

How to Identify with Example Scenario

Find the text in bold to identify issues such as these in API specifications

How to Resolve with Example Scenario

Modify the text in bold to resolve issues such as these in API specifications
References:

More findings

All Findings
Reduced AI Input Tokens
Missing retry header
Mailgun Secrets Found in AI Logs
AppSync GraphQL API missing WAF
Elevated AI Output Tokens
Majority response status codes 3XX