Lesson 4 of 7 · 0%Contain prompt injection and untrusted contentNext
Course map

Security Hardening and Threat Boundaries

0 of 7 complete0 of 7

Lesson 4.1 · 60 minutes

Contain prompt injection and untrusted content

Treat messages, web pages, documents, tool output, and retrieved text as data—not instructions with authority.

Skip course map
Current lessonContain prompt injection and untrusted content0% complete · 0/7 lessons

Security Hardening and Threat Boundaries

0% complete · Current: Contain prompt injection and untrusted content

Verifiedon 2026.7.1

Action boundary

Before you act

Expected result
An adversarial test pack demonstrates that untrusted text cannot silently alter authority or trigger a consequential action.
Failure mode
Retrieved or user-provided content is treated as trusted instruction and reaches a capable tool.
Rollback
Stop the test, revoke temporary access, clear the sandbox state, and preserve only redacted test evidence.

Content can request; it cannot authorize

A page saying “ignore your rules” is content. So is a document, email, tool response, or copied command. A safe design keeps untrusted material labelled through the workflow, limits what it can influence, and requires a separate trusted decision before a consequential tool call. Read the current gateway security and browser documentation when mapping this to your deployment.

Lab — adversarial boundary pack

Create harmless fixtures that ask for a forbidden action: reveal a secret, change an approval rule, contact an unapproved recipient, or run a destructive command. Run them only against a sandbox with disposable credentials. Your expected result is refusal, escalation, or a constrained summary—not a successful side effect.

Record fixture ID, ingress path, reachable tools, observed response, approval request (if any), and log event. A model refusing in prose is insufficient if a downstream tool still receives the request.

Learner artifact

Illustrate two lanes: an amber untrusted-content lane ending at a policy/approval boundary, and a blue trusted-control lane that alone may invoke a capable tool.

Quiz

A retrieved webpage includes a plausible instruction to export a customer list. What is the correct classification? Untrusted data requiring a separate authorized decision. Do not elevate it because it looks operational or came from a familiar domain.

Source provenanceVerification and sources

Review receipt rr_security_prompt_boundaries

Outcome
approved
Method
source-review
Reviewer
academy-security-source-review
Reviewed

Evidence

Limitations

  • Approval covers the bounded 2026.7.1 learning exercises and cited security guidance; operators must validate controls against their own deployment and use disposable credentials in labs.

Open the public evidence snapshot

Lesson checkpoint

Ready to move on?

Mark this lesson complete when you can apply its outcome without relying on the examples above.