GenAI & Agents

Secure RAG Starter

Connect generative AI to your documents and keep existing access rules.

GIST stepIterateShip
Download the PDF
What you get

An assistant that answers from your content and respects who can see what.

Get the Secure RAG Starter overview

The problem it solves, what is included, how it works, the technical components, and how we adapt it with you.

The problem

An assistant can reveal what a search box never would.

Connect a model to your document stores and it can answer from the salary file or the board pack for anyone who asks. Hidden instructions inside documents can also steer what it says.

What this accelerator does

The Secure RAG Starter carries document permissions through to the search index, so people only get answers from content they can already see.

What's included

Answers from your content, inside your access rules.

Four parts, each adapted to your data, platforms, and controls.

01

Permission-aware ingestion

Each document and chunk keeps its source permissions. Files with no matching rule are not indexed.

02

Answers with citations

Every answer cites the source documents it came from.

03

Logging, limits, and cost controls

Every request logged, with daily request and cost limits.

04

Connectors

SharePoint Online and OneDrive through Microsoft Graph, and Confluence Cloud, with their permissions.

You keep the ingestion, connectors, index schema, and assistant code, running under your own identities.

How it works

How permissions work.

  1. Principals at ingestion

    Every document gets allowed and denied groups or users, read from the source system.

  2. Default is nobody

    A file that matches no rule is not indexed at all.

  3. Chunks inherit

    Splitting a document never widens who can see it.

  4. Filter before ranking

    Content a user cannot read is never scored or returned.

  5. Check again

    The assistant re-checks every result and raises an alert if any fails.

  6. Deny wins

    A denied group overrides an allowed one, whichever groups a person belongs to.

Technical detail

Under the hood.

Vendor-neutral Python and configuration, Azure first, with tests included from the start.

Ingestion and ACLs
Permission rules per document and chunk, plus injection screening
Search
Azure AI Search, with the permission filter inside the query
Generation
Azure OpenAI, with retrieved sources marked as untrusted data
Connectors
Graph with Sites.Selected; Confluence through a read-only service account
Assistant layer
Re-check, citations, request log, and usage and cost limits
Offline mode
Keyword search and extractive answers for tests and demos
Proof in the package

Worked example: the same question from two employees.

Bob works in engineering. Alice works in HR. Both ask for the salary range for band L4.

What happens
  • Bob: “I could not find this in the documents you have access to.”
  • Alice: the answer, with a citation
  • A supplier FAQ holds a hidden instruction to the AI
  • Ingestion reports it and leaves that paragraph out
Result

The rest of the supplier FAQ stays searchable. Every request is logged, and any failed permission re-check raises an alert.

Where it fits

Platforms, related accelerators, and limits.

Works with

  • Azure AI Search and Azure OpenAI
  • SharePoint Online, OneDrive, and Confluence Cloud
  • Microsoft Entra ID groups

Pairs with

  • GenAI Evaluation Tests check it before every release
  • AI Agent Controls govern any agents built on it
  • Registered in the AI Governance inventory

Assumptions and limits

  • Permissions are as current as the last sync, so we plan a sync schedule
  • Injection screening catches common patterns; it is one of three layers
  • Production runs on Azure AI Search with vector search added
Ask Datagist AI

Have a question about the Secure RAG Starter?

Get an answer from our pages in seconds, with links to the sources.

Take the overview with you.

Share the overview with your team, or tell us the decision you want to improve and we will tell you whether it fits.