Skip to content

AI security

How to Prevent Sensitive Data Leaks in ChatGPT, Claude, Gemini & Copilot

Stop sensitive data leaks in ChatGPT, Claude, Gemini, and Copilot: compare tenant settings, browser prompt masking, upload DLP limits, and account checks.

What to take away

Preventing sensitive data leaks across ChatGPT, Claude, Google Gemini, and Microsoft Copilot requires three distinct layers: disabling model training in contracted work tenants, verifying whether employees are signed into work or personal accounts in the browser, and inspecting or masking sensitive prompts and text uploads before submission.

1. Separate the four ways company data leaks through AI tools

Teams often treat "data leaking into AI" as a single problem, then buy or configure a control that closes only one path. Before writing browser rules, map which of the four exposure paths actually happens in your workspace.

Contractual no-training terms protect inputs submitted inside your paid enterprise workspace, but they do nothing when an engineer signs into a personal Claude or ChatGPT tab on the same laptop, uploads a CSV export to a signed-out tool, or uses Copilot on a SharePoint site shared with the entire company.

1. Separate the four ways company data leaks through AI tools
Leak pathWhat goes wrongControl layer that addresses it
Consumer or personal AI accountPrompts may be retained or used for model training outside any corporate DPABrowser account-context detection plus domain or session restrictions
Raw PII or secrets in promptsAPI keys, IBANs, customer emails, or confidential terms are sent verbatim to an LLMInline browser prompt masking or targeted sensitive-prompt blocking
File and code attachmentsEmployees attach CSV, JSON, source code, or PDF files directly into chat composersAttachment inspection for text/code plus upload rules for uninspected binary files
Overshared internal groundingMicrosoft 365 Copilot or connected agents surface files with overly broad internal ACLsSharePoint, OneDrive, and Google Drive permission cleanup and OAuth review

References: ANSSI - Security recommendations for a generative AI system · NCSC - Guidelines for secure AI system development

2. Lock down training, retention, and SSO in your approved AI tenants

Give employees at least one approved AI workspace with SSO and a signed Data Processing Addendum before restricting consumer tools. In business tiers such as ChatGPT Enterprise/Team, Claude for Work/Enterprise, Google Workspace with Gemini, and Microsoft 365 Copilot, verify that vendor model training on your organization’s prompts is disabled by default or turned off in admin settings.

Check retention windows, workspace export permissions, and shared-conversation link settings at the same time. A public "share chat" URL created inside an otherwise approved workspace can still expose internal prompts outside your tenant if link sharing is left open.

References: ANSSI - Security recommendations for a generative AI system · Google Workspace Admin Help - Generative AI privacy and governance · Microsoft Learn - Data, Privacy, and Security for Microsoft 365 Copilot

3. Mask or block sensitive prompts at the browser composer

Network proxies and DNS filters can block an entire domain such as chatgpt.com or claude.ai, but they cannot distinguish a harmless formatting question from a pasted production API key, nor can they tell a personal login apart from your corporate workspace without TLS decryption complexities.

Browser-level AI DLP inspects the draft inside the composer right before submission. Decide per data category whether to warn, mask in place with realistic fictional placeholders (for example replacing a real customer email, IBAN, or credential while letting the employee finish drafting), or block submission outright.

  • Credentials and secrets (API keys, tokens, private keys): block or mask immediately and rotate any real secret that left the device.
  • Customer and employee PII / PHI (names, emails, phone numbers, national IDs, health references): mask automatically in-draft so summarizing and translation tasks continue safely.
  • Internal codenames and confidential financial figures: match custom company dictionaries or confidential categories and restrict to approved corporate tenants.

References: NCSC - Guidelines for secure AI system development · Elba Documentation - Browser extension security capabilities

4. Account for attachment formats and inspection boundaries

Employees do not only type prompts; they drag CSV exports, JSON payloads, source files, PDFs, and spreadsheets into ChatGPT, Claude, Gemini, and Copilot. Test how your control handles both text-based uploads and binary documents on every managed browser in your fleet.

Make sure your security team documents exact format boundaries rather than assuming every attachment is deep-scanned. Where a browser control inspects text and code excerpts up to a defined size limit while recording metadata only for binary formats such as PDFs, Office documents, images, or archives, pair browser checks with SaaS file-sharing hygiene and clear policy rules on binary uploads.

References: Elba Documentation - Browser extension security capabilities

5. Validate account context and controls across every managed browser

Run a repeatable four-test script on enrolled devices whenever you roll out or update a rule: a benign prompt on an approved corporate AI account, a synthetic credential or IBAN prompt that should trigger masking or blocking, a personal or signed-out session check, and representative CSV and PDF uploads.

Deploy extensions via MDM or browser management policies (Google Admin for Chrome, Intune or Group Policy for Edge, enterprise policies for Firefox, and Apple Declarative Device Management or macOS installer packages for Safari) so employees cannot silently disable protection.

References: Elba Documentation - Browser extension security capabilities · Elba Documentation - Deploying the browser extension across MDM and browsers

How Elba protects prompts and uploads in ChatGPT, Claude, Gemini & Copilot

Elba’s browser extension runs across Chrome, Edge, Firefox 128+, and Safari 26+ (requiring macOS 26+ and MDM package deployment) and covers ChatGPT, Claude, Google Gemini, and Microsoft Copilot. It detects local account context (work, personal, signed-out, or unknown) without harvesting credentials, blocks unauthorized AI domains, and enforces Browser Security Playbooks.

When configured, Elba blocks sensitive prompts or automatically masks PII, PHI, credentials, financial data, and confidential terms directly inside the composer draft using fictional replacement values (failing closed if classification exceeds its 18-second timeout). For file uploads in ChatGPT, Claude, Gemini, and Copilot, Elba inspects text and code attachments up to 5 files / 16,000 characters; binary files (PDFs, Office documents, most images, and archives) are recorded as metadata only. AI classification runs statelessly via OVHcloud AI Endpoints in Gravelines, France, while stored findings retain only classifications, SHA-256 hashes, and required metadata on OVHcloud EU core databases (or Neon in the US), never raw prompt text.

References: Elba Documentation - Browser extension security capabilities · Elba Documentation - Deploying the browser extension across MDM and browsers

Checklist to prevent AI prompt and upload leaks

0 of 8 checks complete

Your checks stay on this page and reset when you reload it.

Common questions

Does ChatGPT Enterprise or Claude for Work stop leaks on its own?

It protects data submitted inside that contracted workspace from vendor model training, but it does not stop an employee from opening a personal ChatGPT, Claude, or Gemini account in another browser tab or pasting live production secrets that should never leave your environment.

What is the difference between prompt blocking and automated prompt masking?

Prompt blocking stops the message from being sent and explains the policy rule. Automated prompt masking replaces detected sensitive spans (such as names, emails, IBANs, or keys) with realistic fictional values inside the draft so the employee can review the sanitized text and complete their task without exposing real data.

Can browser AI DLP inspect PDFs and Excel files uploaded to ChatGPT or Claude?

Always verify format limits per tool. In Elba’s browser workflow, text and code attachments (such as TXT, Markdown, CSV, JSON, and source files) provide bounded excerpts up to 5 files / 16,000 characters for inspection, whereas binary files such as PDFs, Office workbooks, images, and archives record metadata only.

Does inspecting prompts mean security admins can read everything employees type?

It should not. Follow data-minimization guidance from ANSSI and the NCSC: in Elba, classification runs ephemerally and stored findings retain only the triggered category, SHA-256 hash, and event metadata rather than raw prompt contents.

Sources & further reading

Primary documentation used to review this guide. Product settings and edition requirements can change; check the linked documentation before making changes.

Put it into practice

Browser DLP and prompt masking solutionAI security and automated prompt maskingChatGPT integrationClaude and Anthropic security integrationAI Acceptable Use Policy templateShadow AI discovery and controls
AI security6 min

Shadow AI: discover tools and control sensitive data

Build a Shadow AI inventory, distinguish observed use from verified access, and test controls for sensitive prompts and uploads.

Read the guide
AI security8 min

Copilot and M365 agents: residual oversharing after the policies

Check residual permissions, connectors, and knowledge sources after enabling Microsoft 365 Copilot and Studio agents with this practical SMB checklist.

Read the guide
AI security8 min

AI governance vs Shadow AI: what SMBs should decide beyond inventory

Shadow AI inventory finds tools. SMB AI governance sets approval, data rules, exceptions, and measurement, so policy goes beyond a discovery spreadsheet.

Read the guide
AI security7 min

AI Acceptable Use Policy Template (GDPR & EU AI Act)

Download a free Corporate AI Acceptable Use Policy template and CSV register aligned with GDPR and EU AI Act Article 4, with clear data and account rules.

Read the guide
Data protection9 min

Google Workspace DLP: setup, rules and limits

Check your Workspace edition, configure Drive DLP rules, test detections, and fix risky sharing. Includes rule examples and an access-review checklist.

Read the guide
Applications and access6 min

User access review checklist: from accounts to completed changes

Run an access review with verified accounts, clear decisions, tracked changes, and completion evidence. Includes a reusable review checklist.

Read the guide
Data protection7 min

Slack data loss prevention: coverage, review and verified action

Evaluate Slack DLP, separate message exposure from linked-file access, and test a practical review workflow with clear Elba coverage limits.

Read the guide
Data protection6 min

SharePoint external sharing: review access with Copilot in mind

Review SharePoint and OneDrive sharing, distinguish permissions from discovery controls, and verify access changes with owners and practical checks.

Read the guide
Data protection7 min

Find and fix Anyone links in Google Drive and SharePoint

Build a dated inventory of anonymous file links, decide with owners, and verify changes in Drive, SharePoint, and OneDrive.

Read the guide
Security awareness7 min

After a phishing click: check the SaaS controls training cannot close

Keep phishing practice, then verify mailbox rules, OAuth consent, file links, and sensitive AI use after a suspected compromise.

Read the guide
Security awareness7 min

Deploying a Phishing Report Add-In in Gmail & Outlook with AI Triage

Deploy a native phishing report button in Gmail and Microsoft Outlook: configure least-privilege consent, separate simulations, and speed up AI triage.

Read the guide
Application security7 min

Audit third-party OAuth apps in Google Workspace and Microsoft 365

Inventory connected apps and consent, rank grants by scope, and verify keep, restrict, or revoke decisions in the source.

Read the guide
Applications and access7 min

Enterprise Browser Extension Risk Audit Checklist (Chrome, Edge & Firefox)

Audit Chrome, Edge, and Firefox extensions across your company: evaluate host permissions, spot risky AI/VPN add-ons, and enforce MDM allowlists.

Read the guide
Applications and access6 min

Employee offboarding checklist for SaaS access

Download a free offboarding review template. Confirm accounts, assign access changes, preserve ownership and verify removal in each source application.

Read the guide
Audit evidence8 min

Third-party SaaS and OAuth apps as ISO 27001 evidence (SMB checklist)

Turn your SaaS and OAuth app inventory into ISO 27001:2022 evidence: control mapping, dated exports, owners and decisions. A checklist for lean SMB teams.

Read the guide
Audit evidence8 min

NIS2 Article 21 SaaS & Identity Security Checklist for SMBs and Mid-Market

Map NIS2 Article 21(2) risk-management measures to practical SaaS, MFA, OAuth supply-chain, cloud sharing, Shadow AI, and security training evidence.

Read the guide
Audit evidence8 min

Shadow AI, GDPR & EU AI Act Article 4 Compliance Guide

Align Shadow AI governance with GDPR Articles 5, 28, 32, and 35 and EU AI Act Article 4 AI literacy: processor checks, prompt minimization, and training.

Read the guide
Platform evaluation4 min

Evaluate SaaS security across the whole workflow

Compare how your tools connect a SaaS finding, employee context, an authorised action and verification in the source application.

Read the guide
Applications and access8 min

Shadow IT discovery tools for SMBs: Elba, Nudge Security and With Wings

Compare vendor-stated SaaS and AI discovery, supported responses and deployment needs. Includes a practical pilot checklist for lean IT teams.

Read the guide

From review to remediation

Mask sensitive prompts before they leave the browser.

Test Elba’s prompt masking, sensitive upload checks, and account-context detection on ChatGPT, Claude, Gemini, and Copilot.

Request a demo