What Nobody Tells You About Using Google Gemini in Gmail and Docs

For a year, Gemini was the tab I opened whenever ChatGPT was busy — a backup, not a tool. Then I actually turned on the version built into Gmail, Docs and Sheets, the one you never open on purpose because it's already sitting in the corner of a screen you're using anyway, and it quietly took over three jobs I didn't expect an AI to be any good at.

This is beginner-to-intermediate — nothing here needs a developer account or a business subscription, and every step lives inside apps you already have open most days. If you've never used an AI assistant of any kind, ChatGPT for beginners is the better starting point; this guide assumes you've talked to a chatbot before and just haven't wired one into the inbox and documents you actually work in.

The problem this actually solves

Most people's experience of Gemini is a single browser tab: you open gemini.google.com, ask it something, copy the answer out, and close the tab. That's fine for a one-off question, but it means every use starts from zero — no memory of the email thread you're replying to, no view of the document you're editing, nothing but whatever you paste in. The side panel version is a different thing entirely: it lives inside Gmail, Docs and Sheets themselves, which means it can already see the thread you have open or the sheet you're working in, and act on it directly, instead of you doing the copying and pasting yourself.

The catch is that almost nobody turns it on, because it isn't the default view of "Gemini" most people have in their head. On a personal Google account it typically comes bundled with a Google One AI Premium subscription; on a work or school account it depends on which Workspace plan your organisation is on. Either way, the giveaway is a small sparkle icon in the top corner of Gmail, Docs or Sheets — if you've never noticed it, this is what it does.

Step 1: Turn on the Gemini side panel in Gmail, Docs and Sheets

Open Gmail, Docs or Sheets on the web and look for a small sparkle-shaped icon in the top-right corner of the screen, near your profile picture. Clicking it opens the Gemini side panel as a column down the right-hand side of whatever you're working on. If the icon isn't there at all, the feature isn't enabled on your account yet — for a personal Google account that usually means subscribing to Google One AI Premium; for a work account, it's a setting your Workspace administrator controls. Once it's on, it's on everywhere: the same panel appears in Gmail, Docs, Sheets, Slides and Drive, using the same underlying assistant each time.

Step 2: Draft and reply to email with "Help me write"

Open a new email or hit reply on one already in your inbox, and you'll see a "Help me write" prompt appear near the compose box. Type a rough instruction — "reply saying I can do Thursday but not Friday, keep it friendly" — and Gemini drafts the full email in seconds. The part that actually matters is what comes after: buttons to Formalise, Elaborate, Shorten or Rephrase the draft it just gave you, so you're editing a tone dial rather than rewriting from scratch. I use this most for the replies I'd otherwise put off for two days simply because typing them felt like more effort than the reply was worth.

Step 3: Summarise a thread instead of reading it top to bottom

Open any long email thread and the side panel offers a one-click "Summarize this email" action, which condenses a fifteen-message back-and-forth into a few lines: who wants what, and what's still unresolved. For threads that come back Monday morning after a weekend away, this is the difference between reading everything in order and scanning a summary and diving into the two messages that actually need a reply. Gemini can also be asked directly in the panel to summarise everything unread from a specific sender or label, which is closer to a daily digest than a per-email tool.

Step 4: Draft and rewrite documents in Google Docs

In a Google Doc, the side panel can write a first draft from a plain-English brief — "draft a one-page project update for a client, covering what shipped this week and what's next" — directly into the document, which you then edit rather than write from a blank page. More useful day to day is selecting a paragraph you've already written and asking Gemini to tighten it, make it more formal, or explain it more simply for a reader who isn't technical. It's editing in place, on your own words, rather than a separate chat window you'd have to copy the result out of.

Step 5: Clean and analyse data in Sheets without writing formulas yourself

This is the one that genuinely surprised me. Select a range of data in Sheets, open the side panel, and describe what you want in plain English — "add a column that flags any row where the total is over 500" or "summarise this list by category into a new table." Gemini writes the actual formula or builds the table for you, and you can ask it to explain what a formula does before you trust it on real data. For anyone who has ever quietly avoided a spreadsheet task because they didn't know the right function, this closes that gap without a tutorial.

Step 6: Build one custom Gem for the task you repeat every week

A Gem is a saved version of Gemini with your own standing instructions baked in, so you stop re-explaining the same context every single time. In the Gemini app, go to Gems, create a new one, and give it a name, a role, and the background it needs — for mine, a "Weekly Report Assistant" Gem, I gave it the exact structure and tone my client updates need and pasted in one example so it had a real pattern to match. From then on, I paste in this week's raw notes and it returns a draft already shaped the way I actually send it, which is the same instinct behind the five ChatGPT prompts I reuse every week — the win isn't the AI being clever once, it's not re-explaining yourself every time.

Common mistakes worth avoiding

1. Assuming the standalone app and the side panel are interchangeable. They share a brain but not a memory — a conversation in the gemini.google.com tab doesn't carry over into the Gmail panel, and vice versa. Pick the right surface for the job rather than bouncing between them.
2. Sending the first draft unedited. "Help me write" is a strong starting point, not a finished email — it doesn't know your relationship with the recipient or the history behind the ask. Always read it back before sending.
3. Trusting a Sheets formula without asking Gemini to explain it first. It's usually right, but "usually" isn't good enough for anything touching real numbers you'll act on. The explain step costs one extra prompt and catches the rare mistake.
4. Building five Gems before using one properly. A Gem is only worth the setup time if you genuinely repeat the task weekly. Start with the one thing you retype most, and only add a second once the first has earned its place.

If you're weighing whether a free AI upgrade is worth switching on at all, I ran a similar gut-check when Amazon made Alexa+ free for Prime members — the honest answer both times is that "free" and "worth actually using" turn out to be separate questions. And if what you actually want is an assistant that only ever answers from documents you feed it, rather than the open web, NotebookLM is built for exactly that — a narrower tool than Gemini, on purpose. Either way, the rest of what I've tested along these lines lives on the AI tools & productivity hub.

Everything above only works because the side panel stays scoped to the document or inbox you're already in — it doesn't quietly reach further than that. Which is exactly why Google reportedly retiring its task-specific agent builder in favour of one general-purpose assistant gave me pause: the version of Gemini I've actually come to trust is this narrow one.

Questions people actually ask

Is Gemini in Gmail and Docs free, or do I need to pay for it?

On a personal Google account, the Gemini side panel in Gmail, Docs and Sheets is bundled with a Google One AI Premium subscription, not switched on by default. Some Google Workspace business and education plans include it differently, so what you see depends on which kind of account you're signed into. If you don't see the sparkle icon in the top corner of Gmail or Docs, that's the most likely reason.

Is this the same Gemini as the standalone app at gemini.google.com?

Same underlying model, different surface. The standalone app is a chat window you open on purpose; the side panel in Gmail, Docs and Sheets is the same assistant embedded directly in the document or inbox you're already working in, so it can see and act on what's actually on the page without you copying and pasting anything across.

Does Gemini read all my email to do this?

It only acts on what you explicitly ask it to work with in that session — a thread you open and ask it to summarise, or a draft you ask it to help write. It isn't silently scanning your whole inbox in the background. Google's own account privacy settings control what Gemini can access and for how long, and they're worth checking once when you turn any of this on.

How is this different from Microsoft Copilot or ChatGPT?

The mechanics are similar — an AI assistant living inside the apps you already use rather than a separate chat window — but Gemini's edge is Google's ecosystem specifically: Gmail, Docs, Sheets, Drive and Calendar all in one account. If you live in Outlook and Word instead, the closer comparison is Microsoft Copilot; if you want one AI you carry across every app regardless of vendor, that's the case for paying for ChatGPT separately.

What's a Gem, and is it worth setting one up?

A Gem is a saved version of Gemini with your own standing instructions built in, so you don't retype the same context every time. It's worth the ten minutes it takes if you have one task you repeat weekly — a report, a type of email, a recurring summary — but not worth building five of them on day one. Start with the single task costing you the most repeated typing.