OrchestriAI
Back to the field guide
AI systemsExplainer11 min read

LUCI local MCP screen context for coding agents

LUCI Desktop gives coding agents on-device screen and meeting memory via skills or local MCP, beside computer-use stacks.

Want your coding agents to remember what was on screen and said in meetings?

Free. Three short fields, and we reply by email within one business day.

By Shariq Riaz

In this guide

LUCI Desktop gives coding agents on-device screen and meeting memory via skills or local MCP, beside computer-use stacks.

12 sections6 cited sources11 min read
On this page12 sections
  1. Short answer
  2. Built for agents, not people
  3. Product claim and the gap it closes
  4. Beside OpenAI Computer History
  5. The hard part: 100% local indexing
  6. Privacy claims from the launch post
  7. Skills first, MCP as fallback
  8. MCP setup path and capabilities
  9. Distinct from sibling posts
  10. OpenClaw, Hermes, and Grok Bot-class stacks
  11. Operator checklist
  12. Independence and limitations

This post is about context recall, not computer control. LUCI Desktop indexes screen and meeting history on the Mac or PC and exposes it to coding agents through skills or loopback MCP so Claude Code, Codex, or Cursor can search what was on screen. The agent reads memory; it does not click, type, or run a background window driver (Cua Driver), a smart-home remote MCP (Google Home), or a vendor GUI fleet (Simular Sai).

Memories.ai launched LUCI on September 22, 2026. The launch post and Agent Bridge docs describe on-device capture and agent-side retrieval. This article stays with that launch story and the MCP docs. It is not a Memories.ai review, and it does not claim LUCI ships a supported path for OpenClaw, Hermes, or Grok Bot.

Short answer

Use LUCI when you want a coding agent to recall what was on screen or said in a meeting without uploading that history to a vendor cloud. Prefer skills first (Luci-skills); fall back to local MCP for Claude Code, Codex, Cursor, or any MCP client. Keep LUCI running while you expect live memory. Quitting the app cuts the live path; memory only grows while capture is on.

Do not confuse this with computer-use (click, type, screenshot-driven control), an MCP gateway that prunes tool calls, or the browser-vs-MCP action-surface debate. Those are adjacent posts with different failure modes. Start from what MCP servers are and local vs remote MCP if you need the protocol framing.

Built for agents, not people

Rewind and Microsoft Recall are products a person opens and searches. LUCI is built so the agent retrieves the history itself. CEO Shawn Shen's launch framing (paraphrased): with Rewind or Recall you open the tool and hand-feed context; LUCI plugs into the agent; nothing leaves the machine. Memories.ai does not build the agent. They give the agent a local path into your own computer history. Their personal-use example: Claude Code distills the day to markdown nightly.

That split matters for operators. A human search UI and an agent-callable memory surface solve different jobs even when both look at screen history.

Product claim and the gap it closes

LUCI turns the screen into context Claude Code, Codex, and Cursor can use, entirely on-device. The launch post targets apps and surfaces without APIs: WhatsApp, browser tabs, PDFs, desktop software. If the useful fact lived only on a window, not in a typed MCP tool or REST endpoint, the agent had no clean way to recall it. Screen memory closes that gap as context, not as a substitute for a narrow tool when one exists.

Beside OpenAI Computer History

Per the LUCI launch post, OpenAI's Computer History feature is paid and macOS-limited. LUCI positions itself as free, Mac and Windows, and on-device. Treat that comparison as Memories.ai's launch claim and recheck both products' current docs before you plan a rollout. The design lesson for this site stays the same either way: who indexes the history, where embeddings live, and which process can query them.

We'll set up LUCI's local MCP so the agent gets that context while the data stays on your machine.

The hard part: 100% local indexing

Shen frames the hard engineering problem as 100% local indexing: text and embeddings on-device, not cloud-process-then-store-local. Memories.ai also claims partnerships with Microsoft, Intel, AMD, and Qualcomm for on-device model performance, including a Microsoft Build / Nadella reference in the launch post. Keep those as their claims. For your threat model, the operator question is simpler: does indexing stay on the box you control, and which accelerator path does the app actually use on your hardware?

Privacy claims from the launch post

Memories.ai states:

  • 100% local indexing and storage; nothing uploaded
  • Encrypted local storage that only your own agents access
  • Per-app opt-out; password managers and banking excluded by default
  • Automatic redaction of sensitive info (for example passwords) as captured
  • Runs on an on-device AI accelerator (not CPU) for an all-day light footprint; local meeting transcription is searchable

Those are product claims. Verify them against current LUCI docs and your own capture settings before you treat a shared workstation as safe. Also keep the Agent Bridge privacy boundary in view: memory stays local until the agent pulls it; once pulled, that content is part of the conversation and may leave the machine if the agent runs through a cloud model path.

Skills first, MCP as fallback

Agent Bridge recommends skills as the default path and MCP as the fallback. Three skills ship in the Luci-skills repo:

  • `luci` - search screen and meeting memory
  • `distill` - daily Life folder record
  • `summarize-meeting` - meeting summary path

Skills install into Claude Code, Cursor, and Codex skills folders. The same repo also covers Gemini, Copilot, and Windsurf via repo or npx install paths. Skills call a local PATH command that talks to the running LUCI app. If LUCI is not running, Agent Bridge falls back to written Life folder files.

MCP is the compatibility path for Claude Code, Codex, Cursor, and any MCP client. Memory is built and stored on the machine; queries come to the data; the data does not migrate to Memories.ai. MCP binds to loopback only, keeps the token under OS key protection, and rejects website-origin requests. Local call logs on Insights show volume, not search terms.

MCP setup path and capabilities

From the MCP integrations page and MCP docs:

  1. 1Enable Screen Memory in LUCI.
  2. 2Leave the app running while you expect capture and live queries.
  3. 3Copy the URL, token, and client snippets from the Screen Memory panel.
  4. 4Wire the client: Claude Code (`claude mcp add --transport http`), Codex (`~/.codex/config.toml`), or Cursor (`~/.cursor/mcp.json`) with the Bearer token.

Documented capabilities include exact string search, semantic or fuzzy search, app and time scoping, time-range digest, spoken-word recall, and full-context drill-down.

Operational constraint: if you quit LUCI, the agent cannot reach live memory. Memory only grows while capturing. Plan for that the same way you plan for a local MCP server that is down: the client config may still exist, but the data path is gone until the app is back.

Distinct from sibling posts

Keep LUCI in its lane:

Also useful nearby: what are MCP servers, local vs remote MCP, trust boundaries for self-hosted agents, and OpenClaw vs Hermes.

OpenClaw, Hermes, and Grok Bot-class stacks

OpenClaw and Hermes are processes you run. You choose model routing, toolsets, sandboxes, and which MCP servers attach. Grok Bot-class personal agents raise the same split in smaller form: where planning runs, where tools run, and what context the host can see.

Memories.ai's launch and docs name Claude Code, Codex, Cursor, and other MCP clients for skills or local MCP. They do not document a first-party OpenClaw, Hermes, or Grok Bot path. Do not invent that support. The useful comparison is architectural:

  • If context lives only in chat paste, the agent forgets whatever never got pasted.
  • If context lives in a cloud computer-history product, indexing and retention follow that vendor's rules.
  • If context lives in on-device LUCI memory, the agent queries a local store (skills or loopback MCP) while the app runs; cloud models still see whatever the agent pulls into the prompt.
  • If you self-host OpenClaw or Hermes, a local screen-memory MCP is optional context beside tools you already expose. It does not replace tool policy, sandboxes, or trust boundaries on the Gateway you operate.

Write the trust question down before you enable capture on a shared machine: which apps are opted out, who can read the Bearer token, and whether the agent path is local-only or cloud-backed.

Operator checklist

Whether you evaluate LUCI for personal use or a small team:

  1. 1Decide capture scope: which apps stay opted out; confirm banking and password managers stay excluded.
  2. 2Prefer skills install from Luci-skills; use MCP snippets only when the client needs them.
  3. 3Keep LUCI running during work you expect the agent to recall; treat quit as "live memory offline."
  4. 4Store the MCP Bearer token like any other local credential; do not paste it into tickets or shared repos.
  5. 5Assume cloud agents: anything the agent retrieves can leave with the conversation.
  6. 6Separate personal capture machines from shared CI or pool workers that should not index colleague screens.
  7. 7Recheck current Luci MCP and Agent Bridge docs before you script installs across a fleet.

For build work, AI agent systems place memory tools beside human gates, MCP development shapes narrow tools when screen history is the wrong default, and systems integration keeps credentials and side effects on the right identity.

Independence and limitations

OrchestriAI is an independent implementation provider. Product names are used for identification only. OrchestriAI is not affiliated with, endorsed by, or sponsored by Memories.ai, LUCI, Anthropic, OpenAI, Cursor, OpenClaw, or Nous Research / Hermes. This article summarizes Memories.ai's September 22, 2026 LUCI Desktop launch, the LUCI site, Agent Bridge docs, and MCP docs as of early October 2026. Features, client snippets, privacy defaults, and partnership claims can change. Confirm current Memories.ai and LUCI docs before you size a rollout. OpenClaw, Hermes, and Grok Bot appear here only as design comparisons for where context and tools sit, not as products Memories.ai listed as supported.

Free. Three fields. We reply within one business day.

Want your coding agents to remember what was on screen and said in meetings?

We'll set up LUCI's local MCP so the agent gets that context while the data stays on your machine.

You'll talk to Shariq. Replies come from shariq@orchestriai.com. Leave out passwords and patient records.

What happens next

  1. 1.You send one line about the task.
  2. 2.Shariq reads every message and replies by email within one business day.
  3. 3.If it fits, you get a written plan or a short call. Your choice.
  4. 4.If it does not fit, we tell you and point you to a better option.
“Shariq built our Open Dental to GoHighLevel sync and our AI routing system for new patient inquiries. Both projects were delivered fast, worked right away, and he was responsive whenever we needed adjustments. He understands dental practice workflows and doesn't overcomplicate things.”
Michael Ling, Owner, Smile Again Dental

References used in this article

6 links
Shariq Riaz, founder of OrchestriAI

Written by

Shariq Riaz

Founder, OrchestriAI · CPHIMS · PMP · CBAP

11 years in enterprise IT at Fortune 500 companies. He founded OrchestriAI, an AI automation agency that builds and runs automations and AI agents for healthcare, real estate, financial services, and freight forwarding teams.

Free automation checklist

Free automation checklist for your industry

A one-page checklist of the manual work clinics, real estate teams, financial firms and freight forwarders most often automate. Pick your industry and tick what is still done by hand.

Or read it now, no email needed: Healthcare & dental automation checklist.

Your email comes only to us. No spam, and we never sell it. See the Privacy Policy.

Want this built for you? AI Agents: From $4,000/project

When your process has branches, decisions, and exceptions that need judgment, a linear automation breaks down. We build multi-agent systems where specialized AI agents handle different parts of a complex workflow, coordinating with each other like a well-run team.

Not sure it fits yet? Send us one manual task and we'll email back one specific way to automate it, free.

Keep reading