open-record-replay

项目详情摘要

Open Record/Replay Teach Computer Use agents by demonstration. Record a macOS workflow once, save the evidence, and let an agent turn it into a reusable skill. English | 简体中文 Open Record/Replay is a local-first macOS recorder for workflows that are easier to show than to write down. It captures a user's real desktop actions into structured artifacts such as `session.json` and `events.jsonl`, validates the recording quality, and packages the evidence for an agent's skill creation flow. The goal is simple: if a user can demonstrate a desktop workflow once, an agent should have enough evidence to learn it. Why This Exists Some workflows are hard to describe as prompts: They depend on visible desktop UI. They involve file pickers, menus, modals, or drag-and-drop. They span multiple apps. They depend on personal workspace layout or team-specific conventions. They are easier to learn from a demonstration than from a written runbook. Open Record/Replay gives agents a concrete evidence stream instead of asking them to infer the workflow from a vague description. What You Can Record Open Record/Replay can capture action-level evidence for workflows such as: Sending files or images through a desktop chat app. Creating a document and sharing its link. Opening a browser page, searching, and starting the right media. Moving between browser and desktop apps. Repeating a UI process that is not covered by a clean API or connector. The recorder can capture: `window.changed` `mouse.click` `mouse.drag` `keyboard.text_input` `keyboard.submit` `selection.changed` app/window attribution UI targets selected items Accessibility tree or diff context `events.jsonl` is the primary evidence. Screenshots are not part of the current core recording path. Quick Demo This is the typical flow for teachi