A tool lets AI point at the button while people keep the click
AI agent
Software that carries out computer tasks for a person.
click-through
An overlay that lets clicks reach the app underneath.
Accessibility
Mac features that help software find or control screen elements.
What happened
A public GitHub repository called bigarrow offers a small way for an AI agent, software that carries out computer tasks, to point at a screen. It can draw large arrows, boxes, and labels over a Mac. The project also includes a skill that agents can use. Its README says the tool is click-through, disappears by itself, and never steals focus.
The post reached 216 points and 82 comments on Hacker News, a technology discussion site. Those numbers show community attention. They do not prove that the tool works perfectly.
The problem it addresses
AI agents can find a button, but they should not always press it. A permission prompt, two-factor authentication, a payment confirmation, a signature, or a legal checkbox may require a person's decision. The project describes bigarrow as a way to handle that handoff. Instead of printing an instruction in a terminal, an agent can point at the right place.
How it works
The command-line tool offers three simple actions. point shows one pointer. start keeps an overlay visible. stop removes it. A target can be an element label, an app, a window, or screen coordinates. The overlay lets clicks pass through to the app below. It does not click, type, or capture the screen. The repository also says it contains no AI. It is a visual signal, not a second agent.
The pointer can include a full sentence. It can follow a window or target. It can also speak the label aloud. These options support guided setup, remote help, demonstrations, and moments when the user is away from the desk.
Why the boundary matters
The interesting design choice is the division of labor. The agent can locate the next step. The person keeps control of sensitive actions. This avoids a simple all-or-nothing choice. The agent does not need to stop because a human step exists. The human also does not need to search through many windows alone.
That boundary is only useful if the pointer is clear. A wrong target could confuse a user. A visible arrow could also create false confidence. The tool helps communication, but it cannot decide whether a requested action is wise.
What the project reports
The README explains installation through Homebrew, a Mac package manager. Building from source requires Xcode 16 or newer. It lists macOS 14 or newer. The project reports 87 automated tests and 17 behavior checks. It says the checks ran on macOS 15 and also passed on macOS 26 and macOS 27. Some target-finding features use macOS Accessibility permissions. Window-title reading on macOS 26 may need Screen Recording.
These are claims in the project's own documentation. They are useful evidence, but they are not an independent benchmark.
What remains unknown
The repository does not show how often targeting fails in ordinary apps. It does not show long-term user data. It also does not prove that every agent will choose the right target. We do not yet know how widely people will use the skill.
The next things to watch are releases, reported failures, and real examples. The key question is simple: can agents keep pointing, while people keep the final choice?
A friendly arrow helps AI ask for human help
📰 Full story: A tool lets AI point at the button while people keep the click
bigarrow helps an AI agent show a person where to look.
AI agent
Software that does computer work for a person.
click-through
A drawing that lets clicks pass to the app below.
two-factor authentication
A second proof that helps protect an account.
💡 The gist
- bigarrow is a small tool for computer helpers.
- It never clicks, types, or takes screen pictures.
- Hacker News, a tech discussion site, showed interest.
An AI agent is software that does computer work for a person. Sometimes it reaches a step that needs a human. That step might be a permission box, two-factor authentication, a payment check, or a signature. The agent may know which button matters. Still, a person should decide.
bigarrow is a small tool for a Mac computer. It draws a large arrow, a box, or short text. It can point to a button or window. It can find targets by labels, app names, window names, or coordinates. The drawing is click-through. This means clicks can reach the app underneath.
The tool does not click for you. It does not type for you. It does not capture the screen. The arrow can disappear after a short time. An agent can also start it, stop it, or ask the Mac to read the message aloud.
This matters because agents need a clear way to ask for help. A terminal sentence can be easy to miss. A pointer is visible where the person must act. The person keeps control of sensitive steps. The agent can continue after the person finishes.
The project's public GitHub page reports 87 automated tests and 17 behavior checks. It also lists support for macOS 14 or newer. These are reports from the project. They are not a promise that every app works perfectly.
On Hacker News, the post received 216 points and 82 comments. That shows interest from the community. It does not prove the tool is safe, useful, or correct. More evidence should come from releases and real use.
💬 Is an AI arrow useful?
People liked the idea of an AI pointing at things on the screen, but worried about safety, focus, and unclear explanations.
- The author says Claude refused risky actions such as entering passwords even with administrator power and Yolo mode. This is one person's test.
- A user says Claude CLI helped with two tasks: changing a settings file and using a video app. The arrows guided dragging and clicking, though ffmpeg may be more efficient when a GUI is unnecessary.
- People see uses for Blender, confusing work software, instructions, and helping family. Others ask whether the real fix should be making the dialog come to the front instead of adding an arrow.
- The main safety criticism is that an arrow shows where to click, not whether clicking is wise. Users also worried about hiding permission buttons and unclear documentation; the reply was that the tool's powers should be limited and its maker must be trusted. No exploit was shown.
- People disagreed about quality: some called it low-quality AI-made work, while others enjoyed the creativity of making small new tools.
initial digest at 82 comments (revision 1). We fetched 82 comments and sampled 82 across the thread. These are HN users’ reports, not independently verified facts.
A computer helper points, but people press
📰 Full story: A tool lets AI point at the button while people keep the click
bigarrow helps a computer helper point at the right place.
AI helper
A computer program that helps do jobs.
bigarrow
A little tool that points at things on a screen.
Hacker News
A place where people talk about technology.
An AI helper is a computer program that does jobs. bigarrow is a little tool for that helper. It draws a big arrow on a Mac computer screen. It can draw a box. It can write a few words. It points to the button. It does not press the button. It does not type. It does not take a screen picture. A person makes the final choice. This helps with secret codes and payments. The arrow can go away after a little while.
The project has a GitHub page. Hacker News is a place where tech people talk. Its post had 216 points and 82 comments. Those numbers show attention. They do not show that everything is right.
💬 An AI that points at the screen
An AI can draw a big arrow to show a person where to look. That may help, but the person still has to think before clicking.
- The maker says Claude still said no to some risky jobs, even after being given extra computer power. That is one person's test.
- Another user says the arrows helped Claude show how to change settings and use a video app. People think this could also help with hard apps, instructions, or family.
- Some people ask whether the computer window should simply come to the front. They also say an arrow shows where something is, but not whether it is a good idea to press it.
- People worried about permission windows and unclear instructions. Others said the tool should have only small powers and that its maker must be trusted. Some found the project silly, while others liked the new idea.
initial digest at 82 comments (revision 1). We fetched 82 comments and sampled 82 across the thread. These are HN users’ reports, not independently verified facts.
💬 Can a giant arrow become an AI guide?
HN commenters saw value in pointing at live UI elements, but questioned focus, consent, security, and documentation quality. The reported behavior and problems are author or user self-reports, not independent tests.
initial digest at 82 comments (revision 1). We fetched 82 comments and sampled 82 across the thread. These are HN users’ reports, not independently verified facts.