nidhoggfgg/PhoneUse

phone use for ai

Kotlin

0

41 commits

updated Oct 4, 2026

See the code

See what people are saying

SourceMessageScoreDate

I open-sourced Phone Use: let an AI agent browse and operate your Android apps (r/SideProject)

One of the examples in my Phone Use README is an AI agent browsing Xianyu, checking item details and organizing 29 secondhand RAM offers. Another is the agent exploring a roguelike and clearing its first floor. I've now open-sourced the tool behind these examples. Phone Use connects the AI agent…

1

Oct 4, 2026

Phone Use: control your own Android phone through MCP, without root or ADB (r/mcp)

I'm the author of Phone Use, an MIT-licensed Android app that connects an existing AI agent to your own phone. It exposes screen observations (UI elements and screenshots), taps, swipes, text input and app navigation. No root, ADB or per-app integration is required. For MCP, a local Python stdio…

2

Oct 4, 2026

README

Phone Use

Phone Use

Give AI agents control of your Android phone.

Android 11+ Agent Skill and MCP MIT License

Download APK · Quick start · Examples · Docs

English | 简体中文

Phone Use connects your existing AI agent to your phone through Skill or MCP. The agent can read the screen, tap, swipe, type, and switch apps—no root, ADB, or per-app integration required.

Examples

Compare prices on Xianyu
Collect 29 RAM offers and check item details.

AI browsing secondhand RAM listings on Xianyu and organizing prices by specification

Catch up on QQ messages
Review recent chats and find messages worth a reply.

AI reviewing QQ conversations and summarizing messages that may need a reply

Play a roguelike
Explore, fight, and clear the first floor as a mage.

AI playing a mage, reaching the second dungeon floor, and recapping the run

Discover people on Soul
Follow profiles and summarize their interests.

AI browsing Soul profiles and summarizing the interests of accounts it followed

Quick start

You'll need an Android 11+ phone and an AI agent that can run programs, with Python 3.10+ in its execution environment. Connect the phone and agent's computer to the same Wi-Fi, or another network where the phone is reachable.

  1. Install the app. Download the APK, install it on your phone, and open Phone Use.
  2. Grant permissions. Enable Accessibility and allow notification and local-network permissions when prompted.
  3. Connect your agent. In Connect your AI, select a reachable phone address, tap Copy prompt, and send the whole prompt to your agent. It installs the Skill and starts pairing.

For the first connection, compare the eight-digit code on your phone with the one shown by the agent. If they match, approve on the phone and tell the agent you've confirmed the match.

Pair once, then just ask your agent to use your phone. Pairings survive restarts; removing pairing data or revoking access requires pairing again. Keep the phone awake and unlocked during use.

Manual Skill installation

With Node.js 22.20+, Git, and Python 3.10+ installed:

npx skills add nidhoggfgg/phone-use-skills --skill phone-use

Choose your agent and installation scope, then send it the following, replacing the address with the HTTPS address shown in the app:

Use the phone-use Skill to connect to https://192.168.1.20:8443. Show me the pairing code and wait for my confirmation.

Complete the same code check above. The Skill handles both pairing and phone control; no separate MCP setup is needed.

Features

  • Screen understanding — UI elements and screenshots give agents the context to act.
  • App interaction — Tap, long-press, swipe, scroll, type, launch apps, and navigate.
  • Your agent, your devices — Connect through Skill, MCP, or the Python CLI, with support for multiple phones.
  • On-device authorization — Approve clients on your phone, connect over HTTPS with Skill/MCP, and revoke access at any time.

Documentation

Usage & troubleshooting · Skill & MCP setup · API reference · Build from source

Contributing · Report an issue · Security policy

License

MIT

nidhoggfgg/PhoneUse

phone use for ai

Kotlin

0

41 commits

updated Oct 4, 2026

See the code

See what people are saying

SourceMessageScoreDate

I open-sourced Phone Use: let an AI agent browse and operate your Android apps (r/SideProject)

One of the examples in my Phone Use README is an AI agent browsing Xianyu, checking item details and organizing 29 secondhand RAM offers. Another is the agent exploring a roguelike and clearing its first floor. I've now open-sourced the tool behind these examples. Phone Use connects the AI agent…

1

Oct 4, 2026

Phone Use: control your own Android phone through MCP, without root or ADB (r/mcp)

I'm the author of Phone Use, an MIT-licensed Android app that connects an existing AI agent to your own phone. It exposes screen observations (UI elements and screenshots), taps, swipes, text input and app navigation. No root, ADB or per-app integration is required. For MCP, a local Python stdio…

2

Oct 4, 2026

README

Phone Use

Phone Use

Give AI agents control of your Android phone.

Android 11+ Agent Skill and MCP MIT License

Download APK · Quick start · Examples · Docs

English | 简体中文

Phone Use connects your existing AI agent to your phone through Skill or MCP. The agent can read the screen, tap, swipe, type, and switch apps—no root, ADB, or per-app integration required.

Examples

Compare prices on Xianyu
Collect 29 RAM offers and check item details.

AI browsing secondhand RAM listings on Xianyu and organizing prices by specification

Catch up on QQ messages
Review recent chats and find messages worth a reply.

AI reviewing QQ conversations and summarizing messages that may need a reply

Play a roguelike
Explore, fight, and clear the first floor as a mage.

AI playing a mage, reaching the second dungeon floor, and recapping the run

Discover people on Soul
Follow profiles and summarize their interests.

AI browsing Soul profiles and summarizing the interests of accounts it followed

Quick start

You'll need an Android 11+ phone and an AI agent that can run programs, with Python 3.10+ in its execution environment. Connect the phone and agent's computer to the same Wi-Fi, or another network where the phone is reachable.

  1. Install the app. Download the APK, install it on your phone, and open Phone Use.
  2. Grant permissions. Enable Accessibility and allow notification and local-network permissions when prompted.
  3. Connect your agent. In Connect your AI, select a reachable phone address, tap Copy prompt, and send the whole prompt to your agent. It installs the Skill and starts pairing.

For the first connection, compare the eight-digit code on your phone with the one shown by the agent. If they match, approve on the phone and tell the agent you've confirmed the match.

Pair once, then just ask your agent to use your phone. Pairings survive restarts; removing pairing data or revoking access requires pairing again. Keep the phone awake and unlocked during use.

Manual Skill installation

With Node.js 22.20+, Git, and Python 3.10+ installed:

npx skills add nidhoggfgg/phone-use-skills --skill phone-use

Choose your agent and installation scope, then send it the following, replacing the address with the HTTPS address shown in the app:

Use the phone-use Skill to connect to https://192.168.1.20:8443. Show me the pairing code and wait for my confirmation.

Complete the same code check above. The Skill handles both pairing and phone control; no separate MCP setup is needed.

Features

  • Screen understanding — UI elements and screenshots give agents the context to act.
  • App interaction — Tap, long-press, swipe, scroll, type, launch apps, and navigate.
  • Your agent, your devices — Connect through Skill, MCP, or the Python CLI, with support for multiple phones.
  • On-device authorization — Approve clients on your phone, connect over HTTPS with Skill/MCP, and revoke access at any time.

Documentation

Usage & troubleshooting · Skill & MCP setup · API reference · Build from source

Contributing · Report an issue · Security policy

License

MIT

Languages

Kotlin

70.1%

Python

19.0%

JavaScript

9.2%

HTML

1.2%