Changelog
AXe releases, loaded from GitHub, with the highlights of each version.
What's Changed
Fixed
axe mirrorno longer ignores a viewer's first touches after it connects again. The host remembered the gesture numbers of the last connection, and a viewer starts from one each time it connects, so it took the new touches for repeats and dropped them: after 17 touches in one connection, the first 17 of the next did nothing, while the Home and app switcher buttons still worked. A host that had served more than 32 gestures dropped a later run of 32 instead. The host now forgets them when a viewer connects or leaves, and lifts a finger that a viewer left down.
Installation
Homebrew
brew tap cameroncooke/axe
brew install axe
Manual
Download AXe-macOS-v2.1.1-universal.tar.gz from the assets below and extract it.
Keep the extracted payload together:
axe
Frameworks/
AXe_AXe.bundle/
Then either run ./axe from the extracted directory or symlink that axe executable onto your PATH without moving it away from Frameworks/ and AXe_AXe.bundle/.
What's Changed
Added
axe serve --udid <UDID>keeps one process open and runs one command per standard input line, answering each with the JSON lineaxe --output jsonprints. Setup happens once, and serve keeps the input broker running between commands, so reading the screen and tapping took about 176 ms instead of 290 ms on an iPhone 17 Pro simulator (146 ms with--minimal-keys). Based on the serve mode proposed in #70 by @alex-hall and @dphurley.describe-ui --minimal-keysreads only label, identifier, value, frame, role, role description, type and enabled state, about 30 ms faster on a Settings screen (#70 by @alex-hall).axe device-port --udid <UDID> --port <port>saves a physical device's service directory port when AXe cannot read it on that Mac. AXe checks the port with the device first and uses it until the device's tunnel is recreated. Without--portit prints a line to paste in Terminal that finds the port withnetstatand saves it (#91).- Agent mode can now see and use web pages.
describe-ui --agent --weblists the links, buttons, text fields, checkboxes, pop-up buttons and search suggestions of the pages on screen aswrefs, andtap --agent --ref w3,type --agent --focus --ref w2andkey,key-comboandkey-sequenceact on them, so an agent can fill in a form, clear a field, pick from a drop-down and move around a site or web app;swipe --agenton the web view's scroll area scrolls the page. Safari sheets also list their Back, Forward, Reload, Share and Open in Safari buttons and the keyboard's Previous, Next and Done; their Close button is not reachable through accessibility. It works in WKWebViews in any app, whether or not they setisInspectable, in Safari, SFSafariViewController and ASWebAuthenticationSession sign-in sheets. Only controls a tap would reach now are listed; the page text is left to screenshots. AXe finds each page with a few hit tests, walks it for controls, and checks the element at a control's point again just before the tap and before each key (when the keyboard covers a field, each key checks only that the same app is still in front). On an iPhone 18 Pro simulator (release build) a capture took about 0.29 s with--weband 0.13 s without, and agent commands without--webare as fast as before (#65). axe mirror --udid <UDID>hosts one booted simulator for the free AXe Mirror app on iPhone and iPad, which shows the simulator's screen live and sends touches back. The screen is streamed as HEVC video at up to 60 frames a second with a bitrate that adapts to the link, and the viewer's touches (one or two fingers) and its Home, app switcher and Lock buttons are replayed on the simulator. The command prints one JSON line per event and runs until Ctrl+C. Connections are encrypted from end to end and go directly between the two devices when they can, through a relay when they cannot. When macOS keepsaxeoff the local network, the host says so (eventwarning, codelocalNetworkBlocked) and puts a viewer on the same network on the relay. It needs an Apple silicon Mac with macOS 14.5 or later. The app's source is inAXeMirror/and can be built without the App Store. See Mirror.axe mirror pairshows a one-time code, as text and as a QR code in the terminal, for the app to scan or type; it works once and for ten minutes. Only paired viewers can connect.axe mirror viewerslists them andaxe mirror unpair <name or ID>removes one.axe mirror --udid <UDID> --demo --demo-app <bundle ID>runs a public demo host: any viewer may connect without pairing, one at a time, and is kept inside one app, with the hardware buttons off, touches from the top and bottom edges dropped and the bitrate capped. The host checks which app is in front and, when it is another, drops the visitor's touches and brings the app back. A demo host uses its own key.- The source of the AXe Mirror app for iPhone and iPad is in AXeMirror/. It shares its protocol files with
axe mirror.
Changed
- AXe is now licensed under the GNU General Public License version 3 only (GPL-3.0-only) instead of the MIT License. Running
axeto test an app does not put that app under the GPL; distributing AXe, or software that contains its code, must follow the GPL, and a commercial licence is available for closed-source use. Releases up to and including v2.0.4, and all source published before this change, remain available under the MIT License. The licence and third-party notices now ship in AXe's resource bundle underlicenses/axe. See Licence. axe typenow types on the simulator's own hardware keyboard layout instead of always sending US key positions, so text arrives as written on German, French, British and other keyboards, including characters that need Option or a dead key. Before,yz@arrived aszy“on a German keyboard and#as£on a British one. AXe reads the layout from the simulator's keyboard settings and the key positions from the layout data in its runtime. This coverstypeon every simulator route (plain,--input-mode selected,--agent), batch type steps andserve.--layout <name>names a layout and--layout ussends US key positions as before. On a physical device--layout <name>types on that layout too, with the layout data of the closest installed simulator runtime; a device does not report the keyboard in use, so it keeps US positions by default and refuses--layout auto. (#81, reported with a first implementation in #95 by @scriptease)axe --output json describe-uinow takes as long as plaindescribe-ui, about 45 ms less on a Settings screen, with the same output.
Fixed
- On an Apple TV simulator, AXe now fails at once with
unsupportedDeviceand says it supports iPhone and iPad simulators. Before,describe-ui,tap,swipeandtouchwaited 60 s and then said the simulator was still starting, anddisplays,screenshot,record-videoandstream-videoprinted internal errors. AXe has never supported tvOS;keyandbuttonstill send their input as before (#69, reported by @ashwin-raghuraman). - On the iPhone Duo with iOS 27.1,
hinge read,hinge set, agent input and the plain screenshot no longer fail with "Motion sample reports invalid angle or velocity". That runtime reports no velocity with any hinge sample; AXe now reads it as 0 and still refuses a sample whose angle is invalid (#87, reported by @WingCH). - On the iPhone Duo Home screen, agent captures no longer list every icon, Dock item and status bar control twice. SpringBoard lists the windows of both screens, and AXe now leaves out the windows sized to the screen that is off, so a ref names one control. On a 27.2 Duo the agent capture took 0.22 s instead of 0.37 s folded and 0.29 s instead of 0.40 s open. Folded Home-screen icon taps that were refused as
targetCoverednow go through. (#87) - An agent tap no longer goes through when its tap point lands on bare background instead of the control. SpringBoard on the iPhone Duo can keep an icon's frame from the other screen's layout, so the frame's centre can be empty wallpaper; AXe now refuses that tap with
targetCoveredand sends nothing, where a copy on the screen that is off used to send a tap that did nothing. (#87) - Physical devices on Macs that hide network connections from AXe no longer fail with "The CoreDevice service directory port was not found" and nothing to do about it. AXe found the port with
netstat, which listed no connections to an ad hoc signed AXe on two Macs with macOS 27.2.1 and an endpoint-security agent, and then with a system log scan that took 8 to 41 s and found nothing for a tunnel older than a day. AXe now reads the port withnettopin about 70 ms and no longer scans the log. When that also fails, the error prints one line to paste in Terminal that finds the port and saves it withaxe device-port(#91, reported by @pbush25 and @Jonathanm10). - On the iPhone Duo's open screen in landscape, and on an iPad in landscape, Home-screen frames now match what is on screen, so agent taps on Dock icons, Home-screen icons and the search button go through instead of being refused as
targetCovered. SpringBoard reports those frames in the screen's unrotated portrait coordinates while apps report rotated ones; AXe now rotates SpringBoard's frames. (#87) - On the iPhone Duo, captures no longer list Home-screen icons from the other screen. SpringBoard hands one screen's icon list the other screen's icons, with that screen's positions; AXe now asks each Home-screen button which screen it is on and leaves out the others. Those icons cannot be named on the screen where they appear, because accessibility does not list them there; tap them by coordinates from a screenshot with the capture's snapshot ID. (#87)
- Plain
describe-ui,tap --idandtap --labelon the iPhone Duo now read only the active screen, as agent mode does, so each Home-screen control appears once with frames that match the screen. Plaindescribe-uitook 0.24 s instead of 0.35 s folded and 0.28 s instead of 0.36 s open. (#87) - When an agent swipe, drag or pinch is refused because AXe cannot place its start point inside the chosen area, the message no longer says the screen moved. It names the gesture, and it says to use coordinates only once a fresh screenshot shows the start point is on that area. (#87)
Installation
Homebrew
brew tap cameroncooke/axe
brew install axe
Manual
Download AXe-macOS-v2.1.0-universal.tar.gz from the assets below and extract it.
Keep the extracted payload together:
axe
Frameworks/
AXe_AXe.bundle/
Then either run ./axe from the extracted directory or symlink that axe executable onto your PATH without moving it away from Frameworks/ and AXe_AXe.bundle/.
What's Changed
Notes fallback: using CHANGELOG entry from
2.0.0for2.0.4.
Physical iPhone and iPad support
AXe now automates connected iPhones and iPads as well as simulators. Pass a device's hardware UDID to the same commands you use on a simulator: screenshots, accessibility reads, taps (by point or by --id, --label or --value), swipes, drags, draw, gestures, typing, keys, buttons, batches, rotate, settings, record-video and stream-video, including native H.264 with --format h264.
axe list-devices
axe doctor --udid "$DEVICE_UDID" # pairing, Developer Mode, disk image, lock state
axe describe-ui --udid "$DEVICE_UDID"
axe tap --id "$ELEMENT_ID" --wait-timeout 15 --udid "$DEVICE_UDID"
Pair the device in Xcode, turn on Developer Mode and keep it unlocked; AXe never does any of these for you. button lock needs --allow-lock, and a command a device cannot run fails with unsupportedOnDevice. Reading a device's screen takes about 1 second plus 44 ms per element. See Physical iPhone and iPad and docs/device-support.md.
iPhone Duo support
Every input, read and capture command works on the dual-screen iPhone Duo simulator, on whichever screen is active, in any fold and orientation. New commands show the screens and move the hinge:
axe displays --udid "$UDID" # each screen's role, size, orientation and the hinge angle
axe hinge set tabletop --udid "$UDID" # 0...180, or closed, tabletop, open
axe rotate left --udid "$UDID" # also works on physical devices
--input-mode selected with --screen-id and --screen-uuid refuses to act if a different screen becomes active, and record-video --follow-active-display records one movie through folds and rotations. See Displays, hinge and rotation and the device reference.
Agent mode
Add --agent to describe-ui, tap, type, swipe, drag, the key commands, slider, touch, gesture double-tap, gesture pinch and batch so an AI agent can drive the UI with every action checked. A capture returns compact rows with a ref for each control. An action names a ref, AXe checks the control is still there, sends the input and returns the new screen, so an agent needs no separate read after each action.
axe describe-ui --agent --view navigation --udid "$UDID"
axe tap --agent --snapshot-id "$SNAPSHOT_ID" --ref e9 --udid "$UDID"
axe type 'Ada' --agent --focus --snapshot-id "$SNAPSHOT_ID" --ref e18 --udid "$UDID"
batch --agent fills a form in one call, and a refusal sends no input and carries a typed code. Agent mode needs no model or API key. See Agent mode and the agent reference.
Structured output and error codes
Put --output json before a command to get one JSON result with a typed payload, or a typed error code instead of a message to parse. Simulators and devices share one set of error codes, and JSON Schema files describe every result.
$ axe --output json tap --id no-such-element --udid "$UDID"
{"command":"tap","data":{},"didError":true,"error":{"code":"elementNotFound","message":"No accessibility element matched --id 'no-such-element'. …"},…}
Text output is shorter and consistent too: state commands print their state, input commands print nothing except tap, slider and batch, and errors read as plain sentences. --verbose adds the full detail without changing the exit status. See Output and errors and schemas/.
Added
- Added
axe settingsfor simulators and devices to change appearance, text size, accessibility settings, VoiceOver, simulated location and the simulator status bar (Xcode 27 or later). See Settings. - Added
axe drawto move one finger through up to 1,000 points. See Swipes, gestures and drawing. - Added long press, double tap and two-finger tap to
tap(--hold,--count 2,--touches 2), on a point or an element. See Taps, typing and keys. - Added
--until-idand--until-labelto scroll presets andswipe, which scroll until an element is on screen, plus--distance,--inside-idand--inside-labelfor scroll presets. - Added the
pinch,double-tap,rotate,two-finger-tap,two-finger-holdandtwo-finger-swipegestures, aswipe-from-top-right-cornerpreset that opens Control Centre, and--edge-insetfor edge swipes. - Added
drag --holdto rest the finger before moving, for reordering a list. - Added
slider --endpoint minimum|maximum. - Added
shutdownfor one simulator andclipboard copy --stdinto put text in a simulator's clipboard. See Simulator shutdown and clipboard. - Added the experimental
axe agent "<goal>"command, which works towards a plain-language goal one checked action at a time using TypeSafe AI's Jev model. See docs/agent.md. - Added Claude Code and Codex plugin marketplaces, so the AXe skill stays updated as releases ship (#64 by @tal). See AI skill.
Changed
- Simulator input and screen reads are much faster than in v1.8.0 (measured on an iPhone 18 Pro simulator): a tap takes about 0.08 s instead of about 1 s, a drag 0.9 s instead of 2.5 s, and
describe-ui0.3 s instead of 1.1 to 1.9 s. - Every command's
--helpis rewritten with a short description, examples and one-line option help, and help that was wrong is corrected. - The AXe skill that
axe initinstalls is rewritten around agent mode.
Fixed
- Fixed a command sent straight after
button homeon Xcode 27.2 failing withDTUHID guest barrier timed out. - Fixed a command intermittently failing with
setsockopt(SO_RCVTIMEO) failed: Invalid argument. - Fixed
touchleaving a finger held down after a--delayover 10 seconds, or aftertouch --downwas left without--up. - Fixed an uncaught Objective-C exception crashing AXe; it now prints the exception and exits with 70 (#77 by @sbadakhc).
- Fixed an accessibility read in the first seconds after boot breaking accessibility until the simulator was rebooted (#68).
- Fixed gesture presets on iPads and large iPhones acting on a 390×844 corner of the screen instead of the whole screen.
- Fixed
stream-videosending PNG data as JPEG frames, and MJPEG streams whose frame boundaries did not match their header. - Fixed
axe initleaving out the skill's reference files. - Fixed
tapprinting its error twice when a selector matched nothing, andbatchhiding a step's validation message. - Fixed
touch --helpexamples using options that do not exist (#80 by @demrom).
Various other internal improvements to stability, performance, and code quality.
Removed
- Building from source no longer clones IDB: its frameworks are in
Packages/IDBKit, and theIDB_CHECKOUT_DIR,IDB_GIT_URL,IDB_GIT_REFandIDB_UPSTREAM_BASE_REFbuild settings are gone.
Installation
Homebrew
brew tap cameroncooke/axe
brew install axe
Manual
Download AXe-macOS-v2.0.4-universal.tar.gz from the assets below and extract it.
Keep the extracted payload together:
axe
Frameworks/
AXe_AXe.bundle/
Then either run ./axe from the extracted directory or symlink that axe executable onto your PATH without moving it away from Frameworks/ and AXe_AXe.bundle/.
What's Changed
Notes fallback: using CHANGELOG entry from
2.0.0for2.0.3.
Physical iPhone and iPad support
AXe now automates connected iPhones and iPads as well as simulators. Pass a device's hardware UDID to the same commands you use on a simulator: screenshots, accessibility reads, taps (by point or by --id, --label or --value), swipes, drags, draw, gestures, typing, keys, buttons, batches, rotate, settings, record-video and stream-video, including native H.264 with --format h264.
axe list-devices
axe doctor --udid "$DEVICE_UDID" # pairing, Developer Mode, disk image, lock state
axe describe-ui --udid "$DEVICE_UDID"
axe tap --id "$ELEMENT_ID" --wait-timeout 15 --udid "$DEVICE_UDID"
Pair the device in Xcode, turn on Developer Mode and keep it unlocked; AXe never does any of these for you. button lock needs --allow-lock, and a command a device cannot run fails with unsupportedOnDevice. Reading a device's screen takes about 1 second plus 44 ms per element. See Physical iPhone and iPad and docs/device-support.md.
iPhone Duo support
Every input, read and capture command works on the dual-screen iPhone Duo simulator, on whichever screen is active, in any fold and orientation. New commands show the screens and move the hinge:
axe displays --udid "$UDID" # each screen's role, size, orientation and the hinge angle
axe hinge set tabletop --udid "$UDID" # 0...180, or closed, tabletop, open
axe rotate left --udid "$UDID" # also works on physical devices
--input-mode selected with --screen-id and --screen-uuid refuses to act if a different screen becomes active, and record-video --follow-active-display records one movie through folds and rotations. See Displays, hinge and rotation and the device reference.
Agent mode
Add --agent to describe-ui, tap, type, swipe, drag, the key commands, slider, touch, gesture double-tap, gesture pinch and batch so an AI agent can drive the UI with every action checked. A capture returns compact rows with a ref for each control. An action names a ref, AXe checks the control is still there, sends the input and returns the new screen, so an agent needs no separate read after each action.
axe describe-ui --agent --view navigation --udid "$UDID"
axe tap --agent --snapshot-id "$SNAPSHOT_ID" --ref e9 --udid "$UDID"
axe type 'Ada' --agent --focus --snapshot-id "$SNAPSHOT_ID" --ref e18 --udid "$UDID"
batch --agent fills a form in one call, and a refusal sends no input and carries a typed code. Agent mode needs no model or API key. See Agent mode and the agent reference.
Structured output and error codes
Put --output json before a command to get one JSON result with a typed payload, or a typed error code instead of a message to parse. Simulators and devices share one set of error codes, and JSON Schema files describe every result.
$ axe --output json tap --id no-such-element --udid "$UDID"
{"command":"tap","data":{},"didError":true,"error":{"code":"elementNotFound","message":"No accessibility element matched --id 'no-such-element'. …"},…}
Text output is shorter and consistent too: state commands print their state, input commands print nothing except tap, slider and batch, and errors read as plain sentences. --verbose adds the full detail without changing the exit status. See Output and errors and schemas/.
Added
- Added
axe settingsfor simulators and devices to change appearance, text size, accessibility settings, VoiceOver, simulated location and the simulator status bar (Xcode 27 or later). See Settings. - Added
axe drawto move one finger through up to 1,000 points. See Swipes, gestures and drawing. - Added long press, double tap and two-finger tap to
tap(--hold,--count 2,--touches 2), on a point or an element. See Taps, typing and keys. - Added
--until-idand--until-labelto scroll presets andswipe, which scroll until an element is on screen, plus--distance,--inside-idand--inside-labelfor scroll presets. - Added the
pinch,double-tap,rotate,two-finger-tap,two-finger-holdandtwo-finger-swipegestures, aswipe-from-top-right-cornerpreset that opens Control Centre, and--edge-insetfor edge swipes. - Added
drag --holdto rest the finger before moving, for reordering a list. - Added
slider --endpoint minimum|maximum. - Added
shutdownfor one simulator andclipboard copy --stdinto put text in a simulator's clipboard. See Simulator shutdown and clipboard. - Added the experimental
axe agent "<goal>"command, which works towards a plain-language goal one checked action at a time using TypeSafe AI's Jev model. See docs/agent.md. - Added Claude Code and Codex plugin marketplaces, so the AXe skill stays updated as releases ship (#64 by @tal). See AI skill.
Changed
- Simulator input and screen reads are much faster than in v1.8.0 (measured on an iPhone 18 Pro simulator): a tap takes about 0.08 s instead of about 1 s, a drag 0.9 s instead of 2.5 s, and
describe-ui0.3 s instead of 1.1 to 1.9 s. - Every command's
--helpis rewritten with a short description, examples and one-line option help, and help that was wrong is corrected. - The AXe skill that
axe initinstalls is rewritten around agent mode.
Fixed
- Fixed a command sent straight after
button homeon Xcode 27.2 failing withDTUHID guest barrier timed out. - Fixed a command intermittently failing with
setsockopt(SO_RCVTIMEO) failed: Invalid argument. - Fixed
touchleaving a finger held down after a--delayover 10 seconds, or aftertouch --downwas left without--up. - Fixed an uncaught Objective-C exception crashing AXe; it now prints the exception and exits with 70 (#77 by @sbadakhc).
- Fixed an accessibility read in the first seconds after boot breaking accessibility until the simulator was rebooted (#68).
- Fixed gesture presets on iPads and large iPhones acting on a 390×844 corner of the screen instead of the whole screen.
- Fixed
stream-videosending PNG data as JPEG frames, and MJPEG streams whose frame boundaries did not match their header. - Fixed
axe initleaving out the skill's reference files. - Fixed
tapprinting its error twice when a selector matched nothing, andbatchhiding a step's validation message. - Fixed
touch --helpexamples using options that do not exist (#80 by @demrom).
Various other internal improvements to stability, performance, and code quality.
Removed
- Building from source no longer clones IDB: its frameworks are in
Packages/IDBKit, and theIDB_CHECKOUT_DIR,IDB_GIT_URL,IDB_GIT_REFandIDB_UPSTREAM_BASE_REFbuild settings are gone.
Installation
Homebrew
brew tap cameroncooke/axe
brew install axe
Manual
Download AXe-macOS-v2.0.3-universal.tar.gz from the assets below and extract it.
Keep the extracted payload together:
axe
Frameworks/
AXe_AXe.bundle/
Then either run ./axe from the extracted directory or symlink that axe executable onto your PATH without moving it away from Frameworks/ and AXe_AXe.bundle/.
What's Changed
Notes fallback: using CHANGELOG entry from
2.0.0for2.0.2.
Physical iPhone and iPad support
AXe now automates connected iPhones and iPads as well as simulators. Pass a device's hardware UDID to the same commands you use on a simulator: screenshots, accessibility reads, taps (by point or by --id, --label or --value), swipes, drags, draw, gestures, typing, keys, buttons, batches, rotate, settings, record-video and stream-video, including native H.264 with --format h264.
axe list-devices
axe doctor --udid "$DEVICE_UDID" # pairing, Developer Mode, disk image, lock state
axe describe-ui --udid "$DEVICE_UDID"
axe tap --id "$ELEMENT_ID" --wait-timeout 15 --udid "$DEVICE_UDID"
Pair the device in Xcode, turn on Developer Mode and keep it unlocked; AXe never does any of these for you. button lock needs --allow-lock, and a command a device cannot run fails with unsupportedOnDevice. Reading a device's screen takes about 1 second plus 44 ms per element. See Physical iPhone and iPad and docs/device-support.md.
iPhone Duo support
Every input, read and capture command works on the dual-screen iPhone Duo simulator, on whichever screen is active, in any fold and orientation. New commands show the screens and move the hinge:
axe displays --udid "$UDID" # each screen's role, size, orientation and the hinge angle
axe hinge set tabletop --udid "$UDID" # 0...180, or closed, tabletop, open
axe rotate left --udid "$UDID" # also works on physical devices
--input-mode selected with --screen-id and --screen-uuid refuses to act if a different screen becomes active, and record-video --follow-active-display records one movie through folds and rotations. See Displays, hinge and rotation and the device reference.
Agent mode
Add --agent to describe-ui, tap, type, swipe, drag, the key commands, slider, touch, gesture double-tap, gesture pinch and batch so an AI agent can drive the UI with every action checked. A capture returns compact rows with a ref for each control. An action names a ref, AXe checks the control is still there, sends the input and returns the new screen, so an agent needs no separate read after each action.
axe describe-ui --agent --view navigation --udid "$UDID"
axe tap --agent --snapshot-id "$SNAPSHOT_ID" --ref e9 --udid "$UDID"
axe type 'Ada' --agent --focus --snapshot-id "$SNAPSHOT_ID" --ref e18 --udid "$UDID"
batch --agent fills a form in one call, and a refusal sends no input and carries a typed code. Agent mode needs no model or API key. See Agent mode and the agent reference.
Structured output and error codes
Put --output json before a command to get one JSON result with a typed payload, or a typed error code instead of a message to parse. Simulators and devices share one set of error codes, and JSON Schema files describe every result.
$ axe --output json tap --id no-such-element --udid "$UDID"
{"command":"tap","data":{},"didError":true,"error":{"code":"elementNotFound","message":"No accessibility element matched --id 'no-such-element'. …"},…}
Text output is shorter and consistent too: state commands print their state, input commands print nothing except tap, slider and batch, and errors read as plain sentences. --verbose adds the full detail without changing the exit status. See Output and errors and schemas/.
Added
- Added
axe settingsfor simulators and devices to change appearance, text size, accessibility settings, VoiceOver, simulated location and the simulator status bar (Xcode 27 or later). See Settings. - Added
axe drawto move one finger through up to 1,000 points. See Swipes, gestures and drawing. - Added long press, double tap and two-finger tap to
tap(--hold,--count 2,--touches 2), on a point or an element. See Taps, typing and keys. - Added
--until-idand--until-labelto scroll presets andswipe, which scroll until an element is on screen, plus--distance,--inside-idand--inside-labelfor scroll presets. - Added the
pinch,double-tap,rotate,two-finger-tap,two-finger-holdandtwo-finger-swipegestures, aswipe-from-top-right-cornerpreset that opens Control Centre, and--edge-insetfor edge swipes. - Added
drag --holdto rest the finger before moving, for reordering a list. - Added
slider --endpoint minimum|maximum. - Added
shutdownfor one simulator andclipboard copy --stdinto put text in a simulator's clipboard. See Simulator shutdown and clipboard. - Added the experimental
axe agent "<goal>"command, which works towards a plain-language goal one checked action at a time using TypeSafe AI's Jev model. See docs/agent.md. - Added Claude Code and Codex plugin marketplaces, so the AXe skill stays updated as releases ship (#64 by @tal). See AI skill.
Changed
- Simulator input and screen reads are much faster than in v1.8.0 (measured on an iPhone 18 Pro simulator): a tap takes about 0.08 s instead of about 1 s, a drag 0.9 s instead of 2.5 s, and
describe-ui0.3 s instead of 1.1 to 1.9 s. - Every command's
--helpis rewritten with a short description, examples and one-line option help, and help that was wrong is corrected. - The AXe skill that
axe initinstalls is rewritten around agent mode.
Fixed
- Fixed a command sent straight after
button homeon Xcode 27.2 failing withDTUHID guest barrier timed out. - Fixed a command intermittently failing with
setsockopt(SO_RCVTIMEO) failed: Invalid argument. - Fixed
touchleaving a finger held down after a--delayover 10 seconds, or aftertouch --downwas left without--up. - Fixed an uncaught Objective-C exception crashing AXe; it now prints the exception and exits with 70 (#77 by @sbadakhc).
- Fixed an accessibility read in the first seconds after boot breaking accessibility until the simulator was rebooted (#68).
- Fixed gesture presets on iPads and large iPhones acting on a 390×844 corner of the screen instead of the whole screen.
- Fixed
stream-videosending PNG data as JPEG frames, and MJPEG streams whose frame boundaries did not match their header. - Fixed
axe initleaving out the skill's reference files. - Fixed
tapprinting its error twice when a selector matched nothing, andbatchhiding a step's validation message. - Fixed
touch --helpexamples using options that do not exist (#80 by @demrom).
Various other internal improvements to stability, performance, and code quality.
Removed
- Building from source no longer clones IDB: its frameworks are in
Packages/IDBKit, and theIDB_CHECKOUT_DIR,IDB_GIT_URL,IDB_GIT_REFandIDB_UPSTREAM_BASE_REFbuild settings are gone.
Installation
Homebrew
brew tap cameroncooke/axe
brew install axe
Manual
Download AXe-macOS-v2.0.2-universal.tar.gz from the assets below and extract it.
Keep the extracted payload together:
axe
Frameworks/
AXe_AXe.bundle/
Then either run ./axe from the extracted directory or symlink that axe executable onto your PATH without moving it away from Frameworks/ and AXe_AXe.bundle/.
What's Changed
Notes fallback: using CHANGELOG entry from
2.0.0for2.0.1.
Physical iPhone and iPad support
AXe now automates connected iPhones and iPads as well as simulators. Pass a device's hardware UDID to the same commands you use on a simulator: screenshots, accessibility reads, taps (by point or by --id, --label or --value), swipes, drags, draw, gestures, typing, keys, buttons, batches, rotate, settings, record-video and stream-video, including native H.264 with --format h264.
axe list-devices
axe doctor --udid "$DEVICE_UDID" # pairing, Developer Mode, disk image, lock state
axe describe-ui --udid "$DEVICE_UDID"
axe tap --id "$ELEMENT_ID" --wait-timeout 15 --udid "$DEVICE_UDID"
Pair the device in Xcode, turn on Developer Mode and keep it unlocked; AXe never does any of these for you. button lock needs --allow-lock, and a command a device cannot run fails with unsupportedOnDevice. Reading a device's screen takes about 1 second plus 44 ms per element. See Physical iPhone and iPad and docs/device-support.md.
iPhone Duo support
Every input, read and capture command works on the dual-screen iPhone Duo simulator, on whichever screen is active, in any fold and orientation. New commands show the screens and move the hinge:
axe displays --udid "$UDID" # each screen's role, size, orientation and the hinge angle
axe hinge set tabletop --udid "$UDID" # 0...180, or closed, tabletop, open
axe rotate left --udid "$UDID" # also works on physical devices
--input-mode selected with --screen-id and --screen-uuid refuses to act if a different screen becomes active, and record-video --follow-active-display records one movie through folds and rotations. See Displays, hinge and rotation and the device reference.
Agent mode
Add --agent to describe-ui, tap, type, swipe, drag, the key commands, slider, touch, gesture double-tap, gesture pinch and batch so an AI agent can drive the UI with every action checked. A capture returns compact rows with a ref for each control. An action names a ref, AXe checks the control is still there, sends the input and returns the new screen, so an agent needs no separate read after each action.
axe describe-ui --agent --view navigation --udid "$UDID"
axe tap --agent --snapshot-id "$SNAPSHOT_ID" --ref e9 --udid "$UDID"
axe type 'Ada' --agent --focus --snapshot-id "$SNAPSHOT_ID" --ref e18 --udid "$UDID"
batch --agent fills a form in one call, and a refusal sends no input and carries a typed code. Agent mode needs no model or API key. See Agent mode and the agent reference.
Structured output and error codes
Put --output json before a command to get one JSON result with a typed payload, or a typed error code instead of a message to parse. Simulators and devices share one set of error codes, and JSON Schema files describe every result.
$ axe --output json tap --id no-such-element --udid "$UDID"
{"command":"tap","data":{},"didError":true,"error":{"code":"elementNotFound","message":"No accessibility element matched --id 'no-such-element'. …"},…}
Text output is shorter and consistent too: state commands print their state, input commands print nothing except tap, slider and batch, and errors read as plain sentences. --verbose adds the full detail without changing the exit status. See Output and errors and schemas/.
Added
- Added
axe settingsfor simulators and devices to change appearance, text size, accessibility settings, VoiceOver, simulated location and the simulator status bar (Xcode 27 or later). See Settings. - Added
axe drawto move one finger through up to 1,000 points. See Swipes, gestures and drawing. - Added long press, double tap and two-finger tap to
tap(--hold,--count 2,--touches 2), on a point or an element. See Taps, typing and keys. - Added
--until-idand--until-labelto scroll presets andswipe, which scroll until an element is on screen, plus--distance,--inside-idand--inside-labelfor scroll presets. - Added the
pinch,double-tap,rotate,two-finger-tap,two-finger-holdandtwo-finger-swipegestures, aswipe-from-top-right-cornerpreset that opens Control Centre, and--edge-insetfor edge swipes. - Added
drag --holdto rest the finger before moving, for reordering a list. - Added
slider --endpoint minimum|maximum. - Added
shutdownfor one simulator andclipboard copy --stdinto put text in a simulator's clipboard. See Simulator shutdown and clipboard. - Added the experimental
axe agent "<goal>"command, which works towards a plain-language goal one checked action at a time using TypeSafe AI's Jev model. See docs/agent.md. - Added Claude Code and Codex plugin marketplaces, so the AXe skill stays updated as releases ship (#64 by @tal). See AI skill.
Changed
- Simulator input and screen reads are much faster than in v1.8.0 (measured on an iPhone 18 Pro simulator): a tap takes about 0.08 s instead of about 1 s, a drag 0.9 s instead of 2.5 s, and
describe-ui0.3 s instead of 1.1 to 1.9 s. - Every command's
--helpis rewritten with a short description, examples and one-line option help, and help that was wrong is corrected. - The AXe skill that
axe initinstalls is rewritten around agent mode.
Fixed
- Fixed a command sent straight after
button homeon Xcode 27.2 failing withDTUHID guest barrier timed out. - Fixed a command intermittently failing with
setsockopt(SO_RCVTIMEO) failed: Invalid argument. - Fixed
touchleaving a finger held down after a--delayover 10 seconds, or aftertouch --downwas left without--up. - Fixed an uncaught Objective-C exception crashing AXe; it now prints the exception and exits with 70 (#77 by @sbadakhc).
- Fixed an accessibility read in the first seconds after boot breaking accessibility until the simulator was rebooted (#68).
- Fixed gesture presets on iPads and large iPhones acting on a 390×844 corner of the screen instead of the whole screen.
- Fixed
stream-videosending PNG data as JPEG frames, and MJPEG streams whose frame boundaries did not match their header. - Fixed
axe initleaving out the skill's reference files. - Fixed
tapprinting its error twice when a selector matched nothing, andbatchhiding a step's validation message. - Fixed
touch --helpexamples using options that do not exist (#80 by @demrom).
Various other internal improvements to stability, performance, and code quality.
Removed
- Building from source no longer clones IDB: its frameworks are in
Packages/IDBKit, and theIDB_CHECKOUT_DIR,IDB_GIT_URL,IDB_GIT_REFandIDB_UPSTREAM_BASE_REFbuild settings are gone.
Installation
Homebrew
brew tap cameroncooke/axe
brew install axe
Manual
Download AXe-macOS-v2.0.1-universal.tar.gz from the assets below and extract it.
Keep the extracted payload together:
axe
Frameworks/
AXe_AXe.bundle/
Then either run ./axe from the extracted directory or symlink that axe executable onto your PATH without moving it away from Frameworks/ and AXe_AXe.bundle/.
What's Changed
Physical iPhone and iPad support
AXe now automates connected iPhones and iPads as well as simulators. Pass a device's hardware UDID to the same commands you use on a simulator: screenshots, accessibility reads, taps (by point or by --id, --label or --value), swipes, drags, draw, gestures, typing, keys, buttons, batches, rotate, settings, record-video and stream-video, including native H.264 with --format h264.
axe list-devices
axe doctor --udid "$DEVICE_UDID" # pairing, Developer Mode, disk image, lock state
axe describe-ui --udid "$DEVICE_UDID"
axe tap --id "$ELEMENT_ID" --wait-timeout 15 --udid "$DEVICE_UDID"
Pair the device in Xcode, turn on Developer Mode and keep it unlocked; AXe never does any of these for you. button lock needs --allow-lock, and a command a device cannot run fails with unsupportedOnDevice. Reading a device's screen takes about 1 second plus 44 ms per element. See Physical iPhone and iPad and docs/device-support.md.
iPhone Duo support
Every input, read and capture command works on the dual-screen iPhone Duo simulator, on whichever screen is active, in any fold and orientation. New commands show the screens and move the hinge:
axe displays --udid "$UDID" # each screen's role, size, orientation and the hinge angle
axe hinge set tabletop --udid "$UDID" # 0...180, or closed, tabletop, open
axe rotate left --udid "$UDID" # also works on physical devices
--input-mode selected with --screen-id and --screen-uuid refuses to act if a different screen becomes active, and record-video --follow-active-display records one movie through folds and rotations. See Displays, hinge and rotation and the device reference.
Agent mode
Add --agent to describe-ui, tap, type, swipe, drag, the key commands, slider, touch, gesture double-tap, gesture pinch and batch so an AI agent can drive the UI with every action checked. A capture returns compact rows with a ref for each control. An action names a ref, AXe checks the control is still there, sends the input and returns the new screen, so an agent needs no separate read after each action.
axe describe-ui --agent --view navigation --udid "$UDID"
axe tap --agent --snapshot-id "$SNAPSHOT_ID" --ref e9 --udid "$UDID"
axe type 'Ada' --agent --focus --snapshot-id "$SNAPSHOT_ID" --ref e18 --udid "$UDID"
batch --agent fills a form in one call, and a refusal sends no input and carries a typed code. Agent mode needs no model or API key. See Agent mode and the agent reference.
Structured output and error codes
Put --output json before a command to get one JSON result with a typed payload, or a typed error code instead of a message to parse. Simulators and devices share one set of error codes, and JSON Schema files describe every result.
$ axe --output json tap --id no-such-element --udid "$UDID"
{"command":"tap","data":{},"didError":true,"error":{"code":"elementNotFound","message":"No accessibility element matched --id 'no-such-element'. …"},…}
Text output is shorter and consistent too: state commands print their state, input commands print nothing except tap, slider and batch, and errors read as plain sentences. --verbose adds the full detail without changing the exit status. See Output and errors and schemas/.
Added
- Added
axe settingsfor simulators and devices to change appearance, text size, accessibility settings, VoiceOver, simulated location and the simulator status bar (Xcode 27 or later). See Settings. - Added
axe drawto move one finger through up to 1,000 points. See Swipes, gestures and drawing. - Added long press, double tap and two-finger tap to
tap(--hold,--count 2,--touches 2), on a point or an element. See Taps, typing and keys. - Added
--until-idand--until-labelto scroll presets andswipe, which scroll until an element is on screen, plus--distance,--inside-idand--inside-labelfor scroll presets. - Added the
pinch,double-tap,rotate,two-finger-tap,two-finger-holdandtwo-finger-swipegestures, aswipe-from-top-right-cornerpreset that opens Control Centre, and--edge-insetfor edge swipes. - Added
drag --holdto rest the finger before moving, for reordering a list. - Added
slider --endpoint minimum|maximum. - Added
shutdownfor one simulator andclipboard copy --stdinto put text in a simulator's clipboard. See Simulator shutdown and clipboard. - Added the experimental
axe agent "<goal>"command, which works towards a plain-language goal one checked action at a time using TypeSafe AI's Jev model. See docs/agent.md. - Added Claude Code and Codex plugin marketplaces, so the AXe skill stays updated as releases ship (#64 by @tal). See AI skill.
Changed
- Simulator input and screen reads are much faster than in v1.8.0 (measured on an iPhone 18 Pro simulator): a tap takes about 0.08 s instead of about 1 s, a drag 0.9 s instead of 2.5 s, and
describe-ui0.3 s instead of 1.1 to 1.9 s. - Every command's
--helpis rewritten with a short description, examples and one-line option help, and help that was wrong is corrected. - The AXe skill that
axe initinstalls is rewritten around agent mode.
Fixed
- Fixed a command sent straight after
button homeon Xcode 27.2 failing withDTUHID guest barrier timed out. - Fixed a command intermittently failing with
setsockopt(SO_RCVTIMEO) failed: Invalid argument. - Fixed
touchleaving a finger held down after a--delayover 10 seconds, or aftertouch --downwas left without--up. - Fixed an uncaught Objective-C exception crashing AXe; it now prints the exception and exits with 70 (#77 by @sbadakhc).
- Fixed an accessibility read in the first seconds after boot breaking accessibility until the simulator was rebooted (#68).
- Fixed gesture presets on iPads and large iPhones acting on a 390×844 corner of the screen instead of the whole screen.
- Fixed
stream-videosending PNG data as JPEG frames, and MJPEG streams whose frame boundaries did not match their header. - Fixed
axe initleaving out the skill's reference files. - Fixed
tapprinting its error twice when a selector matched nothing, andbatchhiding a step's validation message. - Fixed
touch --helpexamples using options that do not exist (#80 by @demrom).
Various other internal improvements to stability, performance, and code quality.
Removed
- Building from source no longer clones IDB: its frameworks are in
Packages/IDBKit, and theIDB_CHECKOUT_DIR,IDB_GIT_URL,IDB_GIT_REFandIDB_UPSTREAM_BASE_REFbuild settings are gone.
Installation
Homebrew
brew tap cameroncooke/axe
brew install axe
Manual
Download AXe-macOS-v2.0.0-universal.tar.gz from the assets below and extract it.
Keep the extracted payload together:
axe
Frameworks/
AXe_AXe.bundle/
Then either run ./axe from the extracted directory or symlink that axe executable onto your PATH without moving it away from Frameworks/ and AXe_AXe.bundle/.
If the live feed is unavailable, the canonical release list is at github.com/cameroncooke/AXe/releases.
Highlights
- v2.0.0: Physical iPhone and iPad support, iPhone Duo simulator support with
displays,hingeandrotate, agent mode (--agent) for AI agents,--output jsonwith typed error codes and JSON Schemas,axe settings,axe draw, long press, double tap and two-finger tap ontap, scroll-until-visible, pinch, rotate and two-finger gestures,shutdown,clipboard copy,list-devices,doctor, the experimentalaxe agentcommand, plugin marketplaces for the skill, and much faster simulator input. See What's New in AXe 2. - v1.8.0: Xcode 27 and iOS 27 simulator automation, with Xcode 26 still supported.
- v1.7.0:
slider --id/--label --valuewith value verification,drag, orientation-aware coordinates, and switch activation through--tap-style. - v1.6.0:
--valuetargeting fortap,--element-type, and--wait-timeoutwith--poll-interval. - v1.5.0:
axe batchandaxe init. - v1.3.0:
key-combo. - v1.2.0: Screenshots, and tap by label or accessibility ID.
- v1.1.0: Video streaming and recording.