Kurt Himebauch eb190f2dd7 feat(agent): Agent tab refinements: one-state composer, no snapping, notifications, choices, subagents, dictation, game frame, copy, History search (#2626)
* fix(agent): one-state composer with model and usage on top; reading back stays detached while the agent streams

- The composer no longer has a compact reading bar that a first tap expands: the editor is
  always the editor, and the model picker and context ring move to the top beside the menu.
- The pet chat drops its DeeDee title so that top bar gets the whole width.
- Scrolling back stops following new output; new entries and streamed text only scroll the
  list while it is at the bottom, and sending a message resumes following.
- When the editor slides back in or the keyboard rises, a list at the bottom keeps its last
  lines above the editor, even mid-drag.

* fix(agent): a revise while reading back shows the editor it focuses

* feat(agent): dictate a message, and attach what the running game shows

- With nothing typed, the editor's send button dictates instead, through Android's speech
  recognizer; what is heard follows the text already there. It asks for the microphone the
  first time.
- While a game session is open, a camera button attaches the game's current frame. It is
  copied from the game's own surface, as the bottom screen's screenshots are, so the chat or
  drawer over it is not in the picture.

* feat(agent): a notification when a turn ends unseen, and replies that end in choices offer them as buttons

- A turn that ends while neither the Agent page nor the pet is in view posts a notification:
  finished, failed or asking, with the reply's first line. Opening the Agent page clears it.
- Claude Code's question tool is not available in print mode, so the brief asks the agent to
  end a reply with a choices block instead. The chat shows its options as buttons, and the one
  picked is sent as the next message.

* feat(agent): a subagent's work shows under the call that started it

Claude Code tags a subagent's messages with the call that started it. Its text, thinking and
streamed deltas used to show as the main agent's reply, and its tool calls mixed into the
turn. Now only its tool calls are kept, stored with their parent, and shown inside the
parent's card: a live line with the step count and the latest call, and every call when
the card is opened. Its token counts no longer overwrite the context reading.

* feat(agent): copy a reply or a tool's text, and open a turn's changes in one place

- A turn's footer has a copy button for everything the agent said in it, and tool input and
  output boxes have one each.
- The files-changed chip opens every edit the turn made, file by file.

* feat(agent): search conversations in History

A field above the list keeps the conversations whose title, messages or replies hold the
text, ignoring case. Chat files are read off the main thread, a quarter second after the
last keystroke.

* fix(agent): sending while reading back jumps to the latest

* feat(agent): manage Claude Code's MCP servers and skills from the Agent menu

A new panel lists the MCP servers claude mcp list reports, adds one for every project from a
URL (over HTTP) or a start command (over stdio), and removes it; connectors from the
claude.ai account are listed but managed there. It also lists the skills in
~/.claude/skills with their descriptions, and deletes one after a confirming second tap.

* fix(agent): review follow-ups for the Agent tab refinements

- Choices only come from one fenced block that ends the reply.
- The Agent page counts as on screen only while its activity is started, so a turn ending
  during a game still notifies.
- Picking a choice or Go jumps to the latest like sending does.
- Dictation stops when the chat is hidden or the keyboard sends; stopping it by hand keeps
  the recognizer until its final result.
- A failed JPEG encode is not attached.
- The copied reply is read from the turn each time.
- MCP start commands keep their quoted arguments; the CLI is read beside its 90 s deadline;
  deleting a skill runs off the main thread and removes links without following them.

* fix(agent): scroll the shrinking list after layout, not during measure

* fix(agent): fence-aware choices parsing; dictation stops overwriting edited drafts

* fix(agent): ignore choices blocks nested in a code fence

* fix(agent): treat tilde fences like backtick fences when finding choices

* test(agent): cover a tilde-fenced choices block
2026-11-14 17:35:54 -05:00
2026-10-13 21:27:42 -04:00
2026-10-13 21:27:42 -04:00
2026-10-13 21:27:42 -04:00
2026-10-13 21:27:42 -04:00

DroidDeck

DroidDeck brings the SteamOS experience to Android: Steam Gaming Mode, full Linux desktop, integration with GOG, Epic Games, Xbox, and other storefronts, Steam VR, and more!

100% open source. No ads. No telemetry. No proprietary components. No source withheld.

Download DroidDeck 0.7.1 Join the DroidDeck Discord

Star History Rank

Droid-Deck%2FDroidDeck | Trendshift Droid-Deck%2FDroidDeck | Trendshift

On a Retroid Pocket Duo: Play Steam from the DroidDeck launcher, open Pac-Man in Steam Big Picture and play it, exit the game, then Switch to Desktop from the Power menu

The official website is droid-deck.dev. Only download DroidDeck from this repository's Releases.

The Library switching source chips, changing the card size and opening the Filter menu A Windows game running through Proton with the on-screen controls Two controllers playing split screen on one handheld The Kubuntu desktop with Discover open

Install

  1. Android 9 or newer on Adreno 730 or newer, or any 8xx. Adreno 6xx, Mali, Xclipse and PowerVR are experimental. Adreno 710 is currently unsupported. No root needed.
  2. About 3 GB free for the runtime, plus 1.1 GB for the desktop and emulators.
  3. Install the APK, install the Linux runtime, press Play and sign in to Steam.
  4. On Android 14 and newer, turn on Disable child process restrictions in Developer options. On Android 12 and 13, Steam's first launch shows a Fix it for me button that walks you through it.

Smart glasses setup is in the support matrix. Release notes are in docs/releases.

Help, Preview builds and device reports are on Discord. For bugs, post in #bug-reports with the zip from Share logs.

Build

Needs Docker, Java 17, the Android SDK and NDK, Rust via rustup, GitHub CLI, Python 3 and zstd.

tools/build_local.sh

The APK lands in app/build/outputs/apk/release/. Install it with tools/deploy_local.sh. After the first run, ./gradlew :app:assembleRelease reuses the prepared inputs. Unit tests run with ./gradlew -PskipRust=true :app:testDebugUnitTest, and the helper and preload suite with bash tools/test_local.sh.

On Windows, see tools/run_windows.ps1 and tools/prepare_windows_runtime.py.

Limits

Compatibility and performance vary by device. Desktop compositing is software rendered, and Firefox sandboxing is reduced under proot.

Credits and licence

DroidDeck is GPL-3.0. Steam and Proton belong to Valve Corporation. VITURE, RayNeo, XREAL, Rokid, REDMAGIC, Nintendo Switch and Joy-Con are trademarks of their owners. This project is not affiliated with any of them.

Runtime, Wine and Proton
  • Runtime, shim, input and controller work build on WinNative and Bannerlator by maxjivi05.
  • mmap ring buffer controller input by ribbit384 (WinNative #345).
  • FEX (MIT) runs x86 code. DroidDeck's build puts the platform name under AT_PLATFORM so sharun AppImages by VHSgunzo (MIT) start through its userland-execve loader (MIT). FEX's code disk cache was checked in its source.
  • x86 AppImages, and arm64 ones whose runtime can't unpack on Android, are unpacked with uruntime by VHSgunzo (MIT), shipped unmodified with its licence.
  • x86 programs linking OpenSSL 3 use the copy in the Steam Linux Runtime 4.0. x86 Linux games get the /etc/asound.conf that pressure-vessel writes.
  • WriteProcessMemory hooks fall back to /proc/<pid>/mem the way Wine's server/ptrace.c did before Wine 11.
  • Wine write watches use userfaultfd support in Proton's dlls/ntdll/unix/virtual.c (LGPL-2.1-or-later). libblsession supplies the arm64 syscall number and answers PAGEMAP_SCAN from /proc/self/pagemap.
  • libblsession runs Wine's arm64 SIGUSR2 context handler (dlls/ntdll/unix/signal_arm64.c, LGPL-2.1-or-later) in place on a frame laid out like Linux's arch/arm64/kernel/signal.c, and serves fill_vm_counters in dlls/ntdll/unix/process.c the kernel's own /proc/<pid>/status.
  • droiddeck-ntsync follows the Linux ntsync semantics in Documentation/userspace-api/ntsync.rst (GPL-2.0).
  • The proot fast path orders bindings like PRoot's path/binding.c (GPL-2.0-or-later).
  • DiRT 3 and DiRT Showdown keep their telemetry socket the way RoccoC's DiRTTelemetryErrorFix (MIT) does, based on the fix by Carsten Gottschling.
  • Zink on PowerVR keeps colour textures in colour with Icenowy Zheng's upstream Mesa fix d55418dae7 (MIT), carried as a runtime patch.
  • Games and AppImage, Flatpak and Snap programs such as emulators use Mesa Turnip's per render pass memory choice. The Steam client and Chromium-based apps keep TU_DEBUG=sysmem.
  • Black Ops III and Dark Souls Remastered start without umu-protonfixes (BSD-2-Clause), whose 311210.py and 570940.py fail under ARM64 Proton.
  • ReSkate (GPL-3.0) by Dingo Shenanigans uses the launch option from its README and D3D12 feature level 12_1.
  • The arm64 client's sign in was checked by reading Steam's saved token with the ConnectCache format from deadlock-api-ingest.
Stores
  • Epic Games and GOG build on Phobos's adaptation of Legendary and gogdl. GOG install script registry entries are read the way Heroic Games Launcher (GPL-3.0) reads them.
  • Epic's official Linux launcher preview runs through FEX. That setup is outside Epic's listed Linux support.
  • The launcher's .deb gets the WebKitGTK and GTK 3 libraries it needs from unmodified Debian 13 packages, following @zooluis's research in #2268.
  • Battle.net is by @kayakyakr. It runs Blizzard's own client in Proton (downloaded from Blizzard, not included) and shows key art from the Battle.net Shop. Without Steam, its games see the pad as an Xbox 360 controller via PROTON_SPOOF_STEAMINPUT_VIDPID in Proton's dlls/winebus.sys.
  • The EA store follows the EA app's protocols as documented by ArmchairDevelopers' Maxima (GPL-3.0): sign-in, the GraphQL queries (included verbatim, since EA matches them by hash), build archives, online activation licences and the LSX game endpoint. The code is DroidDeck's own.
  • Battle.net installs drive Blizzard's Agent the way @barncastle's Battle.Net-Installer does, with requests from wowdev.wiki. Read without taking code: @mubaraknumann's unifideck, @djmittens's neo-mittens bnetswitch, @BCD1210's soju and Lutris's product.db reader.
  • World of Warcraft addon imports replace an addon's folder from a temporary copy, as WowUp does, and read flavour folders the way WoWDeck does. No code from either is used.
  • The World of Warcraft addon Download window searches WoWInterface through its MMOUI API. CurseForge opens in the user's browser, with no API and no key.
  • Xbox games load @domsvoboda's xodus-nexus modules (LGPL-2.1-or-later), including wintypes.dll. Minecraft's GameInput setup was checked against @Wyze3306's BedrockOnLinux (MIT).
  • The Xbox Cloud Gaming player uses the WebRTC client of @unknownskl's Greenlight (MIT), and its offer tweaks and sharpening follow @redphx's Better xCloud (MIT). See tools/xcloud-player/NOTICE.md.
  • The itch.io butler pack ships butler's 7z.so, itch.io's build of 7-Zip by Igor Pavlov (LGPL-2.1, unRAR restriction on RAR code), unmodified. Other archives use Apache Commons Compress and the runtime's bsdtar (libarchive).
  • The Store uses Flatpak (LGPL-2.1) through DroidDeck's own bubblewrap shim. Chromium and Electron apps start directly, since zypak by @refi64 (BSD-3-Clause) always uses Flatpak's spawn portal.
  • Folder sync runs Syncthing (MPL-2.0), built from @researchxxl's syncthing-android fork (MPL-2.0).
Audio, video and HUD
  • Steam audio goes through @The412Banner's DirectAudio PulseAudio sink (LGPL-2.1-or-later), built from tools/directaudio/sink.
  • The DroidDeck HUD is @The412Banner's FusionHUD (GPL-3.0 with an attribution term). Its readings match Valve's MangoHud build (MIT), with frame times from gamescope patch 0125.
  • The HUD's CPU, GPU load, thermal and battery readers come from @xXJSONDeruloXx's work.
  • LSFG frame generation comes from Camille LaVey and the Eden project, following lsfg-vk, ported by @maxjivi05. It needs your own copy of Lossless Scaling and ships none of its shaders.
  • Remote Play decodes through Android's MediaCodec or the FFmpeg (LGPL-2.1-or-later) in Steam's runtime. Qualcomm low latency settings follow Moonlight (GPL-3.0).
  • PipeWire (MIT) sockets use the settings in its module-access.c, and WirePlumber (MIT) keeps those clients at full permissions.
Desktop
  • The KDE pacman repository snapshots Arch Linux ARM and installs with pacman (GPL-2.0-or-later).
  • KWin (GPL-2.0-or-later) is patched to pass on the scroll data its wayland_backend.cpp leaves as a TODO.
  • Read without taking code: Qt's qwaylandinputdevice.cpp and qguiapplication.cpp, Konsole's TerminalDisplay.cpp, and Mesa's u_threaded_context.c and zink_resource.c.
  • The Steam Keyboard window rule follows Valve's steamdeck-kde-presets with Bazzite's 0001-steam-virtual-keyboard.patch.
  • Steam's Browse buttons open a GTK 3 file chooser via PyGObject (LGPL-2.1-or-later), shown over Steam by gamescope (BSD-2-Clause) through GetAppIdFromReaper.
  • The AYN Odin 2 phantom second display was confirmed by @SapphireRhodonite's WatermelonDS 0.0.5 notes and iiSU #363, without taking their code.
Smart glasses
VR, Joy-Con and hand tracking
  • Joy-Con VR ports the arm model from Google's GVR SDK for Unity (Apache-2.0) and adapts the hand skeleton from Valve's OpenVR handskeletonsimulation sample (BSD-3-Clause), which follows Moshi Turner's work in Monado. Index offsets come from Monado's vive_poses.c (BSL-1.0).
  • Joy-Con research: Linux's hid-nintendo by Daniel J. Ogorchock, @dekuNukem's Nintendo_Switch_Reverse_Engineering, SDL and AOSP. Checked against ALVR, OpenComposite, PSMoveSteamVRBridge, @F8LEFT's JoyConVr, @krnelpan1c's Daydream-Controller-SteamVR, @yoyobuae's joyconvr, Moonlight and Dolphin. See docs/third-party/joycon.
  • Camera hand tracking runs Google's MediaPipe Pose Landmarker (Lite), BlazePose GHUM 3D and Hand Landmarker (Apache-2.0) on CameraX frames (Apache-2.0), with usage reports off. Checked against JoyConVr's camera app (MIT).
  • Tracking math: the GVR arm model's accelerometer mode, Eric Foxlin's zero velocity updates, Frosio, Pedersini and Borghese's accelerometer autocalibration, a Kalman filter (Kalman, 1960), Horn's quaternion method (1987) and the 1€ filter (Casiez, Roussel and Vogel, 2012).
  • Gestures follow ALVR's hand_gestures.rs (MIT) and Meta Quest's menu pinch, tuned on HaGRID photos (CC BY-SA 4.0, not included).
  • The glove model follows OpenVR's render model reference, is meshed with surface nets (Gibson, 1998; Mikola Lysenko), and uses Inigo Quilez's smooth minimum, distance field ambient occlusion and polygon distance (MIT). See docs/third-party/handtracking.

Star history

Star history chart
S
Description
No description provided
Readme GPL-3.0
1 GiB
0 Stars 1 Watchers 0 Forks
Languages
Kotlin 51.2%
Python 16.7%
C 15.2%
C++ 7.3%
Rust 3.5%
Other 5.9%