Files
DroidDeck/tools/xcloud-player/greenlight/lib/ice.ts
The412Banner c5d7cdc058 Xbox Cloud Gaming: stream from the store and Games tab, native player with DroidDeck frame generation (#1531)
Xbox Cloud Gaming: stream from the store and Games tab, native player with DroidDeck frame generation

Stream Xbox games with Xbox Cloud Gaming (Game Pass) from DroidDeck, outside
the Linux session.

- Backend: `xodus-cli cloud-token` (tools/xbox/droiddeck-cloud-token.patch)
  gets the streaming tokens; they stay in memory.
- Web player (default): the Greenlight player page (tools/xcloud-player, MIT)
  in a WebView, plus Microsoft's own xbox.com/play player. In-stream menu with
  screen effects (sharpen, colour, deband, FXAA, CRT, NTSC, Toon, fps cap),
  stream quality, performance overlay (level, layout, top right / top left)
  and rumble.
- Native player (opt-in, Android 10+, Player engine: Native): Google's WebRTC
  (io.github.webrtc-sdk 125.6422.07, BSD) with the Greenlight protocol ported
  to Kotlin, in its own process (:xcloudnative) with its own instance of
  DroidDeck's compositor. Decoded frames reach the compositor as
  AHardwareBuffers (new stream mode, VK_ANDROID_external_memory_android_
  hardware_buffer import), so DDFG 2x and LSFG 2x/3x/4x run on them. Live
  frame generation, frame-rate target (presets and a 10-165 fps slider, even
  pacing), zero-copy picture, small network buffer, fast decoder, instant
  controller input, overlay with engine and on-screen fps, background end,
  restart and web fallback. It takes the main process's tokens through
  XboxCloudTokenService; they are fetched ahead while a cloud game is shown.
- The compositor requests the dma-buf import extensions only where the driver
  has them (the system driver has none).
- Catalog: cloud availability, Game Pass plan CFQ7TTC0K6L8 counted, library
  filter All / Owned / Game Pass / Cloud, Stream and Add to Games on the store
  page, stream-only Games-tab entries (Stream + Download / Play + Stream).
- Xbox games get VC++ 2015-2022 and the ARM64 runtime registry entries
  (vcredist2022_arm64, built in until the catalog has it) before each launch.
- Controller focus reaches pickers opened from a game page (install location,
  uninstall); Add / Remove from Games keep the focus.

Credits: Greenlight by UnknownSKL (Jim Kroon), MIT, player and protocol;
Better xCloud for the resolution / OS mapping; MGamer404's Bannerlator #627
for the ARM64 runtime approach. Ported from the412banner's Bannerlator.
2026-10-24 23:17:57 -04:00

56 lines
2.0 KiB
TypeScript

import xCloudPlayer from './player'
import Teredo from './teredo'
export default class Ice {
private _peerConnection:RTCPeerConnection
private _iceCandidates: RTCIceCandidate[] = []
constructor(player:xCloudPlayer) {
this._peerConnection = player._peerConnection
this._peerConnection.addEventListener('icecandidate', event => {
if(event.candidate) {
this._iceCandidates.push(event.candidate)
// @TODO: Implement Teredo port selection for remote streaming
}
})
}
getCandidates(){
return this._iceCandidates
}
setRemoteCandidates(candidates:RTCIceCandidate[]){
if(candidates.length === 0){
console.warn('Error: No candidates received!')
}
for(const candidate in candidates){
if(candidates[candidate].candidate === 'a=end-of-candidates') {continue}
const candidateAddress = candidates[candidate].candidate.split(' ')
if(candidateAddress.length > 4 && candidateAddress[4].substr(0, 4) === '2001'){
const teredo = new Teredo(candidateAddress[4])
this._peerConnection.addIceCandidate({
candidate: 'a=candidate:10 1 UDP 1 '+teredo.getIpv4Address()+' 9002 typ host ',
sdpMLineIndex: candidates[candidate].sdpMLineIndex,
sdpMid: candidates[candidate].sdpMid,
})
this._peerConnection.addIceCandidate({
candidate: 'a=candidate:11 1 UDP 1 '+teredo.getIpv4Address()+' '+teredo.getIpv4Port()+' typ host ',
sdpMLineIndex: candidates[candidate].sdpMLineIndex,
sdpMid: candidates[candidate].sdpMid,
})
}
this._peerConnection.addIceCandidate({
candidate: candidates[candidate].candidate,
sdpMid: candidates[candidate].sdpMid,
sdpMLineIndex: candidates[candidate].sdpMLineIndex,
})
}
}
}