​
2025-08-08

​
🎥 Android Screen Recording

These features require upgrading to TypeScript SDK version 26 or later.
Added screen recording capabilities to Android boxes for creating tutorials and debugging UI interactions.
const box = await gboxSDK.create({ type: "android" });

console.info("start recording")

await box.action.screenRecordingStart();

console.info("swipe up")

await box.action.swipe({
  direction: "up"
})

console.info("sleep 5 seconds...")

// you can do anything you want here 
await new Promise((resolve) => setTimeout(resolve, 5000));

const result = await box.action.screenRecordingStop();

// you can download the video from the result
console.info(`recording result: ${JSON.stringify(result, null, 2)}`)

​
📱 Android Media Management

Added media file management capabilities for Android devices, including album listing and media operations.
const box = await gboxSDK.create({ type: "android" });

const albums = await box.media.listAlbums()

console.info(albums)
For more media API endpoints, see Media API Docs.

​
🪝 AI Action Progress Callbacks

Since AI Action execution takes time, we provide a series of callbacks to monitor the progress of the entire operation process.
const box = await gboxSDK.create({ type: "android" });

await box.action.ai("open the youtube app", {
  onActionStart: () => {
    console.info("action start")
  },
  onActionEnd: () => {
    console.info("action end")
  }
}
​
2025-07-29
These features require upgrading to [TypeScript SDK version 25](Typescript GboxSDK) or later.

​
UI Action Support for StorageKey Output Format

UI Action now supports outputFormat: "storageKey", allowing gbox.ai to directly store screenshot information. Compared to returning image data directly, StorageKey provides more flexible storage and access options:
  • presigned URL: System-generated temporary access link with a default validity period of 30 minutes
  • storageKey: A storage key that remains valid throughout the box lifecycle (until the box is deleted)
  • Custom presigned URL: Use createPresignedUrl to create presigned URLs with specified expiration times, convenient for returning to LLM models for image analysis
const box = await gboxSDK.create({ type: "android" });

const res = await box.action.screenshot({
  outputFormat: "storageKey"
})

console.info(`presigned url: ${res.presignedUrl}`)

// create custom presigned url
const customPresignedUrl = await box.storage.createPresignedUrl({
  storageKey: res.uri,
  expiresIn: "1h"
});

console.info(`custom presigned url: ${customPresignedUrl}`)

​
Android Multiple APK Installation Support

Added support for installing multiple APK files using ZIP archives, enabling installation of split APKs and bundle applications.

​
Installation Modes

Single APK Installation (default):
  • Upload and install a single APK file
  • Traditional installation method for standalone applications
Multiple APK Installation (ZIP-based):
  • Upload a ZIP archive containing multiple APK files
  • Automatically extracts and installs all APK files in the correct order
  • Essential for modern Android apps that use App Bundle distribution

​
ZIP Archive Structure

When using multiple APK installation, organize your files as follows:
app-bundle.zip
└── app-folder/
    ├── base.apk           (base application)
    ├── config.arm64_v8a.apk  (architecture-specific)
    ├── config.en.apk      (language resources)
    └── config.xxxhdpi.apk (density-specific resources)

​
Usage Examples

Single APK Installation:
const box = await gboxSDK.create({ type: "android" });

const app = await box.app.install({
  apk: "/path/to/single-app.apk"
});

await app.open();
Multiple APK Installation (ZIP):
const box = await gboxSDK.create({ type: "android" });

const app = await box.app.install({
  apk: "/path/to/app-bundle.zip"
});

await app.open();
​
2025-07-21
These features require upgrading to [TypeScript SDK version 22](Typescript GboxSDK) or later.

​
Android Box Command Support

Added direct command execution support for Android boxes, enabling full system-level control through shell commands.
const box = await gboxSDK.create({ type: "android" });

await box.command({
  commands: ["logcat"],
  onStdout: (data) => {
    console.info("---stdout---");
    console.info(data);
  },
  onStderr: (data) => {
    console.info("---stderr---");
    console.error(data);
  },
});

​
Linux Box Support for UI Action / AI Action

Added UI automation and AI-powered action capabilities to Linux boxes, enabling desktop application interaction and programmatic UI operations.
await gboxSDK.create({ type: "linux" });

await box.action.click({
  x: 100,
  y: 100,
});

await box.action.ai("Open the Chrome browser");

​
Linux Box Command / Run Code Streaming Support

Added real-time streaming support for command execution and code running on Linux boxes, providing immediate feedback and live output monitoring.
const box = await gboxSDK.create({ type: "linux" });

const result = await box.command({
  commands: ["for i in {10..1}; do echo $i; echo $i >&2; sleep 1; done"],
  onStdout: (data) => {
    console.info("---stdout---");
    console.info(data);
  },
  onStderr: (data) => {
    console.info("---stderr---");
    console.error(data);
  },
});

console.info(result);

const result2 = await box.runCode({
  code: `
console.log("something xxxx");
console.error("something error")
`,
  language: "typescript",
  onStdout: (data) => {
    console.info("stdout");
    console.info(data);
  },
  onStderr: (data) => {
    console.info("stderr");
    console.error(data);
  },
});

console.info(result);

​
Browser Action Support

Added browser automation capabilities to Linux boxes, enabling programmatic control and interaction with web browsers and tabs.
const box = await gboxSDK.create({ type: "linux" });

const tabs = await box.browser.listTabInfo()

console.info(tabs);