How the TestDriver agent behaves on GitHub issues, pull requests, and @mentions
日本語の概要は準備中です。原文の説明を表示しています。
Speed up tests with screenshot-based caching
インストール方法を見るインストールする前に、エージェントに与えられる指示の中身を確認できます。
The cache system makes repeated test runs faster. It compares screenshots to cached results. When the screen did not change much, TestDriver uses the cached element positions again. It does not make an AI call.
The cache works at two levels:
find(), the SDK sends the present screenshot and the cache metadata to the API.cacheKey.screen threshold AND the element template match is more than the element threshold, TestDriver returns the cached position.flowchart LR
A[Screenshot + cacheKey] --> B{Screen Diff\n< threshold?}
B -- Yes --> C{Template\nMatch OK?}
C -- Yes --> D[Return cached position]
B -- No --> E[AI Call - fresh]
C -- No --> F[AI Call - fresh]
const testdriver = new TestDriver({
cache: {
enabled: true,
thresholds: {
find: {
screen: 0.05, // 5% pixel diff allowed (default)
element: 0.8, // 80% OpenCV correlation required (default)
},
assert: 0.05, // 5% pixel diff for assertions (default)
},
},
cacheKey: 'my-custom-key', // overrides auto-generated key
});
<ParamField path="cache" type="CacheConfig | false">
Cache configuration object, or `false` to disable entirely.
<Expandable title="properties">
<ParamField path="enabled" type="boolean" default={true}>
Enable or disable the cache system. Requires a valid `cacheKey` to actually activate.
</ParamField>
<ParamField path="thresholds" type="CacheThresholds">
Threshold configuration for different command types.
<Expandable title="properties">
<ParamField path="find" type="FindCacheThresholds">
Thresholds for `find()` and `findAll()`.
<Expandable title="properties">
<ParamField path="screen" type="number" default={0.05}>
Maximum pixel diff percentage allowed between the current screenshot and the cached screenshot. Lower values require a closer match. Range: `0` to `1`.
</ParamField>
<ParamField path="element" type="number" default={0.8}>
Minimum OpenCV template matching correlation required for the cached element crop. Higher values require a closer match. Range: `0` to `1`. Only used for `find()`, not `findAll()`.
</ParamField>
</Expandable>
</ParamField>
<ParamField path="assert" type="number" default={0.05}>
Maximum pixel diff allowed for assertion cache hits.
</ParamField>
</Expandable>
</ParamField>
</Expandable>
</ParamField>
<ParamField path="cacheKey" type="string">
Unique key for cache lookups. If not provided, an auto-generated key is created from a SHA-256 hash of the calling test file (first 16 hex characters). The cache key changes automatically when your test file changes, providing automatic cache invalidation.
</ParamField>
// Via constructor
const testdriver = new TestDriver({ cache: false });
// Via environment variable
// TD_NO_CACHE=true npx vitest run
When cache is disabled, all thresholds are set to -1 internally, causing the API to skip cache lookups.
Override cache thresholds for individual commands:
// Stricter screen matching for this specific find
const el = await testdriver.find('submit button', {
cache: {
thresholds: { screen: 0.01, element: 0.95 },
},
});
// Custom cache key for a specific assertion
await testdriver.assert('dashboard loaded', {
cache: { threshold: 0.01 },
cacheKey: 'dashboard-check',
});
Thresholds are resolved in priority order (highest wins):
| Priority | Source | Example |
|---|---|---|
| 1 (highest) | Per-command option | find(desc, { cache: { thresholds: { screen: 0.1 } } }) |
| 2 | Legacy number argument | find(desc, 0.1) |
| 3 | Global constructor config | new TestDriver({ cache: { thresholds: { find: { screen: 0.1 } } } }) |
| 4 (lowest) | Hard-coded defaults | screen: 0.05, element: 0.8, assert: 0.05 |
When you don't specify a cacheKey, the SDK automatically generates one:
This means:
// Auto-generated cache key from test file hash
const testdriver = new TestDriver();
// cacheKey = "a3f2b1c4d5e6f7a8" (auto)
// Manual override
const testdriver = new TestDriver({ cacheKey: 'login-test-v2' });
Element cache validation uses OpenCV's normalized cross-correlation coefficient (TM_CCOEFF_NORMED) to verify that the cached element is still visible at the expected position.
Algorithm:
cv.matchTemplate() with TM_CCOEFF_NORMED{ x, y, width, height, centerX, centerY }Scale factors tried: [1, 0.5, 2, 0.75, 1.25, 1.5]
Thresholds tried: [0.9, 0.8, 0.7] (picks highest matching threshold)
This accounts for minor scaling differences between screenshots taken at different times or resolutions.
Cache entries are partitioned by:
cacheKey — identifies the test fileos — operating system (linux, windows, darwin)resolution — screen resolutionThis means cache from a Linux run won't be used for a Windows run, even with the same cache key.
API responses include cache metadata:
| Field | Description |
|---|---|
cacheHit | true if cache was used |
similarity | Pixel diff percentage between screenshots |
cacheSimilarity | OpenCV template match score |
Use getDebugInfo() on an element to inspect cache results:
const el = await testdriver.find('submit button');
const debug = el.getDebugInfo();
console.log(debug);
// { cacheHit: true, similarity: 0.02, cacheSimilarity: 0.92, ... }
interface CacheConfig {
enabled?: boolean; // Default: true
thresholds?: CacheThresholds;
}
interface CacheThresholds {
find?: FindCacheThresholds;
assert?: number; // Default: 0.05
}
interface FindCacheThresholds {
screen?: number; // Default: 0.05
element?: number; // Default: 0.8
}
interface CacheDebugInfo {
cacheHit: boolean;
similarity: number;
cacheSimilarity: number;
}
まだレビューはありません。使ってみた感想をお寄せください。
概要と使いどころ
How the TestDriver agent behaves on GitHub issues, pull requests, and @mentions
日本語の概要は準備中です。原文の説明を表示しています。
Execute natural language tasks using AI
日本語の概要は準備中です。原文の説明を表示しています。
Make AI-powered assertions about screen state
日本語の概要は準備中です。原文の説明を表示しています。
Deploy TestDriver on your AWS infrastructure using CloudFormation
日本語の概要は準備中です。原文の説明を表示しています。
How TestDriver learns your app and caches what it discovers for instant, deterministic replays
日本語の概要は準備中です。原文の説明を表示しています。
1.7x faster test execution with intelligent caching and optimization
日本語の概要は準備中です。原文の説明を表示しています。