Skip to content

feat(reporting): Add test ID to test data attributes #6

feat(reporting): Add test ID to test data attributes

feat(reporting): Add test ID to test data attributes #6

Triggered via push February 12, 2025 03:20
Status Failure
Total duration 7m 49s
Artifacts 1

ai-unit-test.yml

on: push
Matrix: main
Fit to window
Zoom out
Zoom in

Annotations

11 errors
main (18.19.0)
Process completed with exit code 1.
tests/ai/llm-inspect.test.ts > basic inspect: packages/midscene/src/ai-model/service-caller/index.ts#L202
Error: 401 You didn't provide an API key. You need to provide your API key in an Authorization header using *** (i.e. Authorization: *** or as the password field (with blank username) if you're accessing the API from your browser and are prompted for a username and password. You can obtain an API key from https://platform.openai.com/account/api-keys. ❯ Function.generate ../../node_modules/.pnpm/openai@4.81.0_ws@8.18.0_zod@3.23.8/node_modules/openai/src/error.ts:76:14 ❯ OpenAI.makeStatusError ../../node_modules/.pnpm/openai@4.81.0_ws@8.18.0_zod@3.23.8/node_modules/openai/src/core.ts:435:21 ❯ OpenAI.makeRequest ../../node_modules/.pnpm/openai@4.81.0_ws@8.18.0_zod@3.23.8/node_modules/openai/src/core.ts:499:24 ❯ call src/ai-model/service-caller/index.ts:202:20 ❯ callToGetJSONObject src/ai-model/service-caller/index.ts:297:20 ❯ Module.AiInspectElement src/ai-model/inspect.ts:198:15 ❯ test.timeout tests/ai/llm-inspect.test.ts:11:29 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { status: 401, headers: { 'alt-svc': 'h3=":443"; ma=86400', 'cf-cache-status': 'DYNAMIC', 'cf-ray': '91097a75bf84eb68-ORD', connection: 'keep-alive', 'content-length': '496', 'content-type': 'application/json; charset=utf-8', date: 'Wed, 12 Feb 2025 03:26:39 GMT', server: 'cloudflare', 'set-cookie': '__cf_bm=wtNts3jo1JngTccO_WxVmo33OCDaenWYWqBnu1UElow-1739330799-1.0.1.1-nGeTGAoz.bNMo_x4MXhvauysQJ01oR.KlZodOM5X_8qfWt86ibH5CvL784JG5SBgETFYvQYxJwjPaTmFHs.QCw; path=/; expires=Wed, 12-Feb-25 03:56:39 GMT; domain=.api.openai.com; HttpOnly; Secure; SameSite=None, _cfuvid=.bGcQs55VX.xbItEmk6fO0ImxAaNMAh0E8gQRfRfNcU-1739330799113-0.0.1.1-604800000; path=/; domain=.api.openai.com; HttpOnly; Secure; SameSite=None', 'strict-transport-security': 'max-age=31536000; includeSubDomains; preload', vary: 'Origin', 'x-content-type-options': 'nosniff', 'x-request-id': 'req_02e19da545e5105ce8b3ef46c8237329' }, request_id: 'req_02e19da545e5105ce8b3ef46c8237329', error: { message: 'You didn\'t provide an API key. You need to provide your API key in an Authorization header using *** (i.e. Authorization: *** or as the password field (with blank username) if you\'re accessing the API from your browser and are prompted for a username and password. You can obtain an API key from https://platform.openai.com/account/api-keys.', type: 'invalid_request_error', param: null, code: null }, code: null, param: null }
tests/ai/assert/assert.test.ts > assert > todo pass: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ Module.callAiFn src/ai-model/common.ts:26:3 ❯ Module.AiAssert src/ai-model/inspect.ts:308:50 ❯ tests/ai/assert/assert.test.ts:17:15
tests/ai/assert/assert.test.ts > assert > todo error: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ Module.callAiFn src/ai-model/common.ts:26:3 ❯ Module.AiAssert src/ai-model/inspect.ts:308:50 ❯ tests/ai/assert/assert.test.ts:29:15
tests/ai/extract/extract.test.ts > extract > todo: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ Module.callAiFn src/ai-model/common.ts:26:3 ❯ Module.AiExtractElementInfo src/ai-model/inspect.ts:262:24 ❯ tests/ai/extract/extract.test.ts:14:29
tests/ai/extract/extract.test.ts > extract > online order: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ Module.callAiFn src/ai-model/common.ts:26:3 ❯ Module.AiExtractElementInfo src/ai-model/inspect.ts:262:24 ❯ tests/ai/extract/extract.test.ts:24:29
tests/ai/extract/extract.test.ts > extract > todo obj: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ Module.callAiFn src/ai-model/common.ts:26:3 ❯ Module.AiExtractElementInfo src/ai-model/inspect.ts:262:24 ❯ tests/ai/extract/extract.test.ts:34:29
tests/ai/llm-planning/basic.test.ts > automation - planning > basic run: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ callAiFn src/ai-model/common.ts:26:3 ❯ Module.plan src/ai-model/llm-planning.ts:57:36 ❯ tests/ai/llm-planning/basic.test.ts:15:25
tests/ai/llm-planning/basic.test.ts > automation - planning > todo mvc - input first todo item: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ callAiFn src/ai-model/common.ts:26:3 ❯ Module.plan src/ai-model/llm-planning.ts:57:36 ❯ tests/ai/llm-planning/basic.test.ts:60:27
tests/ai/llm-planning/basic.test.ts > automation - planning > todo mvc - input second todo item: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ callAiFn src/ai-model/common.ts:26:3 ❯ Module.plan src/ai-model/llm-planning.ts:57:36 ❯ tests/ai/llm-planning/basic.test.ts:60:27
tests/ai/llm-planning/basic.test.ts > automation - planning > todo mvc - input third todo item: packages/midscene/src/ai-model/common.ts#L26
AssertionError: Cannot find config for AI model service. You should set it before using. https://midscenejs.com/model-provider.html - Expected + Received - true + false ❯ callAiFn src/ai-model/common.ts:26:3 ❯ Module.plan src/ai-model/llm-planning.ts:57:36 ❯ tests/ai/llm-planning/basic.test.ts:60:27

Artifacts

Produced during runtime
Name Size
test-ai-output
20.2 MB