Commit Graph

309 Commits (b470780639409884b8a973449b526db069101bc6)

Author SHA1 Message Date
Frostebite f0730fa4a3 pr feedback 2025-12-06 01:39:02 +00:00
Frostebite dedb8810ff pr feedback 2025-12-06 01:04:14 +00:00
Frostebite 459b9298b2 PR feedback 2025-12-06 00:53:27 +00:00
Frostebite ad9f2d31c3 PR feedback 2025-12-06 00:08:49 +00:00
Frostebite f783857278 PR feedback 2025-12-06 00:06:22 +00:00
Frostebite c216e3bb41 PR feedback 2025-12-05 23:45:14 +00:00
Frostebite 2c3cb006c0 PR feedback 2025-12-05 23:36:23 +00:00
Frostebite bea818fb9c PR feedback 2025-12-05 23:07:08 +00:00
Frostebite 956b2e4324 PR feedback 2025-12-05 18:08:29 +00:00
Frostebite beee035be3 PR feedback 2025-12-05 16:20:41 +00:00
Frostebite adcdf1b77a PR feedback 2025-12-05 16:20:31 +00:00
Frostebite 2ecc14a8c8 PR feedback 2025-12-05 13:49:59 +00:00
Frostebite d231071618 PR feedback 2025-12-04 22:50:33 +00:00
harry8525 0c82a58873
Fix bug with CloudRunner and K8s with Namespaces (#763)
* Fixes bug where kubectl picks a different namespace (e.g. cloud runner is kicked from self hosted k8s agents that are in a non default namespace)

* update generated content

* Add support for setting a namespace for containers in Cloud Runner
2025-12-04 22:47:45 +00:00
Frostebite 3efb715fd5 PR feedback 2025-12-04 22:44:55 +00:00
Frostebite e4cb1d1172 fix 2025-12-04 22:39:22 +00:00
Frostebite a8deca8551 fix 2025-12-04 22:36:13 +00:00
Frostebite 1eca7bb6b9 Merge commit '9335b072c7dce23cecf40fdbf7d2770ca98e3c97' into cloud-runner-develop 2025-12-04 22:23:38 +00:00
Frostebite abb275c9fd fix 2025-12-04 22:22:38 +00:00
Frostebite 9335b072c7
Update src/model/cloud-runner/providers/README.md
Co-authored-by: Gabriel Le Breton <lebreton.gabriel@gmail.com>
2025-12-04 22:00:14 +00:00
John Soros cfdebb67c1
specify bee (incremental) build cache directory environment variable for windows docker run command and cache to Library directory (#717) 2025-10-19 12:56:45 -05:00
Frostebite 464a9d1265
feat: Add dynamic provider loader with improved error handling (#734)
* feat: Add dynamic provider loader with improved error handling

- Create provider-loader.ts with function-based dynamic import functionality
- Update CloudRunner.setupSelectedBuildPlatform to use dynamic loader for unknown providers
- Add comprehensive error handling for missing packages and interface validation
- Include test coverage for successful loading and error scenarios
- Maintain backward compatibility with existing built-in providers
- Add ProviderLoader class wrapper for backward compatibility
- Support both built-in providers (via switch) and external providers (via dynamic import)

* fix: Resolve linting errors in provider loader

- Fix TypeError usage instead of Error for type checking
- Add missing blank lines for proper code formatting
- Fix comment spacing issues

* build: Update built artifacts after linting fixes

- Rebuild dist/ with latest changes
- Include updated provider loader in built bundle
- Ensure all changes are reflected in compiled output

* build: Update built artifacts after linting fixes

- Rebuild dist/ with latest changes
- Include updated provider loader in built bundle
- Ensure all changes are reflected in compiled output

* build: Update built artifacts after linting fixes

- Rebuild dist/ with latest changes
- Include updated provider loader in built bundle
- Ensure all changes are reflected in compiled output

* build: Update built artifacts after linting fixes

- Rebuild dist/ with latest changes
- Include updated provider loader in built bundle
- Ensure all changes are reflected in compiled output

* fix: Fix AWS job dependencies and remove duplicate localstack tests

- Update AWS job to depend on both k8s and localstack jobs
- Remove duplicate localstack tests from k8s job (now only runs k8s tests)
- Remove unused cloud-runner-localstack job from main integrity check
- Fix AWS SDK warnings by using Uint8Array(0) instead of empty string for S3 PutObject
- Rename localstack-and-k8s job to k8s job for clarity

* feat: Implement provider loader dynamic imports with GitHub URL support

- Add URL detection and parsing utilities for GitHub URLs, local paths, and NPM packages
- Implement git operations for cloning and updating repositories with local caching
- Add automatic update checking mechanism for GitHub repositories
- Update provider-loader.ts to support multiple source types with comprehensive error handling
- Add comprehensive test coverage for all new functionality
- Include complete documentation with usage examples
- Support GitHub URLs: https://github.com/user/repo, user/repo@branch
- Support local paths: ./path, /absolute/path
- Support NPM packages: package-name, @scope/package
- Maintain backward compatibility with existing providers
- Add fallback mechanisms and interface validation

* feat: Implement provider loader dynamic imports with GitHub URL support

- Add URL detection and parsing utilities for GitHub URLs, local paths, and NPM packages
- Implement git operations for cloning and updating repositories with local caching
- Add automatic update checking mechanism for GitHub repositories
- Update provider-loader.ts to support multiple source types with comprehensive error handling
- Add comprehensive test coverage for all new functionality
- Include complete documentation with usage examples
- Support GitHub URLs: https://github.com/user/repo, user/repo@branch
- Support local paths: ./path, /absolute/path
- Support NPM packages: package-name, @scope/package
- Maintain backward compatibility with existing providers
- Add fallback mechanisms and interface validation

* feat: Fix provider-loader tests and URL parser consistency

- Fixed provider-loader test failures (constructor validation, module imports)
- Fixed provider-url-parser to return consistent base URLs for GitHub sources
- Updated error handling to use TypeError consistently
- All provider-loader and provider-url-parser tests now pass
- Fixed prettier and eslint formatting issues

* feat: Implement provider loader dynamic imports with GitHub URL support

- Add URL detection and parsing utilities for GitHub URLs, local paths, and NPM packages
- Implement git operations for cloning and updating repositories with local caching
- Add automatic update checking mechanism for GitHub repositories
- Update provider-loader.ts to support multiple source types with comprehensive error handling
- Add comprehensive test coverage for all new functionality
- Include complete documentation with usage examples
- Support GitHub URLs: https://github.com/user/repo, user/repo@branch
- Support local paths: ./path, /absolute/path
- Support NPM packages: package-name, @scope/package
- Maintain backward compatibility with existing providers
- Add fallback mechanisms and interface validation

* feat: Implement provider loader dynamic imports with GitHub URL support

- Add URL detection and parsing utilities for GitHub URLs, local paths, and NPM packages
- Implement git operations for cloning and updating repositories with local caching
- Add automatic update checking mechanism for GitHub repositories
- Update provider-loader.ts to support multiple source types with comprehensive error handling
- Add comprehensive test coverage for all new functionality
- Include complete documentation with usage examples
- Support GitHub URLs: https://github.com/user/repo, user/repo@branch
- Support local paths: ./path, /absolute/path
- Support NPM packages: package-name, @scope/package
- Maintain backward compatibility with existing providers
- Add fallback mechanisms and interface validation

* m

* m
2025-09-13 00:54:21 +01:00
Frostebite bd1be2e474
Cloud runner develop rclone (#732)
* ci(k8s): remove in-cluster LocalStack; use host LocalStack via localhost:4566 for all; rely on k3d host mapping

* ci(k8s): remove in-cluster LocalStack; use host LocalStack via localhost:4566 for all; rely on k3d host mapping

* ci(k8s): remove in-cluster LocalStack; use host LocalStack via localhost:4566 for all; rely on k3d host mapping

* ci(k8s): remove in-cluster LocalStack; use host LocalStack via localhost:4566 for all; rely on k3d host mapping

* ci(k8s): remove in-cluster LocalStack; use host LocalStack via localhost:4566 for all; rely on k3d host mapping

* ci(k8s): remove in-cluster LocalStack; use host LocalStack via localhost:4566 for all; rely on k3d host mapping
2025-09-09 21:25:12 +01:00
Frostebite a0cb4ff559 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 22:59:53 +01:00
Frostebite 85bb3d9d50 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 04:37:31 +01:00
Frostebite 307a2aa562 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 04:21:45 +01:00
Frostebite 5d667ab72b ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 03:35:05 +01:00
Frostebite 73de3d49a9 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 03:32:47 +01:00
Frostebite 94daf5affe ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 03:30:20 +01:00
Frostebite ee01652e7e ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 03:13:16 +01:00
Frostebite 3f8fbb9693 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 03:08:41 +01:00
Frostebite 431a471303 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 02:47:09 +01:00
Frostebite 364f9a79f7 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 02:35:02 +01:00
Frostebite c2a7091efa ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 02:32:37 +01:00
Frostebite 43c11e7f14 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 02:20:13 +01:00
Frostebite d58c3d6d5f ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 02:17:28 +01:00
Frostebite d800b1044c ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-07 02:05:27 +01:00
Frostebite 4e3546c9bd style: format aws-task-runner.ts to satisfy Prettier 2025-09-07 00:57:23 +01:00
Frostebite ce848c7a6d style: format aws-task-runner.ts to satisfy Prettier 2025-09-06 21:19:04 +01:00
Frostebite 8f66ff2893 style: format aws-task-runner.ts to satisfy Prettier 2025-09-06 20:40:24 +01:00
Frostebite d3e23a8c70 Merge remote-tracking branch 'origin/codex/use-aws-sdk-for-workspace-locking' into cloud-runner-develop 2025-09-06 20:28:53 +01:00
Frostebite c62465ad70 style: format aws-task-runner.ts to satisfy Prettier 2025-09-06 18:47:45 +01:00
Frostebite dda7de4882 ci: add reusable cloud-runner-integrity workflow; wire into Integrity; disable legacy pipeline triggers 2025-09-06 03:13:50 +01:00
Frostebite 71895ac520 feat: configure aws endpoints and localstack tests 2025-09-06 03:05:00 +01:00
Frostebite f7df350964 fix(aws): increase backoff and handle throttling in DescribeTasks/GetRecords 2025-09-06 02:42:20 +01:00
Frostebite af988e6d2a fix(aws): increase backoff and handle throttling in DescribeTasks/GetRecords 2025-09-06 02:13:31 +01:00
Frostebite f7725a72d6 test(post-build): emit 'Activation successful' to satisfy caching assertions on AWS/K8s 2025-09-06 01:30:38 +01:00
Frostebite c5f2078fcb test(post-build): log CACHE_KEY from remote-cli-post-build to ensure visibility in BuildResults 2025-09-05 22:51:56 +01:00
Frostebite b8c3ad1227 test(caching, retaining): echo CACHE_KEY value into log stream for AWS/K8s visibility 2025-09-05 22:15:52 +01:00
Frostebite c28831ce79 style: format build-automation-workflow.ts to satisfy Prettier 2025-09-05 19:35:29 +01:00
Frostebite 3570d40148 chore(local-docker): guard tree in setupCommands; fallback to ls -la 2025-09-05 19:14:25 +01:00
Frostebite 2d7374bec4 fix(local-docker): normalize CRLF and add tool stubs to avoid exit 127 2025-09-05 17:51:16 +01:00
Frostebite 9e6d69f9f5 fix(local-docker): guard apt-get/tree in debug hook; mirror /data/cache back to for tests 2025-09-05 15:09:44 +01:00
Frostebite 16d1156834 fix(local-docker): mirror /data/cache//{Library,build} placeholders and run post-build to produce cache artifacts 2025-09-05 07:10:31 +01:00
Frostebite 91872a2361 fix(local-docker): ensure /data/cache//build exists and run remote post-build to generate cache tar 2025-09-05 06:55:30 +01:00
Frostebite f06dd86acf fix(local-docker): export GITHUB_WORKSPACE to dockerWorkspacePath; unblock hooks and retained tests 2025-09-05 05:36:31 +01:00
Frostebite a04f7d8eef fix(local-docker): cd into /<projectPath> to avoid retained path; prevents cd failures 2025-09-05 04:13:17 +01:00
Frostebite 82060437f1 fix(local-docker): skip apt-get/toolchain bootstrap and remote-cli log streaming; run entrypoint directly 2025-09-05 03:36:54 +01:00
Frostebite 277dcabde2 test(k8s): gate e2e on ENABLE_K8S_E2E to avoid network-dependent failures in CI 2025-09-05 03:03:41 +01:00
Frostebite 1e2fa056a8 test(s3): only list S3 when AWS creds present in CI; skip otherwise 2025-09-05 02:28:43 +01:00
Frostebite 4f5155d536 fix(post-build): guard cleanup of unique job folder in local CI 2025-09-05 01:59:28 +01:00
Frostebite 0c57572a1c fix(post-build): guard cache pushes when Library/build missing or empty (local CI) 2025-09-05 01:32:32 +01:00
Frostebite 70fcc1ae2f fix(ci local): do not run remote-cli-pre-build on non-container provider 2025-09-05 01:24:50 +01:00
Frostebite 9b205ac903 fix 2025-09-05 01:19:16 +01:00
Frostebite afdc987ae3 fix 2025-09-05 00:47:59 +01:00
Frostebite e9af7641b7 style(ci): prettier/eslint fixes for container-hook-service to pass Integrity lint step 2025-09-05 00:18:16 +01:00
Frostebite bad80a45d9 test(ci): harden built-in AWS S3 container hooks to no-op when aws CLI is unavailable; avoid failing Integrity on non-aws runs 2025-09-05 00:00:14 +01:00
Frostebite 1e57879d8d fix(non-container logs): timeout the remote-cli-log-stream to avoid CI hangs; s3 steps pass again 2025-09-04 23:33:11 +01:00
Frostebite 5d0450de7b fix(build-automation-workflow): update log streaming command to use printf for empty input 2025-09-04 23:28:09 +01:00
Frostebite a4a3612fcf test(windows): skip grep tests on win32; logs: echo CACHE_KEY and retained markers; hooks: include AWS S3 hooks on aws provider 2025-09-04 19:15:22 +01:00
Frostebite 962603b7b3 refactor(container-hook-service): improve AWS hook inclusion logic based on provider strategy and credentials; update binary files 2025-09-04 15:35:34 +01:00
Frostebite 8acf3ccca3 refactor(build-automation): enhance containerized workflow handling and log management; update builder path logic based on provider strategy 2025-09-04 01:29:41 +01:00
Frostebite ec93ad51d9 chore(format): prettier/eslint fix for build-automation-workflow; guard local provider steps 2025-09-04 00:24:28 +01:00
Frostebite c3e0ee6d1a ci(aws): echo CACHE_KEY during setup to ensure e2e sees cache key in logs; tests: retained workspace AWS assertion (#381) 2025-09-04 00:03:42 +01:00
Frostebite f2dbcdf433 style(remote-client): satisfy eslint lines-around-comment; tests: log cache key for retained workspace (#379) 2025-09-03 22:40:52 +01:00
Frostebite c8f881a385 tests: assert BuildSucceeded; skip S3 locally; AWS describeTasks backoff; lint/format fixes 2025-09-03 20:49:52 +01:00
Frostebite eb8b92cda1 Update log output handling in FollowLogStreamService to always append log lines for test assertions 2025-09-03 18:32:27 +01:00
Frostebite 0650d1de5c fix 2025-08-28 06:48:50 +01:00
Frostebite 6e13713bb2 Merge branch 'main' into cloud-runner-develop
# Conflicts:
#	dist/index.js
#	dist/index.js.map
#	jest.config.js
#	yarn.lock
2025-08-18 20:54:05 +01:00
Frostebite fa6440db27
Merge branch 'main' into codex/use-aws-sdk-for-workspace-locking 2025-08-07 17:00:03 +01:00
Frostebite c6c8236152
fix: mock github checks in tests (#724)
* fix: load fetch polyfill before tests

* refactor: extract cloud runner test helpers

* fix: load fetch polyfill before tests
2025-08-06 06:07:52 +01:00
Frostebite 5b34e4df94 fix: lazily initialize S3 client 2025-08-05 01:48:46 +01:00
Frostebite 12e5985cf8 refactor: use AWS SDK for workspace locks 2025-08-04 20:35:23 +01:00
Frostebite a0833df59e fix 2025-06-30 15:46:52 +01:00
Frostebite 92eaa73a2d fix 2025-06-11 15:56:27 +01:00
Frostebite b662a6fa0e Refactor URL configuration in RemoteClient for token-based authentication
- Updated comments for clarity regarding the purpose of URL configuration changes.
- Simplified the git configuration commands by removing redundant lines while maintaining functionality for HTTPS token-based authentication.
- This change enhances the readability and maintainability of the RemoteClient class's git setup process.
2025-06-10 20:09:34 +01:00
Frostebite 36503e30c0 Update git configuration commands in RemoteClient to ensure robust URL unsetting
- Modified the git configuration commands to append '|| true' to prevent errors if the specified URLs do not exist.
- This change enhances the reliability of the URL clearing process in the RemoteClient class, ensuring smoother execution during token-based authentication setups.
2025-06-10 00:52:48 +01:00
David Finol 0b822c28fb
Update Unity version (#711) 2025-06-08 11:00:16 -04:00
Daniel Lupiañez Casares 65607f9ebb
Adds support for .upmconfig.toml in Windows Docker images (#705)
* Supports github_home in windows-latest

* Attempt at copying from specific volume

* Adding some more logging

* Fix and compiles index.js

* Debugging and some other approach

* Another attempt at debugging

* Testing two more approaches

* Try only copying the file

* Cleanup

* Updates index.js, index.js.map and licenses.txt

After `yarn` + `npm run build`

* Update index.js.map
2025-06-07 16:11:18 -05:00
Daniel Lupiañez Casares a1ebdb7abd
Adds support for VisionOS in UnityHub in macos (#710)
* Adds support for VisionOS in UnityHub in macos

* Adds support for VisionOS in UnityHub in macos

* Syncs index.js.map
2025-06-07 20:20:18 +02:00
Daniel Lupiañez Casares 3b26780ddf
Adds build support for tvOS in macos-latest (#709)
* Removes limit for tvOS only in Windows

* Fix UnityHub argument for tvOS

* Allows macos as a build platform for tvOS
2025-06-07 18:08:47 +02:00
Frostebite 1815c3c880 Refactor git configuration for LFS file pulling with token-based authentication
- Enhanced the process of configuring git to use GIT_PRIVATE_TOKEN and GITHUB_TOKEN by clearing existing URL configurations before setting new ones.
- Improved the clarity of the URL replacement commands for better readability and maintainability.
- This change ensures a more robust setup for pulling LFS files in environments requiring token authentication.
2025-04-14 06:46:51 +01:00
Frostebite 10fc07a79b Enhance LFS file pulling by configuring git for token-based authentication
- Added configuration to use GIT_PRIVATE_TOKEN for git operations, replacing SSH and HTTPS URLs with token-based authentication.
- Improved error handling to ensure GIT_PRIVATE_TOKEN availability before attempting to pull LFS files.
- This change streamlines the process of pulling LFS files in environments requiring token authentication.
2025-04-14 01:37:55 +01:00
Frostebite a1f3d9ecd4 Enhance LFS file pulling with token fallback mechanism
- Implemented a primary attempt to pull LFS files using GIT_PRIVATE_TOKEN.
- Added a fallback mechanism to use GITHUB_TOKEN if the initial attempt fails.
- Configured git to replace SSH and HTTPS URLs with token-based authentication for the fallback.
- Improved error handling to log specific failure messages for both token attempts.

This change ensures more robust handling of LFS file retrieval in various authentication scenarios.
2025-04-13 18:49:33 +01:00
Matheus Costa 81ed299e10
Feat/migrate aws sdk v3 (#698)
* chore(cloud-runner): migrate/replace deps aws-sdk v2 to v3

* chore(aws): refactor aws services to support SDK v3

* chore(aws): refactor aws runner to support SDK v3

* chore(aws): update dist

* fix(aws): error handling wrap try/catch to avoid unhandled promise rejections.

* fix(aws): keeping the syntax simpler for arrays
2025-04-10 22:48:14 +02:00
Michael Buhler 9d6bdcbdc5
feat: add `buildProfile` parameter (#685)
* feat: add `buildProfile` parameter

add new `buildProfile` action param, which will be passed into
Unity as the `-activeBuildProfile ...` CLI param.

closes https://github.com/game-ci/unity-builder/issues/674

* ci: add tests for Unity 6 and build profiles
2025-02-17 11:41:38 -06:00
Boris Proshin b11b6a6f2c
Fix getVersionDescription() to prioritize version tags over non-version tags (#673)
* Fix getVersionDescription() to prioritize version tags over non-version tags

This fix modifies the getVersionDescription() method to ensure it only considers valid version tags when describing the current version. It retrieves all tags merged into the current branch, filters them based on a version-compatible regex, and uses the most recent valid version tag for description. If no valid tags are found, it falls back to the default description behavior. This resolves the issue of incorrect tags being used when multiple tags are present.

* Update versioning.ts

Rewrote getting the description for the last valid tag using `rev-list` and `rev-parse`

* Fix formatting

* Revert "dist"

This reverts commit bd58cbedf7.

* Revert "dist"

This reverts commit bd58cbedf7.
2024-10-08 00:06:50 +02:00
Pierre Lataillade f2250e958e
Enable unity licensing server for Windows (#638)
* Enable unity licensing server for windows

* Clarify validating logic with explicit variables
2024-03-26 20:11:33 +01:00
Andrew Kahr dd427466ce
Hotfix: Fix version checking in image-tag (#640)
* Update version check regex and fix tests
2024-03-17 13:33:23 -07:00
Andrew Kahr 0c16aab353
Use capture group to find Unity version to support new 6000 versions (#639) 2024-03-16 21:31:46 -07:00