Commit Graph

574 Commits (42226d597230d38bf65d236bf8056108bd720de3)

Author SHA1 Message Date
Frostebite 42226d5972 download runner each time 2022-04-19 22:01:33 +01:00
Frostebite 04808b449d garbage collect all older than 1d as part of cleanup 2022-04-19 19:24:53 +01:00
Frostebite 8543c3ca5a download runner each time 2022-04-17 15:25:53 +01:00
Frostebite 391a630b75 download runner each time 2022-04-17 15:09:31 +01:00
Frostebite 06f4b21e3b download runner each time 2022-04-17 14:54:27 +01:00
Frostebite 2622a99bb2 ephemeral runner pipeline 2022-04-17 14:37:12 +01:00
Frostebite e262aec982 ephemeral runner pipeline 2022-04-17 14:20:20 +01:00
Frostebite 67f74da614 ephemeral runner pipeline 2022-04-17 14:04:12 +01:00
Frostebite c7f0b4fcf3 self hosted runner pipeline 2022-04-17 02:22:36 +01:00
Frostebite 8e356f212d self hosted runner pipeline 2022-04-17 02:17:48 +01:00
Frostebite 0727a97fdd self hosted runner pipeline 2022-04-17 02:11:55 +01:00
Frostebite 6e877cbc01 self hosted runner pipeline 2022-04-17 02:09:50 +01:00
Frostebite f211dc47b7 self hosted runner pipeline 2022-04-17 02:03:27 +01:00
Frostebite cf6f489116 self hosted runner pipeline 2022-04-17 01:59:47 +01:00
Frostebite 187897f549 self hosted runner pipeline 2022-04-17 01:55:54 +01:00
Frostebite 55102fb56d self hosted runner pipeline 2022-04-17 01:53:00 +01:00
Frostebite 6daab9d8b3 self hosted runner pipeline 2022-04-17 01:49:25 +01:00
Frostebite d0eda30185 self hosted runner pipeline 2022-04-17 01:45:36 +01:00
Frostebite b2d2a1501a garbage collection 2022-04-16 19:26:00 +01:00
Frostebite eb7bcf718a garbage collection 2022-04-16 19:13:13 +01:00
Frostebite bcd33296b6 github ephemeral pipeline support 2022-04-16 18:40:57 +01:00
Frostebite 08fa25dc30 Merge remote-tracking branch 'origin/main' into cloud-runner-develop
# Conflicts:
#	dist/index.js.map
#	src/model/cloud-runner/providers/aws/aws-task-runner.ts
#	src/model/cloud-runner/providers/aws/index.ts
2022-04-16 18:19:32 +01:00
Frostebite e34cd89c08 github ephemeral pipeline support 2022-04-16 16:13:40 +01:00
Frostebite 3987a5687b github ephemeral pipeline support 2022-04-16 15:20:38 +01:00
Frostebite 9ac98b1f51 Merge remote-tracking branch 'origin/cloud-runner-develop' into cloud-runner-develop 2022-04-16 13:24:22 +01:00
Frostebite 96d34f546d remove du from caching, should run manually if interested in size, adds too much runtime to job to include by default 2022-04-16 13:20:28 +01:00
Frostebite 75d418b96e
Update cloud-runner-aws-pipeline.yml 2022-04-14 20:13:35 +01:00
Frostebite 0a65f6e2a8 cloud-runner-system prefix changed to cloud-runner 2022-04-13 21:31:37 +01:00
Webber Takken 5ae03dfef6
Streamline code styles (#384)
* feat: streamline code styles

* feat: spacing for comments and return statements

* chore: enforce camelcase

* fix: remove npm lock file

* fix: add integrity test

* fix: remove logfile

* chore: update node in test workflow
2022-04-12 00:43:41 +02:00
gnomesley 4be5d2ddf4
Add username and password to mac build.sh (#383) 2022-04-11 22:22:52 +02:00
Frostebite d9b4f816bf Merge branch 'cloud-runner-develop' of https://github.com/game-ci/unity-builder into cloud-runner-develop 2022-04-11 14:40:47 +01:00
Frostebite a61c02481f
Cloud Runner v0 - Reliable and trimmed down cloud runner (#353)
* Update cloud-runner-aws-pipeline.yml

* Update cloud-runner-k8s-pipeline.yml

* yarn build

* yarn build

* correct branch ref

* correct branch ref passed to target repo

* Create k8s-tests.yml

* Delete k8s-tests.yml

* correct branch ref passed to target repo

* correct branch ref passed to target repo

* Always describe AWS tasks for now, because unstable error handling

* Remove unused tree commands

* Use lfs guid sum

* Simple override cache push

* Simple override cache push and pull override to allow pure cloud storage driven caching

* Removal of early branch (breaks lfs caching)

* Remove unused tree commands

* Update action.yml

* Update action.yml

* Support cache and input override commands as input + full support custom hooks

* Increase k8s timeout

* replace filename being appended for unknclear reason

* cache key should not contain whitespaces

* Always try and deploy rook for k8s

* Apply k8s files for rook

* Update action.yml

* Apply k8s files for rook

* Apply k8s files for rook

* cache test and action description for kuber storage class

* Correct test and implement dependency health check and start

* GCP-secret run, cache key

* lfs smudge set explicit and undo explicit

* Run using external secret provider to speed up input

* Update cloud-runner-aws-pipeline.yml

* Add nodejs as build step dependency

* Add nodejs as build step dependency

* Cloud Runner Tests must be specified to capture logs from cloud runner for tests

* Cloud Runner Tests must be specified to capture logs from cloud runner for tests

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* better defaults for new inputs

* better defaults

* merge latest

* force build update

* use npm n to update node in unity builder

* use npm n to update node in unity builder

* use npm n to update node in unity builder

* correct new line

* quiet zipping

* quiet zipping

* default secrets for unity username and password

* default secrets for unity username and password

* ls active directory before lfs install

* Get cloud runner secrets from

* Get cloud runner secrets from

* Cleanup setup of default secrets

* Various fixes

* Cleanup setup of default secrets

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* AWS secrets manager support

* less caching logs

* default k8s storage class to pd-standard

* more readable build commands

* Capture aws exit code 1 reliably

* Always replace /head from branch

* k8s default storage class to standard-rwo

* cleanup

* further cleanup input

* further cleanup input

* further cleanup input

* further cleanup input

* further cleanup input

* folder sizes to inspect caching

* dir command for local cloud runner test

* k8s wait for pending because pvc will not create earlier

* prefer k8s standard storage

* handle empty string as cloud runner cluster input

* local-system is now used for cloud runner test implementation AND correctly unset test CLI input

* local-system is now used for cloud runner test implementation AND correctly unset test CLI input

* fix unterminated quote

* fix unterminated quote

* do not share build parameters in tests - in cloud runner this will cause conflicts with resouces of the same name

* remove head and heads from branch prefix

* fix reversed caching direction of cache-push

* fixes

* fixes

* fixes

* cachePull cli

* fixes

* fixes

* fixes

* fixes

* fixes

* order cache test to be first

* order cache test to be first

* fixes

* populate cache key instead of using branch

* cleanup cli

* garbage-collect-aws cli can iterate over aws resources and cli scans all ts files

* import cli methods

* import cli files explicitly

* import cli files explicitly

* import cli files explicitly

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* log parameters in cloud runner parameter test

* log parameters in cloud runner parameter test

* log parameters in cloud runner parameter test

* Cloud runner param test before caching because we have a fast local cache test now

* Using custom build path relative to repo root rather than project root

* aws-garbage-collect at end of pipeline

* aws-garbage-collect do not actually delete anything for now - just list

* remove some legacy du commands

* Update cloud-runner-aws-pipeline.yml

* log contents after cache pull and fix some scenarios with duplicate secrets

* log contents after cache pull and fix some scenarios with duplicate secrets

* log contents after cache pull and fix some scenarios with duplicate secrets

* PR comments

* Replace guid with uuid package

* use fileExists lambda instead of stat to check file exists in caching

* build failed results in core error message

* Delete sample.txt
2022-04-11 00:00:37 +01:00
Frostebite 9f42bc9ddc Delete sample.txt 2022-04-10 23:24:13 +01:00
Frostebite 8b944a640a build failed results in core error message 2022-04-10 23:17:25 +01:00
Frostebite 76d9019b01 use fileExists lambda instead of stat to check file exists in caching 2022-04-10 23:11:36 +01:00
Frostebite e4c0fbfa6f Replace guid with uuid package 2022-04-10 23:05:17 +01:00
Frostebite f2a9adf736 PR comments 2022-04-10 23:01:03 +01:00
Frostebite a28bf4fc3a log contents after cache pull and fix some scenarios with duplicate secrets 2022-04-10 16:37:43 +01:00
Frostebite 30410eaaac log contents after cache pull and fix some scenarios with duplicate secrets 2022-04-10 15:41:15 +01:00
Frostebite db3be9e174 Merge remote-tracking branch 'origin/cloud-runner-develop' into cloud-runner-develop 2022-04-10 15:32:05 +01:00
Frostebite 7913901814 log contents after cache pull and fix some scenarios with duplicate secrets 2022-04-10 15:29:51 +01:00
Frostebite 40dd6b8b37
Update cloud-runner-aws-pipeline.yml 2022-04-10 01:18:44 +01:00
Frostebite cd86d9403e remove some legacy du commands 2022-04-10 00:54:31 +01:00
Frostebite 09c06d936d aws-garbage-collect do not actually delete anything for now - just list 2022-04-09 14:42:09 +01:00
Frostebite 3648e43fc5 aws-garbage-collect at end of pipeline 2022-04-09 14:10:26 +01:00
Frostebite 2481d75d71 Using custom build path relative to repo root rather than project root 2022-04-09 13:38:15 +01:00
Frostebite 305b2de34d Cloud runner param test before caching because we have a fast local cache test now 2022-04-09 13:26:51 +01:00
Frostebite 8a097b4a09 log parameters in cloud runner parameter test 2022-04-09 13:20:43 +01:00
Frostebite ab2f1dce97 log parameters in cloud runner parameter test 2022-04-09 13:15:50 +01:00
Frostebite c717f1e3b6 log parameters in cloud runner parameter test 2022-04-09 12:48:51 +01:00