Commit Graph

599 Commits (2e971d93a4d50bb46632e1dede7340f672edfee2)

Author SHA1 Message Date
Frostebite 96d34f546d remove du from caching, should run manually if interested in size, adds too much runtime to job to include by default 2022-04-16 13:20:28 +01:00
Frostebite 75d418b96e
Update cloud-runner-aws-pipeline.yml 2022-04-14 20:13:35 +01:00
Frostebite 0a65f6e2a8 cloud-runner-system prefix changed to cloud-runner 2022-04-13 21:31:37 +01:00
Webber Takken 5ae03dfef6
Streamline code styles (#384)
* feat: streamline code styles

* feat: spacing for comments and return statements

* chore: enforce camelcase

* fix: remove npm lock file

* fix: add integrity test

* fix: remove logfile

* chore: update node in test workflow
2022-04-12 00:43:41 +02:00
gnomesley 4be5d2ddf4
Add username and password to mac build.sh (#383) 2022-04-11 22:22:52 +02:00
Frostebite d9b4f816bf Merge branch 'cloud-runner-develop' of https://github.com/game-ci/unity-builder into cloud-runner-develop 2022-04-11 14:40:47 +01:00
Frostebite a61c02481f
Cloud Runner v0 - Reliable and trimmed down cloud runner (#353)
* Update cloud-runner-aws-pipeline.yml

* Update cloud-runner-k8s-pipeline.yml

* yarn build

* yarn build

* correct branch ref

* correct branch ref passed to target repo

* Create k8s-tests.yml

* Delete k8s-tests.yml

* correct branch ref passed to target repo

* correct branch ref passed to target repo

* Always describe AWS tasks for now, because unstable error handling

* Remove unused tree commands

* Use lfs guid sum

* Simple override cache push

* Simple override cache push and pull override to allow pure cloud storage driven caching

* Removal of early branch (breaks lfs caching)

* Remove unused tree commands

* Update action.yml

* Update action.yml

* Support cache and input override commands as input + full support custom hooks

* Increase k8s timeout

* replace filename being appended for unknclear reason

* cache key should not contain whitespaces

* Always try and deploy rook for k8s

* Apply k8s files for rook

* Update action.yml

* Apply k8s files for rook

* Apply k8s files for rook

* cache test and action description for kuber storage class

* Correct test and implement dependency health check and start

* GCP-secret run, cache key

* lfs smudge set explicit and undo explicit

* Run using external secret provider to speed up input

* Update cloud-runner-aws-pipeline.yml

* Add nodejs as build step dependency

* Add nodejs as build step dependency

* Cloud Runner Tests must be specified to capture logs from cloud runner for tests

* Cloud Runner Tests must be specified to capture logs from cloud runner for tests

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs

* better defaults for new inputs

* better defaults

* merge latest

* force build update

* use npm n to update node in unity builder

* use npm n to update node in unity builder

* use npm n to update node in unity builder

* correct new line

* quiet zipping

* quiet zipping

* default secrets for unity username and password

* default secrets for unity username and password

* ls active directory before lfs install

* Get cloud runner secrets from

* Get cloud runner secrets from

* Cleanup setup of default secrets

* Various fixes

* Cleanup setup of default secrets

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* Various fixes

* AWS secrets manager support

* less caching logs

* default k8s storage class to pd-standard

* more readable build commands

* Capture aws exit code 1 reliably

* Always replace /head from branch

* k8s default storage class to standard-rwo

* cleanup

* further cleanup input

* further cleanup input

* further cleanup input

* further cleanup input

* further cleanup input

* folder sizes to inspect caching

* dir command for local cloud runner test

* k8s wait for pending because pvc will not create earlier

* prefer k8s standard storage

* handle empty string as cloud runner cluster input

* local-system is now used for cloud runner test implementation AND correctly unset test CLI input

* local-system is now used for cloud runner test implementation AND correctly unset test CLI input

* fix unterminated quote

* fix unterminated quote

* do not share build parameters in tests - in cloud runner this will cause conflicts with resouces of the same name

* remove head and heads from branch prefix

* fix reversed caching direction of cache-push

* fixes

* fixes

* fixes

* cachePull cli

* fixes

* fixes

* fixes

* fixes

* fixes

* order cache test to be first

* order cache test to be first

* fixes

* populate cache key instead of using branch

* cleanup cli

* garbage-collect-aws cli can iterate over aws resources and cli scans all ts files

* import cli methods

* import cli files explicitly

* import cli files explicitly

* import cli files explicitly

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* import cli methods

* log parameters in cloud runner parameter test

* log parameters in cloud runner parameter test

* log parameters in cloud runner parameter test

* Cloud runner param test before caching because we have a fast local cache test now

* Using custom build path relative to repo root rather than project root

* aws-garbage-collect at end of pipeline

* aws-garbage-collect do not actually delete anything for now - just list

* remove some legacy du commands

* Update cloud-runner-aws-pipeline.yml

* log contents after cache pull and fix some scenarios with duplicate secrets

* log contents after cache pull and fix some scenarios with duplicate secrets

* log contents after cache pull and fix some scenarios with duplicate secrets

* PR comments

* Replace guid with uuid package

* use fileExists lambda instead of stat to check file exists in caching

* build failed results in core error message

* Delete sample.txt
2022-04-11 00:00:37 +01:00
Frostebite 9f42bc9ddc Delete sample.txt 2022-04-10 23:24:13 +01:00
Frostebite 8b944a640a build failed results in core error message 2022-04-10 23:17:25 +01:00
Frostebite 76d9019b01 use fileExists lambda instead of stat to check file exists in caching 2022-04-10 23:11:36 +01:00
Frostebite e4c0fbfa6f Replace guid with uuid package 2022-04-10 23:05:17 +01:00
Frostebite f2a9adf736 PR comments 2022-04-10 23:01:03 +01:00
Frostebite a28bf4fc3a log contents after cache pull and fix some scenarios with duplicate secrets 2022-04-10 16:37:43 +01:00
Frostebite 30410eaaac log contents after cache pull and fix some scenarios with duplicate secrets 2022-04-10 15:41:15 +01:00
Frostebite db3be9e174 Merge remote-tracking branch 'origin/cloud-runner-develop' into cloud-runner-develop 2022-04-10 15:32:05 +01:00
Frostebite 7913901814 log contents after cache pull and fix some scenarios with duplicate secrets 2022-04-10 15:29:51 +01:00
Frostebite 40dd6b8b37
Update cloud-runner-aws-pipeline.yml 2022-04-10 01:18:44 +01:00
Frostebite cd86d9403e remove some legacy du commands 2022-04-10 00:54:31 +01:00
Frostebite 09c06d936d aws-garbage-collect do not actually delete anything for now - just list 2022-04-09 14:42:09 +01:00
Frostebite 3648e43fc5 aws-garbage-collect at end of pipeline 2022-04-09 14:10:26 +01:00
Frostebite 2481d75d71 Using custom build path relative to repo root rather than project root 2022-04-09 13:38:15 +01:00
Frostebite 305b2de34d Cloud runner param test before caching because we have a fast local cache test now 2022-04-09 13:26:51 +01:00
Frostebite 8a097b4a09 log parameters in cloud runner parameter test 2022-04-09 13:20:43 +01:00
Frostebite ab2f1dce97 log parameters in cloud runner parameter test 2022-04-09 13:15:50 +01:00
Frostebite c717f1e3b6 log parameters in cloud runner parameter test 2022-04-09 12:48:51 +01:00
Frostebite 13329d9daa import cli methods 2022-04-09 01:04:53 +01:00
Frostebite e0b0ccd6a5 import cli methods 2022-04-08 22:53:35 +01:00
Frostebite 205360e9c2 import cli methods 2022-04-08 22:31:39 +01:00
Frostebite 88080f9f75 import cli methods 2022-04-08 22:19:19 +01:00
Frostebite 6e44166ca9 import cli methods 2022-04-08 22:14:41 +01:00
Frostebite 6c59d79191 import cli methods 2022-04-08 21:55:26 +01:00
Frostebite fb9530048f import cli methods 2022-04-08 21:53:52 +01:00
Frostebite 762843eeba import cli methods 2022-04-08 21:51:23 +01:00
Frostebite ad672df1ef import cli methods 2022-04-08 21:36:17 +01:00
Frostebite b225664081 import cli methods 2022-04-08 21:31:45 +01:00
Frostebite b44b164858 import cli methods 2022-04-08 21:26:19 +01:00
Frostebite 92e0a3d279 import cli methods 2022-04-08 21:22:33 +01:00
Frostebite f3377ec5e1 import cli methods 2022-04-08 21:18:00 +01:00
Frostebite 2518fb20b1 import cli methods 2022-04-08 21:15:40 +01:00
Frostebite 4f9302305a import cli methods 2022-04-08 20:32:19 +01:00
Frostebite 4b948a6cbf import cli methods 2022-04-08 20:27:38 +01:00
Frostebite 66ff910f2f import cli methods 2022-04-08 20:24:03 +01:00
Frostebite 35c077177d import cli methods 2022-04-08 20:16:47 +01:00
Frostebite e8169a6978 import cli methods 2022-04-08 20:12:08 +01:00
Frostebite 57b65aa9ed import cli methods 2022-04-08 20:07:58 +01:00
Frostebite d66e085008 import cli methods 2022-04-08 19:36:58 +01:00
Frostebite df84273a78 import cli methods 2022-04-08 19:22:01 +01:00
Frostebite 97358c6298 import cli methods 2022-04-08 18:29:19 +01:00
Frostebite 9e2f482d05 import cli methods 2022-04-08 18:25:27 +01:00
Frostebite 5d77a9f92d import cli methods 2022-04-08 18:04:59 +01:00