90 Commits (c875c0c3e8d046e10ff87e58d1295b0f3517e101)

Author	SHA1	Message	Date
Frostebite	c875c0c3e8	tree cache push directory	2022-09-18 22:18:59 +01:00
Frostebite	cf733fd1b7	tree cache push directory	2022-09-18 17:43:24 +01:00
Frostebite	9fb18c8d6a	skip included contents	2022-09-18 07:36:28 +01:00
Frostebite	ee68632225	rename	2022-09-18 07:25:55 +01:00
Frostebite	a745b6d025	Task Parameter Serializer will include build params and secrets for local-docker provider	2022-09-18 07:21:20 +01:00
Frostebite	85a35b3ab7	Task Parameter Serializer will include build params and secrets for local-docker provider	2022-09-18 07:15:46 +01:00
Frostebite	76667f4eb5	skip cache push where contents is 0	2022-09-18 06:54:56 +01:00
Frostebite	40078f987c	skip cache push where contents is 0	2022-09-18 06:52:53 +01:00
Frostebite	6577aeb5c1	local-docker provider use docker with commands	2022-09-17 09:22:15 +01:00
Frostebite	20476c3ccc	local-docker provider use docker with commands	2022-09-17 09:14:43 +01:00
Frostebite	8031bac31f	local-docker provider use docker with commands	2022-09-17 09:05:43 +01:00
Frostebite	307bea209b	local-docker provider use docker with commands	2022-09-17 08:43:09 +01:00
Frostebite	92bcdf5e96	local-docker provider use docker with commands	2022-09-17 08:37:57 +01:00
Frostebite	d017aa0d55	Do not include all env vars as secrets!	2022-09-17 06:54:34 +01:00
Frostebite	67696d6253	Do not include all env vars as secrets!	2022-09-17 06:46:59 +01:00
Frostebite	6daf32f531	Do not include all env vars as secrets!	2022-09-17 06:30:51 +01:00
Frostebite	a330d4e9a3	better startup and teardown for tests	2022-09-17 05:44:07 +01:00
Frostebite	5bf0ad0367	better startup and teardown for tests	2022-09-17 05:09:36 +01:00
Frostebite	51d46c2cc0	lock put timestamp first	2022-09-17 04:49:44 +01:00
Frostebite	cefd469364	lock test	2022-09-17 04:41:41 +01:00
Frostebite	9ed3251455	lock test	2022-09-17 04:38:00 +01:00
Frostebite	54eab9797b	Fix s3 command for workspace locking	2022-09-17 04:25:29 +01:00
Frostebite	f72739254b	Fix s3 command for workspace locking	2022-09-17 04:20:09 +01:00
Frostebite	33eb514ce6	Fix cloud runner test - format secret names for validation	2022-09-17 03:52:50 +01:00
Frostebite	7aa9d1ab16	Fix: use project path not repo path to find Packages/manifest.json	2022-09-17 01:50:19 +01:00
Frostebite	b964d3100a	Stub custom hook+step file parameter and CLI command to run	2022-09-17 01:27:38 +01:00
Frostebite	b9608f9169	fix push to cache	2022-09-17 01:09:28 +01:00
Frostebite	d69f044655	fix push to cache	2022-09-17 01:06:38 +01:00
Frostebite	df240154da	Test secrets are serialized correctly	2022-09-16 23:51:19 +01:00
Frostebite	01ccc8ee10	fix push to cache	2022-09-16 22:24:23 +01:00
Frostebite	f226bef5af	Cloud runner preview (#419)	2022-09-16 19:48:40 +01:00
Frostebite	8bd51be73f	improve cleanup to not delete in use task clusters	2022-05-14 17:29:09 +01:00
Frostebite	16b81cc6c8	Extract follow log stream service	2022-05-02 09:11:29 +01:00
Frostebite	795ae32499	fix issue #393	2022-05-01 20:56:08 +01:00
Frostebite	6668e1133e	Only allow ephemeral runners when using cloud runner integration tests flag to avoid unexpected hangup	2022-05-01 19:34:48 +01:00
Frostebite	a47d096f5c	improved garbage collection cli options	2022-05-01 19:32:59 +01:00
Frostebite	fc3724600e	better aws cli commands and better cleanup for aws	2022-05-01 08:29:04 +01:00
Frostebite	3bd297d1c8	better aws cli commands and better cleanup for aws	2022-05-01 08:24:55 +01:00
Frostebite	a184b7abae	Correct aws logs link	2022-05-01 05:43:17 +01:00
Frostebite	483bcf9dd4	Correct aws logs link	2022-05-01 05:40:56 +01:00
Frostebite	8abce48a48	Cloud runner v0.2 - continued quality of life improvements (#387) ... * Update cloud-runner-aws-pipeline.yml * Update cloud-runner-k8s-pipeline.yml * yarn build * yarn build * correct branch ref * correct branch ref passed to target repo * Create k8s-tests.yml * Delete k8s-tests.yml * correct branch ref passed to target repo * correct branch ref passed to target repo * Always describe AWS tasks for now, because unstable error handling * Remove unused tree commands * Use lfs guid sum * Simple override cache push * Simple override cache push and pull override to allow pure cloud storage driven caching * Removal of early branch (breaks lfs caching) * Remove unused tree commands * Update action.yml * Update action.yml * Support cache and input override commands as input + full support custom hooks * Increase k8s timeout * replace filename being appended for unknclear reason * cache key should not contain whitespaces * Always try and deploy rook for k8s * Apply k8s files for rook * Update action.yml * Apply k8s files for rook * Apply k8s files for rook * cache test and action description for kuber storage class * Correct test and implement dependency health check and start * GCP-secret run, cache key * lfs smudge set explicit and undo explicit * Run using external secret provider to speed up input * Update cloud-runner-aws-pipeline.yml * Add nodejs as build step dependency * Add nodejs as build step dependency * Cloud Runner Tests must be specified to capture logs from cloud runner for tests * Cloud Runner Tests must be specified to capture logs from cloud runner for tests * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * better defaults for new inputs * better defaults * merge latest * force build update * use npm n to update node in unity builder * use npm n to update node in unity builder * use npm n to update node in unity builder * correct new line * quiet zipping * quiet zipping * default secrets for unity username and password * default secrets for unity username and password * ls active directory before lfs install * Get cloud runner secrets from * Get cloud runner secrets from * Cleanup setup of default secrets * Various fixes * Cleanup setup of default secrets * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * AWS secrets manager support * less caching logs * default k8s storage class to pd-standard * more readable build commands * Capture aws exit code 1 reliably * Always replace /head from branch * k8s default storage class to standard-rwo * cleanup * further cleanup input * further cleanup input * further cleanup input * further cleanup input * further cleanup input * folder sizes to inspect caching * dir command for local cloud runner test * k8s wait for pending because pvc will not create earlier * prefer k8s standard storage * handle empty string as cloud runner cluster input * local-system is now used for cloud runner test implementation AND correctly unset test CLI input * local-system is now used for cloud runner test implementation AND correctly unset test CLI input * fix unterminated quote * fix unterminated quote * do not share build parameters in tests - in cloud runner this will cause conflicts with resouces of the same name * remove head and heads from branch prefix * fix reversed caching direction of cache-push * fixes * fixes * fixes * cachePull cli * fixes * fixes * fixes * fixes * fixes * order cache test to be first * order cache test to be first * fixes * populate cache key instead of using branch * cleanup cli * garbage-collect-aws cli can iterate over aws resources and cli scans all ts files * import cli methods * import cli files explicitly * import cli files explicitly * import cli files explicitly * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * log parameters in cloud runner parameter test * log parameters in cloud runner parameter test * log parameters in cloud runner parameter test * Cloud runner param test before caching because we have a fast local cache test now * Using custom build path relative to repo root rather than project root * aws-garbage-collect at end of pipeline * aws-garbage-collect do not actually delete anything for now - just list * remove some legacy du commands * Update cloud-runner-aws-pipeline.yml * log contents after cache pull and fix some scenarios with duplicate secrets * log contents after cache pull and fix some scenarios with duplicate secrets * log contents after cache pull and fix some scenarios with duplicate secrets * PR comments * Replace guid with uuid package * use fileExists lambda instead of stat to check file exists in caching * build failed results in core error message * Delete sample.txt * cloud-runner-system prefix changed to cloud-runner * Update cloud-runner-aws-pipeline.yml * remove du from caching, should run manually if interested in size, adds too much runtime to job to include by default * github ephemeral pipeline support * github ephemeral pipeline support * Merge remote-tracking branch 'origin/main' into cloud-runner-develop # Conflicts: # dist/index.js.map # src/model/cloud-runner/providers/aws/aws-task-runner.ts # src/model/cloud-runner/providers/aws/index.ts * garbage collection * garbage collection * self hosted runner pipeline * self hosted runner pipeline * self hosted runner pipeline * self hosted runner pipeline * self hosted runner pipeline * self hosted runner pipeline * self hosted runner pipeline * self hosted runner pipeline * self hosted runner pipeline * self hosted runner pipeline * ephemeral runner pipeline * ephemeral runner pipeline * ephemeral runner pipeline * download runner each time * download runner each time * download runner each time * garbage collect all older than 1d as part of cleanup * download runner each time * number container cpu and memory for aws * per provider container defaults * per provider container defaults * per provider container defaults * per provider container defaults * Skip printing size unless cloudRunnerIntegrationTests is true * transition zip usage in cache to uncompressed tar for speed * transition zip usage in cache to uncompressed tar for speed * transition zip usage in cache to uncompressed tar for speed * transition zip usage in cache to uncompressed tar for speed * per provider container defaults * per provider container defaults * per provider container defaults * per provider container defaults * per provider container defaults * per provider container defaults * per provider container defaults * per provider container defaults * baked in cloud formation template * baked in cloud formation template * baked in cloud formation template * baked in cloud formation template * baked in cloud formation template * baked in cloud formation template * baked in cloud formation template * baked in cloud formation template * better aws commands * better aws commands * parse number for cloud formation template * remove container resource defaults from actions yaml * remove container resource defaults from actions yaml * skip all input readers when cloud runner is local * prefer fs/promises * actually set aws cloud runner step as failure if unity build fails * default to 3gb of ram - webgl fails on 2	2022-04-22 00:47:45 +01:00
Webber Takken	5ae03dfef6	Streamline code styles (#384) ... * feat: streamline code styles * feat: spacing for comments and return statements * chore: enforce camelcase * fix: remove npm lock file * fix: add integrity test * fix: remove logfile * chore: update node in test workflow	2022-04-12 00:43:41 +02:00
Frostebite	a61c02481f	Cloud Runner v0 - Reliable and trimmed down cloud runner (#353) ... * Update cloud-runner-aws-pipeline.yml * Update cloud-runner-k8s-pipeline.yml * yarn build * yarn build * correct branch ref * correct branch ref passed to target repo * Create k8s-tests.yml * Delete k8s-tests.yml * correct branch ref passed to target repo * correct branch ref passed to target repo * Always describe AWS tasks for now, because unstable error handling * Remove unused tree commands * Use lfs guid sum * Simple override cache push * Simple override cache push and pull override to allow pure cloud storage driven caching * Removal of early branch (breaks lfs caching) * Remove unused tree commands * Update action.yml * Update action.yml * Support cache and input override commands as input + full support custom hooks * Increase k8s timeout * replace filename being appended for unknclear reason * cache key should not contain whitespaces * Always try and deploy rook for k8s * Apply k8s files for rook * Update action.yml * Apply k8s files for rook * Apply k8s files for rook * cache test and action description for kuber storage class * Correct test and implement dependency health check and start * GCP-secret run, cache key * lfs smudge set explicit and undo explicit * Run using external secret provider to speed up input * Update cloud-runner-aws-pipeline.yml * Add nodejs as build step dependency * Add nodejs as build step dependency * Cloud Runner Tests must be specified to capture logs from cloud runner for tests * Cloud Runner Tests must be specified to capture logs from cloud runner for tests * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * Refactor and cleanup - no async input, combined setup/build, removed github logs for cli runs * better defaults for new inputs * better defaults * merge latest * force build update * use npm n to update node in unity builder * use npm n to update node in unity builder * use npm n to update node in unity builder * correct new line * quiet zipping * quiet zipping * default secrets for unity username and password * default secrets for unity username and password * ls active directory before lfs install * Get cloud runner secrets from * Get cloud runner secrets from * Cleanup setup of default secrets * Various fixes * Cleanup setup of default secrets * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * Various fixes * AWS secrets manager support * less caching logs * default k8s storage class to pd-standard * more readable build commands * Capture aws exit code 1 reliably * Always replace /head from branch * k8s default storage class to standard-rwo * cleanup * further cleanup input * further cleanup input * further cleanup input * further cleanup input * further cleanup input * folder sizes to inspect caching * dir command for local cloud runner test * k8s wait for pending because pvc will not create earlier * prefer k8s standard storage * handle empty string as cloud runner cluster input * local-system is now used for cloud runner test implementation AND correctly unset test CLI input * local-system is now used for cloud runner test implementation AND correctly unset test CLI input * fix unterminated quote * fix unterminated quote * do not share build parameters in tests - in cloud runner this will cause conflicts with resouces of the same name * remove head and heads from branch prefix * fix reversed caching direction of cache-push * fixes * fixes * fixes * cachePull cli * fixes * fixes * fixes * fixes * fixes * order cache test to be first * order cache test to be first * fixes * populate cache key instead of using branch * cleanup cli * garbage-collect-aws cli can iterate over aws resources and cli scans all ts files * import cli methods * import cli files explicitly * import cli files explicitly * import cli files explicitly * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * import cli methods * log parameters in cloud runner parameter test * log parameters in cloud runner parameter test * log parameters in cloud runner parameter test * Cloud runner param test before caching because we have a fast local cache test now * Using custom build path relative to repo root rather than project root * aws-garbage-collect at end of pipeline * aws-garbage-collect do not actually delete anything for now - just list * remove some legacy du commands * Update cloud-runner-aws-pipeline.yml * log contents after cache pull and fix some scenarios with duplicate secrets * log contents after cache pull and fix some scenarios with duplicate secrets * log contents after cache pull and fix some scenarios with duplicate secrets * PR comments * Replace guid with uuid package * use fileExists lambda instead of stat to check file exists in caching * build failed results in core error message * Delete sample.txt	2022-04-11 00:00:37 +01:00
Philipp Mildenberger	2b399b2641	Add gitPrivateToken support again (#377)	2022-04-05 17:46:52 +02:00
David Finol	40891d6b43	Fix mac builds (#376)	2022-04-04 10:19:40 +02:00
Webber Takken	441be81543	Switch to version 1 images (#374) ... * feat: upgrade to images of version 1 (rolling tag) * chore: indicate what needs to move out of the input class	2022-04-03 17:59:14 +02:00
Paul Pacheco	d98a0ed32d	fix: windows build (#368)	2022-03-31 21:28:40 +02:00
Paul Pacheco	b72639aac0	perf: avoid building docker image (#365) ... * avoid building a custom image * fix: remove unnecessary double-dash * Rebuild with -- fix * linting * Remove unused variable * support windows as well * Fix -- command not found * Fix unused import, remove docker build test * no dockerfile anymore Co-authored-by: Webber Takken <webber.nl@gmail.com>	2022-03-31 01:16:30 +02:00
Webber Takken	9a40b8903e	fix: ensure line endings (#366) ... * fix: ensure line endings * fix: only affect specific files * chore: rearrange attributes order	2022-03-30 23:27:10 +02:00
Webber Takken	f1c154a23c	Attempt to streamline dev lifecycle (git hooks) (#357) ... * fix: misalignments in dev lifecycle * fix: dist no longer added to staged * fix: misalignments in dev lifecycle * chore: multi-platform hooks and tests * chore: multi-platform hooks and tests * chore: add intention for colors * chore: update lint-staged to fix color * chore: update dist files * feat: move to lefthook (remove husky and lint-staged) * feat: move to lefthook (remove husky and lint-staged) * fix: test aftereach * fix: test aftereach * fix: early restore call * feat: jest fails if something gets logged to console * chore: add todos of misplaced code * chore: update dist files * chore: move jest file	2022-03-28 01:23:32 +02:00