Barebones implementation of local builds (#10101)

* Zip deploy fixes

* use staging and specify uploading TAR

* Improve docs

* Allow reading of simple env vars (not secrets) and passing them down to the local build process

* Add some fixes for npm parsing issues

* Adding various local fixes/hacks to make local builds work. It includes:

1. Fix for injecting auto-init variables into the build

2. Fixes how we handle dependencies, nodejs paths, modulepaths, etc. This needs closer attention/fixes.

3. Adds env var handling (not secrets) and determines which env vars to pass down to the build

* Follow-up fixes for ensuring we have account access for cloud storage buckets

* formatting fixes

* Get rid of env override

* Temporarily add a test app to easily test changes

* For local builds, explicitly check for apphosting.yaml files (and all variants) and include them in the final artifact

* Add hono to packages

* Get rid of test app

* Get rid of uniformBucketLevelAccess config which was not required

* Fix tarball unit test

* Make local builds less hardcoded by checking if the build config is actually a local build (instead of assuming true.)

* Add a new experiment flag to control local builds (apphostinglocalbuilds)

* Remove references to runtime flag

* Clean up the PR so that we gate by apphostinglocalbuilds experiment more strictly. We also remove some hardcoded values and we generalize the code so that it does not affect source deploys.

The goal is to prepare this PR so that we can safely submit it to main (behind the experiment flag.)

* Make the code for adding service account IAM permission more restrictive. Only run it if it's a local build and the local build experiment flag is enabled.

* remove es2020 dependency

* feat: barebones local build implementation

* Parser fixes

* Undo some unintended changes

* Undo some unintended changes

* Linter fixes

* Linter fixes

* improve unit tests

* update npm shrinkwrap

* Update the shrinkwrap correctly using the correct npm versions

* Remove env handling which wasn't used yet

* Address review comments

* Enforce experiment flag

* Correct failure string

* linter/formatter

* fix tests

* Fix linter warnings

---------

Co-authored-by: Joanna Wang <annajowang@gmail.com>
Co-authored-by: annajowang <31288696+annajowang@users.noreply.github.com>

Author: 2 people

npm-shrinkwrap.json

@@ -104,7 +104,7 @@
     ]
   },
   "dependencies": {
-    "@apphosting/build": "^0.1.6",
+    "@apphosting/build": "^0.1.7",
     "@apphosting/common": "^0.0.8",
     "@electric-sql/pglite": "^0.3.3",
     "@electric-sql/pglite-tools": "^0.2.8",
@@ -168,6 +168,7 @@
     "stream-chain": "^2.2.4",
     "stream-json": "^1.7.3",
     "superstatic": "^10.0.0",
+    "tar": "^7.5.11",
     "tcp-port-used": "^1.0.2",
     "tmp": "^0.2.3",
     "triple-beam": "^1.3.0",

package.json

@@ -2,7 +2,17 @@ import { BuildConfig, Env } from "../gcp/apphosting";
 import { localBuild as localAppHostingBuild } from "@apphosting/build";
 
 /**
- * Triggers a local apphosting build.
+ * Triggers a local build of your App Hosting codebase.
+ *
+ * This function orchestrates the build process using the App Hosting build adapter.
+ * It detects the framework (though currently defaults/assumes 'nextjs' in some contexts),
+ * generates the necessary build artifacts, and returns metadata about the build.
+ * @param projectRoot - The root directory of the project to build.
+ * @param framework - The framework to use for the build (e.g., 'nextjs').
+ * @return A promise that resolves to the build output, including:
+ *          - `outputFiles`: Paths to the generated build artifacts.
+ *          - `annotations`: Metadata annotations relating to the build.
+ *          - `buildConfig`: Configuration derived from the build process (e.g. run commands, environment variables).
  */
 export async function localBuild(
   projectRoot: string,