feat(orchestrator): record upload compression metrics

[ValentaTomas]

Summary

Record upload artifact sizes and compression ratios for sandbox build uploads so compression behavior is visible in telemetry.

Test plan

• go test ./packages/orchestrator/pkg/sandbox ./packages/shared/pkg/telemetry

[cursor]

PR Summary

Medium Risk
Adds new upload-size/compression telemetry with extra attributes and per-upload work (stat + header serialization), which could increase overhead and metric cardinality if useCase is unbounded.

Overview
This PR adds new OpenTelemetry histograms for upload uncompressed/compressed bytes and compression ratio, and records them during both v3 and v4 build uploads (including header objects). Potential issues: use_case and file_type attributes can drive high metric cardinality, v3 uploads now do an extra os.Stat syscall per artifact, and header uploads now serialize headers post-store just to compute size (extra CPU/alloc on the hot path).

^{Reviewed by Cursor Bugbot for commit c1242ad. Bugbot is set up for automated code reviews on this repo. Configure here.}

[codecov]

❌ 2 Tests Failed:

Tests completed	Failed	Passed	Skipped
2655	2	2653	7

View the full list of 2 ❄️ flaky test(s)

github.com/e2b-dev/infra/tests/integration/internal/tests/orchestrator::TestSandboxMemoryIntegrity

Flake rate in main: 66.25% (Passed 375 times, Failed 736 times)

Stack Traces | 80.4s run time

=== RUN   TestSandboxMemoryIntegrity
=== PAUSE TestSandboxMemoryIntegrity
=== CONT  TestSandboxMemoryIntegrity
    sandbox_memory_integrity_test.go:27: Build completed successfully
--- FAIL: TestSandboxMemoryIntegrity (80.36s)

github.com/e2b-dev/infra/tests/integration/internal/tests/orchestrator::TestSandboxMemoryIntegrity/tmpfs_hash

Flake rate in main: 66.61% (Passed 365 times, Failed 728 times)

Stack Traces | 98.3s run time

=== RUN   TestSandboxMemoryIntegrity/tmpfs_hash
=== PAUSE TestSandboxMemoryIntegrity/tmpfs_hash
=== CONT  TestSandboxMemoryIntegrity/tmpfs_hash
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{start:{pid:1252}}
Executing command bash in sandbox isoehqhl5cvux839wfhia (user: root)
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stdout:"Total memory: 985 MB\nUsed memory before tmpfs mount: 189 MB\nFree memory before tmpfs mount: 795 MB\nMemory to use in integrity test (80% of free, min 64MB): 636 MB\n"}}
Executing command bash in sandbox isoehqhl5cvux839wfhia (user: root)
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"636+0 records in\n636+0 records out\n666894336 bytes (667 MB, 636 MiB) copied, 3.17843 s, 210 MB/s\n"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"\tCommand be"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"ing timed: \""}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"dd if=/dev/urandom of=/mnt/testfile bs=1M count=636\"\n\t"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"User time (seconds): 0.00\n\tSystem time (seconds"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"): 3.16\n\tP"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"ercen"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"t of CP"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"U thi"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"s job"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:" got: "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"99%\n\tElapsed (wall clock) time (h:mm:ss or m:ss): 0:03.18\n\tA"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"verage"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:" shared text "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"size "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"(kbyt"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"es): "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"0\n\tAv"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"erage unshared data size (kbytes): 0\n\tAverage stack size (kb"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"yte"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"s):"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:" 0\n\tAverage total size (kbytes): 0\n\tMaximum resident set si"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"ze (k"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"bytes): 2704"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"\n\tAve"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"rage r"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"esid"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"ent s"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"et size "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"(kbytes): 0\n\tMajor (req"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"uiring"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:" I/O)"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:" page f"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"ault"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"s: 2\n\t"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"Minor "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"(recl"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"aiming a frame) page faults: 347\n\tVoluntary context switches:"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:" 3\n\tI"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"nvol"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"untar"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"y con"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"text swi"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"tche"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"s: 13\n"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"\tSwaps: 0\n\tFile system inputs: 176\n\tFile system outputs: "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"0\n\tSo"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"cket mes"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"sage"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"s sent: "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"0\n\tS"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"ocket me"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"ssag"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"es received: 0\n\tSignals delivered: 0\n\tPage size (b"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"ytes)"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:": "}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stderr:"4096\n\tExit status: 0\n"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{data:{stdout:"Used memory after tmpfs mount and file fill: 831 MB\n"}}
    sandbox_memory_integrity_test.go:70: Command [bash] output: event:{end:{exited:true  status:"exit status 0"}}
    sandbox_memory_integrity_test.go:70: Command [bash] completed successfully in sandbox iztly5ids7ma8kn9iikau
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
    sandbox_memory_integrity_test.go:80: Command [bash] output: event:{start:{pid:1268}}
    sandbox_memory_integrity_test.go:80: Command [bash] output: event:{data:{stdout:"53d0cc11b69d27462684394aa5f76569db08e37d351a664907bccc54bb42e5d2\n"}}
    sandbox_memory_integrity_test.go:80: Command [bash] output: event:{end:{exited:true  status:"exit status 0"}}
    sandbox_memory_integrity_test.go:80: Command [bash] completed successfully in sandbox iztly5ids7ma8kn9iikau
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
    sandbox_memory_integrity_test.go:80: Command [bash] output: event:{start:{pid:1271}}
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
Executing command bash in sandbox iztly5ids7ma8kn9iikau (user: root)
    sandbox_memory_integrity_test.go:110: 
        	Error Trace:	.../tests/orchestrator/sandbox_memory_integrity_test.go:81
        	            				.../hostedtoolcache/go/1.26.3.../src/runtime/asm_amd64.s:1771
        	Error:      	Received unexpected error:
        	            	failed to execute command bash in sandbox iztly5ids7ma8kn9iikau: unavailable: HTTP status 502 Bad Gateway
    sandbox_memory_integrity_test.go:110: 
        	Error Trace:	.../tests/orchestrator/sandbox_memory_integrity_test.go:78
        	            				.../tests/orchestrator/sandbox_memory_integrity_test.go:110
        	Error:      	Condition never satisfied
        	Test:       	TestSandboxMemoryIntegrity/tmpfs_hash
--- FAIL: TestSandboxMemoryIntegrity/tmpfs_hash (98.35s)

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}

[gemini-code-assist]

Code Review

The symbols meter and ratioBp are used in packages/orchestrator/pkg/sandbox/upload_metrics.go but are not defined, which will cause a compilation error. The implementation for ratioBp must also include a check for zero uncompressed size to prevent a division by zero error.

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b4e6327911

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d66ee67369

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".