feat(cdp): record httpCalls for destinations

[meikelmosby]

Problem

Just as we migrated the old JavaScript transformations running in VM2 to inlined JavaScript transformations, we want to apply the same approach to destinations. Given the challenges we encountered with transformations, we need to take a more structured approach. The key aspects of destinations are HTTP calls and their responses, so we need a solution that records outgoing HTTP requests and their corresponding responses. By comparing these, we can ensure confidence in the migration.

Changes

I've implemented an HTTP recorder that captures and logs HTTP requests and their responses during plugin execution. This enhancement focuses on recording HTTP calls made by plugins during event processing without modifying the existing fetch implementation.

👉 Stay up-to-date with PostHog coding conventions for a smoother review.

Does this work well for both Cloud and self-hosted?

How did you test this code?

• unit tests for the single components
• TODO: test it out locally

[greptile-apps]

PR Summary

Implemented HTTP call recording for destinations to support migration from VM2 to inlined JavaScript transformations, focusing on capturing request/response details for comparison.

• Added recorded-fetch.ts utility that wraps trackedFetch to record HTTP requests and responses without altering functionality
• Integrated recording in run.ts with conditional activation based on DESTINATION_MIGRATION_DIFFING_ENABLED flag
• Created global HTTP call recorder in imports.ts with both direct and conditional recording functions
• Added comprehensive test coverage in vm-recorded-fetch.test.ts and recorded-fetch.test.ts for various scenarios
• Implemented proper cleanup to prevent memory leaks and detailed logging of request/response information

_{7 file(s) reviewed, 4 comment(s)
Edit PR Review Bot Settings | Greptile}