Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(data-warehouse): Upgrade deltalake - take two! #29136

Open
wants to merge 21 commits into
base: master
Choose a base branch
from

Conversation

Gilbert09
Copy link
Member

@Gilbert09 Gilbert09 commented Feb 24, 2025

Problem

Changes

  • In the meantime, build deltalake for our platform/architecture in our dockerfile
  • We pull down the 0.25.1 tag, and build the rust lib targeted at our pods platform
  • This is then manually pip install'ed
  • This does add about ~8 mins to our docker build times, but this is also only a temporary solution right now

Does this work well for both Cloud and self-hosted?

Maybe?!

How did you test this code?

  • Tested with getting this PR up in dev - I can confirm it works as expected and the underlying bug we were having has gone

@posthog-bot
Copy link
Contributor

Hey @Gilbert09! 👋
This pull request seems to contain no description. Please add useful context, rationale, and/or any other information that will help make sense of this change now and in the distant Mars-based future.

@Gilbert09 Gilbert09 requested a review from a team February 24, 2025 19:18
Copy link
Member

@EDsCODE EDsCODE left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

give it a go

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants