Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Creating tile data is slow due to large files of over 10GB (tif) #383

Open
MICZTOP opened this issue Dec 30, 2024 · 1 comment
Open

Creating tile data is slow due to large files of over 10GB (tif) #383

MICZTOP opened this issue Dec 30, 2024 · 1 comment

Comments

@MICZTOP
Copy link

MICZTOP commented Dec 30, 2024

Creating tile data for files over 10GB is slow and takes a month. It would be great if we could use GPUs to handle it

@Gigas002
Copy link
Owner

Gigas002 commented Jan 11, 2025

While it is a great idea, I don't think it's easily feasible on dotnet, at least it wasn't sever years ago when I was actively developing this project and was looking into a way to do it.
I am using libvips bindings to crop images, at that time it was the best choice performance-wise. Since that time I have heard, that ImageMagick have implemented some GPU workloads via OpenCL, so it may be a good idea to look at Magick.NET to implement this.
I think implementing a native library on some lower-level language like c++ and creating bindings for c# would be a good solution too, but even more complicated than above task.
Also, I don't remember the app taking so long to crop a 10Gb tiff file. I once fed it a 200Gb tiff and it took a week on my workstation to crop it.

Personally, I'd prefer just to rewrite it on rust for better low-level stuff support and control over things. The library isn't complicated, and I think theoretically it's kinda doable, using image, proj, gdal and wgpu crates.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants