We currently run a live web application which utilises standard azure mounted file storage to store 2tb worth of metocean data in netcdf format. On here we run python queries directly on the data e.g. Xarray. Extract 1 month of wave height data for a single location (this takes about 10 seconds).

We want to scale this storage and looking at different solutions such as azure datalake. Is a datalake mountable and accessible like a normal storage drive? Is this suitable for more immediate queries or more suited to long term data intensive calculations? Any ideas on a better solution?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.