We currently run a live web application which utilises standard azure mounted file storage to store 2tb worth of metocean data in netcdf format. On here we run python queries directly on the data e.g. Xarray. Extract 1 month of wave height data for a single location (this takes about 10 seconds).
We want to scale this storage and looking at different solutions such as azure datalake. Is a datalake mountable and accessible like a normal storage drive? Is this suitable for more immediate queries or more suited to long term data intensive calculations? Any ideas on a better solution?