Right now we perform the following data flow upon a ChunkedBloscFileDataManager cache miss:
- Ask the next layer for data
- Save the retrieved data to disk
- Return a copy of that retrieved data
In order to improve performance and save roundtrip time on that initial request, we should perform step 2 (saving the data to disk) in parallel with returning it to the user. Or, rather, spawn a routine to save data to disk in parallel (and allow it to finish even once the HTTP request is closed).
Right now we perform the following data flow upon a
ChunkedBloscFileDataManagercache miss:In order to improve performance and save roundtrip time on that initial request, we should perform step 2 (saving the data to disk) in parallel with returning it to the user. Or, rather, spawn a routine to save data to disk in parallel (and allow it to finish even once the HTTP request is closed).