Module tvix_castore::import::blobs

Structs

• ConcurrentBlobUploader
  The concurrent blob uploader provides a mechanism for concurrently uploading small blobs. This is useful when ingesting from sources like tarballs and archives which each blob entry must be read sequentially. Ingesting many small blobs sequentially becomes slow due to round trip time with the blob service. The concurrent blob uploader will buffer small blobs in memory and upload them to the blob service in the background.

Enums

• Error

Constants

• CONCURRENT_BLOB_UPLOAD_THRESHOLD 🔒
  Files smaller than this threshold, in bytes, are uploaded to the BlobService in the background.
• MAX_BUFFER_SIZE 🔒
  The maximum amount of bytes allowed to be buffered in memory to perform async blob uploads.

Functions

• upload_blob 🔒