Struct tvix_castore::directoryservice::bigtable::BigtableDirectoryService

pub struct BigtableDirectoryService {
    client: BigTable,
    params: BigtableParameters,
}

Provides a DirectoryService implementation using Bigtable as an underlying K/V store.

Data format

We use Bigtable as a plain K/V store. The row key is the digest of the directory, in hexlower. Inside the row, we currently have a single column/cell, again using the hexlower directory digest. Its value is the Directory message, serialized in canonical protobuf. We currently only populate this column.

In the future, we might want to introduce “bucketing”, essentially storing all directories inserted via put_multiple_start in a batched form. This will prevent looking up intermediate Directories, which are not directly at the root, so rely on store composition.

Fields

client: BigTable

params: BigtableParameters

Implementations

impl BigtableDirectoryService

pub async fn connect(params: BigtableParameters) -> Result<Self, Error>

Trait Implementations

impl Clone for BigtableDirectoryService

fn clone(&self) -> BigtableDirectoryService

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl DirectoryService for BigtableDirectoryService

fn get<'life0, 'life1, 'async_trait>( &'life0 self, digest: &'life1 B3Digest ) -> Pin<Box<dyn Future<Output = Result<Option<Directory>, Error>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Looks up a single Directory message by its digest. The returned Directory message must be valid. In case the directory is not found, Ok(None) is returned.

fn put<'life0, 'async_trait>( &'life0 self, directory: Directory ) -> Pin<Box<dyn Future<Output = Result<B3Digest, Error>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Uploads a single Directory message, and returns the calculated digest, or an error. An error must also be returned if the message is not valid.

fn get_recursive( &self, root_directory_digest: &B3Digest ) -> BoxStream<'static, Result<Directory, Error>>

Looks up a closure of Directory. Ideally this would be a impl Stream<Item = Result<Directory, Error>>, and we’d be able to add a default implementation for it here, but we can’t have that yet.

fn put_multiple_start(&self) -> Box<dyn DirectoryPutter + 'static>

where Self: Clone,

Allows persisting a closure of Directory, which is a graph of connected Directory messages.