Struct DictionaryIndexTask 

pub struct DictionaryIndexTask {
    database: Database,
}

Indexes .index dictionary files into SQLite for fast word lookups.

On each startup the task resumes from where it left off, so large dictionaries are indexed incrementally across restarts.

Fields

database: Database

Implementations

impl DictionaryIndexTask

pub fn new(database: Database) -> Self

Creates a new DictionaryIndexTask.

fn detect_metadata(path_str: &str) -> (bool, bool)

Detects dictionary metadata by scanning the first lines of the .index file for 00-database-allchars and 00-database-case-sensitive entries.

Returns (case_sensitive, all_chars).

fn resolve_index_state( &self, index_path: &Path, path_str: &str, fp_str: &str, ) -> Option<(i64, u64, u64, bool)>

Queries or initialises the metadata row for fp_str, returning (dict_id, skip_lines, total_lines).

Returns None when the file is already fully indexed or a DB error occurs, signalling that index_file should skip this file.

fn mark_completed( &self, dict_id: i64, path_str: &str, current_line: u64, total_lines: u64, )

Marks the dictionary as fully indexed in the metadata table.

fn parse_index_line<'a>( path_str: &str, line: &'a str, ) -> Option<(&'a str, i64, i64)>

Parses one tab-separated line from a .index file.

Returns None for lines that cannot be decoded. On decode failure a tracing error is emitted so the caller can skip the line without losing diagnostic info. Metadata lines such as 00-database-* are parsed normally so they are indexed and available for dictionary metadata queries.

fn scan_and_batch( &self, job: &IndexFileJob<'_>, skip_lines: u64, hub: &Sender<Event>, shutdown: &ShutdownSignal, ) -> Option<u64>

Drives the line-by-line scan of an open index file, collecting entries into batches and flushing them to the database.

Returns Some(current_line) when scanning completed normally, None when a flush error or shutdown cut it short.

fn index_file( &self, index_path: &Path, hub: &Sender<Event>, shutdown: &ShutdownSignal, )

fn flush_batch( &self, job: &IndexFileJob<'_>, batch: &[(i64, String, i64, i64, Option<String>)], current_line: u64, hub: &Sender<Event>, ) -> Result<(), Error>

fn delete_stale_entries( &self, on_disk_fingerprints: &[String], hub: &Sender<Event>, shutdown: &ShutdownSignal, )

Removes index data for dictionaries that are no longer present on disk.

For each fingerprint in dictionary_index_meta that has no corresponding .index file in on_disk_fingerprints, this method marks the meta row as incomplete before deletion begins. This ensures that if the process is interrupted mid-deletion, the next startup does not treat a partially deleted dictionary as fully indexed. Entries are then removed in batches via delete_entries_for_dict, after which the meta row itself is deleted.

Trait Implementations

impl BackgroundTask for DictionaryIndexTask

fn id(&self) -> TaskId

Returns the unique identifier for this task.

fn run(&mut self, hub: &Sender<Event>, shutdown: &ShutdownSignal)

Runs the task until shutdown is requested.

fn stop(&mut self)

Called when the task is being stopped.