IDEFICS

Arguments

Options

--idefics_model_namestr

Help: Name of the LLAVA model to use

• Default: HuggingFaceM4/idefics-9b-instruct

--classification_promptstr

Help: Prompt to use for classification. If <classnames> is present, it will be replaced with the class names. If <datasetname> is present, it will be replaced with the dataset name

• Default: ``Instruction: Classify the following image into a single category from the following list: <classnames>.

``

Classes

class models.idefics.FinalModel(dataset, args, denorm_transform, device)

Bases: Module

forward(x)

get_closest_classname(pred_class_name)

class models.idefics.Idefics(backbone, loss, args, transform, dataset=None)

Bases: ContinualModel

STATIC Continual Learning with LLAVA.

COMPATIBILITY: List[str] = ['class-il', 'domain-il', 'task-il', 'general-continual']

NAME: str = 'idefics'

begin_task(dataset)

forward(x)

static get_parser(parser)

Return type:

ArgumentParser

observe(inputs, labels, not_aug_inputs, epoch=None)