How to use the llm component in any module?

[Kovaxs]

I want to use llm right after doc upload, so I've created a custom component. The thing is I receiving this error each time I've try to invoke it lazy.__call__() takes 1 positional argument but 2 were given. This code lives in libs/kotaemon/kotaemon/loaders/custom_loader.py.

This is my component:

class ExtractMetadataPipeline(BaseComponent):
    """Rewrite user question

    Args:
        llm: the language model to rewrite question
        rewrite_template: the prompt template for llm to paraphrase a text input
    """

    llm: ChatLLM # = Node(default_callback=lambda _: llms.get_default())
    rewrite_template: str = PROMPT

    def run(self, context: str) -> str:  # type: ignore
        print(context)
        prompt_template = PromptTemplate(self.rewrite_template)
        prompt = prompt_template.populate(context=context)
        messages = [
            SystemMessage(content="You are a helpful assistant"),
            HumanMessage(content=prompt),
        ]
        return self.llm(messages)
    @classmethod
    def get_info(cls):
        return {"id": "ExtractMetadataPipeline"}

This is how I invoke the component:

 self.extract_metadata_pipeline: ExtractMetadataPipeline = (
            ExtractMetadataPipeline.withx()
        )

[...]

metadata = self.extract_metadata_pipeline(metadata_context)

Am I missing something? Could you provide way to access llm at any point (obviously if there is a way of doing such thing)?

[Kovaxs]

I discovered how to do it: here the code snippet to get access to the default selected LLM:

llm = llms.get_default()
response = llm("hello")

If I am wrong correct me.

[taprosoft]

It's correct!