:py:mod:`medcat.utils.relation_extraction.llama.tokenizer`
==========================================================

.. py:module:: medcat.utils.relation_extraction.llama.tokenizer


Module Contents
---------------

Classes
~~~~~~~

.. autoapisummary::

   medcat.utils.relation_extraction.llama.tokenizer.TokenizerWrapperLlama_RelationExtraction




Attributes
~~~~~~~~~~

.. autoapisummary::

   medcat.utils.relation_extraction.llama.tokenizer.logger


.. py:data:: logger

   

.. py:class:: TokenizerWrapperLlama_RelationExtraction(hf_tokenizers=None, max_seq_length = None, add_special_tokens = False)


   Bases: :py:obj:`medcat.utils.relation_extraction.tokenizer.BaseTokenizerWrapper_RelationExtraction`

   Wrapper around a huggingface Llama tokenizer so that it works with the
   RelCAT models.

   :param hf_tokenizers: A huggingface Fast Llama.
   :type hf_tokenizers: `transformers.LlamaTokenizerFast`

   .. py:attribute:: name
      :value: 'tokenizer_wrapper_llama_rel'

      

   .. py:attribute:: pretrained_model_name_or_path
      :value: 'meta-llama/Llama-3.1-8B'

      

   .. py:method:: load(tokenizer_path, relcat_config, **kwargs)
      :classmethod: