# tinker_cookbook.tokenizer_utils.register_tokenizer

### [**tinker_cookbook.tokenizer_utils.register_tokenizer**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/tokenizer_utils.py#L119)(*name*, *factory*)

Register a custom tokenizer factory.

Once registered, [`get_tokenizer`](https://tinker-docs.thinkingmachines.ai/cookbook/api-reference/tokenizer_utils/get_tokenizer/index.md) will call `factory()` instead of loading from HuggingFace when the given `name` is requested.

**Parameters:**

- [**name**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/tokenizer_utils.py#L120) (*str*) – The tokenizer name (typically a HuggingFace model ID like `"Foo/foo_tokenizer"`).
- [**factory**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/tokenizer_utils.py#L121) (*Callable\[[], Tokenizer\]*) – A callable that takes no arguments and returns a Tokenizer instance.

**Returns:** *None*

```python
def my_tokenizer_factory():
return MyCustomTokenizer()
register_tokenizer("Foo/foo_tokenizer", my_tokenizer_factory)
```

## Referenced by

- [tinker_cookbook.tokenizer_utils.get_registered_tokenizer_names](https://tinker-docs.thinkingmachines.ai/cookbook/api-reference/tokenizer_utils/get_registered_tokenizer_names/index.md)
- [tinker_cookbook.tokenizer_utils.get_tokenizer](https://tinker-docs.thinkingmachines.ai/cookbook/api-reference/tokenizer_utils/get_tokenizer/index.md)
- [tinker_cookbook.tokenizer_utils.is_tokenizer_registered](https://tinker-docs.thinkingmachines.ai/cookbook/api-reference/tokenizer_utils/is_tokenizer_registered/index.md)