# tinker_cookbook.eval.SamplingClientEvaluator

## *class* [**tinker_cookbook.eval.SamplingClientEvaluator**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/eval/evaluators.py#L35)()

An evaluator that uses a SamplingClient to compute metrics (e.g., accuracy).

```python
class AccuracyEval(SamplingClientEvaluator):
async def __call__(self, sampling_client):
acc = await measure_accuracy(sampling_client, self.test_set)
return {"eval/accuracy": acc}
```

### [**__call__**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/eval/evaluators.py#L46)(*sampling_client*)

Run evaluation and return a dict of metric names to values.

**Parameters:**

- [**sampling_client**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/eval/evaluators.py#L46) (*tinker.[SamplingClient](https://tinker-docs.thinkingmachines.ai/tinker/api-reference/samplingclient/index.md)*) – The Tinker sampling client to evaluate with.

**Returns:** A dict mapping metric names to float values.