Skip to content

Commit 43106f7

Browse files
committed
Update README
1 parent 7376540 commit 43106f7

1 file changed

Lines changed: 3 additions & 1 deletion

File tree

README.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -158,6 +158,7 @@ We utilized the model presented in [Conneau et al](https://arxiv.org/pdf/1705.02
158158
[BERT-tiny model](https://huggingface.co/prajjwal1/bert-tiny) for the respective BERT blocks. It classifies pairs of
159159
sentences as having a contradiction, entailment or neutral relation. It was implemented in pure PyTorch and pure
160160
MLX respectively. We do not initialize it with any pre-trained weights, so the benchmark can be seen as pure training.
161+
The dataset for training was the [NLI dataset](https://sbert.net/datasets/AllNLI.tsv.gz).
161162

162163
The only adaptation in this case was that we used PyTorch dataloader for the MLX model too, as it was compatible with
163164
the tokenizer library. Even though the data loader creates a PyTorch tensor for each input, we can transform it to a
@@ -168,7 +169,8 @@ numpy array without extra copies, so this setting did not harm the MLX results.
168169
For the PyTorch setting, we used HuggingFace transformers library to download and execute the tiny whisper model. For
169170
the MLX benchmark, we used the [MLX examples tools](https://github.com/ml-explore/mlx-examples/tree/main/whisper) to
170171
download tiny whisper and convert it to the MLX format, using `float32` as the inner data type to match that of PyTorch
171-
(see [mlx_models/configure.sh](mlx_models/configure.sh)).
172+
(see [mlx_models/configure.sh](mlx_models/configure.sh)). The inference code for MLX leverages the `mlx_whisper`
173+
library.
172174

173175
### TinyLLama inference
174176

0 commit comments

Comments
 (0)