Skip to content

Commit b1c8b97

Browse files
feat: Added M1 Max Results (#2)
1 parent 43106f7 commit b1c8b97

2 files changed

Lines changed: 99 additions & 1 deletion

File tree

README.md

Lines changed: 42 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -69,6 +69,48 @@ to [raw_results.txt](raw_results.txt).
6969
</tbody>
7070
</table>
7171

72+
<table>
73+
<thead>
74+
<tr>
75+
<th colspan="4">M1 Max (10 CPU core, 32 GPU core, 64 GB RAM) </th>
76+
</tr>
77+
</thead>
78+
<thead>
79+
<tr>
80+
<th>Benchmark</th>
81+
<th>PyTorch time (s)</th>
82+
<th>MLX time (s)</th>
83+
</tr>
84+
</thead>
85+
<tbody>
86+
<tr>
87+
<td>Training a transformer <br> language model</td>
88+
<td> 1106.75 </td>
89+
<td> 752.25 </td>
90+
</tr>
91+
<tr>
92+
<td>Training BERT</td>
93+
<td> 793.67 </td>
94+
<td> 499.34 </td>
95+
</tr>
96+
<tr>
97+
<td>Whisper inference</td>
98+
<td> 21.28 </td>
99+
<td> 6.95 </td>
100+
</tr>
101+
<tr>
102+
<td>TinyLLama inference</td>
103+
<td> 50.98 </td>
104+
<td> 20.61 </td>
105+
</tr>
106+
<tr>
107+
<td>CPU/GPU switch</td>
108+
<td> 251.71 </td>
109+
<td> 214.57 </td>
110+
</tr>
111+
</tbody>
112+
</table>
113+
72114
<table>
73115
<thead>
74116
<tr>

raw_results.txt

Lines changed: 57 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,7 @@ Framework: pytorch
3030
Framework: mlx
3131
Average: 8.509361457824706s - Median: 8.509169936180115s
3232

33+
3334
---- TinyLLama inference ----
3435
=> Values from ten executions
3536

@@ -39,6 +40,7 @@ Framework: pytorch
3940
Framework: mlx
4041
Average: 33.38054447174072s - Median: 33.322925329208374s
4142

43+
4244
---- CPU/GPU switch ----
4345
=> Values from ten executions
4446

@@ -50,6 +52,58 @@ Framework: mlx
5052

5153
==================================================================
5254

55+
============================= M1 Max =============================
56+
57+
---- Training a transformers language model ----
58+
=> Values from three executions
59+
60+
Framework: pytorch
61+
Average: 1106.7549295464829s - Median: 1101.3749282211793s
62+
63+
Framework: mlx
64+
Average: 752.2592077255249s - Median: 752.2592812234227s
65+
66+
67+
---- Training BERT ----
68+
=> Values from three executions
69+
70+
Framework: pytorch
71+
Average: 793.6759963925679s - Median: 793.610111951828s
72+
73+
Framework: mlx
74+
Average: 499.343544960022s - Median: 498.0613958835602s
75+
76+
77+
---- Whisper inference ----
78+
=> Values from ten executions
79+
80+
Framework: pytorch
81+
Average: 21.27653947197935s - Median: 21.204530119895964s
82+
83+
Framework: mlx
84+
Average: 6.946336317062378s - Median: 6.937196493148804s
85+
86+
87+
---- TinyLLama inference ----
88+
=> Values from ten executions
89+
90+
Framework: pytorch
91+
Average: 50.98743650913239s - Median: 47.73779845237732s
92+
93+
Framework: mlx
94+
Average: 20.61291913986206s - Median: 20.613165140151978s
95+
96+
97+
---- CPU/GPU switch ----
98+
=> Values from ten executions
99+
100+
Framework: pytorch
101+
Average: 251.71098244190216s - Median: 252.021404504776s
102+
103+
Framework: mlx
104+
Average: 214.5735635280609s - Median: 214.57463908195496s
105+
106+
==================================================================
53107

54108
============================= M3 Max =============================
55109

@@ -82,6 +136,7 @@ Framework: pytorch
82136
Framework: mlx
83137
Average: 4.8507798433303835s - Median: 4.839159846305847s
84138

139+
85140
---- TinyLLama inference ----
86141
=> Values from ten executions
87142

@@ -91,6 +146,7 @@ Framework: pytorch
91146
Framework: mlx
92147
Average: 15.41469841003418s - Median: 15.389396786689758s
93148

149+
94150
---- CPU/GPU switch ----
95151
=> Values from ten executions
96152

@@ -100,4 +156,4 @@ Framework: pytorch
100156
Framework: mlx
101157
Average: 140.5102721452713s - Median: 140.51127195358276s
102158

103-
==================================================================
159+
==================================================================

0 commit comments

Comments
 (0)