GateGPT: 56k tokens per second Transformer (KV cache) on FPGA at 80 MHz

 (twitter.com)

40 points | by laxmena a day ago ago

13 comments