Introducing LEAF: LLM Edge Assessment Framework for Generative AI on the Edge

Today's article comes from the journal of Machine Learning and Knowledge Extraction. The authors are Abdulkadhim et al., from Szechenyi Istvan University, in Hungary. In this paper they showcase a benchmarking suite designed specifically for generative AI models running on consumer hardware, edge devices, and smaller servers.

DOI: 10.3390/make8020048