On-Device Inference Benchmark: Gen AI tasks' performance across devices from Laptops to Mobile to Edge IoT
Works with both text and multimodal models and can be deployed on any devices
Compact text-audio-in model with optimized performance and size for edge devices
Pocket-size multimodal model with 9x token reduction for on-device deployment
AI Agent System Automates Influencer Discovery, Outreach and Campaign Management
LLM OS Empowering Seamless, Private, and Lightning-fast Interaction Across Mobile Apps
A practical exploration of on-device AI for chatting with document: from basic Q&A to specialized tasks with LoRA