Ferret-UI: MLLMs for Enhanced UI Understanding & On-Device Interaction
Ferret-UI is an MLLM designed for mobile UI understanding, addressing general MLLM limitations. Ferret-UI Lite offers local, private on-device interaction, using synthetic data & a multi-agent system. It excels in low-level tasks, with evolution to multi-platform support.