open-autoglm-phone-agent

Skill by ara.so — Daily 2026 Skills collection. Open-AutoGLM is an open-source AI phone agent framework that enables natural language control of Android, HarmonyOS NEXT, and iOS devices. It uses the AutoGLM vision-language model (9B parameters) to perceive screen content and execute multi-step tasks like "open Meituan and search for nearby hot pot restaurants." BigModel (ZhipuAI) ModelScope Expected output includes a ... block followed by do(action="Launch", app="...") . If the chain-of-thought is very short or garbled, the model deployment has failed. For JavaScript/TypeScript automation using AutoGLM: The AutoGLM model outputs structured actions: Cause : Incorrect vLLM/SGLang startup parameters. Fix : Ensure --chat-template-content-format string (vLLM) and --mm-process-config with max_pixels:5000000 are set. Check transformers version compatibility. Fix : Fix : ADB Keyboard must be installed AND enabled: Cause : Model cannot identify a path to complete the task.