Honor Debuts a New AI Agent That Can Learn and Perceive Your Display

It selected a restaurant, however then could not full the method because the spot it selected required a bank card to substantiate a reservation, at which level the consumer needed to take over. You may be versatile in your question—in one other instance, asking it to e-book a “highly rated” restaurant meant it might take a look at opinions with excessive scores, although the agent does not do any extra analysis than that. It is not cross-referencing OpenTable opinions with knowledge from different components of the online, particularly since all of this knowledge is processed on gadget and is not despatched to the cloud.

This type of agentic synthetic intelligence is the present buzzword within the tech sphere. My colleague Will Knight lately examined an AI assistant that might browse the online and carry out duties on-line. Google late final yr unveiled its Gemini 2 AI mannequin educated to take actions in your behalf. It additionally renews the thought of a generative consumer interface for smartphones—at MWC 2024, we noticed just a few firms engaged on methods to work together with apps with out utilizing apps in any respect, as an alternative leaning on AI assistants to generate a consumer interface as you issued a command.

Honor’s method feels considerably like what Rabbit—of the notorious Rabbit R1—is doing with Educate Mode, the place you practice its assistant manually to finish a job. There isn’t any must entry an app’s Utility Programming Interface (API), which is the standard manner apps or companies talk with one another. The agent memorizes the method, permitting you to then problem the command and have it execute the duty.

However Honor says its self-reliant AI execution mannequin is not educated to observe strict steps—it is able to multimodal display context recognition to carry out duties autonomously. As an alternative of getting to coach the assistant to study each single a part of the OpenTable app, it’s able to understanding the semantic components of the consumer interface and can follow-through with a multi-step course of to execute your request. Honor highlighted that this course of was more economical: “Not like rivals reminiscent of Apple, Samsung, and Google, which depend on exterior APIs—leading to larger operational prices—Honor’s AI Agent independently manages a variety of duties.”