Computer Use interface #967
Oceania2018
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Implement a unified abstraction layer for computer use. Currently, each company's model has differences in API implementation, but the fundamental principle remains the same: recognizing clickable elements through screen captures, outputting coordinates, and performing operations using the operating system's mouse and keyboard APIs.
Beta Was this translation helpful? Give feedback.
All reactions