Skip to content

feat: add GetFile, GetFileList, ClearVirtualDisplays agent OS commands #277

Open
mlikasam-askui wants to merge 7 commits into
mainfrom
feat/agent-os-getfile-getfilelist-clear-virtual-displays
Open

feat: add GetFile, GetFileList, ClearVirtualDisplays agent OS commands #277
mlikasam-askui wants to merge 7 commits into
mainfrom
feat/agent-os-getfile-getfilelist-clear-virtual-displays

Conversation

@mlikasam-askui
Copy link
Copy Markdown
Contributor

Jira: SOLENG-363, SOLENG-362

mlikasam-askui and others added 5 commits May 13, 2026 08:46
Wire up three new commands on AskUiControllerClient via _send_command:

- get_file_list(path): returns the list of file paths at the given
  directory on the device under automation.
- get_file(path): decodes the base64 payload returned by the controller
  and dispatches to Image.Image when the bytes parse as an image, or to
  str when they decode cleanly as UTF-8 text. Anything else raises a
  DesktopAgentOsError, matching the server contract that always
  base64-encodes the raw file bytes.
- clear_virtual_displays(): removes all virtual displays, leaving only
  real ones active.
Comment thread src/askui/tools/askui/askui_controller.py
Comment thread src/askui/tools/askui/askui_controller.py
Comment thread src/askui/tools/askui/askui_controller.py
Comment thread src/askui/tools/askui/askui_controller.py Outdated
Comment thread src/askui/tools/store/computer/experimental/get_file.py
@philipph-askui
Copy link
Copy Markdown
Contributor

What happens if I have the current controller on mac and the agent tries to call the read_file, I assume it will crash?
Can we add a warning to the 2 new tools that they are currently only available under windows and that they will cause the execution to crash under mac/linux?

should we need to update the docs and add a hint, that e.g. the read_file operation is only available on windows currently?

@mlikasam-askui
Copy link
Copy Markdown
Contributor Author

What happens if I have the current controller on mac and the agent tries to call the read_file, I assume it will crash? Can we add a warning to the 2 new tools that they are currently only available under windows and that they will cause the execution to crash under mac/linux?

should we need to update the docs and add a hint, that e.g. the read_file operation is only available on windows currently?

It won’t crash. The agent will receive an error indicating that the currently used control does not support the requested command.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants