issue
hey Simular team, thanks for open sourcing simulang, i've been experimenting with it for gui automations
what im trying to do is an Outlook triage workflow that goes through the list of unread emails (left rectangle below), clicks through each and gets full context of email body (right rectangle).
issue im facing is, as outlook doesn't expose AX based clicking for the email nodes, for clicking action, im using simulang’s MouseController, which sends global mouse events:
mouse.moveMouse(x, y, Coordinate.Abs)
mouse.button(Button.Left, Direction.Click)
these events go to the foreground UI, i.e., stealing focus
some references
previously im using cua-driver for such workflows, which synthesizes mouse events and posts them to the target pid via CGEvent, rather than using the global mouse. (see here for its implementation).
would be great if simulang supports such api for clicking without stealing focus, e.g.:
mouse.clickPid(pid, x, y)
mouse.clickWindow(windowId, x, y)
thanks!
issue
hey Simular team, thanks for open sourcing simulang, i've been experimenting with it for gui automations
what im trying to do is an Outlook triage workflow that goes through the list of unread emails (left rectangle below), clicks through each and gets full context of email body (right rectangle).
issue im facing is, as outlook doesn't expose AX based clicking for the email nodes, for clicking action, im using simulang’s
MouseController, which sends global mouse events:these events go to the foreground UI, i.e., stealing focus
some references
previously im using cua-driver for such workflows, which synthesizes mouse events and posts them to the target pid via CGEvent, rather than using the global mouse. (see here for its implementation).
would be great if simulang supports such api for clicking without stealing focus, e.g.:
thanks!