How to automate the click operation of "desktop software"?
the company"s project needs to automate the "mechanical repeated click action of some software", which involves: the click of the button, the selection of the file, the input of the input box,
to find the information on the Internet, and you can use the handle of windows to get some controls of the window.
excuse me: 1) which language is specifically implemented?
2) can all three of the above functions be implemented in this way?
3) if the company wants to hire an engineer to do this, which position should the company look for? (.net\ c-sharp\ cPP\ python?)
1. Use spy PP to get the handle of the related control.
2. Use pywin32 as a third-party library for programming.
3, then package it with pyInstaller, and you can use it on the windows machine.
if your software uses today's popular DrectUI interface, then spyPP will not be able to get a handle to the relevant control. I don't have any rice to mix. If other Daniel has a way, you might as well let me know.
pynput may satisfy you.
http://mp.weixin.qq.com/s/OcX.
there is a solution that pyautogui, can easily operate the mouse and keyboard. In fact, there are many free deliveries to manipulate the mouse and keyboard, and pywin32 is also a kind of solution. But I think the most troublesome thing is how to get the windows and controls you want to input. As 1L said, some UI interfaces really can't get control handles. However, pyautogui has a screenshot feature and comes with a locationOnScreen (you can see the official documents for details). However, the function of identifying the location has limitations, that is, the size of the image used for recognition must be the same as the original (please note that the size must be exactly the same, and the win10 should turn off the transparency effect), otherwise the location cannot be identified. However, you can use the screenshot function of pyautogui and opencv to achieve location, coupled with keyboard and mouse control can solve the problem that some UI can not get the handle and can't control it.
can't the button wizard satisfy you?
can simulate user actions, get page elements, encapsulate them into instructions and embed them in code.
I have done similar software, which was developed in the background of java. Encapsulating page instructions can be done with webdriver. If necessary, you can email me gaoyingde@foxmail.com
try the mouse module of python
.
