首页 > 代码库 > EasyMonkeyDevice vs MonkeyDevice&HierarchyViewer API Mapping Matrix

EasyMonkeyDevice vs MonkeyDevice&HierarchyViewer API Mapping Matrix

1. 前言

本来这次文章的title是写成和前几篇类似的《EasyMonkeyDevice API实践全记录》,内容也打算把每个API的实践和建议给记录下来,但后来想了下觉得这样子并不是最好的方法,鉴于EasyMonkeyDevice其实就是在前几章描述的MonkeyDevice和HierarchyViewer的基础上加了一层Wrapper,把原来的通过接受坐标点或者ViewNode来操作控件的思想统一成通过控件ID来操作,其实最终它们都会转换成坐标点或ViewNode进行操作。以touch和visible这两个API为例子,大家看下以下的源码就很清楚了。
MonkeyDevice里面的touch是用坐标点作为参数的,而下面的EasyMonkeyDevice用得是id(By这个类里面就一个ID而已,有兴趣查其源码),最终还是转成坐标点:
public void touch(By selector, TouchPressType type)
    {
        Point p = getElementCenter(selector);
        mDevice.getImpl().touch(p.x, p.y, type);
    }
HierarchyViewer里面的Visible用的是ViewNode,EasyMonkeyDevice用得是id,最终还是转成ViewNode:
public boolean visible(By selector)
    {
        ViewNode node = selector.findView(mHierarchyViewer);
        return mHierarchyViewer.visible(node);
    }
所以本文应该除了给出API的实践之外还应该把每个API和其与MonkeyDevice和HierarchyViewer的API所对应的API给列出来做一个对应的Map,方便我们参考。

实践中我们还是用SDK自带的NotePad APK,假设已经有一个Note存在的情况下,通过以下步骤来走一遍EasyMonkeyDevice的所有API:
  • 使用MonkeyDevice对象实例化EasyMonkeyDevice
  • 通过ID Touch一个Note
  • 获得进入NoteEditor activity后的WindowId并验证是否正确
  • 通过ID检查Note的内容这个EditText是否存在和可见
  • 通过Note的ID获得Text
  • 通过Note的ID Type进新Text
  • 通过Note的ID获得Location
以下是我们操作过程中会看到的两个Activity的截图,先贴上来给大家对以上步骤有一个感性认识,最后我会贴出实践验证性代码。
NotesList Activity截图:

NoteEditor Activity截图:


2. EaysyMonkeyDevice API List and Sample

EasyMonkeyDevice是在MonkeyDevice和HierarchyViewer的基础上出来的一个类,按照本人的理解,主要增加的功能就是:

  • 在MonkeyDevice和HierarchyViewer的基础上针对部分API增加了对控件ID的支持以操作控件
以下是个人整理的列表:尝试对所有的API进行一个描述和示例Demo

Return

EasyMonkeyDevice

Demo

Comment

 

 

EasyMonkeyDevice(

MonkeyDevice device)

Use Monkey device to construct

an EasyMonkeyDevice object,

note that it would instantiate a

HierarchyViewer member by

device within this constructor

 

device = MonkeyRunner.waitForConnection()

 

eDevice=EasyMonkeyDevice(device)

Constructor

Void

touch(By selector,

TouchPressType type)

Sends a touch event specified

by ‘type’ to the screen location

specified by ‘by’

 触摸点击主窗口:

#Step 1: try touching on the first note

eDevice.touch(By.id(‘id/text1‘),

              MonkeyDevice.DOWN_AND_UP)

触摸弹出框或Menu Options会失败:

MonkeyRunner.sleep(2)

print ‘Show Menu Options‘

device.press(‘KEYCODE_MENU‘,

             MonkeyDevice.DOWN_AND_UP);

 

MonkeyRunner.sleep(3)

print ‘Press on the menu entry of \

 \"Add note\"‘

eDevice.touch(By.id(‘id/title‘),

               MonkeyDevice.DOWN)

 

参数By实际上

只有By.ID,从

其源码可以看

出来;

type参数跟

MonkeyDevice

一样就那几个

DOWN/UP之类的

 

根据个人实践

和网上评论,

对系统菜单和

弹出框的支持

有问题

Void

type(By selector, String text)

Types a string into the specified

object

 

#Step 5: setText

eDevice.type(By.id(noteId), ‘New‘)

 

Boolean

exists(By selector)

Checks if the specified object

exists.

 

#Step3: is note EditText exist?

noteId = ‘id/note‘

if True == eDevice.exists(By.id(noteId)):

    print ‘Note exist‘

else:

    print ‘Note not found!‘

    exit(2)

 

Boolean

visible(By selector)

Checks if the specified object is visible.

 

#Step4: is note EditText visible?

if True == eDevice.visible(By.id(noteId)):

    print ‘Note is visible‘

else:

    print ‘Note is invisible‘

    exit(3)

 

String

getText(By selector)

Obtain the text in the selected

input box.

 

#Step 4: getText

text = eDevice.getText(By.id(noteId))

print ‘Note text:‘,text.encode(‘utf-8‘)

 

String

getFocusedWindowId()

Gets the id of the focused window.

returns = "The symbolic id of the

focused window or None."

 

#Step 2: Get the window ID

winId = ‘com.example.android.notepad/\

    com.example.android.notepad.NoteEditor‘

#Need to sleep a while till ready

MonkeyRunner.sleep(3)

winId = eDevice.getFocusedWindowId()

if(winId == winId):

    print "Edit Note WinId is:",\

        winId.encode(‘utf-8‘)

else:

    print "Failed"

    exit(1)



 结果跟

HierarchyViewer

getFocusedWin

dowName

返回值一模

一样,所以

猜想WindowID

WindowName

是同一回事

PyTuple

locate(By selector)

Locates the coordinates of the

selected object

returns = "Tuple containing

(x,y,w,h) location and size.")

 

#Step 6: locate

locate = eDevice.locate(By.id(noteId))

print ‘Location(x,y,w,h) is:‘,locate

 


3. EasyMonkeyDevice vs MonkeyDevice API Mapping Matrix

这里会列出MonkeyDevice的所有API已经EasyMonkeyDevice与其对应的API,没有去掉冗余是因为方便今后Reference的时候知道EasyMonkeyDevice并不是完全把所有MonkeyDevice的API都进行Wrap的,只有以下两个。下面一章理同。
  • touch:MonkeyDevice通过坐标点touch;EasyMonkeyDevice通过控件ID去touch
  • type:MonkeyDevice往当前focused地方输入;EasyMonkeyDevice往由ID指定控件输入

EasyMonkeyDevice API vs MonkeyDevice API

 

MonkeyDevice

EasyMonkeyDevice

Comment

 

Void broadcastIntent (string uri, string action,

 string data, string mimetype, 

iterable categories dictionary extras, 

component component, iterable flags)

Broadcasts an Intent to this device, as if the

Intent were coming from an application.

 

 

Void drag (tuple start, tuple end, float duration, 

integer steps)

Simulates a drag gesture (touch, hold, and

move) on this device‘s screen.

 

 

ObjectgetProperty (string key)

Given the name of a system environment

variable, returns its value for this device.

The available variable names are listed in

the detailed description of this method.

 

 

ObjectgetSystemProperty (string key)

The API equivalent of adb shell getprop

<key>. This is provided for

use by platform developers.

 

 

Void installPackage (string path)

Installs the Android application or test package

 contained in packageFile onto this device.

If the application or test package is already

installed, it is replaced.

 

 

Dictionaryinstrument (string className, dictionary args)

Runs the specified component under

Android instrumentation, and returns the results

 in a dictionary whose exact format is dictated

by the component being run.

 The component must already be present on

this device.

 

 

Void press (string name, dictionary type)

Sends the key event specified by type to the

key specified by keycode.

 

 

Void reboot (string into)

Reboots this device into the bootloader

specified by bootloadType.

 

 

Void removePackage (string package)

Deletes the specified package from this device,

 including its data and cache.

 

 

Objectshell (string cmd)

Executes an adb shell command and returns

the result, if any.

 

 

Void startActivity (string uri, string action, 

string data, string mimetype, iterable categories 

dictionary extras, component component, flags)

Starts an Activity on this device by sending an

Intent constructed from the supplied arguments.

 

 

MonkeyImagetakeSnapshot()

Captures the entire screen buffer of this device,

yielding a MonkeyImage object containing

a screen capture of the current display.

 

 

Void touch (integer x, integer y, integer type)

Sends a touch event specified by type to the

screen location specified by x and y.

Void touch(By selector, TouchPressType type)

Sends a touch event specified by

‘type’ to the screen location specified

 by ‘by’

MonkeyDevice通过坐标点touch

EasyMonkeyDevice通过控件IDtouch

Void type (string message)

Sends the characters contained in message to

this device, as if they had been typed on

the device‘s keyboard. This is equivalent to

calling press() for each keycode in message 

using the key event type DOWN_AND_UP.

Void type(By selector, String text)

Types a string into the specified

object

MonkeyDevice往当前focused地方输入;

EasyMonkeyDevice往由ID指定控件输入

Void wake ()

Wakes the screen of this device.

 

 

HierarchyViewer getHierarchyViewer()

Get the HierarchyViewer object for the device.

 

 

PyListgetPropertyList()

Retrieve the properties that can be queried

 

 

PyListgetViewIdList()

Retrieve the view ids for the current application

 

 

MonkeyViewgetViewById(String id)

doc = "Obtains the view with the specified id.",

args = {"id"},

argDocs = {"The id of the view to retrieve."},

returns = "The view object with the specified id."

 

 

MonkeyViewgetViewByAccessibilityIds(String WinId, String accessId)

args = {"windowId", "accessibility id"}

argDocs = {"The window id of the view to

retrieve.", "The accessibility id of the view to

retrieve."},

returns = "The view object with the specified id.")

 

 

MonkeyViewgetRootView()

Obtains current root view

 

 

PyListgetViewsByText(String text)

Obtains a list of views that contain the specified

text.",

args = {"text"},

returns = "A list of view objects that contain the specified text.")

 

 


4. EasyMonkeyDevice vs HierarchyViewer Mapping Matrix

EasyMonkeyDevice Wrap了HiearchyViewer 的相应API而得到以下这些API
  • getFocusedWindowId:Wrap了hierarchyviewer的getFocusedWindowName,不再使用ViewNode而使用ID来的获得Window id/Name,其实根据我的实践id/name是同一回事
  • locate:其实就是把HierarchyViewer的getAbsolutePositionOfView和getAbsoluteCenterOfView整合在一起获得起始坐标和Width/Hight,前者获得其实坐标,后者获得中心位置,相减后乘以2就是EasyMonkeyDevice想要的Width/Hight了
  • visible: 同样是把参数由ViewNode改成id
  • getText:同上

EasyMonkeyDevice API vs HierarchViewer API

 

HierarchyViewer

EasyMonkeyDevice

Comment

 

public ViewNode findViewById(String id)

/**

* Find a view by id.

* @param id id for the view.

* @return view with the specified ID, or {@code null} if no view found.

*/

 

 

 

public ViewNode findViewById(String id, ViewNode rootNode)

/**

* Find a view by ID, starting from the given root node

* @param id ID of the view you‘re looking for

* @param rootNode the ViewNode at which to begin the traversal

* @return view with the specified ID, or {@code null} if no view found.

*/

 

 

public String getFocusedWindowName()

/**

* Gets the window that currently receives the focus.

* @return name of the window that currently receives the focus.

*/

 

String getFocusedWindowId()

Gets the id of the focused window.

returns = "The symbolic id of the focused window or None."

 

public static Point getAbsolutePositionOfView(ViewNode node)/**

* Gets the absolute x/y position of the view node.

*

* @param node view node to find position of.

* @return point specifying the x/y position of the node.

*/

 

PyTuple locate(By selector)

Locates the coordinates of the selected object

returns = "Tuple containing (x,y,w,h) location and size.")

 

public static Point getAbsoluteCenterOfView(ViewNode node)

/**

* Gets the absolute x/y center of the specified view node.

*

* @param node view node to find position of.

* @return absolute x/y center of the specified view node.

*/

public boolean visible(ViewNode node)

/**

* Gets the visibility of a given element.

* @param selector selector for the view.

* @return True if the element is visible.

*/

 

boolean visible(By selector)

Checks if the specified object is visible.

 

public String getText(ViewNode node)

/**

* Gets the text of a given element.

*

* @param selector selector for the view.

* @return the text of the given element.

*/

 

String getText(By selector)

Obtain the text in the selected input box.

 


5. EasyMonkeyDevice Standalone API

剩下一个API是没有跟以上的MonkeyDevice和HierarchyViewer有任何对应关系的:
  • visible:通过id检查该控件是否存在,猜想应该是google在代码重构的时候增加的一个方法方便大家判断而已

EasyMonkeyDevice Standalone API

 

EasyMonkeDevice

Comment

 

boolean exists(By selector)

Checks if the specified object exists.

 


6. 验证性代码

from com.android.monkeyrunner import MonkeyRunner,MonkeyDevice,MonkeyImage
from com.android.monkeyrunner.easy import EasyMonkeyDevice,By
from com.android.chimpchat.hierarchyviewer import HierarchyViewer
from com.android.hierarchyviewerlib.models import ViewNode, Window
from java.awt import Point

#from com.android.hierarchyviewerlib.device import 

#Connect to the target device

device = MonkeyRunner.waitForConnection()

eDevice=EasyMonkeyDevice(device) 
device.startActivity(component="com.example.android.notepad/com.example.android.notepad.NotesList")

'''
MonkeyRunner.sleep(2)
print 'Show Menu Options'
device.press('KEYCODE_MENU',
             MonkeyDevice.DOWN_AND_UP);

MonkeyRunner.sleep(3)
print 'Press on the menu entry of  \"Add note\"'
eDevice.touch(By.id('id/title'),
               MonkeyDevice.DOWN)

MonkeyRunner.sleep(2)
device.press('KEYCODE_MENU', 
             MonkeyDevice.DOWN_AND_UP);
'''

#Step 1: try touching on the first note
eDevice.touch(By.id('id/text1'),
              MonkeyDevice.DOWN_AND_UP)

#Step 2: Get the window ID 
winId = 'com.example.android.notepad/    com.example.android.notepad.NoteEditor'
#Need to sleep a while till ready
MonkeyRunner.sleep(3)
winId = eDevice.getFocusedWindowId() 
if(winId == winId):
    print "Edit Note WinId is:",        winId.encode('utf-8')
else:
    print "Failed"
    exit(1)

#Step3: is note EditText exist?
noteId = 'id/note'
if True == eDevice.exists(By.id(noteId)):
    print 'Note exist'
else:
    print 'Note not found!'
    exit(2)

#Step4: is note EditText visible?
if True == eDevice.visible(By.id(noteId)):
    print 'Note is visible'
else:
    print 'Note is invisible'
    exit(3)

#Step 4: getText
text = eDevice.getText(By.id(noteId))
print 'Note text:',text.encode('utf-8')

#Step 5: setText
eDevice.type(By.id(noteId), 'New')

#Step 6: locate
locate = eDevice.locate(By.id(noteId))
print 'Location(x,y,w,h) is:',locate

7. EasyMonkeyDevice Source Code for Your Reference 

/*jadclipse*/// Decompiled by Jad v1.5.8e. Copyright 2001 Pavel Kouznetsov.

package com.android.monkeyrunner.easy;

import com.android.chimpchat.hierarchyviewer.HierarchyViewer;
import com.android.hierarchyviewerlib.models.ViewNode;
import com.android.monkeyrunner.JythonUtils;
import com.google.common.base.Preconditions;
import org.python.core.*;

public class By extends PyObject
    implements ClassDictInit
{

    public static void classDictInit(PyObject dict)
    {
        JythonUtils.convertDocAnnotationsForClass(com/android/monkeyrunner/easy/By, dict);
    }

    By(String id)
    {
        this.id = id;
    }

    public static By id(PyObject args[], String kws[])
    {
        ArgParser ap = JythonUtils.createArgParser(args, kws);
        Preconditions.checkNotNull(ap);
        String id = ap.getString(0);
        return new By(id);
    }

    public static By id(String id)
    {
        return new By(id);
    }

    public ViewNode findView(HierarchyViewer viewer)
    {
        return viewer.findViewById(id);
    }

    private String id;
}


/*
	DECOMPILATION REPORT

	Decompiled from: D:\Projects\Workspace\JarPackages\monkeyrunner.jar
	Total time: 69 ms
	Jad reported messages/errors:
The class file version is 50.0 (only 45.3, 46.0 and 47.0 are supported)
	Exit status: 0
	Caught exceptions:
*/

8. By Class Source Code for Your Better Reference

/*jadclipse*/// Decompiled by Jad v1.5.8e. Copyright 2001 Pavel Kouznetsov.

package com.android.monkeyrunner.easy;

import com.android.chimpchat.core.IChimpDevice;
import com.android.chimpchat.core.TouchPressType;
import com.android.chimpchat.hierarchyviewer.HierarchyViewer;
import com.android.hierarchyviewerlib.models.ViewNode;
import com.android.monkeyrunner.JythonUtils;
import com.android.monkeyrunner.MonkeyDevice;
import com.google.common.base.Preconditions;
import java.util.Set;
import org.eclipse.swt.graphics.Point;
import org.python.core.*;

// Referenced classes of package com.android.monkeyrunner.easy:
//            By

public class EasyMonkeyDevice extends PyObject
    implements ClassDictInit
{

    public static void classDictInit(PyObject dict)
    {
        JythonUtils.convertDocAnnotationsForClass(com/android/monkeyrunner/easy/EasyMonkeyDevice, dict);
    }

    public EasyMonkeyDevice(MonkeyDevice device)
    {
        mDevice = device;
        mHierarchyViewer = device.getImpl().getHierarchyViewer();
    }

    public void touch(PyObject args[], String kws[])
    {
        ArgParser ap = JythonUtils.createArgParser(args, kws);
        Preconditions.checkNotNull(ap);
        By selector = getSelector(ap, 0);
        String tmpType = ap.getString(1);
        TouchPressType type = TouchPressType.fromIdentifier(tmpType);
        Preconditions.checkNotNull(type, (new StringBuilder()).append("Invalid touch type: ").append(tmpType).toString());
        touch(selector, type);
    }

    public void touch(By selector, TouchPressType type)
    {
        Point p = getElementCenter(selector);
        mDevice.getImpl().touch(p.x, p.y, type);
    }

    public void type(PyObject args[], String kws[])
    {
        ArgParser ap = JythonUtils.createArgParser(args, kws);
        Preconditions.checkNotNull(ap);
        By selector = getSelector(ap, 0);
        String text = ap.getString(1);
        type(selector, text);
    }

    public void type(By selector, String text)
    {
        Point p = getElementCenter(selector);
        mDevice.getImpl().touch(p.x, p.y, TouchPressType.DOWN_AND_UP);
        mDevice.getImpl().type(text);
    }

    public PyTuple locate(PyObject args[], String kws[])
    {
        ArgParser ap = JythonUtils.createArgParser(args, kws);
        Preconditions.checkNotNull(ap);
        By selector = getSelector(ap, 0);
        ViewNode node = selector.findView(mHierarchyViewer);
        Point p = HierarchyViewer.getAbsolutePositionOfView(node);
        PyTuple tuple = new PyTuple(new PyObject[] {
            new PyInteger(p.x), new PyInteger(p.y), new PyInteger(node.width), new PyInteger(node.height)
        });
        return tuple;
    }

    public boolean exists(PyObject args[], String kws[])
    {
        ArgParser ap = JythonUtils.createArgParser(args, kws);
        Preconditions.checkNotNull(ap);
        By selector = getSelector(ap, 0);
        return exists(selector);
    }

    public boolean exists(By selector)
    {
        ViewNode node = selector.findView(mHierarchyViewer);
        return node != null;
    }

    public boolean visible(PyObject args[], String kws[])
    {
        ArgParser ap = JythonUtils.createArgParser(args, kws);
        Preconditions.checkNotNull(ap);
        By selector = getSelector(ap, 0);
        return visible(selector);
    }

    public boolean visible(By selector)
    {
        ViewNode node = selector.findView(mHierarchyViewer);
        return mHierarchyViewer.visible(node);
    }

    public String getText(PyObject args[], String kws[])
    {
        ArgParser ap = JythonUtils.createArgParser(args, kws);
        Preconditions.checkNotNull(ap);
        By selector = getSelector(ap, 0);
        return getText(selector);
    }

    public String getText(By selector)
    {
        ViewNode node = selector.findView(mHierarchyViewer);
        return mHierarchyViewer.getText(node);
    }

    public String getFocusedWindowId(PyObject args[], String kws[])
    {
        return getFocusedWindowId();
    }

    public String getFocusedWindowId()
    {
        return mHierarchyViewer.getFocusedWindowName();
    }

    public PyObject __findattr_ex__(String name)
    {
        if(!EXPORTED_METHODS.contains(name))
            return mDevice.__findattr_ex__(name);
        else
            return super.__findattr_ex__(name);
    }

    private By getSelector(ArgParser ap, int i)
    {
        return (By)ap.getPyObject(i).__tojava__(com/android/monkeyrunner/easy/By);
    }

    private Point getElementCenter(By selector)
    {
        ViewNode node = selector.findView(mHierarchyViewer);
        if(node == null)
        {
            throw new PyException(Py.ValueError, String.format("View not found: %s", new Object[] {
                selector
            }));
        } else
        {
            Point p = HierarchyViewer.getAbsoluteCenterOfView(node);
            return p;
        }
    }

    private MonkeyDevice mDevice;
    private HierarchyViewer mHierarchyViewer;
    private static final Set EXPORTED_METHODS = JythonUtils.getMethodNames(com/android/monkeyrunner/easy/EasyMonkeyDevice);

}


/*
	DECOMPILATION REPORT

	Decompiled from: D:\Projects\Workspace\JarPackages\monkeyrunner.jar
	Total time: 920 ms
	Jad reported messages/errors:
The class file version is 50.0 (only 45.3, 46.0 and 47.0 are supported)
	Exit status: 0
	Caught exceptions:
*/


EasyMonkeyDevice vs MonkeyDevice&HierarchyViewer API Mapping Matrix