This page (revision-34) was last changed on 23-Apr-2022 17:06 by Harry Metske

This page was created on 23-Apr-2022 17:06 by Harry Metske

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Page revision history

Version Date Modified Size Author Changes ... Change note
34 23-Apr-2022 17:06 32 KB Harry Metske to previous
33 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
32 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
31 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
30 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
29 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
28 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
27 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
26 23-Apr-2022 17:06 27 KB Harry Metske to previous | to last
25 23-Apr-2022 17:06 27 KB Harry Metske to previous | to last
24 23-Apr-2022 17:06 24 KB Harry Metske to previous | to last 3.0.0-svn-80
23 23-Apr-2022 17:06 19 KB Harry Metske to previous | to last
22 23-Apr-2022 17:06 19 KB Harry Metske to previous | to last
21 23-Apr-2022 17:06 17 KB Harry Metske to previous | to last

Page References

Incoming links Outgoing links
JSPWiki JUnit test performance management
JSPWiki JUnit test performance management

Version management

Difference between version and

At line 3 removed one line
* Use the information created with every run of the tests task, each JUnit test produces an [XML format report|TEST-org.apache.wiki.TextUtilTest.xml] containing response times, see tab
At line 5 changed 2 lines
%%tabbedSection
%%tab-Main
[{TableOfContents }]
\\
At line 7 added 3 lines
The idea is to use the information created by the JUnit tests.
\\Every time you run an " ant tests", a ''reports'' directory is created containing a test report for each test.
each JUnit test produces an [XML format report|TEST-org.apache.wiki.TextUtilTest.xml] containing response times, errors and failures.
At line 9 changed 3 lines
* parse all these files, get the response times out
* store them in an SQL DB (JSPWikiPerfDB)
* table testcase DDL:
I wrote some code that gathers this information and stores it in an SQL database.
\\It takes two parameters :
* the name of the directory %%small (i.e. "/home/metskem/workspace/JSPWiki/build/tests/reports") %%
* a tag that identifies this test run %%small (i.e. "3.0.0-svn-17") %%
If we gather this information for each JSPWiki level that has significant changes, we could analyze if, and where performance differences occur, and also keep track of a lot of other things.
! DDL testcaseresult table
At line 24 added one line
`tag` varchar(32) NOT NULL,
At line 18 changed one line
`timestamp` timestamp NOT NULL default CURRENT_TIMESTAMP on update CURRENT_TIMESTAMP,
`timestamp` timestamp NOT NULL,
At line 21 changed 3 lines
`time` int(11) NOT NULL default '0',
PRIMARY KEY (`hostname`,`timestamp`,`classname`,`name`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`time` double(8,3) NOT NULL default '0.000',
PRIMARY KEY (`hostname`,`classname`,`name`,`timestamp`)
) TYPE=InnoDB DEFAULT CHARSET=utf8;
At line 26 changed one line
* table testcase example content :
! Sample content testcaseresult
At line 28 changed 9 lines
mysql> select * from testcase;
+----------+---------------------+------------------------------+--------------------+------+
| hostname | timestamp | classname | name | time |
+----------+---------------------+------------------------------+--------------------+------+
| bismarck | 2009-02-14 18:03:35 | org.apache.wiki.TextUtilTest | testEncodeName_1 | 0 |
| bismarck | 2009-02-14 18:03:35 | org.apache.wiki.TextUtilTest | testEncodeName_2 | 6 |
| bismarck | 2009-02-14 18:03:35 | org.apache.wiki.TextUtilTest | testReplaceString1 | 1 |
+----------+---------------------+------------------------------+--------------------+------+
3 rows in set (0.01 sec)
mysql> select * from testcaseresult limit 10;
+--------------+----------+---------------------+---------------------------------------------+-------------------------------------+-------+
| tag | hostname | timestamp | classname | name | time |
+--------------+----------+---------------------+---------------------------------------------+-------------------------------------+-------+
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest | testDeleteGroup | 1.990 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest | testSaveExistingGroup | 1.968 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest | testSaveNewGroup | 2.011 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest | testView | 2.398 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest | testViewNonExistent | 1.972 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest | testViewNullGroup | 1.967 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | testRename | 1.975 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | testRenameReferences | 1.972 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | testRenameReferencesChangeRefsFalse | 1.969 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | testRenameReferencesChangeRefsTrue | 1.975 |
+--------------+----------+---------------------+---------------------------------------------+-------------------------------------+-------+
10 rows in set (0.01 sec)
At line 38 removed 2 lines
* table testsuite DDL :
{{{
At line 56 added 4 lines
! DDL testsuiteresult table
{{{
At line 64 added one line
`tag` varchar(32) NOT NULL,
At line 46 changed one line
`timestamp` timestamp NOT NULL default CURRENT_TIMESTAMP on update CURRENT_TIMESTAMP,
`timestamp` timestamp NOT NULL,
At line 51 changed 2 lines
PRIMARY KEY (`hostname`,`timestamp`,`name`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`time` double(8,3) NOT NULL default '0.000',
PRIMARY KEY (`hostname`,`name`,`timestamp`)
) TYPE=InnoDB DEFAULT CHARSET=utf8;
At line 56 removed one line
/%
At line 78 added one line
! Sample content testsuiteresult
At line 59 changed one line
%%tab-TestReport
{{{
mysql> select * from testsuiteresult;
+--------------+----------+---------------------+--------------------------------------------------------------+--------+-------+----------+--------+
| tag | hostname | timestamp | name | errors | tests | failures | time |
+--------------+----------+---------------------+--------------------------------------------------------------+--------+-------+----------+--------+
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest | 0 | 6 | 0 | 12.310 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | 0 | 6 | 0 | 11.867 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:54 | org.apache.wiki.action.WikiContextFactoryTest | 0 | 5 | 0 | 6.423 |
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:17:21 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 3 | 0 | 1.245 |
}}}
At line 61 changed one line
%%prettify
!! Running the collector tool
Each run will insert about 100 records in the testsuiteresult table, and about a 1000 rows in the testcaseresult table.
\\The following is an example output of a run:
At line 63 changed 271 lines
<?xml version="1.0" encoding="UTF-8" ?>
<testsuite errors="0" failures="0" hostname="bismarck" name="org.apache.wiki.TextUtilTest"
tests="34" time="0.025" timestamp="2009-02-14T18:03:35">
<properties>
<property name="env.DESKTOP_SESSION" value="gnome"></property>
<property name="file.encoding.pkg" value="sun.io"></property>
<property name="@logfile@" value="/tmp/jspwiki/logs/jspwiki.log"></property>
<property name="jdbc.jar.present" value="tests/lib/hsqldb.jar"></property>
<property name="java.home" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre"></property>
<property name="jdbc.driver.jar" value="tests/lib/hsqldb.jar"></property>
<property name="jspwiki.specialPage.NewGroup" value="NewGroup.jsp"></property>
<property name="env.GDM_LANG" value="en_US.UTF-8"></property>
<property name="war.compile.jsps" value="true"></property>
<property name="jspwiki.userdatabase.lockExpiry" value="lock_expiry"></property>
<property name="ant.file.JSPWiki" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
<property name="jspwiki.interWikiRef.TWiki" value="http://twiki.org/cgi-bin/view/TWiki/%s"></property>
<property name="env.DISPLAY" value=":0.0"></property>
<property name="env.LS_COLORS" value="no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.svgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:"></property>
<property name="debug" value="true"></property>
<property name="tests.db.scripts" value="tests/etc/db/hsql"></property>
<property name="env.XDG_SESSION_COOKIE" value="f054683b9c91e14bec778a5b48c6c18f-1234620764.533961-246543790"></property>
<property name="jspwiki.userdatabase.created" value="created"></property>
<property name="jspwiki.pageProvider" value="FileSystemProvider"></property>
<property name="jarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar"></property>
<property name="java.endorsed.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/endorsed"></property>
<property name="env.LOGNAME" value="metskem"></property>
<property name="jdbc.driver.url" value="jdbc:hsqldb:hsql://localhost/jspwiki"></property>
<property name="env.USERNAME" value="metskem"></property>
<property name="jdbc.driver.id" value="hsql"></property>
<property name="env.SESSION_MANAGER" value="local/bismarck:/tmp/.ICE-unix/12389"></property>
<property name="sun.os.patch.level" value="unknown"></property>
<property name="jspwiki.userdatabase.loginName" value="login_name"></property>
<property name="env.GDM_XSERVER_LOCATION" value="local"></property>
<property name="java.vendor.url" value="http://java.sun.com/"></property>
<property name="webtests.port" value="10024"></property>
<property name="java.version" value="1.5.0_16"></property>
<property name="env.ORBIT_SOCKETDIR" value="/tmp/orbit-metskem"></property>
<property name="svn.repository" value="http://svn.apache.org/repos/asf/incubator/jspwiki"></property>
<property name="jspwiki.templateDir" value="default"></property>
<property name="jspwiki.diffProvider" value="TraditionalDiffProvider"></property>
<property name="java.vendor.url.bug" value="http://java.sun.com/cgi-bin/bugreport.cgi"></property>
<property name="env.XDG_DATA_DIRS" value="/usr/local/share/:/usr/share/:/usr/share/gdm/"></property>
<property name="jspwiki.usePageCache" value="true"></property>
<property name="jspwiki.applicationName" value="JSPWiki"></property>
<property name="jspwiki.interWikiRef.WikiWikiWeb" value="http://c2.com/cgi/wiki?%s"></property>
<property name="user.name" value="metskem"></property>
<property name="env.LANG" value="en_US.UTF-8"></property>
<property name="sun.io.unicode.encoding" value="UnicodeLittle"></property>
<property name="@tests.auth.filename" value="/tmp/testrepository/auth.txt"></property>
<property name="sun.jnu.encoding" value="UTF-8"></property>
<property name="env.DBUS_SESSION_BUS_ADDRESS" value="unix:abstract=/tmp/dbus-lDtIGDPxHU,guid=8dfb9cc4886aa571127ca1264996d15d"></property>
<property name="java.runtime.name" value="Java(TM) 2 Runtime Environment, Standard Edition"></property>
<property name="optimize" value="false"></property>
<property name="jks.password" value="jspwiki"></property>
<property name="jspwiki.repository" value="priha"></property>
<property name="java.specification.name" value="Java Platform API Specification"></property>
<property name="@mail.smtp.port@" value="25"></property>
<property name="user.timezone" value=""></property>
<property name="selenium-rc.jar" value="tests/lib/selenium-server-1.0-beta1.jar"></property>
<property name="path.separator" value=":"></property>
<property name="@tests.filter@" value="tests/etc/filters.xml"></property>
<property name="@pagedir@" value="/tmp/jspwiki/wikipages"></property>
<property name="jspwiki.userdatabase.datasource" value="jdbc/UserDatabase"></property>
<property name="hsql.server.dbname.0" value="jspwiki"></property>
<property name="jspwiki.groupdatabase.member" value="member"></property>
<property name="file.encoding" value="UTF-8"></property>
<property name="jspwiki.attachmentProvider" value="BasicAttachmentProvider"></property>
<property name="build" value="/home/metskem/workspace/JSPWiki/build"></property>
<property name="env.HOME" value="/home/metskem"></property>
<property name="tests.reports" value="/home/metskem/workspace/JSPWiki/build/tests/reports"></property>
<property name="ant.file" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
<property name="jspwiki.translatorReader.allowHTML" value="false"></property>
<property name="env.GTK_RC_FILES" value="/etc/gtk/gtkrc:/home/metskem/.gtkrc-1.2-gnome2"></property>
<property name="java.io.tmpdir" value="/tmp"></property>
<property name="env.GNOME_KEYRING_PID" value="12379"></property>
<property name="user.language" value="en"></property>
<property name="jspwiki.translatorReader.useOutlinkImage" value="true"></property>
<property name="line.separator" value="
"></property>
<property name="jspwiki.userdatabase.table" value="users"></property>
<property name="jspwiki.baseURL" value=""></property>
<property name="jspwiki.rss.interval" value="3600"></property>
<property name="jspwiki.interWikiRef.Wikipedia" value="http://www.wikipedia.com/wiki/%s"></property>
<property name="@tests.logfile@" value="/tmp/jspwikitests.log"></property>
<property name="jspwiki.searchProvider" value="LuceneSearchProvider"></property>
<property name="webtests.reports" value="/home/metskem/workspace/JSPWiki/build/webtests/reports"></property>
<property name="jdbc.admin.id" value="SA"></property>
<property name="java.vm.info" value="mixed mode, sharing"></property>
<property name="jspwiki.userdatabase.password" value="password"></property>
<property name="sun.desktop" value="gnome"></property>
<property name="java.vm.specification.name" value="Java Virtual Machine Specification"></property>
<property name="env.COLORTERM" value="gnome-terminal"></property>
<property name="jspwiki.aclManager" value="org.apache.wiki.auth.acl.DefaultAclManager"></property>
<property name="jspwiki.plugin.searchPath" value=""></property>
<property name="jspwiki.groupdatabase.name" value="name"></property>
<property name="static.user" value="apache"></property>
<property name="compile.jsps" value="true"></property>
<property name="code.i18n" value="src/WebContent/WEB-INF/classes"></property>
<property name="testjarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar"></property>
<property name="env.GDMSESSION" value="gnome"></property>
<property name="env.GREP_COLOR" value="97;45"></property>
<property name="java.awt.printerjob" value="sun.print.PSPrinterJob"></property>
<property name="jspwiki.rss.fileName" value="rss.rdf"></property>
<property name="jspwiki.loginModule.class" value="org.apache.wiki.auth.login.UserDatabaseLoginModule"></property>
<property name="ant.version" value="Apache Ant version 1.7.1 compiled on October 3 2008"></property>
<property name="env.WINDOWID" value="60820599"></property>
<property name="@tests.workdir@" value="/tmp/testworkdir"></property>
<property name="webtests.temp" value="/tmp/webtests"></property>
<property name="jspwiki.interWikiRef.Doc" value="http://doc.jspwiki.org/2.8/wiki/%s"></property>
<property name="war.build" value="/home/metskem/workspace/JSPWiki/build/war"></property>
<property name="jspwiki.specialPage.UserPreferences" value="UserPreferences.jsp"></property>
<property name="tmplt.i18n.dir" value="i18n_templates"></property>
<property name="code.src" value="src/java"></property>
<property name="jspwiki.translatorReader.matchEnglishPlurals" value="true"></property>
<property name="jspwiki.groupdatabase.created" value="created"></property>
<property name="jspwiki.interWikiRef.Google" value="http://www.google.com/search?q=%s"></property>
<property name="db.scripts" value="etc/db/hsql"></property>
<property name="os.name" value="Linux"></property>
<property name="java.specification.vendor" value="Sun Microsystems Inc."></property>
<property name="code.web" value="src/WebContent"></property>
<property name="env.TERM" value="xterm"></property>
<property name="java.vm.name" value="Java HotSpot(TM) Client VM"></property>
<property name="@spamlog@" value="/tmp/jspwiki/logs/spamlog.log"></property>
<property name="jspwiki.groupdatabase.membertable" value="group_members"></property>
<property name="jdbc.admin.password" value=""></property>
<property name="jspwiki.specialPage.CreateGroup" value="NewGroup.jsp"></property>
<property name="jspwiki.rss.channelDescription" value="Oh poor me, my owner has not set jspwiki.rss.channelLanguage = en-us"></property>
<property name="@appname@" value="JSPWiki"></property>
<property name="hsql.server.database.0" value="file:jspwiki"></property>
<property name="jspwiki.breakTitleWithSpaces" value="false"></property>
<property name="java.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
<property name="svn.tag" value="trunk"></property>
<property name="jspwiki.userdatabase.modified" value="modified"></property>
<property name="env.PATH" value="/home/metskem/bin:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/X11R6/bin"></property>
<property name="jspwiki.userdatabase.attributes" value="attributes"></property>
<property name="jspwiki.fileSystemProvider.pageDir" value="/tmp/jspwiki/wikipages"></property>
<property name="hsql" value="true"></property>
<property name="ant.java.version" value="1.5"></property>
<property name="install.src" value="/tmp/metskem/JSPWiki/svnsrc"></property>
<property name="basedir" value="/home/metskem/workspace/JSPWiki"></property>
<property name="java.class.version" value="49.0"></property>
<property name="jspwiki.specialPage.Login" value="Login.jsp"></property>
<property name="env.LD_LIBRARY_PATH" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
<property name="jspwiki.tests.auth" value="true"></property>
<property name="ant.home" value="/usr/share/ant"></property>
<property name="@tests.pagedir@" value="/tmp/testrepository"></property>
<property name="env.GNOME_KEYRING_SOCKET" value="/tmp/keyring-s4QYDm/socket"></property>
<property name="release.dir" value="releases"></property>
<property name="static.group" value="daemon"></property>
<property name="jspwiki.rss.generate" value="false"></property>
<property name="docs.javadoc" value="doc/javadoc"></property>
<property name="jdbc.driver.class" value="org.hsqldb.jdbcDriver"></property>
<property name="sun.boot.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386"></property>
<property name="sun.management.compiler" value="HotSpot Client Compiler"></property>
<property name="db.props.exist" value="true"></property>
<property name="hsql.up" value="true"></property>
<property name="java.awt.graphicsenv" value="sun.awt.X11GraphicsEnvironment"></property>
<property name="jspwiki.authorizer" value="org.apache.wiki.auth.authorize.WebContainerAuthorizer"></property>
<property name="env.USER" value="metskem"></property>
<property name="jspwiki.groupdatabase.modifier" value="modifier"></property>
<property name="jspwiki.groupdatabase.creator" value="creator"></property>
<property name="jdbc.user.id" value="jspwiki"></property>
<property name="jspwiki.groupdatabase.table" value="groups"></property>
<property name="jdbc.user.password" value="password"></property>
<property name="ant.project.name" value="JSPWiki"></property>
<property name="webtests.build" value="/home/metskem/workspace/JSPWiki/build/webtests"></property>
<property name="jspwiki.groupdatabase.modified" value="modified"></property>
<property name="java.vm.specification.version" value="1.0"></property>
<property name="env.NLSPATH" value="/usr/dt/lib/nls/msg/%L/%N.cat"></property>
<property name="tmpdir" value="/tmp/metskem/JSPWiki"></property>
<property name="sun.cpu.isalist" value=""></property>
<property name="jspwiki.groupdatabase.datasource" value="jdbc/GroupDatabase"></property>
<property name="java.ext.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/ext"></property>
<property name="os.version" value="2.6.27-11-generic"></property>
<property name="jspwiki.userdatabase.fullName" value="full_name"></property>
<property name="jspwiki.interWikiRef.Edit" value="Edit.jsp?page=%s"></property>
<property name="user.home" value="/home/metskem"></property>
<property name="jspwiki.basicAttachmentProvider.storageDir" value="/tmp/jspwiki/wikipages"></property>
<property name="java.vm.vendor" value="Sun Microsystems Inc."></property>
<property name="webtests.browser" value="*firefox /tmp/ff/usr/lib/firefox/firefox-2-bin"></property>
<property name="build.properties" value="build.properties"></property>
<property name="env.JAVA_HOME" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16"></property>
<property name="hsql.server.port" value="9001"></property>
<property name="jspwiki.translatorReader.camelCaseLinks" value="false"></property>
<property name="env.XAUTHORITY" value="/home/metskem/.Xauthority"></property>
<property name="jspwiki.userdatabase.uid" value="uid"></property>
<property name="user.dir" value="/home/metskem/workspace/JSPWiki"></property>
<property name="env.WINDOWPATH" value="8:8:8:8"></property>
<property name="env.XFILESEARCHPATH" value="/usr/dt/app-defaults/%L/Dt"></property>
<property name="jspwiki.userdatabase.wikiName" value="wiki_name"></property>
<property name="env.PWD" value="/home/metskem/workspace/JSPWiki"></property>
<property name="sun.cpu.endian" value="little"></property>
<property name="warfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.war"></property>
<property name="jspwiki.userdatabase.role" value="role"></property>
<property name="@mail.from@" value="JSPWiki &lt;JSPWiki@localhost&gt;"></property>
<property name="deprecation" value="false"></property>
<property name="java.vm.version" value="1.5.0_16-b02"></property>
<property name="java.class.path" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar:/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/lib/tools.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/activation.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/akismet-java-1.02.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-codec-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-fileupload-1.2.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-httpclient-3.0.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-io-1.4.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-lang-2.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/ecs.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/freshcookies-security-0.60.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jabsorb-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-tablibs-standard-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-taglibs-jstl-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jaxen.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcl-over-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcr-1.0.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jdom.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jrcs-diff.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jsp-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jul-to-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/log4j-1.2.14.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene-highlighter.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/mail.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/nekohtml.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/oscache.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/priha-0.1.13.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/sandler.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/servlet-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-api-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-log4j12-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/stripes-1.5.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/xmlrpc.jar:/home/metskem/workspace/JSPWiki/tests/lib/commons-el-1.0.jar:/home/metskem/workspace/JSPWiki/tests/lib/custom_rhino.jar:/home/metskem/workspace/JSPWiki/tests/lib/hsqldb.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-compiler-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-runtime-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-jmx-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-plus-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-servlet-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/junit.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-java-client-driver-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-server-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xercesImpl-2.6.2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xml-apis-1.0.b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/yuicompressor-2.3.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/classes:/home/metskem/workspace/JSPWiki/tests/etc:/usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-junit.jar"></property>
<property name="ant.library.dir" value="/usr/share/ant/lib"></property>
<property name="webtests.shutdown" value="19041"></property>
<property name="os.arch" value="i386"></property>
<property name="jspwiki.interWikiRef.MeatballWiki" value="http://usemod.com/cgi-bin/mb.pl?%s"></property>
<property name="sun.java.launcher" value="SUN_STANDARD"></property>
<property name="tests.build" value="/home/metskem/workspace/JSPWiki/build/tests/classes"></property>
<property name="ant.core.lib" value="/usr/share/ant/lib/ant.jar"></property>
<property name="jspwiki.interWikiRef.JSPWiki" value="http://www.jspwiki.org/wiki/%s"></property>
<property name="java.vm.specification.vendor" value="Sun Microsystems Inc."></property>
<property name="jspwiki.groupdatabase" value="org.apache.wiki.auth.authorize.XMLGroupDatabase"></property>
<property name="code.build" value="/home/metskem/workspace/JSPWiki/build/classes"></property>
<property name="file.separator" value="/"></property>
<property name="jspwiki.userdatabase.email" value="email"></property>
<property name="jspwiki.encoding" value="UTF-8"></property>
<property name="java.runtime.version" value="1.5.0_16-b02"></property>
<property name="env.SSH_AUTH_SOCK" value="/tmp/keyring-s4QYDm/ssh"></property>
<property name="sun.boot.class.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/rt.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i18n.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jsse.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jce.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/charsets.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/classes"></property>
<property name="userdb.setup" value="tests/etc/db/hsql/userdb-setup.ddl"></property>
<property name="tests" value="tests"></property>
<property name="user.country" value="US"></property>
<property name="jspwiki.userdatabase.roleTable" value="roles"></property>
<property name="env.SHELL" value="/usr/bin/fish"></property>
<property name="@securitylog@" value="/tmp/jspwiki/logs/security.log"></property>
<property name="tests.src" value="tests/java"></property>
<property name="@mail.smtp.host@" value="127.0.0.1"></property>
<property name="java.vendor" value="Sun Microsystems Inc."></property>
<property name="install.fulldir" value="/tmp/metskem/JSPWiki/install"></property>
<property name="jspwiki.specialPage.FindPage" value="Search.jsp"></property>
<property name="env.GPG_AGENT_INFO" value="/tmp/seahorse-khoj7K/S.gpg-agent:12498:1"></property>
<property name="jspwiki.userdatabase" value="org.apache.wiki.auth.user.XMLUserDatabase"></property>
<property name="java.specification.version" value="1.5"></property>
<property name="jspwiki.lockExpiryTime" value="60"></property>
<property name="sun.arch.data.model" value="32"></property>
<property name="env.GNOME_DESKTOP_SESSION_ID" value="this-is-deprecated"></property>
<property name="userdb.teardown" value="tests/etc/db/hsql/userdb-teardown.ddl"></property>
</properties>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_2" time="0.0060"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeName_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_3" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_1" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString5" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive2" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive5" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata3" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata5" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata6" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata7" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetBooleanProperty" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection1" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testBooleanParameter" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testTrimmedProperty" time="0.0010"></testcase>
<system-out><![CDATA[]]></system-out>
<system-err><![CDATA[]]></system-err>
</testsuite>
21:08:14,974 WARN MainProcessor:122 - processing 106 files from directory /home/metskem/workspace/JSPWiki/build/tests/reports, tag : 3.0.0-svn-72
21:08:16,241 ERROR MainProcessor:135 - parsing completed in 1 second(s)
21:08:16,348 INFO DBUtil:100 - class com.mysql.jdbc.Driver succesfully loaded
21:08:17,993 INFO DBUtil:125 - transaction support present ? : true
21:08:27,327 WARN DBUtil:169 - committing changes....
21:08:27,330 WARN DBUtil:171 - commit completed
21:08:27,334 ERROR MainProcessor:97 - inserted 1161 rows in 11 seconds
At line 335 changed 3 lines
%%
/%
/%
!! Some useful queries
Here are a couple of examples of queries we could run.
! Overall statistics
{{{
mysql> select tag,sum(tests),avg(time),sum(time) from testsuiteresult group by tag order by tag;
+--------------+------------+-----------+-----------+
| tag | sum(tests) | avg(time) | sum(time) |
+--------------+------------+-----------+-----------+
| 2.8.2-svn-13 | 948 | 1.9197143 | 174.694 |
| 3.0.0-svn-17 | 944 | 5.5338652 | 492.514 |
| 3.0.0-svn-71 | 1050 | 4.4532762 | 467.594 |
| 3.0.0-svn-72 | 1055 | 4.5185849 | 478.970 |
| 3.0.0-svn-73 | 1057 | 4.6632617 | 498.969 |
| 3.0.0-svn-76 | 1033 | 4.5757476 | 471.302 |
| 3.0.0-svn-80 | 950 | 4.3344433 | 420.441 |
| 3.0.0-svn-85 | 949 | 3.0273196 | 293.650 |
| 3.0.0-svn-93 | 948 | 2.7866327 | 273.090 |
| 3.0.0-svn-96 | 948 | 2.8197959 | 276.340 |
+--------------+------------+-----------+-----------+
10 rows in set (0.06 sec)
}}}
! Number of testsuites having errors or failures, grouped by tag
There is also a [daily refreshed version|http://www.computerhok.nl/tmp/jspwiki-testresult.html]
{{{
mysql> select tag as version,max(timestamp) as date ,sum(tests) as tests ,sum(errors) as errors ,sum(failures)/sum(tests)*100 as 'error %',sum(failures) as failures, sum(failures)/sum(tests)*100 as 'failure %' from testsuiteresult group by tag order by timestamp;
+---------------+---------------------+-------+--------+---------+----------+-----------+
| version | date | tests | errors | error % | failures | failure % |
+---------------+---------------------+-------+--------+---------+----------+-----------+
| 3.0.0-svn-71 | 2009-02-19 19:21:30 | 1050 | 5 | 0.0952 | 1 | 0.0952 |
| 2.8.2-svn-13 | 2009-02-19 20:14:21 | 948 | 0 | 0.2110 | 2 | 0.2110 |
| 3.0.0-svn-17 | 2009-02-22 13:00:45 | 944 | 0 | 0.1059 | 1 | 0.1059 |
| 3.0.0-svn-72 | 2009-02-24 19:37:49 | 1055 | 5 | 0.1896 | 2 | 0.1896 |
| 3.0.0-svn-73 | 2009-02-25 20:21:18 | 1057 | 1 | 0.1892 | 2 | 0.1892 |
| 3.0.0-svn-76 | 2009-03-01 19:04:10 | 1033 | 1 | 0.0968 | 1 | 0.0968 |
| 3.0.0-svn-80 | 2009-03-06 20:41:24 | 950 | 45 | 7.6842 | 73 | 7.6842 |
| 3.0.0-svn-85 | 2009-03-18 18:07:45 | 949 | 46 | 8.6407 | 82 | 8.6407 |
| 3.0.0-svn-93 | 2009-04-05 17:26:52 | 948 | 53 | 12.1308 | 115 | 12.1308 |
| 3.0.0-svn-96 | 2009-04-06 17:09:47 | 948 | 70 | 10.8650 | 103 | 10.8650 |
| 3.0.0-svn-102 | 2009-04-16 18:28:20 | 952 | 50 | 11.6597 | 111 | 11.6597 |
| 3.0.0-svn-159 | 2009-09-30 19:07:11 | 998 | 37 | 3.2064 | 32 | 3.2064 |
| 3.0.0-svn-161 | 2009-10-08 17:55:33 | 1018 | 37 | 4.7151 | 48 | 4.7151 |
+---------------+---------------------+-------+--------+---------+----------+-----------+
13 rows in set (0.07 sec)
}}}
! Errors / failures by class / tag
{{{
mysql> select tag,name,errors,failures,time from testsuiteresult where failures>0 or errors > 0 order by name,tag;
+--------------+------------------------------------------------------------+--------+----------+---------+
| tag | name | errors | failures | time |
+--------------+------------------------------------------------------------+--------+----------+---------+
| 3.0.0-svn-80 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 0 | 1.092 |
| 3.0.0-svn-85 | org.apache.wiki.action.DeleteActionBeanTest | 0 | 3 | 1.123 |
| 3.0.0-svn-93 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 0 | 1.058 |
| 3.0.0-svn-80 | org.apache.wiki.action.RenameActionBeanTest | 0 | 6 | 13.108 |
| 3.0.0-svn-85 | org.apache.wiki.action.RenameActionBeanTest | 0 | 4 | 11.771 |
| 3.0.0-svn-93 | org.apache.wiki.action.RenameActionBeanTest | 0 | 4 | 11.249 |
| 3.0.0-svn-80 | org.apache.wiki.action.ViewActionBeanTest | 0 | 2 | 5.597 |
| 3.0.0-svn-80 | org.apache.wiki.action.WikiContextFactoryTest | 0 | 1 | 6.216 |
| 3.0.0-svn-80 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 1 | 0 | 1.032 |
| 3.0.0-svn-85 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 1 | 1.097 |
| 3.0.0-svn-93 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 1 | 1.666 |
| 3.0.0-svn-80 | org.apache.wiki.auth.AuthorizationManagerTest | 1 | 0 | 5.174 |
| 3.0.0-svn-93 | org.apache.wiki.auth.AuthorizationManagerTest | 0 | 2 | 4.960 |
| 3.0.0-svn-80 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.343 |
| 3.0.0-svn-85 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.470 |
| 3.0.0-svn-93 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.194 |
| 3.0.0-svn-80 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.225 |
| 3.0.0-svn-85 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.316 |
| 3.0.0-svn-93 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.111 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 0 | 1.236 |
| 3.0.0-svn-72 | org.apache.wiki.content.ContentManagerTest | 4 | 0 | 1.243 |
| 3.0.0-svn-85 | org.apache.wiki.content.ContentManagerTest | 1 | 0 | 1.261 |
| 3.0.0-svn-93 | org.apache.wiki.content.ContentManagerTest | 1 | 0 | 1.388 |
| 3.0.0-svn-93 | org.apache.wiki.content.EnglishPluralsPageNameResolverTest | 0 | 1 | 0.310 |
| 3.0.0-svn-80 | org.apache.wiki.content.PageRenamerTest | 17 | 3 | 7.174 |
| 3.0.0-svn-85 | org.apache.wiki.content.PageRenamerTest | 18 | 3 | 7.533 |
| 3.0.0-svn-93 | org.apache.wiki.content.PageRenamerTest | 18 | 3 | 7.391 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 0.103 |
| 3.0.0-svn-72 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 0.989 |
| 3.0.0-svn-73 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 3.377 |
| 3.0.0-svn-80 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 0 | 27 | 68.912 |
| 3.0.0-svn-85 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 1 | 28 | 67.451 |
| 3.0.0-svn-93 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 2 | 52 | 61.415 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.CounterPluginTest | 3 | 0 | 1.925 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.CounterPluginTest | 3 | 0 | 1.708 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.IndexPluginTest | 0 | 1 | 0.413 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.InsertPageTest | 0 | 2 | 2.137 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.PluginManagerTest | 15 | 0 | 6.208 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.RecentChangesPluginTest | 2 | 1 | 1.448 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.RecentChangesPluginTest | 0 | 3 | 3.612 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.RecentChangesPluginTest | 0 | 3 | 1.243 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 2 | 1.311 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 3 | 1.326 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 3 | 1.323 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferringPagesPluginTest | 1 | 3 | 3.605 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.ReferringPagesPluginTest | 0 | 6 | 3.553 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.ReferringPagesPluginTest | 0 | 7 | 3.520 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 2.926 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 3.001 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 2.874 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.837 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.836 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.893 |
| 3.0.0-svn-80 | org.apache.wiki.ReferenceManagerTest | 1 | 1 | 19.646 |
| 3.0.0-svn-85 | org.apache.wiki.ReferenceManagerTest | 14 | 2 | 15.744 |
| 3.0.0-svn-93 | org.apache.wiki.ReferenceManagerTest | 2 | 13 | 15.591 |
| 3.0.0-svn-85 | org.apache.wiki.render.RenderingManagerTest | 1 | 0 | 0.359 |
| 3.0.0-svn-80 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 1 | 0.737 |
| 3.0.0-svn-85 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 1 | 0.670 |
| 3.0.0-svn-93 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 2 | 0.656 |
| 3.0.0-svn-80 | org.apache.wiki.rss.RSSGeneratorTest | 2 | 0 | 0.948 |
| 3.0.0-svn-80 | org.apache.wiki.search.SearchManagerTest | 4 | 1 | 8.328 |
| 3.0.0-svn-85 | org.apache.wiki.search.SearchManagerTest | 4 | 1 | 8.068 |
| 3.0.0-svn-93 | org.apache.wiki.search.SearchManagerTest | 4 | 0 | 7.556 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.092 |
| 3.0.0-svn-72 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.093 |
| 3.0.0-svn-73 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.479 |
| 3.0.0-svn-76 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.102 |
| 3.0.0-svn-80 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.507 |
| 3.0.0-svn-85 | org.apache.wiki.ui.migrator.JspParserTest | 0 | 1 | 0.060 |
| 3.0.0-svn-93 | org.apache.wiki.ui.migrator.JspParserTest | 0 | 1 | 0.072 |
| 3.0.0-svn-80 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.437 |
| 3.0.0-svn-85 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.384 |
| 3.0.0-svn-93 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.135 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 0 | 1 | 20.025 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 0 | 1 | 37.644 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.495 |
| 3.0.0-svn-72 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.517 |
| 3.0.0-svn-73 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.863 |
| 3.0.0-svn-76 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.308 |
| 3.0.0-svn-80 | org.apache.wiki.WikiEngineTest | 5 | 13 | 15.016 |
| 3.0.0-svn-85 | org.apache.wiki.WikiEngineTest | 3 | 12 | 15.350 |
| 3.0.0-svn-93 | org.apache.wiki.WikiEngineTest | 4 | 10 | 14.265 |
| 3.0.0-svn-80 | org.apache.wiki.workflow.ApprovalWorkflowTest | 2 | 0 | 1.621 |
| 3.0.0-svn-85 | org.apache.wiki.workflow.ApprovalWorkflowTest | 0 | 2 | 1.587 |
| 3.0.0-svn-93 | org.apache.wiki.workflow.ApprovalWorkflowTest | 0 | 2 | 1.409 |
| 3.0.0-svn-80 | org.apache.wiki.xmlrpc.RPCHandlerTest | 4 | 0 | 1.447 |
| 3.0.0-svn-85 | org.apache.wiki.xmlrpc.RPCHandlerTest | 0 | 2 | 1.525 |
| 3.0.0-svn-93 | org.apache.wiki.xmlrpc.RPCHandlerTest | 1 | 0 | 1.193 |
| 3.0.0-svn-80 | stress.MassiveRepositoryTest | 1 | 0 | 124.826 |
| 3.0.0-svn-85 | stress.MassiveRepositoryTest | 1 | 0 | 0.391 |
+--------------+------------------------------------------------------------+--------+----------+---------+
91 rows in set (0.02 sec)
}}}
! Number of testsuites/testcases per tag (buildlevel)
{{{
mysql> select tag,count(*) from testcaseresult group by tag order by tag;
+--------------+----------+
| tag | count(*) |
+--------------+----------+
| 2.8.2-svn-13 | 948 |
| 3.0.0-svn-17 | 944 |
| 3.0.0-svn-71 | 1050 |
| 3.0.0-svn-72 | 1055 |
| 3.0.0-svn-73 | 1057 |
| 3.0.0-svn-76 | 1033 |
| 3.0.0-svn-80 | 950 |
+--------------+----------+
7 rows in set (0.22 sec)
}}}
! All testsuites per tag having errors or failures
{{{
mysql> select tag,name,tests,errors,failures from testsuiteresult where errors>0 or failures > 0 group by tag,name order by name,tag;
+--------------+---------------------------------------------------+-------+--------+----------+
| tag | name | tests | errors | failures |
+--------------+---------------------------------------------------+-------+--------+----------+
| 3.0.0-svn-80 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 3 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.action.RenameActionBeanTest | 7 | 0 | 6 |
| 3.0.0-svn-80 | org.apache.wiki.action.ViewActionBeanTest | 3 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.action.WikiContextFactoryTest | 5 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 3 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.auth.AuthorizationManagerTest | 15 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 11 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.auth.UserManagerTest | 5 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-72 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.content.PageRenamerTest | 21 | 17 | 3 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-72 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-73 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 200 | 0 | 27 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.InsertPageTest | 6 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.RecentChangesPluginTest | 3 | 2 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferredPagesPluginTest | 3 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferringPagesPluginTest | 8 | 1 | 3 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.TableOfContentsTest | 8 | 0 | 5 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 2 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.ReferenceManagerTest | 18 | 1 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.render.WysiwygEditingRendererTest | 2 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.rss.RSSGeneratorTest | 2 | 2 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.search.SearchManagerTest | 6 | 4 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-72 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-73 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-76 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.ui.stripes.HandlerInfoTest | 4 | 0 | 1 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-72 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-73 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-76 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.WikiEngineTest | 34 | 5 | 13 |
| 3.0.0-svn-80 | org.apache.wiki.workflow.ApprovalWorkflowTest | 5 | 2 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.xmlrpc.RPCHandlerTest | 4 | 4 | 0 |
| 3.0.0-svn-80 | stress.MassiveRepositoryTest | 1 | 1 | 0 |
+--------------+---------------------------------------------------+-------+--------+----------+
41 rows in set (0.02 sec)
}}}
! 10 most time taking testsuites
{{{
mysql> select tag,name,tests,time from testsuiteresult order by time desc,name,tag limit 10;
+--------------+------------------------------------------------+-------+--------+
| tag | name | tests | time |
+--------------+------------------------------------------------+-------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest | 1 | 84.526 |
| 3.0.0-svn-73 | stress.MassiveRepositoryTest | 1 | 81.273 |
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | 1 | 78.442 |
| 3.0.0-svn-72 | stress.MassiveRepositoryTest | 1 | 76.723 |
| 3.0.0-svn-76 | stress.MassiveRepositoryTest | 1 | 75.437 |
| 3.0.0-svn-17 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 70.827 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | 1 | 69.571 |
| 3.0.0-svn-73 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 68.615 |
| 3.0.0-svn-72 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 67.173 |
| 3.0.0-svn-76 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 66.869 |
+--------------+------------------------------------------------+-------+--------+
10 rows in set (0.03 sec)
}}}
! Classes with most testcases
{{{
mysql> select distinct name,tests from testsuiteresult order by tests desc limit 15;
+-----------------------------------------------------------+-------+
| name | tests |
+-----------------------------------------------------------+-------+
| org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 |
| org.apache.wiki.parser.CreoleToJSPWikiTranslatorTest | 83 |
| org.apache.wiki.WikiEngineTest | 44 |
| org.apache.wiki.TextUtilTest | 35 |
| org.apache.wiki.TextUtilTest | 34 |
| org.apache.wiki.workflow.WorkflowTest | 24 |
| org.apache.wiki.content.PageRenamerTest | 21 |
| org.apache.wiki.ReferenceManagerTest | 18 |
| org.apache.wiki.auth.AuthorizationManagerTest | 17 |
| org.apache.wiki.htmltowiki.HtmlStringToWikiTranslatorTest | 17 |
| org.apache.wiki.ReleaseTest | 17 |
| org.apache.wiki.plugin.PluginManagerTest | 16 |
| org.apache.wiki.VariableManagerTest | 16 |
| org.apache.wiki.workflow.SimpleDecisionTest | 16 |
| org.apache.wiki.dav.DavPathTest | 15 |
+-----------------------------------------------------------+-------+
15 rows in set (0.05 sec)
}}}
! 15 most time taking testcase methods
{{{
mysql> select tag,classname,name,time from testcaseresult order by time desc,name,tag limit 15;
+--------------+------------------------------------------+------------------------+--------+
| tag | classname | name | time |
+--------------+------------------------------------------+------------------------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest | testMassiveRepository1 | 84.308 |
| 3.0.0-svn-73 | stress.MassiveRepositoryTest | testMassiveRepository1 | 81.271 |
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | testMassiveRepository1 | 78.440 |
| 3.0.0-svn-72 | stress.MassiveRepositoryTest | testMassiveRepository1 | 76.721 |
| 3.0.0-svn-76 | stress.MassiveRepositoryTest | testMassiveRepository1 | 75.435 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | testMassiveRepository1 | 69.569 |
| 3.0.0-svn-73 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.724 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.530 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.474 |
| 3.0.0-svn-72 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.433 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.396 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.360 |
| 3.0.0-svn-73 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.349 |
| 3.0.0-svn-76 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.343 |
| 3.0.0-svn-72 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.340 |
+--------------+------------------------------------------+------------------------+--------+
15 rows in set (0.30 sec)
}}}
! Testsuites that have increased their test time the most between releases
{{{
mysql> select name,(max(time)-min(time))/avg(time)*100 as percdelta,min(time),max(time),avg(time) from testsuiteresult where tag='3.0.0-svn-71' or tag='3.0.0-svn-72' group by name order by 2 desc limit 25;
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
| name | percdelta | min(time) | max(time) | avg(time) |
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
| org.apache.wiki.auth.permissions.PagePermissionTest | 76.92307692308 | 0.004 | 0.009 | 0.0065000 |
| org.apache.wiki.dav.DavPathTest | 73.68421052632 | 0.006 | 0.013 | 0.0095000 |
| org.apache.wiki.auth.permissions.WikiPermissionTest | 66.66666666667 | 0.004 | 0.008 | 0.0060000 |
| org.apache.wiki.util.ClassUtilTest | 66.66666666667 | 0.003 | 0.006 | 0.0045000 |
| org.apache.wiki.workflow.SimpleDecisionTest | 60.00000000000 | 0.007 | 0.013 | 0.0100000 |
| org.apache.wiki.parser.CreoleToJSPWikiTranslatorTest | 49.81412639405 | 0.101 | 0.168 | 0.1345000 |
| org.apache.wiki.PageManagerTest | 47.19887955182 | 4.364 | 7.060 | 5.7120000 |
| org.apache.wiki.util.CommentedPropertiesTest | 46.40000000000 | 0.048 | 0.077 | 0.0625000 |
| org.apache.wiki.ui.migrator.JspDocumentTest | 40.00000000000 | 0.002 | 0.003 | 0.0025000 |
| org.apache.wiki.workflow.TaskTest | 40.00000000000 | 0.006 | 0.009 | 0.0075000 |
| org.apache.wiki.ui.migrator.JspParserTest | 38.46153846154 | 0.042 | 0.062 | 0.0520000 |
| org.apache.wiki.auth.permissions.GroupPermissionTest | 35.29411764706 | 0.007 | 0.010 | 0.0085000 |
| org.apache.wiki.auth.authorize.WebContainerAuthorizerTest | 34.02489626556 | 1.400 | 1.974 | 1.6870000 |
| org.apache.wiki.auth.authorize.GroupTest | 32.66381297333 | 2.541 | 3.533 | 3.0370000 |
| org.apache.wiki.util.PriorityListTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.parser.MarkupParserTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.content.WikiNameTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.PropertyReaderTest | 25.00000000000 | 0.014 | 0.018 | 0.0160000 |
| org.apache.wiki.attachment.AttachmentManagerTest | 24.69245065935 | 4.952 | 6.347 | 5.6495000 |
| org.apache.wiki.auth.acl.DefaultAclManagerTest | 24.02159244265 | 0.978 | 1.245 | 1.1115000 |
| org.apache.wiki.FileUtilTest | 23.85964912281 | 0.251 | 0.319 | 0.2850000 |
| org.apache.wiki.util.UtilJ2eeCompatTest | 22.22222222222 | 0.004 | 0.005 | 0.0045000 |
| org.apache.wiki.auth.authorize.JDBCGroupDatabaseTest | 21.84782608696 | 1.639 | 2.041 | 1.8400000 |
| org.apache.wiki.util.CryptoUtilTest | 18.18181818182 | 0.005 | 0.006 | 0.0055000 |
| org.apache.wiki.ReleaseTest | 18.18181818182 | 0.015 | 0.018 | 0.0165000 |
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
25 rows in set (0.03 sec)
}}}
This page (revision-34) was last changed on 23-Apr-2022 17:06 by Harry MetskeTop