JSPWiki JUnit test performance management
Back to current versionRestore this version

JSPWiki JUnit test performance management#

Table of Contents


  • parse all these files, get the response times out
  • store them in an SQL DB (JSPWikiPerfDB)
  • table testcase DDL: 
DROP TABLE IF EXISTS `testcaseresult`;
SET @saved_cs_client     = @@character_set_client;
SET character_set_client = utf8;
CREATE TABLE `testcaseresult` (
  `tag` varchar(32) NOT NULL,
  `hostname` varchar(32) NOT NULL,
  `timestamp` timestamp NOT NULL,
  `classname` varchar(128) NOT NULL,
  `name` varchar(128) NOT NULL,
  `time` double(8,3) NOT NULL default '0.000',
  PRIMARY KEY  (`hostname`,`classname`,`name`,`timestamp`)
) TYPE=InnoDB DEFAULT CHARSET=utf8;
SET character_set_client = @saved_cs_client;
  • table testcase example content : 
mysql> select * from testcaseresult limit 10;
+--------------+----------+---------------------+---------------------------------------------+-------------------------------------+-------+
| tag          | hostname | timestamp           | classname                                   | name                                | time  |
+--------------+----------+---------------------+---------------------------------------------+-------------------------------------+-------+
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest  | testDeleteGroup                     | 1.990 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest  | testSaveExistingGroup               | 1.968 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest  | testSaveNewGroup                    | 2.011 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest  | testView                            | 2.398 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest  | testViewNonExistent                 | 1.972 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest  | testViewNullGroup                   | 1.967 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | testRename                          | 1.975 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | testRenameReferences                | 1.972 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | testRenameReferencesChangeRefsFalse | 1.969 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest | testRenameReferencesChangeRefsTrue  | 1.975 | 
+--------------+----------+---------------------+---------------------------------------------+-------------------------------------+-------+
10 rows in set (0.01 sec)
  • table testsuite DDL : 
DROP TABLE IF EXISTS `testsuiteresult`;
SET @saved_cs_client     = @@character_set_client;
SET character_set_client = utf8;
CREATE TABLE `testsuiteresult` (
  `tag` varchar(32) NOT NULL,
  `hostname` varchar(32) NOT NULL,
  `timestamp` timestamp NOT NULL,
  `name` varchar(128) NOT NULL,
  `errors` int(11) NOT NULL default '0',
  `tests` int(11) NOT NULL default '0',
  `failures` int(11) NOT NULL default '0',
  `time` double(8,3) NOT NULL default '0.000',
  PRIMARY KEY  (`hostname`,`name`,`timestamp`)
) TYPE=InnoDB DEFAULT CHARSET=utf8;
SET character_set_client = @saved_cs_client;
  • example testsuite result : 
mysql> select * from testsuiteresult;
+--------------+----------+---------------------+--------------------------------------------------------------+--------+-------+----------+--------+
| tag          | hostname | timestamp           | name                                                         | errors | tests | failures | time   |
+--------------+----------+---------------------+--------------------------------------------------------------+--------+-------+----------+--------+
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:15:55 | org.apache.wiki.action.GroupActionBeanTest                   |      0 |     6 |        0 | 12.310 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:18 | org.apache.wiki.action.RenameActionBeanTest                  |      0 |     6 |        0 | 11.867 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:16:54 | org.apache.wiki.action.WikiContextFactoryTest                |      0 |     5 |        0 |  6.423 | 
| 3.0.0-svn-71 | bismarck | 2009-02-19 19:17:21 | org.apache.wiki.auth.acl.DefaultAclManagerTest               |      0 |     3 |        0 |  1.245 |
  • save this in a file and execute it : mysql --host=blackpearl --database=JSPWikiPerfDB --user=....... --password=...... < ff.sql
' 

<?xml version="1.0" encoding="UTF-8" ?>
<testsuite errors="0" failures="0" hostname="bismarck" name="org.apache.wiki.TextUtilTest" 
tests="34" time="0.025" timestamp="2009-02-14T18:03:35">
  <properties>
    <property name="env.DESKTOP_SESSION" value="gnome"></property>
    <property name="file.encoding.pkg" value="sun.io"></property>
    <property name="@logfile@" value="/tmp/jspwiki/logs/jspwiki.log"></property>
    <property name="jdbc.jar.present" value="tests/lib/hsqldb.jar"></property>
    <property name="java.home" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre"></property>
    <property name="jdbc.driver.jar" value="tests/lib/hsqldb.jar"></property>
    <property name="jspwiki.specialPage.NewGroup" value="NewGroup.jsp"></property>
    <property name="env.GDM_LANG" value="en_US.UTF-8"></property>
    <property name="war.compile.jsps" value="true"></property>
    <property name="jspwiki.userdatabase.lockExpiry" value="lock_expiry"></property>
    <property name="ant.file.JSPWiki" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
    <property name="jspwiki.interWikiRef.TWiki" value="http://twiki.org/cgi-bin/view/TWiki/%s"></property>
    <property name="env.DISPLAY" value=":0.0"></property>
    <property name="env.LS_COLORS" value="no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.svgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:"></property>
    <property name="debug" value="true"></property>
    <property name="tests.db.scripts" value="tests/etc/db/hsql"></property>
    <property name="env.XDG_SESSION_COOKIE" value="f054683b9c91e14bec778a5b48c6c18f-1234620764.533961-246543790"></property>
    <property name="jspwiki.userdatabase.created" value="created"></property>
    <property name="jspwiki.pageProvider" value="FileSystemProvider"></property>
    <property name="jarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar"></property>
    <property name="java.endorsed.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/endorsed"></property>
    <property name="env.LOGNAME" value="metskem"></property>
    <property name="jdbc.driver.url" value="jdbc:hsqldb:hsql://localhost/jspwiki"></property>
    <property name="env.USERNAME" value="metskem"></property>
    <property name="jdbc.driver.id" value="hsql"></property>
    <property name="env.SESSION_MANAGER" value="local/bismarck:/tmp/.ICE-unix/12389"></property>
    <property name="sun.os.patch.level" value="unknown"></property>
    <property name="jspwiki.userdatabase.loginName" value="login_name"></property>
    <property name="env.GDM_XSERVER_LOCATION" value="local"></property>
    <property name="java.vendor.url" value="http://java.sun.com/"></property>
    <property name="webtests.port" value="10024"></property>
    <property name="java.version" value="1.5.0_16"></property>
    <property name="env.ORBIT_SOCKETDIR" value="/tmp/orbit-metskem"></property>
    <property name="svn.repository" value="http://svn.apache.org/repos/asf/incubator/jspwiki"></property>
    <property name="jspwiki.templateDir" value="default"></property>
    <property name="jspwiki.diffProvider" value="TraditionalDiffProvider"></property>
    <property name="java.vendor.url.bug" value="http://java.sun.com/cgi-bin/bugreport.cgi"></property>
    <property name="env.XDG_DATA_DIRS" value="/usr/local/share/:/usr/share/:/usr/share/gdm/"></property>
    <property name="jspwiki.usePageCache" value="true"></property>
    <property name="jspwiki.applicationName" value="JSPWiki"></property>
    <property name="jspwiki.interWikiRef.WikiWikiWeb" value="http://c2.com/cgi/wiki?%s"></property>
    <property name="user.name" value="metskem"></property>
    <property name="env.LANG" value="en_US.UTF-8"></property>
    <property name="sun.io.unicode.encoding" value="UnicodeLittle"></property>
    <property name="@tests.auth.filename" value="/tmp/testrepository/auth.txt"></property>
    <property name="sun.jnu.encoding" value="UTF-8"></property>
    <property name="env.DBUS_SESSION_BUS_ADDRESS" value="unix:abstract=/tmp/dbus-lDtIGDPxHU,guid=8dfb9cc4886aa571127ca1264996d15d"></property>
    <property name="java.runtime.name" value="Java(TM) 2 Runtime Environment, Standard Edition"></property>
    <property name="optimize" value="false"></property>
    <property name="jks.password" value="jspwiki"></property>
    <property name="jspwiki.repository" value="priha"></property>
    <property name="java.specification.name" value="Java Platform API Specification"></property>
    <property name="@mail.smtp.port@" value="25"></property>
    <property name="user.timezone" value=""></property>
    <property name="selenium-rc.jar" value="tests/lib/selenium-server-1.0-beta1.jar"></property>
    <property name="path.separator" value=":"></property>
    <property name="@tests.filter@" value="tests/etc/filters.xml"></property>
    <property name="@pagedir@" value="/tmp/jspwiki/wikipages"></property>
    <property name="jspwiki.userdatabase.datasource" value="jdbc/UserDatabase"></property>
    <property name="hsql.server.dbname.0" value="jspwiki"></property>
    <property name="jspwiki.groupdatabase.member" value="member"></property>
    <property name="file.encoding" value="UTF-8"></property>
    <property name="jspwiki.attachmentProvider" value="BasicAttachmentProvider"></property>
    <property name="build" value="/home/metskem/workspace/JSPWiki/build"></property>
    <property name="env.HOME" value="/home/metskem"></property>
    <property name="tests.reports" value="/home/metskem/workspace/JSPWiki/build/tests/reports"></property>
    <property name="ant.file" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
    <property name="jspwiki.translatorReader.allowHTML" value="false"></property>
    <property name="env.GTK_RC_FILES" value="/etc/gtk/gtkrc:/home/metskem/.gtkrc-1.2-gnome2"></property>
    <property name="java.io.tmpdir" value="/tmp"></property>
    <property name="env.GNOME_KEYRING_PID" value="12379"></property>
    <property name="user.language" value="en"></property>
    <property name="jspwiki.translatorReader.useOutlinkImage" value="true"></property>
    <property name="line.separator" value="
"></property>
    <property name="jspwiki.userdatabase.table" value="users"></property>
    <property name="jspwiki.baseURL" value=""></property>
    <property name="jspwiki.rss.interval" value="3600"></property>
    <property name="jspwiki.interWikiRef.Wikipedia" value="http://www.wikipedia.com/wiki/%s"></property>
    <property name="@tests.logfile@" value="/tmp/jspwikitests.log"></property>
    <property name="jspwiki.searchProvider" value="LuceneSearchProvider"></property>
    <property name="webtests.reports" value="/home/metskem/workspace/JSPWiki/build/webtests/reports"></property>
    <property name="jdbc.admin.id" value="SA"></property>
    <property name="java.vm.info" value="mixed mode, sharing"></property>
    <property name="jspwiki.userdatabase.password" value="password"></property>
    <property name="sun.desktop" value="gnome"></property>
    <property name="java.vm.specification.name" value="Java Virtual Machine Specification"></property>
    <property name="env.COLORTERM" value="gnome-terminal"></property>
    <property name="jspwiki.aclManager" value="org.apache.wiki.auth.acl.DefaultAclManager"></property>
    <property name="jspwiki.plugin.searchPath" value=""></property>
    <property name="jspwiki.groupdatabase.name" value="name"></property>
    <property name="static.user" value="apache"></property>
    <property name="compile.jsps" value="true"></property>
    <property name="code.i18n" value="src/WebContent/WEB-INF/classes"></property>
    <property name="testjarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar"></property>
    <property name="env.GDMSESSION" value="gnome"></property>
    <property name="env.GREP_COLOR" value="97;45"></property>
    <property name="java.awt.printerjob" value="sun.print.PSPrinterJob"></property>
    <property name="jspwiki.rss.fileName" value="rss.rdf"></property>
    <property name="jspwiki.loginModule.class" value="org.apache.wiki.auth.login.UserDatabaseLoginModule"></property>
    <property name="ant.version" value="Apache Ant version 1.7.1 compiled on October 3 2008"></property>
    <property name="env.WINDOWID" value="60820599"></property>
    <property name="@tests.workdir@" value="/tmp/testworkdir"></property>
    <property name="webtests.temp" value="/tmp/webtests"></property>
    <property name="jspwiki.interWikiRef.Doc" value="http://doc.jspwiki.org/2.8/wiki/%s"></property>
    <property name="war.build" value="/home/metskem/workspace/JSPWiki/build/war"></property>
    <property name="jspwiki.specialPage.UserPreferences" value="UserPreferences.jsp"></property>
    <property name="tmplt.i18n.dir" value="i18n_templates"></property>
    <property name="code.src" value="src/java"></property>
    <property name="jspwiki.translatorReader.matchEnglishPlurals" value="true"></property>
    <property name="jspwiki.groupdatabase.created" value="created"></property>
    <property name="jspwiki.interWikiRef.Google" value="http://www.google.com/search?q=%s"></property>
    <property name="db.scripts" value="etc/db/hsql"></property>
    <property name="os.name" value="Linux"></property>
    <property name="java.specification.vendor" value="Sun Microsystems Inc."></property>
    <property name="code.web" value="src/WebContent"></property>
    <property name="env.TERM" value="xterm"></property>
    <property name="java.vm.name" value="Java HotSpot(TM) Client VM"></property>
    <property name="@spamlog@" value="/tmp/jspwiki/logs/spamlog.log"></property>
    <property name="jspwiki.groupdatabase.membertable" value="group_members"></property>
    <property name="jdbc.admin.password" value=""></property>
    <property name="jspwiki.specialPage.CreateGroup" value="NewGroup.jsp"></property>
    <property name="jspwiki.rss.channelDescription" value="Oh poor me, my owner has not set jspwiki.rss.channelLanguage = en-us"></property>
    <property name="@appname@" value="JSPWiki"></property>
    <property name="hsql.server.database.0" value="file:jspwiki"></property>
    <property name="jspwiki.breakTitleWithSpaces" value="false"></property>
    <property name="java.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
    <property name="svn.tag" value="trunk"></property>
    <property name="jspwiki.userdatabase.modified" value="modified"></property>
    <property name="env.PATH" value="/home/metskem/bin:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/X11R6/bin"></property>
    <property name="jspwiki.userdatabase.attributes" value="attributes"></property>
    <property name="jspwiki.fileSystemProvider.pageDir" value="/tmp/jspwiki/wikipages"></property>
    <property name="hsql" value="true"></property>
    <property name="ant.java.version" value="1.5"></property>
    <property name="install.src" value="/tmp/metskem/JSPWiki/svnsrc"></property>
    <property name="basedir" value="/home/metskem/workspace/JSPWiki"></property>
    <property name="java.class.version" value="49.0"></property>
    <property name="jspwiki.specialPage.Login" value="Login.jsp"></property>
    <property name="env.LD_LIBRARY_PATH" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
    <property name="jspwiki.tests.auth" value="true"></property>
    <property name="ant.home" value="/usr/share/ant"></property>
    <property name="@tests.pagedir@" value="/tmp/testrepository"></property>
    <property name="env.GNOME_KEYRING_SOCKET" value="/tmp/keyring-s4QYDm/socket"></property>
    <property name="release.dir" value="releases"></property>
    <property name="static.group" value="daemon"></property>
    <property name="jspwiki.rss.generate" value="false"></property>
    <property name="docs.javadoc" value="doc/javadoc"></property>
    <property name="jdbc.driver.class" value="org.hsqldb.jdbcDriver"></property>
    <property name="sun.boot.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386"></property>
    <property name="sun.management.compiler" value="HotSpot Client Compiler"></property>
    <property name="db.props.exist" value="true"></property>
    <property name="hsql.up" value="true"></property>
    <property name="java.awt.graphicsenv" value="sun.awt.X11GraphicsEnvironment"></property>
    <property name="jspwiki.authorizer" value="org.apache.wiki.auth.authorize.WebContainerAuthorizer"></property>
    <property name="env.USER" value="metskem"></property>
    <property name="jspwiki.groupdatabase.modifier" value="modifier"></property>
    <property name="jspwiki.groupdatabase.creator" value="creator"></property>
    <property name="jdbc.user.id" value="jspwiki"></property>
    <property name="jspwiki.groupdatabase.table" value="groups"></property>
    <property name="jdbc.user.password" value="password"></property>
    <property name="ant.project.name" value="JSPWiki"></property>
    <property name="webtests.build" value="/home/metskem/workspace/JSPWiki/build/webtests"></property>
    <property name="jspwiki.groupdatabase.modified" value="modified"></property>
    <property name="java.vm.specification.version" value="1.0"></property>
    <property name="env.NLSPATH" value="/usr/dt/lib/nls/msg/%L/%N.cat"></property>
    <property name="tmpdir" value="/tmp/metskem/JSPWiki"></property>
    <property name="sun.cpu.isalist" value=""></property>
    <property name="jspwiki.groupdatabase.datasource" value="jdbc/GroupDatabase"></property>
    <property name="java.ext.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/ext"></property>
    <property name="os.version" value="2.6.27-11-generic"></property>
    <property name="jspwiki.userdatabase.fullName" value="full_name"></property>
    <property name="jspwiki.interWikiRef.Edit" value="Edit.jsp?page=%s"></property>
    <property name="user.home" value="/home/metskem"></property>
    <property name="jspwiki.basicAttachmentProvider.storageDir" value="/tmp/jspwiki/wikipages"></property>
    <property name="java.vm.vendor" value="Sun Microsystems Inc."></property>
    <property name="webtests.browser" value="*firefox /tmp/ff/usr/lib/firefox/firefox-2-bin"></property>
    <property name="build.properties" value="build.properties"></property>
    <property name="env.JAVA_HOME" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16"></property>
    <property name="hsql.server.port" value="9001"></property>
    <property name="jspwiki.translatorReader.camelCaseLinks" value="false"></property>
    <property name="env.XAUTHORITY" value="/home/metskem/.Xauthority"></property>
    <property name="jspwiki.userdatabase.uid" value="uid"></property>
    <property name="user.dir" value="/home/metskem/workspace/JSPWiki"></property>
    <property name="env.WINDOWPATH" value="8:8:8:8"></property>
    <property name="env.XFILESEARCHPATH" value="/usr/dt/app-defaults/%L/Dt"></property>
    <property name="jspwiki.userdatabase.wikiName" value="wiki_name"></property>
    <property name="env.PWD" value="/home/metskem/workspace/JSPWiki"></property>
    <property name="sun.cpu.endian" value="little"></property>
    <property name="warfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.war"></property>
    <property name="jspwiki.userdatabase.role" value="role"></property>
    <property name="@mail.from@" value="JSPWiki &lt;JSPWiki@localhost&gt;"></property>
    <property name="deprecation" value="false"></property>
    <property name="java.vm.version" value="1.5.0_16-b02"></property>
    <property name="java.class.path" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar:/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/lib/tools.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/activation.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/akismet-java-1.02.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-codec-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-fileupload-1.2.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-httpclient-3.0.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-io-1.4.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-lang-2.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/ecs.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/freshcookies-security-0.60.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jabsorb-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-tablibs-standard-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-taglibs-jstl-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jaxen.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcl-over-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcr-1.0.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jdom.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jrcs-diff.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jsp-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jul-to-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/log4j-1.2.14.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene-highlighter.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/mail.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/nekohtml.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/oscache.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/priha-0.1.13.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/sandler.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/servlet-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-api-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-log4j12-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/stripes-1.5.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/xmlrpc.jar:/home/metskem/workspace/JSPWiki/tests/lib/commons-el-1.0.jar:/home/metskem/workspace/JSPWiki/tests/lib/custom_rhino.jar:/home/metskem/workspace/JSPWiki/tests/lib/hsqldb.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-compiler-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-runtime-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-jmx-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-plus-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-servlet-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/junit.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-java-client-driver-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-server-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xercesImpl-2.6.2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xml-apis-1.0.b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/yuicompressor-2.3.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/classes:/home/metskem/workspace/JSPWiki/tests/etc:/usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-junit.jar"></property>
    <property name="ant.library.dir" value="/usr/share/ant/lib"></property>
    <property name="webtests.shutdown" value="19041"></property>
    <property name="os.arch" value="i386"></property>
    <property name="jspwiki.interWikiRef.MeatballWiki" value="http://usemod.com/cgi-bin/mb.pl?%s"></property>
    <property name="sun.java.launcher" value="SUN_STANDARD"></property>
    <property name="tests.build" value="/home/metskem/workspace/JSPWiki/build/tests/classes"></property>
    <property name="ant.core.lib" value="/usr/share/ant/lib/ant.jar"></property>
    <property name="jspwiki.interWikiRef.JSPWiki" value="http://www.jspwiki.org/wiki/%s"></property>
    <property name="java.vm.specification.vendor" value="Sun Microsystems Inc."></property>
    <property name="jspwiki.groupdatabase" value="org.apache.wiki.auth.authorize.XMLGroupDatabase"></property>
    <property name="code.build" value="/home/metskem/workspace/JSPWiki/build/classes"></property>
    <property name="file.separator" value="/"></property>
    <property name="jspwiki.userdatabase.email" value="email"></property>
    <property name="jspwiki.encoding" value="UTF-8"></property>
    <property name="java.runtime.version" value="1.5.0_16-b02"></property>
    <property name="env.SSH_AUTH_SOCK" value="/tmp/keyring-s4QYDm/ssh"></property>
    <property name="sun.boot.class.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/rt.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i18n.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jsse.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jce.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/charsets.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/classes"></property>
    <property name="userdb.setup" value="tests/etc/db/hsql/userdb-setup.ddl"></property>
    <property name="tests" value="tests"></property>
    <property name="user.country" value="US"></property>
    <property name="jspwiki.userdatabase.roleTable" value="roles"></property>
    <property name="env.SHELL" value="/usr/bin/fish"></property>
    <property name="@securitylog@" value="/tmp/jspwiki/logs/security.log"></property>
    <property name="tests.src" value="tests/java"></property>
    <property name="@mail.smtp.host@" value="127.0.0.1"></property>
    <property name="java.vendor" value="Sun Microsystems Inc."></property>
    <property name="install.fulldir" value="/tmp/metskem/JSPWiki/install"></property>
    <property name="jspwiki.specialPage.FindPage" value="Search.jsp"></property>
    <property name="env.GPG_AGENT_INFO" value="/tmp/seahorse-khoj7K/S.gpg-agent:12498:1"></property>
    <property name="jspwiki.userdatabase" value="org.apache.wiki.auth.user.XMLUserDatabase"></property>
    <property name="java.specification.version" value="1.5"></property>
    <property name="jspwiki.lockExpiryTime" value="60"></property>
    <property name="sun.arch.data.model" value="32"></property>
    <property name="env.GNOME_DESKTOP_SESSION_ID" value="this-is-deprecated"></property>
    <property name="userdb.teardown" value="tests/etc/db/hsql/userdb-teardown.ddl"></property>
  </properties>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_1" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_2" time="0.0060"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_3" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeName_1" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_1" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_2" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_3" time="0.0010"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_4" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_1" time="0.0010"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_2" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_3" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString1" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString4" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString5" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString2" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString3" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive1" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive2" time="0.0010"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive3" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive4" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive5" time="0.0010"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata1" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata2" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata3" time="0.0010"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata4" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata5" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata6" time="0.0010"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata7" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testGetBooleanProperty" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection1" time="0.0010"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection2" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection3" time="0.0"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testBooleanParameter" time="0.0010"></testcase>
  <testcase classname="org.apache.wiki.TextUtilTest" name="testTrimmedProperty" time="0.0010"></testcase>
  <system-out><![CDATA[]]></system-out>
  <system-err><![CDATA[]]></system-err>
</testsuite>

Some useful queries#

Overall statistics#

mysql> select tag,sum(tests),avg(time),sum(time) from testsuiteresult group by tag order by time;
+--------------+------------+-----------+-----------+
| tag          | sum(tests) | avg(time) | sum(time) |
+--------------+------------+-----------+-----------+
| 2.8.2-svn-13 |        948 | 1.9197143 |   174.694 | 
| 3.0.0-svn-17 |        944 | 5.5338652 |   492.514 | 
| 3.0.0-svn-71 |       1050 | 4.4532762 |   467.594 | 
+--------------+------------+-----------+-----------+
3 rows in set (0.29 sec)

All testsuites per tag having errors or failures#

mysql> select tag,name,tests,errors,failures from testsuiteresult where  errors>0 or failures > 0 group by tag,name order by name,tag;
+--------------+------------------------------------------------+-------+--------+----------+
| tag          | name                                           | tests | errors | failures |
+--------------+------------------------------------------------+-------+--------+----------+
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest     |     4 |      4 |        0 | 
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest  |     3 |      0 |        1 | 
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest |     8 |      1 |        0 | 
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest                 |    44 |      0 |        1 | 
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest                 |    44 |      0 |        1 | 
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest                 |    44 |      0 |        1 | 
+--------------+------------------------------------------------+-------+--------+----------+
6 rows in set (0.01 sec)

10 most time taking testsuites#

mysql> select tag,name,tests,time from testsuiteresult order by time desc,name,tag limit 10;
+--------------+------------------------------------------------+-------+--------+
| tag          | name                                           | tests | time   |
+--------------+------------------------------------------------+-------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest                   |     1 | 84.526 | 
| 3.0.0-svn-71 | stress.MassiveRepositoryTest                   |     1 | 78.442 | 
| 3.0.0-svn-17 | org.apache.wiki.parser.JSPWikiMarkupParserTest |   205 | 70.827 | 
| 2.8.2-svn-13 | stress.MassiveRepositoryTest                   |     1 | 69.571 | 
| 3.0.0-svn-71 | org.apache.wiki.parser.JSPWikiMarkupParserTest |   205 | 66.344 | 
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest       |     6 | 43.761 | 
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest       |     6 | 42.688 | 
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest       |     6 | 40.240 | 
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest                 |    44 | 37.644 | 
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest                 |    44 | 35.495 | 
+--------------+------------------------------------------------+-------+--------+
10 rows in set (0.01 sec)

Classes with most testcases#

mysql> select distinct name,tests from testsuiteresult order by tests desc limit 15;
+-----------------------------------------------------------+-------+
| name                                                      | tests |
+-----------------------------------------------------------+-------+
| org.apache.wiki.parser.JSPWikiMarkupParserTest            |   205 | 
| org.apache.wiki.parser.CreoleToJSPWikiTranslatorTest      |    83 | 
| org.apache.wiki.WikiEngineTest                            |    44 | 
| org.apache.wiki.TextUtilTest                              |    35 | 
| org.apache.wiki.TextUtilTest                              |    34 | 
| org.apache.wiki.workflow.WorkflowTest                     |    24 | 
| org.apache.wiki.content.PageRenamerTest                   |    21 | 
| org.apache.wiki.ReferenceManagerTest                      |    18 | 
| org.apache.wiki.auth.AuthorizationManagerTest             |    17 | 
| org.apache.wiki.htmltowiki.HtmlStringToWikiTranslatorTest |    17 | 
| org.apache.wiki.ReleaseTest                               |    17 | 
| org.apache.wiki.plugin.PluginManagerTest                  |    16 | 
| org.apache.wiki.VariableManagerTest                       |    16 | 
| org.apache.wiki.workflow.SimpleDecisionTest               |    16 | 
| org.apache.wiki.dav.DavPathTest                           |    15 | 
+-----------------------------------------------------------+-------+
15 rows in set (0.00 sec)

15 most time taking testcase methods#

mysql> select tag,classname,name,time from testcaseresult order by time desc,name,tag limit 15;
+--------------+-----------------------------------------------+------------------------------+--------+
| tag          | classname                                     | name                         | time   |
+--------------+-----------------------------------------------+------------------------------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest                  | testMassiveRepository1       | 84.308 | 
| 3.0.0-svn-71 | stress.MassiveRepositoryTest                  | testMassiveRepository1       | 78.440 | 
| 2.8.2-svn-13 | stress.MassiveRepositoryTest                  | testMassiveRepository1       | 69.569 | 
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch             | 10.530 | 
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch2            | 10.474 | 
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch3            | 10.396 | 
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch             | 10.360 | 
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch2            | 10.322 | 
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch3            | 10.316 | 
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch             | 10.070 | 
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch2            | 10.029 | 
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest      | testSimpleSearch3            | 10.029 | 
| 3.0.0-svn-71 | org.apache.wiki.providers.RCSFileProviderTest | testMillionChanges           |  7.179 | 
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest                | testExternalModificationRefs |  6.418 | 
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest                | testExternalModification     |  6.350 | 
+--------------+-----------------------------------------------+------------------------------+--------+
15 rows in set (0.11 sec)

Testsuites that have increased their test time the most between releases#

mysql> select name,(max(time)-min(time))/avg(time)*100 as percdelta,min(time),max(time) from testsuiteresult where tag='3.0.0-svn-17' or tag='2.8.2-svn-13' group by name order by 2 desc limit 25;
+-----------------------------------------------------------+-----------------+-----------+-----------+
| name                                                      | percdelta       | min(time) | max(time) |
+-----------------------------------------------------------+-----------------+-----------+-----------+
| org.apache.wiki.util.ClassUtilTest                        | 197.54098360656 |     0.003 |     0.485 | 
| org.apache.wiki.util.SerializerTest                       | 196.02649006623 |     0.003 |     0.299 | 
| org.apache.wiki.workflow.FactTest                         | 194.95798319328 |     0.003 |     0.235 | 
| org.apache.wiki.parser.MarkupParserTest                   | 194.78260869565 |     0.003 |     0.227 | 
| org.apache.wiki.ui.RedirectCommandTest                    | 194.61883408072 |     0.003 |     0.220 | 
| org.apache.wiki.util.UtilJ2eeCompatTest                   | 194.36619718310 |     0.005 |     0.350 | 
| org.apache.wiki.util.PriorityListTest                     | 192.88888888889 |     0.004 |     0.221 | 
| org.apache.wiki.auth.acl.AclEntryImplTest                 | 192.72727272727 |     0.004 |     0.216 | 
| org.apache.wiki.workflow.OutcomeTest                      | 192.19143576826 |     0.031 |     1.557 | 
| org.apache.wiki.ui.GroupCommandTest                       | 191.42300194932 |     0.044 |     2.008 | 
| org.apache.wiki.auth.permissions.AllPermissionTest        | 190.90909090909 |     0.005 |     0.215 | 
| org.apache.wiki.filters.FilterManagerTest                 | 190.89715536105 |     0.052 |     2.233 | 
| org.apache.wiki.plugin.GroupsTest                         | 190.70307960488 |     0.040 |     1.681 | 
| org.apache.wiki.util.MailUtilTest                         | 190.67110899572 |     0.049 |     2.052 | 
| org.apache.wiki.util.CryptoUtilTest                       | 190.62500000000 |     0.006 |     0.250 | 
| org.apache.wiki.ui.PageCommandTest                        | 190.48977650975 |     0.050 |     2.053 | 
| org.apache.wiki.auth.login.WebContainerLoginModuleTest    | 190.36973344798 |     0.056 |     2.270 | 
| org.apache.wiki.auth.permissions.WikiPermissionTest       | 189.47368421053 |     0.006 |     0.222 | 
| org.apache.wiki.dav.DavPathTest                           | 189.39393939394 |     0.007 |     0.257 | 
| org.apache.wiki.workflow.TaskTest                         | 189.18918918919 |     0.006 |     0.216 | 
| org.apache.wiki.ui.WikiCommandTest                        | 188.67187500000 |     0.058 |     1.990 | 
| org.apache.wiki.auth.login.CookieAssertionLoginModuleTest | 188.39694656489 |     0.057 |     1.908 | 
| org.apache.wiki.plugin.UndefinedPagesPluginTest           | 188.21630347054 |     0.073 |     2.405 | 
| org.apache.wiki.render.WysiwygEditingRendererTest         | 188.12260536398 |     0.062 |     2.026 | 
| org.apache.wiki.auth.login.UserDatabaseLoginModuleTest    | 187.73869346734 |     0.061 |     1.929 | 
+-----------------------------------------------------------+-----------------+-----------+-----------+
25 rows in set (0.02 sec)