This page (revision-34) was last changed on 23-Apr-2022 17:06 by Harry Metske

This page was created on 23-Apr-2022 17:06 by Harry Metske

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Page revision history

Version Date Modified Size Author Changes ... Change note
34 23-Apr-2022 17:06 32 KB Harry Metske to previous
33 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
32 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
31 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
30 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
29 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
28 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
27 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
26 23-Apr-2022 17:06 27 KB Harry Metske to previous | to last
25 23-Apr-2022 17:06 27 KB Harry Metske to previous | to last
24 23-Apr-2022 17:06 24 KB Harry Metske to previous | to last 3.0.0-svn-80
23 23-Apr-2022 17:06 19 KB Harry Metske to previous | to last
22 23-Apr-2022 17:06 19 KB Harry Metske to previous | to last
21 23-Apr-2022 17:06 17 KB Harry Metske to previous | to last

Page References

Incoming links Outgoing links
JSPWiki JUnit test performance management
JSPWiki JUnit test performance management

Version management

Difference between version and

At line 3 removed one line
* Use the information created with every run of the tests task, each JUnit test produces an [XML format report|TEST-org.apache.wiki.TextUtilTest.xml] containing response times, see tab
At line 5 changed 2 lines
%%tabbedSection
%%tab-Main
[{TableOfContents }]
\\
At line 7 added 3 lines
The idea is to use the information created by the JUnit tests.
\\Every time you run an " ant tests", a ''reports'' directory is created containing a test report for each test.
each JUnit test produces an [XML format report|TEST-org.apache.wiki.TextUtilTest.xml] containing response times, errors and failures.
At line 9 changed 3 lines
* parse all these files, get the response times out
* store them in an SQL DB (JSPWikiPerfDB)
* table testcase DDL:
I wrote some code that gathers this information and stores it in an SQL database.
\\It takes two parameters :
* the name of the directory %%small (i.e. "/home/metskem/workspace/JSPWiki/build/tests/reports") %%
* a tag that identifies this test run %%small (i.e. "3.0.0-svn-17") %%
If we gather this information for each JSPWiki level that has significant changes, we could analyze if, and where performance differences occur, and also keep track of a lot of other things.
! DDL testcaseresult table
At line 27 changed one line
* table testcase example content :
! Sample content testcaseresult
At line 46 changed one line
* table testsuite DDL :
! DDL testsuiteresult table
At line 64 changed one line
* example testsuite result :
! Sample content testsuiteresult
At line 75 removed 3 lines
* save this in a file and execute it : ''mysql --host=blackpearl --database=JSPWikiPerfDB --user=....... --password=...... < ff.sql
''
/%
At line 91 added one line
!! Running the collector tool
At line 80 changed 3 lines
%%tab-TestReport
%%prettify
Each run will insert about 100 records in the testsuiteresult table, and about a 1000 rows in the testcaseresult table.
\\The following is an example output of a run:
At line 84 changed 271 lines
<?xml version="1.0" encoding="UTF-8" ?>
<testsuite errors="0" failures="0" hostname="bismarck" name="org.apache.wiki.TextUtilTest"
tests="34" time="0.025" timestamp="2009-02-14T18:03:35">
<properties>
<property name="env.DESKTOP_SESSION" value="gnome"></property>
<property name="file.encoding.pkg" value="sun.io"></property>
<property name="@logfile@" value="/tmp/jspwiki/logs/jspwiki.log"></property>
<property name="jdbc.jar.present" value="tests/lib/hsqldb.jar"></property>
<property name="java.home" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre"></property>
<property name="jdbc.driver.jar" value="tests/lib/hsqldb.jar"></property>
<property name="jspwiki.specialPage.NewGroup" value="NewGroup.jsp"></property>
<property name="env.GDM_LANG" value="en_US.UTF-8"></property>
<property name="war.compile.jsps" value="true"></property>
<property name="jspwiki.userdatabase.lockExpiry" value="lock_expiry"></property>
<property name="ant.file.JSPWiki" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
<property name="jspwiki.interWikiRef.TWiki" value="http://twiki.org/cgi-bin/view/TWiki/%s"></property>
<property name="env.DISPLAY" value=":0.0"></property>
<property name="env.LS_COLORS" value="no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.svgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:"></property>
<property name="debug" value="true"></property>
<property name="tests.db.scripts" value="tests/etc/db/hsql"></property>
<property name="env.XDG_SESSION_COOKIE" value="f054683b9c91e14bec778a5b48c6c18f-1234620764.533961-246543790"></property>
<property name="jspwiki.userdatabase.created" value="created"></property>
<property name="jspwiki.pageProvider" value="FileSystemProvider"></property>
<property name="jarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar"></property>
<property name="java.endorsed.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/endorsed"></property>
<property name="env.LOGNAME" value="metskem"></property>
<property name="jdbc.driver.url" value="jdbc:hsqldb:hsql://localhost/jspwiki"></property>
<property name="env.USERNAME" value="metskem"></property>
<property name="jdbc.driver.id" value="hsql"></property>
<property name="env.SESSION_MANAGER" value="local/bismarck:/tmp/.ICE-unix/12389"></property>
<property name="sun.os.patch.level" value="unknown"></property>
<property name="jspwiki.userdatabase.loginName" value="login_name"></property>
<property name="env.GDM_XSERVER_LOCATION" value="local"></property>
<property name="java.vendor.url" value="http://java.sun.com/"></property>
<property name="webtests.port" value="10024"></property>
<property name="java.version" value="1.5.0_16"></property>
<property name="env.ORBIT_SOCKETDIR" value="/tmp/orbit-metskem"></property>
<property name="svn.repository" value="http://svn.apache.org/repos/asf/incubator/jspwiki"></property>
<property name="jspwiki.templateDir" value="default"></property>
<property name="jspwiki.diffProvider" value="TraditionalDiffProvider"></property>
<property name="java.vendor.url.bug" value="http://java.sun.com/cgi-bin/bugreport.cgi"></property>
<property name="env.XDG_DATA_DIRS" value="/usr/local/share/:/usr/share/:/usr/share/gdm/"></property>
<property name="jspwiki.usePageCache" value="true"></property>
<property name="jspwiki.applicationName" value="JSPWiki"></property>
<property name="jspwiki.interWikiRef.WikiWikiWeb" value="http://c2.com/cgi/wiki?%s"></property>
<property name="user.name" value="metskem"></property>
<property name="env.LANG" value="en_US.UTF-8"></property>
<property name="sun.io.unicode.encoding" value="UnicodeLittle"></property>
<property name="@tests.auth.filename" value="/tmp/testrepository/auth.txt"></property>
<property name="sun.jnu.encoding" value="UTF-8"></property>
<property name="env.DBUS_SESSION_BUS_ADDRESS" value="unix:abstract=/tmp/dbus-lDtIGDPxHU,guid=8dfb9cc4886aa571127ca1264996d15d"></property>
<property name="java.runtime.name" value="Java(TM) 2 Runtime Environment, Standard Edition"></property>
<property name="optimize" value="false"></property>
<property name="jks.password" value="jspwiki"></property>
<property name="jspwiki.repository" value="priha"></property>
<property name="java.specification.name" value="Java Platform API Specification"></property>
<property name="@mail.smtp.port@" value="25"></property>
<property name="user.timezone" value=""></property>
<property name="selenium-rc.jar" value="tests/lib/selenium-server-1.0-beta1.jar"></property>
<property name="path.separator" value=":"></property>
<property name="@tests.filter@" value="tests/etc/filters.xml"></property>
<property name="@pagedir@" value="/tmp/jspwiki/wikipages"></property>
<property name="jspwiki.userdatabase.datasource" value="jdbc/UserDatabase"></property>
<property name="hsql.server.dbname.0" value="jspwiki"></property>
<property name="jspwiki.groupdatabase.member" value="member"></property>
<property name="file.encoding" value="UTF-8"></property>
<property name="jspwiki.attachmentProvider" value="BasicAttachmentProvider"></property>
<property name="build" value="/home/metskem/workspace/JSPWiki/build"></property>
<property name="env.HOME" value="/home/metskem"></property>
<property name="tests.reports" value="/home/metskem/workspace/JSPWiki/build/tests/reports"></property>
<property name="ant.file" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
<property name="jspwiki.translatorReader.allowHTML" value="false"></property>
<property name="env.GTK_RC_FILES" value="/etc/gtk/gtkrc:/home/metskem/.gtkrc-1.2-gnome2"></property>
<property name="java.io.tmpdir" value="/tmp"></property>
<property name="env.GNOME_KEYRING_PID" value="12379"></property>
<property name="user.language" value="en"></property>
<property name="jspwiki.translatorReader.useOutlinkImage" value="true"></property>
<property name="line.separator" value="
"></property>
<property name="jspwiki.userdatabase.table" value="users"></property>
<property name="jspwiki.baseURL" value=""></property>
<property name="jspwiki.rss.interval" value="3600"></property>
<property name="jspwiki.interWikiRef.Wikipedia" value="http://www.wikipedia.com/wiki/%s"></property>
<property name="@tests.logfile@" value="/tmp/jspwikitests.log"></property>
<property name="jspwiki.searchProvider" value="LuceneSearchProvider"></property>
<property name="webtests.reports" value="/home/metskem/workspace/JSPWiki/build/webtests/reports"></property>
<property name="jdbc.admin.id" value="SA"></property>
<property name="java.vm.info" value="mixed mode, sharing"></property>
<property name="jspwiki.userdatabase.password" value="password"></property>
<property name="sun.desktop" value="gnome"></property>
<property name="java.vm.specification.name" value="Java Virtual Machine Specification"></property>
<property name="env.COLORTERM" value="gnome-terminal"></property>
<property name="jspwiki.aclManager" value="org.apache.wiki.auth.acl.DefaultAclManager"></property>
<property name="jspwiki.plugin.searchPath" value=""></property>
<property name="jspwiki.groupdatabase.name" value="name"></property>
<property name="static.user" value="apache"></property>
<property name="compile.jsps" value="true"></property>
<property name="code.i18n" value="src/WebContent/WEB-INF/classes"></property>
<property name="testjarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar"></property>
<property name="env.GDMSESSION" value="gnome"></property>
<property name="env.GREP_COLOR" value="97;45"></property>
<property name="java.awt.printerjob" value="sun.print.PSPrinterJob"></property>
<property name="jspwiki.rss.fileName" value="rss.rdf"></property>
<property name="jspwiki.loginModule.class" value="org.apache.wiki.auth.login.UserDatabaseLoginModule"></property>
<property name="ant.version" value="Apache Ant version 1.7.1 compiled on October 3 2008"></property>
<property name="env.WINDOWID" value="60820599"></property>
<property name="@tests.workdir@" value="/tmp/testworkdir"></property>
<property name="webtests.temp" value="/tmp/webtests"></property>
<property name="jspwiki.interWikiRef.Doc" value="http://doc.jspwiki.org/2.8/wiki/%s"></property>
<property name="war.build" value="/home/metskem/workspace/JSPWiki/build/war"></property>
<property name="jspwiki.specialPage.UserPreferences" value="UserPreferences.jsp"></property>
<property name="tmplt.i18n.dir" value="i18n_templates"></property>
<property name="code.src" value="src/java"></property>
<property name="jspwiki.translatorReader.matchEnglishPlurals" value="true"></property>
<property name="jspwiki.groupdatabase.created" value="created"></property>
<property name="jspwiki.interWikiRef.Google" value="http://www.google.com/search?q=%s"></property>
<property name="db.scripts" value="etc/db/hsql"></property>
<property name="os.name" value="Linux"></property>
<property name="java.specification.vendor" value="Sun Microsystems Inc."></property>
<property name="code.web" value="src/WebContent"></property>
<property name="env.TERM" value="xterm"></property>
<property name="java.vm.name" value="Java HotSpot(TM) Client VM"></property>
<property name="@spamlog@" value="/tmp/jspwiki/logs/spamlog.log"></property>
<property name="jspwiki.groupdatabase.membertable" value="group_members"></property>
<property name="jdbc.admin.password" value=""></property>
<property name="jspwiki.specialPage.CreateGroup" value="NewGroup.jsp"></property>
<property name="jspwiki.rss.channelDescription" value="Oh poor me, my owner has not set jspwiki.rss.channelLanguage = en-us"></property>
<property name="@appname@" value="JSPWiki"></property>
<property name="hsql.server.database.0" value="file:jspwiki"></property>
<property name="jspwiki.breakTitleWithSpaces" value="false"></property>
<property name="java.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
<property name="svn.tag" value="trunk"></property>
<property name="jspwiki.userdatabase.modified" value="modified"></property>
<property name="env.PATH" value="/home/metskem/bin:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/X11R6/bin"></property>
<property name="jspwiki.userdatabase.attributes" value="attributes"></property>
<property name="jspwiki.fileSystemProvider.pageDir" value="/tmp/jspwiki/wikipages"></property>
<property name="hsql" value="true"></property>
<property name="ant.java.version" value="1.5"></property>
<property name="install.src" value="/tmp/metskem/JSPWiki/svnsrc"></property>
<property name="basedir" value="/home/metskem/workspace/JSPWiki"></property>
<property name="java.class.version" value="49.0"></property>
<property name="jspwiki.specialPage.Login" value="Login.jsp"></property>
<property name="env.LD_LIBRARY_PATH" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
<property name="jspwiki.tests.auth" value="true"></property>
<property name="ant.home" value="/usr/share/ant"></property>
<property name="@tests.pagedir@" value="/tmp/testrepository"></property>
<property name="env.GNOME_KEYRING_SOCKET" value="/tmp/keyring-s4QYDm/socket"></property>
<property name="release.dir" value="releases"></property>
<property name="static.group" value="daemon"></property>
<property name="jspwiki.rss.generate" value="false"></property>
<property name="docs.javadoc" value="doc/javadoc"></property>
<property name="jdbc.driver.class" value="org.hsqldb.jdbcDriver"></property>
<property name="sun.boot.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386"></property>
<property name="sun.management.compiler" value="HotSpot Client Compiler"></property>
<property name="db.props.exist" value="true"></property>
<property name="hsql.up" value="true"></property>
<property name="java.awt.graphicsenv" value="sun.awt.X11GraphicsEnvironment"></property>
<property name="jspwiki.authorizer" value="org.apache.wiki.auth.authorize.WebContainerAuthorizer"></property>
<property name="env.USER" value="metskem"></property>
<property name="jspwiki.groupdatabase.modifier" value="modifier"></property>
<property name="jspwiki.groupdatabase.creator" value="creator"></property>
<property name="jdbc.user.id" value="jspwiki"></property>
<property name="jspwiki.groupdatabase.table" value="groups"></property>
<property name="jdbc.user.password" value="password"></property>
<property name="ant.project.name" value="JSPWiki"></property>
<property name="webtests.build" value="/home/metskem/workspace/JSPWiki/build/webtests"></property>
<property name="jspwiki.groupdatabase.modified" value="modified"></property>
<property name="java.vm.specification.version" value="1.0"></property>
<property name="env.NLSPATH" value="/usr/dt/lib/nls/msg/%L/%N.cat"></property>
<property name="tmpdir" value="/tmp/metskem/JSPWiki"></property>
<property name="sun.cpu.isalist" value=""></property>
<property name="jspwiki.groupdatabase.datasource" value="jdbc/GroupDatabase"></property>
<property name="java.ext.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/ext"></property>
<property name="os.version" value="2.6.27-11-generic"></property>
<property name="jspwiki.userdatabase.fullName" value="full_name"></property>
<property name="jspwiki.interWikiRef.Edit" value="Edit.jsp?page=%s"></property>
<property name="user.home" value="/home/metskem"></property>
<property name="jspwiki.basicAttachmentProvider.storageDir" value="/tmp/jspwiki/wikipages"></property>
<property name="java.vm.vendor" value="Sun Microsystems Inc."></property>
<property name="webtests.browser" value="*firefox /tmp/ff/usr/lib/firefox/firefox-2-bin"></property>
<property name="build.properties" value="build.properties"></property>
<property name="env.JAVA_HOME" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16"></property>
<property name="hsql.server.port" value="9001"></property>
<property name="jspwiki.translatorReader.camelCaseLinks" value="false"></property>
<property name="env.XAUTHORITY" value="/home/metskem/.Xauthority"></property>
<property name="jspwiki.userdatabase.uid" value="uid"></property>
<property name="user.dir" value="/home/metskem/workspace/JSPWiki"></property>
<property name="env.WINDOWPATH" value="8:8:8:8"></property>
<property name="env.XFILESEARCHPATH" value="/usr/dt/app-defaults/%L/Dt"></property>
<property name="jspwiki.userdatabase.wikiName" value="wiki_name"></property>
<property name="env.PWD" value="/home/metskem/workspace/JSPWiki"></property>
<property name="sun.cpu.endian" value="little"></property>
<property name="warfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.war"></property>
<property name="jspwiki.userdatabase.role" value="role"></property>
<property name="@mail.from@" value="JSPWiki &lt;JSPWiki@localhost&gt;"></property>
<property name="deprecation" value="false"></property>
<property name="java.vm.version" value="1.5.0_16-b02"></property>
<property name="java.class.path" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar:/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/lib/tools.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/activation.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/akismet-java-1.02.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-codec-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-fileupload-1.2.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-httpclient-3.0.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-io-1.4.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-lang-2.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/ecs.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/freshcookies-security-0.60.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jabsorb-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-tablibs-standard-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-taglibs-jstl-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jaxen.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcl-over-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcr-1.0.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jdom.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jrcs-diff.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jsp-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jul-to-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/log4j-1.2.14.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene-highlighter.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/mail.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/nekohtml.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/oscache.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/priha-0.1.13.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/sandler.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/servlet-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-api-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-log4j12-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/stripes-1.5.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/xmlrpc.jar:/home/metskem/workspace/JSPWiki/tests/lib/commons-el-1.0.jar:/home/metskem/workspace/JSPWiki/tests/lib/custom_rhino.jar:/home/metskem/workspace/JSPWiki/tests/lib/hsqldb.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-compiler-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-runtime-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-jmx-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-plus-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-servlet-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/junit.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-java-client-driver-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-server-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xercesImpl-2.6.2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xml-apis-1.0.b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/yuicompressor-2.3.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/classes:/home/metskem/workspace/JSPWiki/tests/etc:/usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-junit.jar"></property>
<property name="ant.library.dir" value="/usr/share/ant/lib"></property>
<property name="webtests.shutdown" value="19041"></property>
<property name="os.arch" value="i386"></property>
<property name="jspwiki.interWikiRef.MeatballWiki" value="http://usemod.com/cgi-bin/mb.pl?%s"></property>
<property name="sun.java.launcher" value="SUN_STANDARD"></property>
<property name="tests.build" value="/home/metskem/workspace/JSPWiki/build/tests/classes"></property>
<property name="ant.core.lib" value="/usr/share/ant/lib/ant.jar"></property>
<property name="jspwiki.interWikiRef.JSPWiki" value="http://www.jspwiki.org/wiki/%s"></property>
<property name="java.vm.specification.vendor" value="Sun Microsystems Inc."></property>
<property name="jspwiki.groupdatabase" value="org.apache.wiki.auth.authorize.XMLGroupDatabase"></property>
<property name="code.build" value="/home/metskem/workspace/JSPWiki/build/classes"></property>
<property name="file.separator" value="/"></property>
<property name="jspwiki.userdatabase.email" value="email"></property>
<property name="jspwiki.encoding" value="UTF-8"></property>
<property name="java.runtime.version" value="1.5.0_16-b02"></property>
<property name="env.SSH_AUTH_SOCK" value="/tmp/keyring-s4QYDm/ssh"></property>
<property name="sun.boot.class.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/rt.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i18n.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jsse.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jce.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/charsets.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/classes"></property>
<property name="userdb.setup" value="tests/etc/db/hsql/userdb-setup.ddl"></property>
<property name="tests" value="tests"></property>
<property name="user.country" value="US"></property>
<property name="jspwiki.userdatabase.roleTable" value="roles"></property>
<property name="env.SHELL" value="/usr/bin/fish"></property>
<property name="@securitylog@" value="/tmp/jspwiki/logs/security.log"></property>
<property name="tests.src" value="tests/java"></property>
<property name="@mail.smtp.host@" value="127.0.0.1"></property>
<property name="java.vendor" value="Sun Microsystems Inc."></property>
<property name="install.fulldir" value="/tmp/metskem/JSPWiki/install"></property>
<property name="jspwiki.specialPage.FindPage" value="Search.jsp"></property>
<property name="env.GPG_AGENT_INFO" value="/tmp/seahorse-khoj7K/S.gpg-agent:12498:1"></property>
<property name="jspwiki.userdatabase" value="org.apache.wiki.auth.user.XMLUserDatabase"></property>
<property name="java.specification.version" value="1.5"></property>
<property name="jspwiki.lockExpiryTime" value="60"></property>
<property name="sun.arch.data.model" value="32"></property>
<property name="env.GNOME_DESKTOP_SESSION_ID" value="this-is-deprecated"></property>
<property name="userdb.teardown" value="tests/etc/db/hsql/userdb-teardown.ddl"></property>
</properties>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_2" time="0.0060"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeName_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_3" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_1" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString5" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive2" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive5" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata3" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata5" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata6" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata7" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetBooleanProperty" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection1" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testBooleanParameter" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testTrimmedProperty" time="0.0010"></testcase>
<system-out><![CDATA[]]></system-out>
<system-err><![CDATA[]]></system-err>
</testsuite>
21:08:14,974 WARN MainProcessor:122 - processing 106 files from directory /home/metskem/workspace/JSPWiki/build/tests/reports, tag : 3.0.0-svn-72
21:08:16,241 ERROR MainProcessor:135 - parsing completed in 1 second(s)
21:08:16,348 INFO DBUtil:100 - class com.mysql.jdbc.Driver succesfully loaded
21:08:17,993 INFO DBUtil:125 - transaction support present ? : true
21:08:27,327 WARN DBUtil:169 - committing changes....
21:08:27,330 WARN DBUtil:171 - commit completed
21:08:27,334 ERROR MainProcessor:97 - inserted 1161 rows in 11 seconds
At line 356 removed 3 lines
%%
/%
/%
At line 362 changed one line
! all testsuites per tag having errors or failures
Here are a couple of examples of queries we could run.
! Overall statistics
At line 364 changed 12 lines
mysql> select tag,name,tests,errors,failures from testsuiteresult where errors>0 or failures > 0 group by tag,name order by name,tag;
+--------------+------------------------------------------------+-------+--------+----------+
| tag | name | tests | errors | failures |
+--------------+------------------------------------------------+-------+--------+----------+
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
+--------------+------------------------------------------------+-------+--------+----------+
6 rows in set (0.01 sec)
mysql> select tag,sum(tests),avg(time),sum(time) from testsuiteresult group by tag order by tag;
+--------------+------------+-----------+-----------+
| tag | sum(tests) | avg(time) | sum(time) |
+--------------+------------+-----------+-----------+
| 2.8.2-svn-13 | 948 | 1.9197143 | 174.694 |
| 3.0.0-svn-17 | 944 | 5.5338652 | 492.514 |
| 3.0.0-svn-71 | 1050 | 4.4532762 | 467.594 |
| 3.0.0-svn-72 | 1055 | 4.5185849 | 478.970 |
| 3.0.0-svn-73 | 1057 | 4.6632617 | 498.969 |
| 3.0.0-svn-76 | 1033 | 4.5757476 | 471.302 |
| 3.0.0-svn-80 | 950 | 4.3344433 | 420.441 |
| 3.0.0-svn-85 | 949 | 3.0273196 | 293.650 |
| 3.0.0-svn-93 | 948 | 2.7866327 | 273.090 |
| 3.0.0-svn-96 | 948 | 2.8197959 | 276.340 |
+--------------+------------+-----------+-----------+
10 rows in set (0.06 sec)
}}}
At line 129 added 25 lines
! Number of testsuites having errors or failures, grouped by tag
There is also a [daily refreshed version|http://www.computerhok.nl/tmp/jspwiki-testresult.html]
{{{
mysql> select tag as version,max(timestamp) as date ,sum(tests) as tests ,sum(errors) as errors ,sum(failures)/sum(tests)*100 as 'error %',sum(failures) as failures, sum(failures)/sum(tests)*100 as 'failure %' from testsuiteresult group by tag order by timestamp;
+---------------+---------------------+-------+--------+---------+----------+-----------+
| version | date | tests | errors | error % | failures | failure % |
+---------------+---------------------+-------+--------+---------+----------+-----------+
| 3.0.0-svn-71 | 2009-02-19 19:21:30 | 1050 | 5 | 0.0952 | 1 | 0.0952 |
| 2.8.2-svn-13 | 2009-02-19 20:14:21 | 948 | 0 | 0.2110 | 2 | 0.2110 |
| 3.0.0-svn-17 | 2009-02-22 13:00:45 | 944 | 0 | 0.1059 | 1 | 0.1059 |
| 3.0.0-svn-72 | 2009-02-24 19:37:49 | 1055 | 5 | 0.1896 | 2 | 0.1896 |
| 3.0.0-svn-73 | 2009-02-25 20:21:18 | 1057 | 1 | 0.1892 | 2 | 0.1892 |
| 3.0.0-svn-76 | 2009-03-01 19:04:10 | 1033 | 1 | 0.0968 | 1 | 0.0968 |
| 3.0.0-svn-80 | 2009-03-06 20:41:24 | 950 | 45 | 7.6842 | 73 | 7.6842 |
| 3.0.0-svn-85 | 2009-03-18 18:07:45 | 949 | 46 | 8.6407 | 82 | 8.6407 |
| 3.0.0-svn-93 | 2009-04-05 17:26:52 | 948 | 53 | 12.1308 | 115 | 12.1308 |
| 3.0.0-svn-96 | 2009-04-06 17:09:47 | 948 | 70 | 10.8650 | 103 | 10.8650 |
| 3.0.0-svn-102 | 2009-04-16 18:28:20 | 952 | 50 | 11.6597 | 111 | 11.6597 |
| 3.0.0-svn-159 | 2009-09-30 19:07:11 | 998 | 37 | 3.2064 | 32 | 3.2064 |
| 3.0.0-svn-161 | 2009-10-08 17:55:33 | 1018 | 37 | 4.7151 | 48 | 4.7151 |
+---------------+---------------------+-------+--------+---------+----------+-----------+
13 rows in set (0.07 sec)
At line 155 added 100 lines
! Errors / failures by class / tag
{{{
mysql> select tag,name,errors,failures,time from testsuiteresult where failures>0 or errors > 0 order by name,tag;
+--------------+------------------------------------------------------------+--------+----------+---------+
| tag | name | errors | failures | time |
+--------------+------------------------------------------------------------+--------+----------+---------+
| 3.0.0-svn-80 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 0 | 1.092 |
| 3.0.0-svn-85 | org.apache.wiki.action.DeleteActionBeanTest | 0 | 3 | 1.123 |
| 3.0.0-svn-93 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 0 | 1.058 |
| 3.0.0-svn-80 | org.apache.wiki.action.RenameActionBeanTest | 0 | 6 | 13.108 |
| 3.0.0-svn-85 | org.apache.wiki.action.RenameActionBeanTest | 0 | 4 | 11.771 |
| 3.0.0-svn-93 | org.apache.wiki.action.RenameActionBeanTest | 0 | 4 | 11.249 |
| 3.0.0-svn-80 | org.apache.wiki.action.ViewActionBeanTest | 0 | 2 | 5.597 |
| 3.0.0-svn-80 | org.apache.wiki.action.WikiContextFactoryTest | 0 | 1 | 6.216 |
| 3.0.0-svn-80 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 1 | 0 | 1.032 |
| 3.0.0-svn-85 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 1 | 1.097 |
| 3.0.0-svn-93 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 1 | 1.666 |
| 3.0.0-svn-80 | org.apache.wiki.auth.AuthorizationManagerTest | 1 | 0 | 5.174 |
| 3.0.0-svn-93 | org.apache.wiki.auth.AuthorizationManagerTest | 0 | 2 | 4.960 |
| 3.0.0-svn-80 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.343 |
| 3.0.0-svn-85 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.470 |
| 3.0.0-svn-93 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.194 |
| 3.0.0-svn-80 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.225 |
| 3.0.0-svn-85 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.316 |
| 3.0.0-svn-93 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.111 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 0 | 1.236 |
| 3.0.0-svn-72 | org.apache.wiki.content.ContentManagerTest | 4 | 0 | 1.243 |
| 3.0.0-svn-85 | org.apache.wiki.content.ContentManagerTest | 1 | 0 | 1.261 |
| 3.0.0-svn-93 | org.apache.wiki.content.ContentManagerTest | 1 | 0 | 1.388 |
| 3.0.0-svn-93 | org.apache.wiki.content.EnglishPluralsPageNameResolverTest | 0 | 1 | 0.310 |
| 3.0.0-svn-80 | org.apache.wiki.content.PageRenamerTest | 17 | 3 | 7.174 |
| 3.0.0-svn-85 | org.apache.wiki.content.PageRenamerTest | 18 | 3 | 7.533 |
| 3.0.0-svn-93 | org.apache.wiki.content.PageRenamerTest | 18 | 3 | 7.391 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 0.103 |
| 3.0.0-svn-72 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 0.989 |
| 3.0.0-svn-73 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 3.377 |
| 3.0.0-svn-80 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 0 | 27 | 68.912 |
| 3.0.0-svn-85 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 1 | 28 | 67.451 |
| 3.0.0-svn-93 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 2 | 52 | 61.415 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.CounterPluginTest | 3 | 0 | 1.925 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.CounterPluginTest | 3 | 0 | 1.708 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.IndexPluginTest | 0 | 1 | 0.413 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.InsertPageTest | 0 | 2 | 2.137 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.PluginManagerTest | 15 | 0 | 6.208 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.RecentChangesPluginTest | 2 | 1 | 1.448 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.RecentChangesPluginTest | 0 | 3 | 3.612 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.RecentChangesPluginTest | 0 | 3 | 1.243 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 2 | 1.311 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 3 | 1.326 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 3 | 1.323 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferringPagesPluginTest | 1 | 3 | 3.605 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.ReferringPagesPluginTest | 0 | 6 | 3.553 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.ReferringPagesPluginTest | 0 | 7 | 3.520 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 2.926 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 3.001 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 2.874 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.837 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.836 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.893 |
| 3.0.0-svn-80 | org.apache.wiki.ReferenceManagerTest | 1 | 1 | 19.646 |
| 3.0.0-svn-85 | org.apache.wiki.ReferenceManagerTest | 14 | 2 | 15.744 |
| 3.0.0-svn-93 | org.apache.wiki.ReferenceManagerTest | 2 | 13 | 15.591 |
| 3.0.0-svn-85 | org.apache.wiki.render.RenderingManagerTest | 1 | 0 | 0.359 |
| 3.0.0-svn-80 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 1 | 0.737 |
| 3.0.0-svn-85 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 1 | 0.670 |
| 3.0.0-svn-93 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 2 | 0.656 |
| 3.0.0-svn-80 | org.apache.wiki.rss.RSSGeneratorTest | 2 | 0 | 0.948 |
| 3.0.0-svn-80 | org.apache.wiki.search.SearchManagerTest | 4 | 1 | 8.328 |
| 3.0.0-svn-85 | org.apache.wiki.search.SearchManagerTest | 4 | 1 | 8.068 |
| 3.0.0-svn-93 | org.apache.wiki.search.SearchManagerTest | 4 | 0 | 7.556 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.092 |
| 3.0.0-svn-72 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.093 |
| 3.0.0-svn-73 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.479 |
| 3.0.0-svn-76 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.102 |
| 3.0.0-svn-80 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.507 |
| 3.0.0-svn-85 | org.apache.wiki.ui.migrator.JspParserTest | 0 | 1 | 0.060 |
| 3.0.0-svn-93 | org.apache.wiki.ui.migrator.JspParserTest | 0 | 1 | 0.072 |
| 3.0.0-svn-80 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.437 |
| 3.0.0-svn-85 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.384 |
| 3.0.0-svn-93 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.135 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 0 | 1 | 20.025 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 0 | 1 | 37.644 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.495 |
| 3.0.0-svn-72 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.517 |
| 3.0.0-svn-73 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.863 |
| 3.0.0-svn-76 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.308 |
| 3.0.0-svn-80 | org.apache.wiki.WikiEngineTest | 5 | 13 | 15.016 |
| 3.0.0-svn-85 | org.apache.wiki.WikiEngineTest | 3 | 12 | 15.350 |
| 3.0.0-svn-93 | org.apache.wiki.WikiEngineTest | 4 | 10 | 14.265 |
| 3.0.0-svn-80 | org.apache.wiki.workflow.ApprovalWorkflowTest | 2 | 0 | 1.621 |
| 3.0.0-svn-85 | org.apache.wiki.workflow.ApprovalWorkflowTest | 0 | 2 | 1.587 |
| 3.0.0-svn-93 | org.apache.wiki.workflow.ApprovalWorkflowTest | 0 | 2 | 1.409 |
| 3.0.0-svn-80 | org.apache.wiki.xmlrpc.RPCHandlerTest | 4 | 0 | 1.447 |
| 3.0.0-svn-85 | org.apache.wiki.xmlrpc.RPCHandlerTest | 0 | 2 | 1.525 |
| 3.0.0-svn-93 | org.apache.wiki.xmlrpc.RPCHandlerTest | 1 | 0 | 1.193 |
| 3.0.0-svn-80 | stress.MassiveRepositoryTest | 1 | 0 | 124.826 |
| 3.0.0-svn-85 | stress.MassiveRepositoryTest | 1 | 0 | 0.391 |
+--------------+------------------------------------------------------------+--------+----------+---------+
91 rows in set (0.02 sec)
}}}
At line 256 added 68 lines
! Number of testsuites/testcases per tag (buildlevel)
{{{
mysql> select tag,count(*) from testcaseresult group by tag order by tag;
+--------------+----------+
| tag | count(*) |
+--------------+----------+
| 2.8.2-svn-13 | 948 |
| 3.0.0-svn-17 | 944 |
| 3.0.0-svn-71 | 1050 |
| 3.0.0-svn-72 | 1055 |
| 3.0.0-svn-73 | 1057 |
| 3.0.0-svn-76 | 1033 |
| 3.0.0-svn-80 | 950 |
+--------------+----------+
7 rows in set (0.22 sec)
}}}
! All testsuites per tag having errors or failures
{{{
mysql> select tag,name,tests,errors,failures from testsuiteresult where errors>0 or failures > 0 group by tag,name order by name,tag;
+--------------+---------------------------------------------------+-------+--------+----------+
| tag | name | tests | errors | failures |
+--------------+---------------------------------------------------+-------+--------+----------+
| 3.0.0-svn-80 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 3 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.action.RenameActionBeanTest | 7 | 0 | 6 |
| 3.0.0-svn-80 | org.apache.wiki.action.ViewActionBeanTest | 3 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.action.WikiContextFactoryTest | 5 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 3 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.auth.AuthorizationManagerTest | 15 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 11 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.auth.UserManagerTest | 5 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-72 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.content.PageRenamerTest | 21 | 17 | 3 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-72 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-73 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 200 | 0 | 27 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.InsertPageTest | 6 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.RecentChangesPluginTest | 3 | 2 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferredPagesPluginTest | 3 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferringPagesPluginTest | 8 | 1 | 3 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.TableOfContentsTest | 8 | 0 | 5 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 2 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.ReferenceManagerTest | 18 | 1 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.render.WysiwygEditingRendererTest | 2 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.rss.RSSGeneratorTest | 2 | 2 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.search.SearchManagerTest | 6 | 4 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-72 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-73 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-76 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.ui.stripes.HandlerInfoTest | 4 | 0 | 1 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-72 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-73 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-76 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.WikiEngineTest | 34 | 5 | 13 |
| 3.0.0-svn-80 | org.apache.wiki.workflow.ApprovalWorkflowTest | 5 | 2 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.xmlrpc.RPCHandlerTest | 4 | 4 | 0 |
| 3.0.0-svn-80 | stress.MassiveRepositoryTest | 1 | 1 | 0 |
+--------------+---------------------------------------------------+-------+--------+----------+
41 rows in set (0.02 sec)
}}}
At line 331 added one line
| 3.0.0-svn-73 | stress.MassiveRepositoryTest | 1 | 81.273 |
At line 333 added 2 lines
| 3.0.0-svn-72 | stress.MassiveRepositoryTest | 1 | 76.723 |
| 3.0.0-svn-76 | stress.MassiveRepositoryTest | 1 | 75.437 |
At line 389 changed 6 lines
| 3.0.0-svn-71 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 66.344 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | 6 | 43.761 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | 6 | 42.688 |
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest | 6 | 40.240 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 44 | 37.644 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 35.495 |
| 3.0.0-svn-73 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 68.615 |
| 3.0.0-svn-72 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 67.173 |
| 3.0.0-svn-76 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 66.869 |
At line 396 changed 2 lines
10 rows in set (0.01 sec)
10 rows in set (0.03 sec)
At line 400 changed one line
! classes with most testcases
! Classes with most testcases
At line 422 changed one line
15 rows in set (0.00 sec)
15 rows in set (0.05 sec)
At line 428 changed 20 lines
+--------------+-----------------------------------------------+------------------------------+--------+
| tag | classname | name | time |
+--------------+-----------------------------------------------+------------------------------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest | testMassiveRepository1 | 84.308 |
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | testMassiveRepository1 | 78.440 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | testMassiveRepository1 | 69.569 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.530 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.474 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.396 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.360 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.322 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.316 |
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.070 |
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.029 |
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.029 |
| 3.0.0-svn-71 | org.apache.wiki.providers.RCSFileProviderTest | testMillionChanges | 7.179 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | testExternalModificationRefs | 6.418 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | testExternalModification | 6.350 |
+--------------+-----------------------------------------------+------------------------------+--------+
15 rows in set (0.11 sec)
+--------------+------------------------------------------+------------------------+--------+
| tag | classname | name | time |
+--------------+------------------------------------------+------------------------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest | testMassiveRepository1 | 84.308 |
| 3.0.0-svn-73 | stress.MassiveRepositoryTest | testMassiveRepository1 | 81.271 |
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | testMassiveRepository1 | 78.440 |
| 3.0.0-svn-72 | stress.MassiveRepositoryTest | testMassiveRepository1 | 76.721 |
| 3.0.0-svn-76 | stress.MassiveRepositoryTest | testMassiveRepository1 | 75.435 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | testMassiveRepository1 | 69.569 |
| 3.0.0-svn-73 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.724 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.530 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.474 |
| 3.0.0-svn-72 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.433 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.396 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.360 |
| 3.0.0-svn-73 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.349 |
| 3.0.0-svn-76 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.343 |
| 3.0.0-svn-72 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.340 |
+--------------+------------------------------------------+------------------------+--------+
15 rows in set (0.30 sec)
At line 450 changed one line
! Testsuites that have increased in time most between releases
! Testsuites that have increased their test time the most between releases
At line 452 changed 31 lines
mysql> select name,(max(time)-min(time))/avg(time)*100 as percdelta,min(time),max(time) from testsuiteresult where tag='3.0.0-svn-17' or tag='2.8.2-svn-13' group by name order by 2 desc limit 25;
+-----------------------------------------------------------+-----------------+-----------+-----------+
| name | percdelta | min(time) | max(time) |
+-----------------------------------------------------------+-----------------+-----------+-----------+
| org.apache.wiki.util.ClassUtilTest | 197.54098360656 | 0.003 | 0.485 |
| org.apache.wiki.util.SerializerTest | 196.02649006623 | 0.003 | 0.299 |
| org.apache.wiki.workflow.FactTest | 194.95798319328 | 0.003 | 0.235 |
| org.apache.wiki.parser.MarkupParserTest | 194.78260869565 | 0.003 | 0.227 |
| org.apache.wiki.ui.RedirectCommandTest | 194.61883408072 | 0.003 | 0.220 |
| org.apache.wiki.util.UtilJ2eeCompatTest | 194.36619718310 | 0.005 | 0.350 |
| org.apache.wiki.util.PriorityListTest | 192.88888888889 | 0.004 | 0.221 |
| org.apache.wiki.auth.acl.AclEntryImplTest | 192.72727272727 | 0.004 | 0.216 |
| org.apache.wiki.workflow.OutcomeTest | 192.19143576826 | 0.031 | 1.557 |
| org.apache.wiki.ui.GroupCommandTest | 191.42300194932 | 0.044 | 2.008 |
| org.apache.wiki.auth.permissions.AllPermissionTest | 190.90909090909 | 0.005 | 0.215 |
| org.apache.wiki.filters.FilterManagerTest | 190.89715536105 | 0.052 | 2.233 |
| org.apache.wiki.plugin.GroupsTest | 190.70307960488 | 0.040 | 1.681 |
| org.apache.wiki.util.MailUtilTest | 190.67110899572 | 0.049 | 2.052 |
| org.apache.wiki.util.CryptoUtilTest | 190.62500000000 | 0.006 | 0.250 |
| org.apache.wiki.ui.PageCommandTest | 190.48977650975 | 0.050 | 2.053 |
| org.apache.wiki.auth.login.WebContainerLoginModuleTest | 190.36973344798 | 0.056 | 2.270 |
| org.apache.wiki.auth.permissions.WikiPermissionTest | 189.47368421053 | 0.006 | 0.222 |
| org.apache.wiki.dav.DavPathTest | 189.39393939394 | 0.007 | 0.257 |
| org.apache.wiki.workflow.TaskTest | 189.18918918919 | 0.006 | 0.216 |
| org.apache.wiki.ui.WikiCommandTest | 188.67187500000 | 0.058 | 1.990 |
| org.apache.wiki.auth.login.CookieAssertionLoginModuleTest | 188.39694656489 | 0.057 | 1.908 |
| org.apache.wiki.plugin.UndefinedPagesPluginTest | 188.21630347054 | 0.073 | 2.405 |
| org.apache.wiki.render.WysiwygEditingRendererTest | 188.12260536398 | 0.062 | 2.026 |
| org.apache.wiki.auth.login.UserDatabaseLoginModuleTest | 187.73869346734 | 0.061 | 1.929 |
+-----------------------------------------------------------+-----------------+-----------+-----------+
25 rows in set (0.02 sec)
mysql> select name,(max(time)-min(time))/avg(time)*100 as percdelta,min(time),max(time),avg(time) from testsuiteresult where tag='3.0.0-svn-71' or tag='3.0.0-svn-72' group by name order by 2 desc limit 25;
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
| name | percdelta | min(time) | max(time) | avg(time) |
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
| org.apache.wiki.auth.permissions.PagePermissionTest | 76.92307692308 | 0.004 | 0.009 | 0.0065000 |
| org.apache.wiki.dav.DavPathTest | 73.68421052632 | 0.006 | 0.013 | 0.0095000 |
| org.apache.wiki.auth.permissions.WikiPermissionTest | 66.66666666667 | 0.004 | 0.008 | 0.0060000 |
| org.apache.wiki.util.ClassUtilTest | 66.66666666667 | 0.003 | 0.006 | 0.0045000 |
| org.apache.wiki.workflow.SimpleDecisionTest | 60.00000000000 | 0.007 | 0.013 | 0.0100000 |
| org.apache.wiki.parser.CreoleToJSPWikiTranslatorTest | 49.81412639405 | 0.101 | 0.168 | 0.1345000 |
| org.apache.wiki.PageManagerTest | 47.19887955182 | 4.364 | 7.060 | 5.7120000 |
| org.apache.wiki.util.CommentedPropertiesTest | 46.40000000000 | 0.048 | 0.077 | 0.0625000 |
| org.apache.wiki.ui.migrator.JspDocumentTest | 40.00000000000 | 0.002 | 0.003 | 0.0025000 |
| org.apache.wiki.workflow.TaskTest | 40.00000000000 | 0.006 | 0.009 | 0.0075000 |
| org.apache.wiki.ui.migrator.JspParserTest | 38.46153846154 | 0.042 | 0.062 | 0.0520000 |
| org.apache.wiki.auth.permissions.GroupPermissionTest | 35.29411764706 | 0.007 | 0.010 | 0.0085000 |
| org.apache.wiki.auth.authorize.WebContainerAuthorizerTest | 34.02489626556 | 1.400 | 1.974 | 1.6870000 |
| org.apache.wiki.auth.authorize.GroupTest | 32.66381297333 | 2.541 | 3.533 | 3.0370000 |
| org.apache.wiki.util.PriorityListTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.parser.MarkupParserTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.content.WikiNameTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.PropertyReaderTest | 25.00000000000 | 0.014 | 0.018 | 0.0160000 |
| org.apache.wiki.attachment.AttachmentManagerTest | 24.69245065935 | 4.952 | 6.347 | 5.6495000 |
| org.apache.wiki.auth.acl.DefaultAclManagerTest | 24.02159244265 | 0.978 | 1.245 | 1.1115000 |
| org.apache.wiki.FileUtilTest | 23.85964912281 | 0.251 | 0.319 | 0.2850000 |
| org.apache.wiki.util.UtilJ2eeCompatTest | 22.22222222222 | 0.004 | 0.005 | 0.0045000 |
| org.apache.wiki.auth.authorize.JDBCGroupDatabaseTest | 21.84782608696 | 1.639 | 2.041 | 1.8400000 |
| org.apache.wiki.util.CryptoUtilTest | 18.18181818182 | 0.005 | 0.006 | 0.0055000 |
| org.apache.wiki.ReleaseTest | 18.18181818182 | 0.015 | 0.018 | 0.0165000 |
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
25 rows in set (0.03 sec)
This page (revision-34) was last changed on 23-Apr-2022 17:06 by Harry MetskeTop