This page (revision-34) was last changed on 23-Apr-2022 17:06 by Harry Metske

This page was created on 23-Apr-2022 17:06 by Harry Metske

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Page revision history

Version Date Modified Size Author Changes ... Change note
34 23-Apr-2022 17:06 32 KB Harry Metske to previous
33 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
32 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
31 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
30 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
29 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
28 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
27 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
26 23-Apr-2022 17:06 27 KB Harry Metske to previous | to last
25 23-Apr-2022 17:06 27 KB Harry Metske to previous | to last
24 23-Apr-2022 17:06 24 KB Harry Metske to previous | to last 3.0.0-svn-80
23 23-Apr-2022 17:06 19 KB Harry Metske to previous | to last
22 23-Apr-2022 17:06 19 KB Harry Metske to previous | to last
21 23-Apr-2022 17:06 17 KB Harry Metske to previous | to last

Page References

Incoming links Outgoing links
JSPWiki JUnit test performance management
JSPWiki JUnit test performance management

Version management

Difference between version and

At line 3 added one line
* Use the information created with every run of the tests task, each JUnit test produces an [XML format report|TEST-org.apache.wiki.TextUtilTest.xml] containing response times, see tab
At line 4 changed 2 lines
[{TableOfContents }]
\\
%%tabbedSection
%%tab-Main
At line 7 removed 3 lines
The idea is to use the information created by the JUnit tests.
\\Every time you run an " ant tests", a ''reports'' directory is created containing a test report for each test.
each JUnit test produces an [XML format report|TEST-org.apache.wiki.TextUtilTest.xml] containing response times, errors and failures.
At line 11 changed 8 lines
I wrote some code that gathers this information and stores it in an SQL database.
\\It takes two parameters :
* the name of the directory %%small (i.e. "/home/metskem/workspace/JSPWiki/build/tests/reports") %%
* a tag that identifies this test run %%small (i.e. "3.0.0-svn-17") %%
If we gather this information for each JSPWiki level that has significant changes, we could analyze if, and where performance differences occur, and also keep track of a lot of other things.
! DDL testcaseresult table
* parse all these files, get the response times out
* store them in an SQL DB (JSPWikiPerfDB)
* table testcase DDL:
At line 34 changed 3 lines
! Sample content testcaseresult
* table testcase example content :
At line 55 changed 4 lines
! DDL testsuiteresult table
* table testsuite DDL :
At line 76 changed 4 lines
! Sample content testsuiteresult
* example testsuite result :
At line 75 added 3 lines
* save this in a file and execute it : ''mysql --host=blackpearl --database=JSPWikiPerfDB --user=....... --password=...... < ff.sql
''
/%
At line 91 removed one line
!! Running the collector tool
At line 93 changed 2 lines
Each run will insert about 100 records in the testsuiteresult table, and about a 1000 rows in the testcaseresult table.
\\The following is an example output of a run:
%%tab-TestReport
%%prettify
At line 96 changed 7 lines
21:08:14,974 WARN MainProcessor:122 - processing 106 files from directory /home/metskem/workspace/JSPWiki/build/tests/reports, tag : 3.0.0-svn-72
21:08:16,241 ERROR MainProcessor:135 - parsing completed in 1 second(s)
21:08:16,348 INFO DBUtil:100 - class com.mysql.jdbc.Driver succesfully loaded
21:08:17,993 INFO DBUtil:125 - transaction support present ? : true
21:08:27,327 WARN DBUtil:169 - committing changes....
21:08:27,330 WARN DBUtil:171 - commit completed
21:08:27,334 ERROR MainProcessor:97 - inserted 1161 rows in 11 seconds
<?xml version="1.0" encoding="UTF-8" ?>
<testsuite errors="0" failures="0" hostname="bismarck" name="org.apache.wiki.TextUtilTest"
tests="34" time="0.025" timestamp="2009-02-14T18:03:35">
<properties>
<property name="env.DESKTOP_SESSION" value="gnome"></property>
<property name="file.encoding.pkg" value="sun.io"></property>
<property name="@logfile@" value="/tmp/jspwiki/logs/jspwiki.log"></property>
<property name="jdbc.jar.present" value="tests/lib/hsqldb.jar"></property>
<property name="java.home" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre"></property>
<property name="jdbc.driver.jar" value="tests/lib/hsqldb.jar"></property>
<property name="jspwiki.specialPage.NewGroup" value="NewGroup.jsp"></property>
<property name="env.GDM_LANG" value="en_US.UTF-8"></property>
<property name="war.compile.jsps" value="true"></property>
<property name="jspwiki.userdatabase.lockExpiry" value="lock_expiry"></property>
<property name="ant.file.JSPWiki" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
<property name="jspwiki.interWikiRef.TWiki" value="http://twiki.org/cgi-bin/view/TWiki/%s"></property>
<property name="env.DISPLAY" value=":0.0"></property>
<property name="env.LS_COLORS" value="no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.svgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:"></property>
<property name="debug" value="true"></property>
<property name="tests.db.scripts" value="tests/etc/db/hsql"></property>
<property name="env.XDG_SESSION_COOKIE" value="f054683b9c91e14bec778a5b48c6c18f-1234620764.533961-246543790"></property>
<property name="jspwiki.userdatabase.created" value="created"></property>
<property name="jspwiki.pageProvider" value="FileSystemProvider"></property>
<property name="jarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar"></property>
<property name="java.endorsed.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/endorsed"></property>
<property name="env.LOGNAME" value="metskem"></property>
<property name="jdbc.driver.url" value="jdbc:hsqldb:hsql://localhost/jspwiki"></property>
<property name="env.USERNAME" value="metskem"></property>
<property name="jdbc.driver.id" value="hsql"></property>
<property name="env.SESSION_MANAGER" value="local/bismarck:/tmp/.ICE-unix/12389"></property>
<property name="sun.os.patch.level" value="unknown"></property>
<property name="jspwiki.userdatabase.loginName" value="login_name"></property>
<property name="env.GDM_XSERVER_LOCATION" value="local"></property>
<property name="java.vendor.url" value="http://java.sun.com/"></property>
<property name="webtests.port" value="10024"></property>
<property name="java.version" value="1.5.0_16"></property>
<property name="env.ORBIT_SOCKETDIR" value="/tmp/orbit-metskem"></property>
<property name="svn.repository" value="http://svn.apache.org/repos/asf/incubator/jspwiki"></property>
<property name="jspwiki.templateDir" value="default"></property>
<property name="jspwiki.diffProvider" value="TraditionalDiffProvider"></property>
<property name="java.vendor.url.bug" value="http://java.sun.com/cgi-bin/bugreport.cgi"></property>
<property name="env.XDG_DATA_DIRS" value="/usr/local/share/:/usr/share/:/usr/share/gdm/"></property>
<property name="jspwiki.usePageCache" value="true"></property>
<property name="jspwiki.applicationName" value="JSPWiki"></property>
<property name="jspwiki.interWikiRef.WikiWikiWeb" value="http://c2.com/cgi/wiki?%s"></property>
<property name="user.name" value="metskem"></property>
<property name="env.LANG" value="en_US.UTF-8"></property>
<property name="sun.io.unicode.encoding" value="UnicodeLittle"></property>
<property name="@tests.auth.filename" value="/tmp/testrepository/auth.txt"></property>
<property name="sun.jnu.encoding" value="UTF-8"></property>
<property name="env.DBUS_SESSION_BUS_ADDRESS" value="unix:abstract=/tmp/dbus-lDtIGDPxHU,guid=8dfb9cc4886aa571127ca1264996d15d"></property>
<property name="java.runtime.name" value="Java(TM) 2 Runtime Environment, Standard Edition"></property>
<property name="optimize" value="false"></property>
<property name="jks.password" value="jspwiki"></property>
<property name="jspwiki.repository" value="priha"></property>
<property name="java.specification.name" value="Java Platform API Specification"></property>
<property name="@mail.smtp.port@" value="25"></property>
<property name="user.timezone" value=""></property>
<property name="selenium-rc.jar" value="tests/lib/selenium-server-1.0-beta1.jar"></property>
<property name="path.separator" value=":"></property>
<property name="@tests.filter@" value="tests/etc/filters.xml"></property>
<property name="@pagedir@" value="/tmp/jspwiki/wikipages"></property>
<property name="jspwiki.userdatabase.datasource" value="jdbc/UserDatabase"></property>
<property name="hsql.server.dbname.0" value="jspwiki"></property>
<property name="jspwiki.groupdatabase.member" value="member"></property>
<property name="file.encoding" value="UTF-8"></property>
<property name="jspwiki.attachmentProvider" value="BasicAttachmentProvider"></property>
<property name="build" value="/home/metskem/workspace/JSPWiki/build"></property>
<property name="env.HOME" value="/home/metskem"></property>
<property name="tests.reports" value="/home/metskem/workspace/JSPWiki/build/tests/reports"></property>
<property name="ant.file" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
<property name="jspwiki.translatorReader.allowHTML" value="false"></property>
<property name="env.GTK_RC_FILES" value="/etc/gtk/gtkrc:/home/metskem/.gtkrc-1.2-gnome2"></property>
<property name="java.io.tmpdir" value="/tmp"></property>
<property name="env.GNOME_KEYRING_PID" value="12379"></property>
<property name="user.language" value="en"></property>
<property name="jspwiki.translatorReader.useOutlinkImage" value="true"></property>
<property name="line.separator" value="
"></property>
<property name="jspwiki.userdatabase.table" value="users"></property>
<property name="jspwiki.baseURL" value=""></property>
<property name="jspwiki.rss.interval" value="3600"></property>
<property name="jspwiki.interWikiRef.Wikipedia" value="http://www.wikipedia.com/wiki/%s"></property>
<property name="@tests.logfile@" value="/tmp/jspwikitests.log"></property>
<property name="jspwiki.searchProvider" value="LuceneSearchProvider"></property>
<property name="webtests.reports" value="/home/metskem/workspace/JSPWiki/build/webtests/reports"></property>
<property name="jdbc.admin.id" value="SA"></property>
<property name="java.vm.info" value="mixed mode, sharing"></property>
<property name="jspwiki.userdatabase.password" value="password"></property>
<property name="sun.desktop" value="gnome"></property>
<property name="java.vm.specification.name" value="Java Virtual Machine Specification"></property>
<property name="env.COLORTERM" value="gnome-terminal"></property>
<property name="jspwiki.aclManager" value="org.apache.wiki.auth.acl.DefaultAclManager"></property>
<property name="jspwiki.plugin.searchPath" value=""></property>
<property name="jspwiki.groupdatabase.name" value="name"></property>
<property name="static.user" value="apache"></property>
<property name="compile.jsps" value="true"></property>
<property name="code.i18n" value="src/WebContent/WEB-INF/classes"></property>
<property name="testjarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar"></property>
<property name="env.GDMSESSION" value="gnome"></property>
<property name="env.GREP_COLOR" value="97;45"></property>
<property name="java.awt.printerjob" value="sun.print.PSPrinterJob"></property>
<property name="jspwiki.rss.fileName" value="rss.rdf"></property>
<property name="jspwiki.loginModule.class" value="org.apache.wiki.auth.login.UserDatabaseLoginModule"></property>
<property name="ant.version" value="Apache Ant version 1.7.1 compiled on October 3 2008"></property>
<property name="env.WINDOWID" value="60820599"></property>
<property name="@tests.workdir@" value="/tmp/testworkdir"></property>
<property name="webtests.temp" value="/tmp/webtests"></property>
<property name="jspwiki.interWikiRef.Doc" value="http://doc.jspwiki.org/2.8/wiki/%s"></property>
<property name="war.build" value="/home/metskem/workspace/JSPWiki/build/war"></property>
<property name="jspwiki.specialPage.UserPreferences" value="UserPreferences.jsp"></property>
<property name="tmplt.i18n.dir" value="i18n_templates"></property>
<property name="code.src" value="src/java"></property>
<property name="jspwiki.translatorReader.matchEnglishPlurals" value="true"></property>
<property name="jspwiki.groupdatabase.created" value="created"></property>
<property name="jspwiki.interWikiRef.Google" value="http://www.google.com/search?q=%s"></property>
<property name="db.scripts" value="etc/db/hsql"></property>
<property name="os.name" value="Linux"></property>
<property name="java.specification.vendor" value="Sun Microsystems Inc."></property>
<property name="code.web" value="src/WebContent"></property>
<property name="env.TERM" value="xterm"></property>
<property name="java.vm.name" value="Java HotSpot(TM) Client VM"></property>
<property name="@spamlog@" value="/tmp/jspwiki/logs/spamlog.log"></property>
<property name="jspwiki.groupdatabase.membertable" value="group_members"></property>
<property name="jdbc.admin.password" value=""></property>
<property name="jspwiki.specialPage.CreateGroup" value="NewGroup.jsp"></property>
<property name="jspwiki.rss.channelDescription" value="Oh poor me, my owner has not set jspwiki.rss.channelLanguage = en-us"></property>
<property name="@appname@" value="JSPWiki"></property>
<property name="hsql.server.database.0" value="file:jspwiki"></property>
<property name="jspwiki.breakTitleWithSpaces" value="false"></property>
<property name="java.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
<property name="svn.tag" value="trunk"></property>
<property name="jspwiki.userdatabase.modified" value="modified"></property>
<property name="env.PATH" value="/home/metskem/bin:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/X11R6/bin"></property>
<property name="jspwiki.userdatabase.attributes" value="attributes"></property>
<property name="jspwiki.fileSystemProvider.pageDir" value="/tmp/jspwiki/wikipages"></property>
<property name="hsql" value="true"></property>
<property name="ant.java.version" value="1.5"></property>
<property name="install.src" value="/tmp/metskem/JSPWiki/svnsrc"></property>
<property name="basedir" value="/home/metskem/workspace/JSPWiki"></property>
<property name="java.class.version" value="49.0"></property>
<property name="jspwiki.specialPage.Login" value="Login.jsp"></property>
<property name="env.LD_LIBRARY_PATH" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
<property name="jspwiki.tests.auth" value="true"></property>
<property name="ant.home" value="/usr/share/ant"></property>
<property name="@tests.pagedir@" value="/tmp/testrepository"></property>
<property name="env.GNOME_KEYRING_SOCKET" value="/tmp/keyring-s4QYDm/socket"></property>
<property name="release.dir" value="releases"></property>
<property name="static.group" value="daemon"></property>
<property name="jspwiki.rss.generate" value="false"></property>
<property name="docs.javadoc" value="doc/javadoc"></property>
<property name="jdbc.driver.class" value="org.hsqldb.jdbcDriver"></property>
<property name="sun.boot.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386"></property>
<property name="sun.management.compiler" value="HotSpot Client Compiler"></property>
<property name="db.props.exist" value="true"></property>
<property name="hsql.up" value="true"></property>
<property name="java.awt.graphicsenv" value="sun.awt.X11GraphicsEnvironment"></property>
<property name="jspwiki.authorizer" value="org.apache.wiki.auth.authorize.WebContainerAuthorizer"></property>
<property name="env.USER" value="metskem"></property>
<property name="jspwiki.groupdatabase.modifier" value="modifier"></property>
<property name="jspwiki.groupdatabase.creator" value="creator"></property>
<property name="jdbc.user.id" value="jspwiki"></property>
<property name="jspwiki.groupdatabase.table" value="groups"></property>
<property name="jdbc.user.password" value="password"></property>
<property name="ant.project.name" value="JSPWiki"></property>
<property name="webtests.build" value="/home/metskem/workspace/JSPWiki/build/webtests"></property>
<property name="jspwiki.groupdatabase.modified" value="modified"></property>
<property name="java.vm.specification.version" value="1.0"></property>
<property name="env.NLSPATH" value="/usr/dt/lib/nls/msg/%L/%N.cat"></property>
<property name="tmpdir" value="/tmp/metskem/JSPWiki"></property>
<property name="sun.cpu.isalist" value=""></property>
<property name="jspwiki.groupdatabase.datasource" value="jdbc/GroupDatabase"></property>
<property name="java.ext.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/ext"></property>
<property name="os.version" value="2.6.27-11-generic"></property>
<property name="jspwiki.userdatabase.fullName" value="full_name"></property>
<property name="jspwiki.interWikiRef.Edit" value="Edit.jsp?page=%s"></property>
<property name="user.home" value="/home/metskem"></property>
<property name="jspwiki.basicAttachmentProvider.storageDir" value="/tmp/jspwiki/wikipages"></property>
<property name="java.vm.vendor" value="Sun Microsystems Inc."></property>
<property name="webtests.browser" value="*firefox /tmp/ff/usr/lib/firefox/firefox-2-bin"></property>
<property name="build.properties" value="build.properties"></property>
<property name="env.JAVA_HOME" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16"></property>
<property name="hsql.server.port" value="9001"></property>
<property name="jspwiki.translatorReader.camelCaseLinks" value="false"></property>
<property name="env.XAUTHORITY" value="/home/metskem/.Xauthority"></property>
<property name="jspwiki.userdatabase.uid" value="uid"></property>
<property name="user.dir" value="/home/metskem/workspace/JSPWiki"></property>
<property name="env.WINDOWPATH" value="8:8:8:8"></property>
<property name="env.XFILESEARCHPATH" value="/usr/dt/app-defaults/%L/Dt"></property>
<property name="jspwiki.userdatabase.wikiName" value="wiki_name"></property>
<property name="env.PWD" value="/home/metskem/workspace/JSPWiki"></property>
<property name="sun.cpu.endian" value="little"></property>
<property name="warfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.war"></property>
<property name="jspwiki.userdatabase.role" value="role"></property>
<property name="@mail.from@" value="JSPWiki &lt;JSPWiki@localhost&gt;"></property>
<property name="deprecation" value="false"></property>
<property name="java.vm.version" value="1.5.0_16-b02"></property>
<property name="java.class.path" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar:/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/lib/tools.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/activation.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/akismet-java-1.02.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-codec-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-fileupload-1.2.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-httpclient-3.0.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-io-1.4.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-lang-2.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/ecs.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/freshcookies-security-0.60.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jabsorb-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-tablibs-standard-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-taglibs-jstl-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jaxen.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcl-over-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcr-1.0.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jdom.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jrcs-diff.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jsp-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jul-to-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/log4j-1.2.14.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene-highlighter.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/mail.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/nekohtml.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/oscache.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/priha-0.1.13.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/sandler.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/servlet-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-api-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-log4j12-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/stripes-1.5.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/xmlrpc.jar:/home/metskem/workspace/JSPWiki/tests/lib/commons-el-1.0.jar:/home/metskem/workspace/JSPWiki/tests/lib/custom_rhino.jar:/home/metskem/workspace/JSPWiki/tests/lib/hsqldb.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-compiler-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-runtime-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-jmx-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-plus-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-servlet-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/junit.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-java-client-driver-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-server-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xercesImpl-2.6.2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xml-apis-1.0.b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/yuicompressor-2.3.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/classes:/home/metskem/workspace/JSPWiki/tests/etc:/usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-junit.jar"></property>
<property name="ant.library.dir" value="/usr/share/ant/lib"></property>
<property name="webtests.shutdown" value="19041"></property>
<property name="os.arch" value="i386"></property>
<property name="jspwiki.interWikiRef.MeatballWiki" value="http://usemod.com/cgi-bin/mb.pl?%s"></property>
<property name="sun.java.launcher" value="SUN_STANDARD"></property>
<property name="tests.build" value="/home/metskem/workspace/JSPWiki/build/tests/classes"></property>
<property name="ant.core.lib" value="/usr/share/ant/lib/ant.jar"></property>
<property name="jspwiki.interWikiRef.JSPWiki" value="http://www.jspwiki.org/wiki/%s"></property>
<property name="java.vm.specification.vendor" value="Sun Microsystems Inc."></property>
<property name="jspwiki.groupdatabase" value="org.apache.wiki.auth.authorize.XMLGroupDatabase"></property>
<property name="code.build" value="/home/metskem/workspace/JSPWiki/build/classes"></property>
<property name="file.separator" value="/"></property>
<property name="jspwiki.userdatabase.email" value="email"></property>
<property name="jspwiki.encoding" value="UTF-8"></property>
<property name="java.runtime.version" value="1.5.0_16-b02"></property>
<property name="env.SSH_AUTH_SOCK" value="/tmp/keyring-s4QYDm/ssh"></property>
<property name="sun.boot.class.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/rt.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i18n.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jsse.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jce.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/charsets.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/classes"></property>
<property name="userdb.setup" value="tests/etc/db/hsql/userdb-setup.ddl"></property>
<property name="tests" value="tests"></property>
<property name="user.country" value="US"></property>
<property name="jspwiki.userdatabase.roleTable" value="roles"></property>
<property name="env.SHELL" value="/usr/bin/fish"></property>
<property name="@securitylog@" value="/tmp/jspwiki/logs/security.log"></property>
<property name="tests.src" value="tests/java"></property>
<property name="@mail.smtp.host@" value="127.0.0.1"></property>
<property name="java.vendor" value="Sun Microsystems Inc."></property>
<property name="install.fulldir" value="/tmp/metskem/JSPWiki/install"></property>
<property name="jspwiki.specialPage.FindPage" value="Search.jsp"></property>
<property name="env.GPG_AGENT_INFO" value="/tmp/seahorse-khoj7K/S.gpg-agent:12498:1"></property>
<property name="jspwiki.userdatabase" value="org.apache.wiki.auth.user.XMLUserDatabase"></property>
<property name="java.specification.version" value="1.5"></property>
<property name="jspwiki.lockExpiryTime" value="60"></property>
<property name="sun.arch.data.model" value="32"></property>
<property name="env.GNOME_DESKTOP_SESSION_ID" value="this-is-deprecated"></property>
<property name="userdb.teardown" value="tests/etc/db/hsql/userdb-teardown.ddl"></property>
</properties>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_2" time="0.0060"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeName_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_3" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_1" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString5" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive2" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive5" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata3" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata5" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata6" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata7" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetBooleanProperty" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection1" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testBooleanParameter" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testTrimmedProperty" time="0.0010"></testcase>
<system-out><![CDATA[]]></system-out>
<system-err><![CDATA[]]></system-err>
</testsuite>
At line 356 added 3 lines
%%
/%
/%
At line 107 changed 3 lines
Here are a couple of examples of queries we could run.
! Overall statistics
! all testsuites per tag having errors or failures
At line 111 changed 17 lines
mysql> select tag,sum(tests),avg(time),sum(time) from testsuiteresult group by tag order by tag;
+--------------+------------+-----------+-----------+
| tag | sum(tests) | avg(time) | sum(time) |
+--------------+------------+-----------+-----------+
| 2.8.2-svn-13 | 948 | 1.9197143 | 174.694 |
| 3.0.0-svn-17 | 944 | 5.5338652 | 492.514 |
| 3.0.0-svn-71 | 1050 | 4.4532762 | 467.594 |
| 3.0.0-svn-72 | 1055 | 4.5185849 | 478.970 |
| 3.0.0-svn-73 | 1057 | 4.6632617 | 498.969 |
| 3.0.0-svn-76 | 1033 | 4.5757476 | 471.302 |
| 3.0.0-svn-80 | 950 | 4.3344433 | 420.441 |
| 3.0.0-svn-85 | 949 | 3.0273196 | 293.650 |
| 3.0.0-svn-93 | 948 | 2.7866327 | 273.090 |
| 3.0.0-svn-96 | 948 | 2.8197959 | 276.340 |
+--------------+------------+-----------+-----------+
10 rows in set (0.06 sec)
}}}
mysql> select tag,name,tests,errors,failures from testsuiteresult where errors>0 or failures > 0 group by tag,name order by name,tag;
+--------------+------------------------------------------------+-------+--------+----------+
| tag | name | tests | errors | failures |
+--------------+------------------------------------------------+-------+--------+----------+
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
+--------------+------------------------------------------------+-------+--------+----------+
6 rows in set (0.01 sec)
At line 129 removed 25 lines
! Number of testsuites having errors or failures, grouped by tag
There is also a [daily refreshed version|http://www.computerhok.nl/tmp/jspwiki-testresult.html]
{{{
mysql> select tag as version,max(timestamp) as date ,sum(tests) as tests ,sum(errors) as errors ,sum(failures)/sum(tests)*100 as 'error %',sum(failures) as failures, sum(failures)/sum(tests)*100 as 'failure %' from testsuiteresult group by tag order by timestamp;
+---------------+---------------------+-------+--------+---------+----------+-----------+
| version | date | tests | errors | error % | failures | failure % |
+---------------+---------------------+-------+--------+---------+----------+-----------+
| 3.0.0-svn-71 | 2009-02-19 19:21:30 | 1050 | 5 | 0.0952 | 1 | 0.0952 |
| 2.8.2-svn-13 | 2009-02-19 20:14:21 | 948 | 0 | 0.2110 | 2 | 0.2110 |
| 3.0.0-svn-17 | 2009-02-22 13:00:45 | 944 | 0 | 0.1059 | 1 | 0.1059 |
| 3.0.0-svn-72 | 2009-02-24 19:37:49 | 1055 | 5 | 0.1896 | 2 | 0.1896 |
| 3.0.0-svn-73 | 2009-02-25 20:21:18 | 1057 | 1 | 0.1892 | 2 | 0.1892 |
| 3.0.0-svn-76 | 2009-03-01 19:04:10 | 1033 | 1 | 0.0968 | 1 | 0.0968 |
| 3.0.0-svn-80 | 2009-03-06 20:41:24 | 950 | 45 | 7.6842 | 73 | 7.6842 |
| 3.0.0-svn-85 | 2009-03-18 18:07:45 | 949 | 46 | 8.6407 | 82 | 8.6407 |
| 3.0.0-svn-93 | 2009-04-05 17:26:52 | 948 | 53 | 12.1308 | 115 | 12.1308 |
| 3.0.0-svn-96 | 2009-04-06 17:09:47 | 948 | 70 | 10.8650 | 103 | 10.8650 |
| 3.0.0-svn-102 | 2009-04-16 18:28:20 | 952 | 50 | 11.6597 | 111 | 11.6597 |
| 3.0.0-svn-159 | 2009-09-30 19:07:11 | 998 | 37 | 3.2064 | 32 | 3.2064 |
| 3.0.0-svn-161 | 2009-10-08 17:55:33 | 1018 | 37 | 4.7151 | 48 | 4.7151 |
+---------------+---------------------+-------+--------+---------+----------+-----------+
13 rows in set (0.07 sec)
At line 155 removed 100 lines
! Errors / failures by class / tag
{{{
mysql> select tag,name,errors,failures,time from testsuiteresult where failures>0 or errors > 0 order by name,tag;
+--------------+------------------------------------------------------------+--------+----------+---------+
| tag | name | errors | failures | time |
+--------------+------------------------------------------------------------+--------+----------+---------+
| 3.0.0-svn-80 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 0 | 1.092 |
| 3.0.0-svn-85 | org.apache.wiki.action.DeleteActionBeanTest | 0 | 3 | 1.123 |
| 3.0.0-svn-93 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 0 | 1.058 |
| 3.0.0-svn-80 | org.apache.wiki.action.RenameActionBeanTest | 0 | 6 | 13.108 |
| 3.0.0-svn-85 | org.apache.wiki.action.RenameActionBeanTest | 0 | 4 | 11.771 |
| 3.0.0-svn-93 | org.apache.wiki.action.RenameActionBeanTest | 0 | 4 | 11.249 |
| 3.0.0-svn-80 | org.apache.wiki.action.ViewActionBeanTest | 0 | 2 | 5.597 |
| 3.0.0-svn-80 | org.apache.wiki.action.WikiContextFactoryTest | 0 | 1 | 6.216 |
| 3.0.0-svn-80 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 1 | 0 | 1.032 |
| 3.0.0-svn-85 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 1 | 1.097 |
| 3.0.0-svn-93 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 1 | 1.666 |
| 3.0.0-svn-80 | org.apache.wiki.auth.AuthorizationManagerTest | 1 | 0 | 5.174 |
| 3.0.0-svn-93 | org.apache.wiki.auth.AuthorizationManagerTest | 0 | 2 | 4.960 |
| 3.0.0-svn-80 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.343 |
| 3.0.0-svn-85 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.470 |
| 3.0.0-svn-93 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.194 |
| 3.0.0-svn-80 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.225 |
| 3.0.0-svn-85 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.316 |
| 3.0.0-svn-93 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.111 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 0 | 1.236 |
| 3.0.0-svn-72 | org.apache.wiki.content.ContentManagerTest | 4 | 0 | 1.243 |
| 3.0.0-svn-85 | org.apache.wiki.content.ContentManagerTest | 1 | 0 | 1.261 |
| 3.0.0-svn-93 | org.apache.wiki.content.ContentManagerTest | 1 | 0 | 1.388 |
| 3.0.0-svn-93 | org.apache.wiki.content.EnglishPluralsPageNameResolverTest | 0 | 1 | 0.310 |
| 3.0.0-svn-80 | org.apache.wiki.content.PageRenamerTest | 17 | 3 | 7.174 |
| 3.0.0-svn-85 | org.apache.wiki.content.PageRenamerTest | 18 | 3 | 7.533 |
| 3.0.0-svn-93 | org.apache.wiki.content.PageRenamerTest | 18 | 3 | 7.391 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 0.103 |
| 3.0.0-svn-72 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 0.989 |
| 3.0.0-svn-73 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 3.377 |
| 3.0.0-svn-80 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 0 | 27 | 68.912 |
| 3.0.0-svn-85 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 1 | 28 | 67.451 |
| 3.0.0-svn-93 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 2 | 52 | 61.415 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.CounterPluginTest | 3 | 0 | 1.925 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.CounterPluginTest | 3 | 0 | 1.708 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.IndexPluginTest | 0 | 1 | 0.413 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.InsertPageTest | 0 | 2 | 2.137 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.PluginManagerTest | 15 | 0 | 6.208 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.RecentChangesPluginTest | 2 | 1 | 1.448 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.RecentChangesPluginTest | 0 | 3 | 3.612 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.RecentChangesPluginTest | 0 | 3 | 1.243 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 2 | 1.311 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 3 | 1.326 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 3 | 1.323 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferringPagesPluginTest | 1 | 3 | 3.605 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.ReferringPagesPluginTest | 0 | 6 | 3.553 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.ReferringPagesPluginTest | 0 | 7 | 3.520 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 2.926 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 3.001 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 2.874 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.837 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.836 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.893 |
| 3.0.0-svn-80 | org.apache.wiki.ReferenceManagerTest | 1 | 1 | 19.646 |
| 3.0.0-svn-85 | org.apache.wiki.ReferenceManagerTest | 14 | 2 | 15.744 |
| 3.0.0-svn-93 | org.apache.wiki.ReferenceManagerTest | 2 | 13 | 15.591 |
| 3.0.0-svn-85 | org.apache.wiki.render.RenderingManagerTest | 1 | 0 | 0.359 |
| 3.0.0-svn-80 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 1 | 0.737 |
| 3.0.0-svn-85 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 1 | 0.670 |
| 3.0.0-svn-93 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 2 | 0.656 |
| 3.0.0-svn-80 | org.apache.wiki.rss.RSSGeneratorTest | 2 | 0 | 0.948 |
| 3.0.0-svn-80 | org.apache.wiki.search.SearchManagerTest | 4 | 1 | 8.328 |
| 3.0.0-svn-85 | org.apache.wiki.search.SearchManagerTest | 4 | 1 | 8.068 |
| 3.0.0-svn-93 | org.apache.wiki.search.SearchManagerTest | 4 | 0 | 7.556 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.092 |
| 3.0.0-svn-72 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.093 |
| 3.0.0-svn-73 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.479 |
| 3.0.0-svn-76 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.102 |
| 3.0.0-svn-80 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.507 |
| 3.0.0-svn-85 | org.apache.wiki.ui.migrator.JspParserTest | 0 | 1 | 0.060 |
| 3.0.0-svn-93 | org.apache.wiki.ui.migrator.JspParserTest | 0 | 1 | 0.072 |
| 3.0.0-svn-80 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.437 |
| 3.0.0-svn-85 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.384 |
| 3.0.0-svn-93 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.135 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 0 | 1 | 20.025 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 0 | 1 | 37.644 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.495 |
| 3.0.0-svn-72 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.517 |
| 3.0.0-svn-73 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.863 |
| 3.0.0-svn-76 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.308 |
| 3.0.0-svn-80 | org.apache.wiki.WikiEngineTest | 5 | 13 | 15.016 |
| 3.0.0-svn-85 | org.apache.wiki.WikiEngineTest | 3 | 12 | 15.350 |
| 3.0.0-svn-93 | org.apache.wiki.WikiEngineTest | 4 | 10 | 14.265 |
| 3.0.0-svn-80 | org.apache.wiki.workflow.ApprovalWorkflowTest | 2 | 0 | 1.621 |
| 3.0.0-svn-85 | org.apache.wiki.workflow.ApprovalWorkflowTest | 0 | 2 | 1.587 |
| 3.0.0-svn-93 | org.apache.wiki.workflow.ApprovalWorkflowTest | 0 | 2 | 1.409 |
| 3.0.0-svn-80 | org.apache.wiki.xmlrpc.RPCHandlerTest | 4 | 0 | 1.447 |
| 3.0.0-svn-85 | org.apache.wiki.xmlrpc.RPCHandlerTest | 0 | 2 | 1.525 |
| 3.0.0-svn-93 | org.apache.wiki.xmlrpc.RPCHandlerTest | 1 | 0 | 1.193 |
| 3.0.0-svn-80 | stress.MassiveRepositoryTest | 1 | 0 | 124.826 |
| 3.0.0-svn-85 | stress.MassiveRepositoryTest | 1 | 0 | 0.391 |
+--------------+------------------------------------------------------------+--------+----------+---------+
91 rows in set (0.02 sec)
}}}
At line 256 removed 68 lines
! Number of testsuites/testcases per tag (buildlevel)
{{{
mysql> select tag,count(*) from testcaseresult group by tag order by tag;
+--------------+----------+
| tag | count(*) |
+--------------+----------+
| 2.8.2-svn-13 | 948 |
| 3.0.0-svn-17 | 944 |
| 3.0.0-svn-71 | 1050 |
| 3.0.0-svn-72 | 1055 |
| 3.0.0-svn-73 | 1057 |
| 3.0.0-svn-76 | 1033 |
| 3.0.0-svn-80 | 950 |
+--------------+----------+
7 rows in set (0.22 sec)
}}}
! All testsuites per tag having errors or failures
{{{
mysql> select tag,name,tests,errors,failures from testsuiteresult where errors>0 or failures > 0 group by tag,name order by name,tag;
+--------------+---------------------------------------------------+-------+--------+----------+
| tag | name | tests | errors | failures |
+--------------+---------------------------------------------------+-------+--------+----------+
| 3.0.0-svn-80 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 3 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.action.RenameActionBeanTest | 7 | 0 | 6 |
| 3.0.0-svn-80 | org.apache.wiki.action.ViewActionBeanTest | 3 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.action.WikiContextFactoryTest | 5 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 3 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.auth.AuthorizationManagerTest | 15 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 11 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.auth.UserManagerTest | 5 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-72 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.content.PageRenamerTest | 21 | 17 | 3 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-72 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-73 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 200 | 0 | 27 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.InsertPageTest | 6 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.RecentChangesPluginTest | 3 | 2 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferredPagesPluginTest | 3 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferringPagesPluginTest | 8 | 1 | 3 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.TableOfContentsTest | 8 | 0 | 5 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 2 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.ReferenceManagerTest | 18 | 1 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.render.WysiwygEditingRendererTest | 2 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.rss.RSSGeneratorTest | 2 | 2 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.search.SearchManagerTest | 6 | 4 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-72 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-73 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-76 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.ui.stripes.HandlerInfoTest | 4 | 0 | 1 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-72 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-73 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-76 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.WikiEngineTest | 34 | 5 | 13 |
| 3.0.0-svn-80 | org.apache.wiki.workflow.ApprovalWorkflowTest | 5 | 2 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.xmlrpc.RPCHandlerTest | 4 | 4 | 0 |
| 3.0.0-svn-80 | stress.MassiveRepositoryTest | 1 | 1 | 0 |
+--------------+---------------------------------------------------+-------+--------+----------+
41 rows in set (0.02 sec)
}}}
At line 331 removed one line
| 3.0.0-svn-73 | stress.MassiveRepositoryTest | 1 | 81.273 |
At line 333 removed 2 lines
| 3.0.0-svn-72 | stress.MassiveRepositoryTest | 1 | 76.723 |
| 3.0.0-svn-76 | stress.MassiveRepositoryTest | 1 | 75.437 |
At line 337 changed 3 lines
| 3.0.0-svn-73 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 68.615 |
| 3.0.0-svn-72 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 67.173 |
| 3.0.0-svn-76 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 66.869 |
| 3.0.0-svn-71 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 66.344 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | 6 | 43.761 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | 6 | 42.688 |
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest | 6 | 40.240 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 44 | 37.644 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 35.495 |
At line 341 changed one line
10 rows in set (0.03 sec)
10 rows in set (0.01 sec)
At line 344 changed one line
! Classes with most testcases
! classes with most testcases
At line 366 changed one line
15 rows in set (0.05 sec)
15 rows in set (0.00 sec)
At line 372 changed 20 lines
+--------------+------------------------------------------+------------------------+--------+
| tag | classname | name | time |
+--------------+------------------------------------------+------------------------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest | testMassiveRepository1 | 84.308 |
| 3.0.0-svn-73 | stress.MassiveRepositoryTest | testMassiveRepository1 | 81.271 |
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | testMassiveRepository1 | 78.440 |
| 3.0.0-svn-72 | stress.MassiveRepositoryTest | testMassiveRepository1 | 76.721 |
| 3.0.0-svn-76 | stress.MassiveRepositoryTest | testMassiveRepository1 | 75.435 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | testMassiveRepository1 | 69.569 |
| 3.0.0-svn-73 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.724 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.530 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.474 |
| 3.0.0-svn-72 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.433 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.396 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.360 |
| 3.0.0-svn-73 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.349 |
| 3.0.0-svn-76 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.343 |
| 3.0.0-svn-72 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.340 |
+--------------+------------------------------------------+------------------------+--------+
15 rows in set (0.30 sec)
+--------------+-----------------------------------------------+------------------------------+--------+
| tag | classname | name | time |
+--------------+-----------------------------------------------+------------------------------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest | testMassiveRepository1 | 84.308 |
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | testMassiveRepository1 | 78.440 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | testMassiveRepository1 | 69.569 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.530 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.474 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.396 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.360 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.322 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.316 |
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.070 |
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.029 |
| 2.8.2-svn-13 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.029 |
| 3.0.0-svn-71 | org.apache.wiki.providers.RCSFileProviderTest | testMillionChanges | 7.179 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | testExternalModificationRefs | 6.418 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | testExternalModification | 6.350 |
+--------------+-----------------------------------------------+------------------------------+--------+
15 rows in set (0.11 sec)
At line 394 changed one line
! Testsuites that have increased their test time the most between releases
! Testsuites that have increased in time most between releases
At line 396 changed 31 lines
mysql> select name,(max(time)-min(time))/avg(time)*100 as percdelta,min(time),max(time),avg(time) from testsuiteresult where tag='3.0.0-svn-71' or tag='3.0.0-svn-72' group by name order by 2 desc limit 25;
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
| name | percdelta | min(time) | max(time) | avg(time) |
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
| org.apache.wiki.auth.permissions.PagePermissionTest | 76.92307692308 | 0.004 | 0.009 | 0.0065000 |
| org.apache.wiki.dav.DavPathTest | 73.68421052632 | 0.006 | 0.013 | 0.0095000 |
| org.apache.wiki.auth.permissions.WikiPermissionTest | 66.66666666667 | 0.004 | 0.008 | 0.0060000 |
| org.apache.wiki.util.ClassUtilTest | 66.66666666667 | 0.003 | 0.006 | 0.0045000 |
| org.apache.wiki.workflow.SimpleDecisionTest | 60.00000000000 | 0.007 | 0.013 | 0.0100000 |
| org.apache.wiki.parser.CreoleToJSPWikiTranslatorTest | 49.81412639405 | 0.101 | 0.168 | 0.1345000 |
| org.apache.wiki.PageManagerTest | 47.19887955182 | 4.364 | 7.060 | 5.7120000 |
| org.apache.wiki.util.CommentedPropertiesTest | 46.40000000000 | 0.048 | 0.077 | 0.0625000 |
| org.apache.wiki.ui.migrator.JspDocumentTest | 40.00000000000 | 0.002 | 0.003 | 0.0025000 |
| org.apache.wiki.workflow.TaskTest | 40.00000000000 | 0.006 | 0.009 | 0.0075000 |
| org.apache.wiki.ui.migrator.JspParserTest | 38.46153846154 | 0.042 | 0.062 | 0.0520000 |
| org.apache.wiki.auth.permissions.GroupPermissionTest | 35.29411764706 | 0.007 | 0.010 | 0.0085000 |
| org.apache.wiki.auth.authorize.WebContainerAuthorizerTest | 34.02489626556 | 1.400 | 1.974 | 1.6870000 |
| org.apache.wiki.auth.authorize.GroupTest | 32.66381297333 | 2.541 | 3.533 | 3.0370000 |
| org.apache.wiki.util.PriorityListTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.parser.MarkupParserTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.content.WikiNameTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.PropertyReaderTest | 25.00000000000 | 0.014 | 0.018 | 0.0160000 |
| org.apache.wiki.attachment.AttachmentManagerTest | 24.69245065935 | 4.952 | 6.347 | 5.6495000 |
| org.apache.wiki.auth.acl.DefaultAclManagerTest | 24.02159244265 | 0.978 | 1.245 | 1.1115000 |
| org.apache.wiki.FileUtilTest | 23.85964912281 | 0.251 | 0.319 | 0.2850000 |
| org.apache.wiki.util.UtilJ2eeCompatTest | 22.22222222222 | 0.004 | 0.005 | 0.0045000 |
| org.apache.wiki.auth.authorize.JDBCGroupDatabaseTest | 21.84782608696 | 1.639 | 2.041 | 1.8400000 |
| org.apache.wiki.util.CryptoUtilTest | 18.18181818182 | 0.005 | 0.006 | 0.0055000 |
| org.apache.wiki.ReleaseTest | 18.18181818182 | 0.015 | 0.018 | 0.0165000 |
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
25 rows in set (0.03 sec)
mysql> select name,(max(time)-min(time))/avg(time)*100 as percdelta,min(time),max(time) from testsuiteresult where tag='3.0.0-svn-17' or tag='2.8.2-svn-13' group by name order by 2 desc limit 25;
+-----------------------------------------------------------+-----------------+-----------+-----------+
| name | percdelta | min(time) | max(time) |
+-----------------------------------------------------------+-----------------+-----------+-----------+
| org.apache.wiki.util.ClassUtilTest | 197.54098360656 | 0.003 | 0.485 |
| org.apache.wiki.util.SerializerTest | 196.02649006623 | 0.003 | 0.299 |
| org.apache.wiki.workflow.FactTest | 194.95798319328 | 0.003 | 0.235 |
| org.apache.wiki.parser.MarkupParserTest | 194.78260869565 | 0.003 | 0.227 |
| org.apache.wiki.ui.RedirectCommandTest | 194.61883408072 | 0.003 | 0.220 |
| org.apache.wiki.util.UtilJ2eeCompatTest | 194.36619718310 | 0.005 | 0.350 |
| org.apache.wiki.util.PriorityListTest | 192.88888888889 | 0.004 | 0.221 |
| org.apache.wiki.auth.acl.AclEntryImplTest | 192.72727272727 | 0.004 | 0.216 |
| org.apache.wiki.workflow.OutcomeTest | 192.19143576826 | 0.031 | 1.557 |
| org.apache.wiki.ui.GroupCommandTest | 191.42300194932 | 0.044 | 2.008 |
| org.apache.wiki.auth.permissions.AllPermissionTest | 190.90909090909 | 0.005 | 0.215 |
| org.apache.wiki.filters.FilterManagerTest | 190.89715536105 | 0.052 | 2.233 |
| org.apache.wiki.plugin.GroupsTest | 190.70307960488 | 0.040 | 1.681 |
| org.apache.wiki.util.MailUtilTest | 190.67110899572 | 0.049 | 2.052 |
| org.apache.wiki.util.CryptoUtilTest | 190.62500000000 | 0.006 | 0.250 |
| org.apache.wiki.ui.PageCommandTest | 190.48977650975 | 0.050 | 2.053 |
| org.apache.wiki.auth.login.WebContainerLoginModuleTest | 190.36973344798 | 0.056 | 2.270 |
| org.apache.wiki.auth.permissions.WikiPermissionTest | 189.47368421053 | 0.006 | 0.222 |
| org.apache.wiki.dav.DavPathTest | 189.39393939394 | 0.007 | 0.257 |
| org.apache.wiki.workflow.TaskTest | 189.18918918919 | 0.006 | 0.216 |
| org.apache.wiki.ui.WikiCommandTest | 188.67187500000 | 0.058 | 1.990 |
| org.apache.wiki.auth.login.CookieAssertionLoginModuleTest | 188.39694656489 | 0.057 | 1.908 |
| org.apache.wiki.plugin.UndefinedPagesPluginTest | 188.21630347054 | 0.073 | 2.405 |
| org.apache.wiki.render.WysiwygEditingRendererTest | 188.12260536398 | 0.062 | 2.026 |
| org.apache.wiki.auth.login.UserDatabaseLoginModuleTest | 187.73869346734 | 0.061 | 1.929 |
+-----------------------------------------------------------+-----------------+-----------+-----------+
25 rows in set (0.02 sec)
This page (revision-34) was last changed on 23-Apr-2022 17:06 by Harry MetskeTop