This page (revision-34) was last changed on 23-Apr-2022 17:06 by Harry Metske

This page was created on 23-Apr-2022 17:06 by Harry Metske

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Page revision history

Version Date Modified Size Author Changes ... Change note
34 23-Apr-2022 17:06 32 KB Harry Metske to previous
33 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
32 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
31 23-Apr-2022 17:06 32 KB Harry Metske to previous | to last
30 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
29 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
28 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
27 23-Apr-2022 17:06 31 KB Harry Metske to previous | to last
26 23-Apr-2022 17:06 27 KB Harry Metske to previous | to last
25 23-Apr-2022 17:06 27 KB Harry Metske to previous | to last
24 23-Apr-2022 17:06 24 KB Harry Metske to previous | to last 3.0.0-svn-80
23 23-Apr-2022 17:06 19 KB Harry Metske to previous | to last
22 23-Apr-2022 17:06 19 KB Harry Metske to previous | to last
21 23-Apr-2022 17:06 17 KB Harry Metske to previous | to last

Page References

Incoming links Outgoing links
JSPWiki JUnit test performance management
JSPWiki JUnit test performance management

Version management

Difference between version and

At line 3 added one line
* Use the information created with every run of the tests task, each JUnit test produces an [XML format report|TEST-org.apache.wiki.TextUtilTest.xml] containing response times, see tab
At line 4 changed 2 lines
[{TableOfContents }]
\\
%%tabbedSection
%%tab-Main
At line 7 removed 3 lines
The idea is to use the information created by the JUnit tests.
\\Every time you run an " ant tests", a ''reports'' directory is created containing a test report for each test.
each JUnit test produces an [XML format report|TEST-org.apache.wiki.TextUtilTest.xml] containing response times, errors and failures.
At line 11 changed 8 lines
I wrote some code that gathers this information and stores it in an SQL database.
\\It takes two parameters :
* the name of the directory %%small (i.e. "/home/metskem/workspace/JSPWiki/build/tests/reports") %%
* a tag that identifies this test run %%small (i.e. "3.0.0-svn-17") %%
If we gather this information for each JSPWiki level that has significant changes, we could analyze if, and where performance differences occur, and also keep track of a lot of other things.
! DDL testcaseresult table
* parse all these files, get the response times out
* store them in an SQL DB (JSPWikiPerfDB)
* table testcase DDL:
At line 34 changed 3 lines
! Sample content testcaseresult
* table testcase example content :
At line 55 changed 4 lines
! DDL testsuiteresult table
* table testsuite DDL :
At line 76 changed 4 lines
! Sample content testsuiteresult
* example testsuite result :
At line 75 added 3 lines
* save this in a file and execute it : ''mysql --host=blackpearl --database=JSPWikiPerfDB --user=....... --password=...... < ff.sql
''
/%
At line 91 removed one line
!! Running the collector tool
At line 93 changed 2 lines
Each run will insert about 100 records in the testsuiteresult table, and about a 1000 rows in the testcaseresult table.
\\The following is an example output of a run:
%%tab-TestReport
%%prettify
At line 96 changed 7 lines
21:08:14,974 WARN MainProcessor:122 - processing 106 files from directory /home/metskem/workspace/JSPWiki/build/tests/reports, tag : 3.0.0-svn-72
21:08:16,241 ERROR MainProcessor:135 - parsing completed in 1 second(s)
21:08:16,348 INFO DBUtil:100 - class com.mysql.jdbc.Driver succesfully loaded
21:08:17,993 INFO DBUtil:125 - transaction support present ? : true
21:08:27,327 WARN DBUtil:169 - committing changes....
21:08:27,330 WARN DBUtil:171 - commit completed
21:08:27,334 ERROR MainProcessor:97 - inserted 1161 rows in 11 seconds
<?xml version="1.0" encoding="UTF-8" ?>
<testsuite errors="0" failures="0" hostname="bismarck" name="org.apache.wiki.TextUtilTest"
tests="34" time="0.025" timestamp="2009-02-14T18:03:35">
<properties>
<property name="env.DESKTOP_SESSION" value="gnome"></property>
<property name="file.encoding.pkg" value="sun.io"></property>
<property name="@logfile@" value="/tmp/jspwiki/logs/jspwiki.log"></property>
<property name="jdbc.jar.present" value="tests/lib/hsqldb.jar"></property>
<property name="java.home" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre"></property>
<property name="jdbc.driver.jar" value="tests/lib/hsqldb.jar"></property>
<property name="jspwiki.specialPage.NewGroup" value="NewGroup.jsp"></property>
<property name="env.GDM_LANG" value="en_US.UTF-8"></property>
<property name="war.compile.jsps" value="true"></property>
<property name="jspwiki.userdatabase.lockExpiry" value="lock_expiry"></property>
<property name="ant.file.JSPWiki" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
<property name="jspwiki.interWikiRef.TWiki" value="http://twiki.org/cgi-bin/view/TWiki/%s"></property>
<property name="env.DISPLAY" value=":0.0"></property>
<property name="env.LS_COLORS" value="no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.svgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:"></property>
<property name="debug" value="true"></property>
<property name="tests.db.scripts" value="tests/etc/db/hsql"></property>
<property name="env.XDG_SESSION_COOKIE" value="f054683b9c91e14bec778a5b48c6c18f-1234620764.533961-246543790"></property>
<property name="jspwiki.userdatabase.created" value="created"></property>
<property name="jspwiki.pageProvider" value="FileSystemProvider"></property>
<property name="jarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar"></property>
<property name="java.endorsed.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/endorsed"></property>
<property name="env.LOGNAME" value="metskem"></property>
<property name="jdbc.driver.url" value="jdbc:hsqldb:hsql://localhost/jspwiki"></property>
<property name="env.USERNAME" value="metskem"></property>
<property name="jdbc.driver.id" value="hsql"></property>
<property name="env.SESSION_MANAGER" value="local/bismarck:/tmp/.ICE-unix/12389"></property>
<property name="sun.os.patch.level" value="unknown"></property>
<property name="jspwiki.userdatabase.loginName" value="login_name"></property>
<property name="env.GDM_XSERVER_LOCATION" value="local"></property>
<property name="java.vendor.url" value="http://java.sun.com/"></property>
<property name="webtests.port" value="10024"></property>
<property name="java.version" value="1.5.0_16"></property>
<property name="env.ORBIT_SOCKETDIR" value="/tmp/orbit-metskem"></property>
<property name="svn.repository" value="http://svn.apache.org/repos/asf/incubator/jspwiki"></property>
<property name="jspwiki.templateDir" value="default"></property>
<property name="jspwiki.diffProvider" value="TraditionalDiffProvider"></property>
<property name="java.vendor.url.bug" value="http://java.sun.com/cgi-bin/bugreport.cgi"></property>
<property name="env.XDG_DATA_DIRS" value="/usr/local/share/:/usr/share/:/usr/share/gdm/"></property>
<property name="jspwiki.usePageCache" value="true"></property>
<property name="jspwiki.applicationName" value="JSPWiki"></property>
<property name="jspwiki.interWikiRef.WikiWikiWeb" value="http://c2.com/cgi/wiki?%s"></property>
<property name="user.name" value="metskem"></property>
<property name="env.LANG" value="en_US.UTF-8"></property>
<property name="sun.io.unicode.encoding" value="UnicodeLittle"></property>
<property name="@tests.auth.filename" value="/tmp/testrepository/auth.txt"></property>
<property name="sun.jnu.encoding" value="UTF-8"></property>
<property name="env.DBUS_SESSION_BUS_ADDRESS" value="unix:abstract=/tmp/dbus-lDtIGDPxHU,guid=8dfb9cc4886aa571127ca1264996d15d"></property>
<property name="java.runtime.name" value="Java(TM) 2 Runtime Environment, Standard Edition"></property>
<property name="optimize" value="false"></property>
<property name="jks.password" value="jspwiki"></property>
<property name="jspwiki.repository" value="priha"></property>
<property name="java.specification.name" value="Java Platform API Specification"></property>
<property name="@mail.smtp.port@" value="25"></property>
<property name="user.timezone" value=""></property>
<property name="selenium-rc.jar" value="tests/lib/selenium-server-1.0-beta1.jar"></property>
<property name="path.separator" value=":"></property>
<property name="@tests.filter@" value="tests/etc/filters.xml"></property>
<property name="@pagedir@" value="/tmp/jspwiki/wikipages"></property>
<property name="jspwiki.userdatabase.datasource" value="jdbc/UserDatabase"></property>
<property name="hsql.server.dbname.0" value="jspwiki"></property>
<property name="jspwiki.groupdatabase.member" value="member"></property>
<property name="file.encoding" value="UTF-8"></property>
<property name="jspwiki.attachmentProvider" value="BasicAttachmentProvider"></property>
<property name="build" value="/home/metskem/workspace/JSPWiki/build"></property>
<property name="env.HOME" value="/home/metskem"></property>
<property name="tests.reports" value="/home/metskem/workspace/JSPWiki/build/tests/reports"></property>
<property name="ant.file" value="/home/metskem/workspace/JSPWiki/build.xml"></property>
<property name="jspwiki.translatorReader.allowHTML" value="false"></property>
<property name="env.GTK_RC_FILES" value="/etc/gtk/gtkrc:/home/metskem/.gtkrc-1.2-gnome2"></property>
<property name="java.io.tmpdir" value="/tmp"></property>
<property name="env.GNOME_KEYRING_PID" value="12379"></property>
<property name="user.language" value="en"></property>
<property name="jspwiki.translatorReader.useOutlinkImage" value="true"></property>
<property name="line.separator" value="
"></property>
<property name="jspwiki.userdatabase.table" value="users"></property>
<property name="jspwiki.baseURL" value=""></property>
<property name="jspwiki.rss.interval" value="3600"></property>
<property name="jspwiki.interWikiRef.Wikipedia" value="http://www.wikipedia.com/wiki/%s"></property>
<property name="@tests.logfile@" value="/tmp/jspwikitests.log"></property>
<property name="jspwiki.searchProvider" value="LuceneSearchProvider"></property>
<property name="webtests.reports" value="/home/metskem/workspace/JSPWiki/build/webtests/reports"></property>
<property name="jdbc.admin.id" value="SA"></property>
<property name="java.vm.info" value="mixed mode, sharing"></property>
<property name="jspwiki.userdatabase.password" value="password"></property>
<property name="sun.desktop" value="gnome"></property>
<property name="java.vm.specification.name" value="Java Virtual Machine Specification"></property>
<property name="env.COLORTERM" value="gnome-terminal"></property>
<property name="jspwiki.aclManager" value="org.apache.wiki.auth.acl.DefaultAclManager"></property>
<property name="jspwiki.plugin.searchPath" value=""></property>
<property name="jspwiki.groupdatabase.name" value="name"></property>
<property name="static.user" value="apache"></property>
<property name="compile.jsps" value="true"></property>
<property name="code.i18n" value="src/WebContent/WEB-INF/classes"></property>
<property name="testjarfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar"></property>
<property name="env.GDMSESSION" value="gnome"></property>
<property name="env.GREP_COLOR" value="97;45"></property>
<property name="java.awt.printerjob" value="sun.print.PSPrinterJob"></property>
<property name="jspwiki.rss.fileName" value="rss.rdf"></property>
<property name="jspwiki.loginModule.class" value="org.apache.wiki.auth.login.UserDatabaseLoginModule"></property>
<property name="ant.version" value="Apache Ant version 1.7.1 compiled on October 3 2008"></property>
<property name="env.WINDOWID" value="60820599"></property>
<property name="@tests.workdir@" value="/tmp/testworkdir"></property>
<property name="webtests.temp" value="/tmp/webtests"></property>
<property name="jspwiki.interWikiRef.Doc" value="http://doc.jspwiki.org/2.8/wiki/%s"></property>
<property name="war.build" value="/home/metskem/workspace/JSPWiki/build/war"></property>
<property name="jspwiki.specialPage.UserPreferences" value="UserPreferences.jsp"></property>
<property name="tmplt.i18n.dir" value="i18n_templates"></property>
<property name="code.src" value="src/java"></property>
<property name="jspwiki.translatorReader.matchEnglishPlurals" value="true"></property>
<property name="jspwiki.groupdatabase.created" value="created"></property>
<property name="jspwiki.interWikiRef.Google" value="http://www.google.com/search?q=%s"></property>
<property name="db.scripts" value="etc/db/hsql"></property>
<property name="os.name" value="Linux"></property>
<property name="java.specification.vendor" value="Sun Microsystems Inc."></property>
<property name="code.web" value="src/WebContent"></property>
<property name="env.TERM" value="xterm"></property>
<property name="java.vm.name" value="Java HotSpot(TM) Client VM"></property>
<property name="@spamlog@" value="/tmp/jspwiki/logs/spamlog.log"></property>
<property name="jspwiki.groupdatabase.membertable" value="group_members"></property>
<property name="jdbc.admin.password" value=""></property>
<property name="jspwiki.specialPage.CreateGroup" value="NewGroup.jsp"></property>
<property name="jspwiki.rss.channelDescription" value="Oh poor me, my owner has not set jspwiki.rss.channelLanguage = en-us"></property>
<property name="@appname@" value="JSPWiki"></property>
<property name="hsql.server.database.0" value="file:jspwiki"></property>
<property name="jspwiki.breakTitleWithSpaces" value="false"></property>
<property name="java.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
<property name="svn.tag" value="trunk"></property>
<property name="jspwiki.userdatabase.modified" value="modified"></property>
<property name="env.PATH" value="/home/metskem/bin:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/X11R6/bin"></property>
<property name="jspwiki.userdatabase.attributes" value="attributes"></property>
<property name="jspwiki.fileSystemProvider.pageDir" value="/tmp/jspwiki/wikipages"></property>
<property name="hsql" value="true"></property>
<property name="ant.java.version" value="1.5"></property>
<property name="install.src" value="/tmp/metskem/JSPWiki/svnsrc"></property>
<property name="basedir" value="/home/metskem/workspace/JSPWiki"></property>
<property name="java.class.version" value="49.0"></property>
<property name="jspwiki.specialPage.Login" value="Login.jsp"></property>
<property name="env.LD_LIBRARY_PATH" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386/client:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/../lib/i386"></property>
<property name="jspwiki.tests.auth" value="true"></property>
<property name="ant.home" value="/usr/share/ant"></property>
<property name="@tests.pagedir@" value="/tmp/testrepository"></property>
<property name="env.GNOME_KEYRING_SOCKET" value="/tmp/keyring-s4QYDm/socket"></property>
<property name="release.dir" value="releases"></property>
<property name="static.group" value="daemon"></property>
<property name="jspwiki.rss.generate" value="false"></property>
<property name="docs.javadoc" value="doc/javadoc"></property>
<property name="jdbc.driver.class" value="org.hsqldb.jdbcDriver"></property>
<property name="sun.boot.library.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i386"></property>
<property name="sun.management.compiler" value="HotSpot Client Compiler"></property>
<property name="db.props.exist" value="true"></property>
<property name="hsql.up" value="true"></property>
<property name="java.awt.graphicsenv" value="sun.awt.X11GraphicsEnvironment"></property>
<property name="jspwiki.authorizer" value="org.apache.wiki.auth.authorize.WebContainerAuthorizer"></property>
<property name="env.USER" value="metskem"></property>
<property name="jspwiki.groupdatabase.modifier" value="modifier"></property>
<property name="jspwiki.groupdatabase.creator" value="creator"></property>
<property name="jdbc.user.id" value="jspwiki"></property>
<property name="jspwiki.groupdatabase.table" value="groups"></property>
<property name="jdbc.user.password" value="password"></property>
<property name="ant.project.name" value="JSPWiki"></property>
<property name="webtests.build" value="/home/metskem/workspace/JSPWiki/build/webtests"></property>
<property name="jspwiki.groupdatabase.modified" value="modified"></property>
<property name="java.vm.specification.version" value="1.0"></property>
<property name="env.NLSPATH" value="/usr/dt/lib/nls/msg/%L/%N.cat"></property>
<property name="tmpdir" value="/tmp/metskem/JSPWiki"></property>
<property name="sun.cpu.isalist" value=""></property>
<property name="jspwiki.groupdatabase.datasource" value="jdbc/GroupDatabase"></property>
<property name="java.ext.dirs" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/ext"></property>
<property name="os.version" value="2.6.27-11-generic"></property>
<property name="jspwiki.userdatabase.fullName" value="full_name"></property>
<property name="jspwiki.interWikiRef.Edit" value="Edit.jsp?page=%s"></property>
<property name="user.home" value="/home/metskem"></property>
<property name="jspwiki.basicAttachmentProvider.storageDir" value="/tmp/jspwiki/wikipages"></property>
<property name="java.vm.vendor" value="Sun Microsystems Inc."></property>
<property name="webtests.browser" value="*firefox /tmp/ff/usr/lib/firefox/firefox-2-bin"></property>
<property name="build.properties" value="build.properties"></property>
<property name="env.JAVA_HOME" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16"></property>
<property name="hsql.server.port" value="9001"></property>
<property name="jspwiki.translatorReader.camelCaseLinks" value="false"></property>
<property name="env.XAUTHORITY" value="/home/metskem/.Xauthority"></property>
<property name="jspwiki.userdatabase.uid" value="uid"></property>
<property name="user.dir" value="/home/metskem/workspace/JSPWiki"></property>
<property name="env.WINDOWPATH" value="8:8:8:8"></property>
<property name="env.XFILESEARCHPATH" value="/usr/dt/app-defaults/%L/Dt"></property>
<property name="jspwiki.userdatabase.wikiName" value="wiki_name"></property>
<property name="env.PWD" value="/home/metskem/workspace/JSPWiki"></property>
<property name="sun.cpu.endian" value="little"></property>
<property name="warfile" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.war"></property>
<property name="jspwiki.userdatabase.role" value="role"></property>
<property name="@mail.from@" value="JSPWiki &lt;JSPWiki@localhost&gt;"></property>
<property name="deprecation" value="false"></property>
<property name="java.vm.version" value="1.5.0_16-b02"></property>
<property name="java.class.path" value="/home/metskem/workspace/JSPWiki/build/JSPWiki.jar:/home/metskem/workspace/JSPWiki/build/JSPWiki-tests.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/lib/tools.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/activation.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/akismet-java-1.02.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-codec-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-fileupload-1.2.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-httpclient-3.0.1.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-io-1.4.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/commons-lang-2.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/ecs.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/freshcookies-security-0.60.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jabsorb-1.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-tablibs-standard-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jakarta-taglibs-jstl-1.1.2.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jaxen.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcl-over-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jcr-1.0.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jdom.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jrcs-diff.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jsp-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/jul-to-slf4j-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/log4j-1.2.14.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene-highlighter.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/lucene.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/mail.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/nekohtml.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/oscache.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/priha-0.1.13.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/sandler.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/servlet-api.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-api-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/slf4j-log4j12-1.5.6.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/stripes-1.5.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/lib/xmlrpc.jar:/home/metskem/workspace/JSPWiki/tests/lib/commons-el-1.0.jar:/home/metskem/workspace/JSPWiki/tests/lib/custom_rhino.jar:/home/metskem/workspace/JSPWiki/tests/lib/hsqldb.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-compiler-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jasper-runtime-5.5.25.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-jmx-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-plus-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/jetty-servlet-5.1.14.jar:/home/metskem/workspace/JSPWiki/tests/lib/junit.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-java-client-driver-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/selenium-server-1.0b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xercesImpl-2.6.2.jar:/home/metskem/workspace/JSPWiki/tests/lib/xml-apis-1.0.b2.jar:/home/metskem/workspace/JSPWiki/tests/lib/yuicompressor-2.3.3.jar:/home/metskem/workspace/JSPWiki/src/WebContent/WEB-INF/classes:/home/metskem/workspace/JSPWiki/tests/etc:/usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-junit.jar"></property>
<property name="ant.library.dir" value="/usr/share/ant/lib"></property>
<property name="webtests.shutdown" value="19041"></property>
<property name="os.arch" value="i386"></property>
<property name="jspwiki.interWikiRef.MeatballWiki" value="http://usemod.com/cgi-bin/mb.pl?%s"></property>
<property name="sun.java.launcher" value="SUN_STANDARD"></property>
<property name="tests.build" value="/home/metskem/workspace/JSPWiki/build/tests/classes"></property>
<property name="ant.core.lib" value="/usr/share/ant/lib/ant.jar"></property>
<property name="jspwiki.interWikiRef.JSPWiki" value="http://www.jspwiki.org/wiki/%s"></property>
<property name="java.vm.specification.vendor" value="Sun Microsystems Inc."></property>
<property name="jspwiki.groupdatabase" value="org.apache.wiki.auth.authorize.XMLGroupDatabase"></property>
<property name="code.build" value="/home/metskem/workspace/JSPWiki/build/classes"></property>
<property name="file.separator" value="/"></property>
<property name="jspwiki.userdatabase.email" value="email"></property>
<property name="jspwiki.encoding" value="UTF-8"></property>
<property name="java.runtime.version" value="1.5.0_16-b02"></property>
<property name="env.SSH_AUTH_SOCK" value="/tmp/keyring-s4QYDm/ssh"></property>
<property name="sun.boot.class.path" value="/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/rt.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/i18n.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jsse.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/jce.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/lib/charsets.jar:/usr/lib/jvm/java-1.5.0-sun-1.5.0.16/jre/classes"></property>
<property name="userdb.setup" value="tests/etc/db/hsql/userdb-setup.ddl"></property>
<property name="tests" value="tests"></property>
<property name="user.country" value="US"></property>
<property name="jspwiki.userdatabase.roleTable" value="roles"></property>
<property name="env.SHELL" value="/usr/bin/fish"></property>
<property name="@securitylog@" value="/tmp/jspwiki/logs/security.log"></property>
<property name="tests.src" value="tests/java"></property>
<property name="@mail.smtp.host@" value="127.0.0.1"></property>
<property name="java.vendor" value="Sun Microsystems Inc."></property>
<property name="install.fulldir" value="/tmp/metskem/JSPWiki/install"></property>
<property name="jspwiki.specialPage.FindPage" value="Search.jsp"></property>
<property name="env.GPG_AGENT_INFO" value="/tmp/seahorse-khoj7K/S.gpg-agent:12498:1"></property>
<property name="jspwiki.userdatabase" value="org.apache.wiki.auth.user.XMLUserDatabase"></property>
<property name="java.specification.version" value="1.5"></property>
<property name="jspwiki.lockExpiryTime" value="60"></property>
<property name="sun.arch.data.model" value="32"></property>
<property name="env.GNOME_DESKTOP_SESSION_ID" value="this-is-deprecated"></property>
<property name="userdb.teardown" value="tests/etc/db/hsql/userdb-teardown.ddl"></property>
</properties>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_2" time="0.0060"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeName_3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeName_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_3" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testEncodeNameUTF8_4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_1" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testDecodeNameUTF8_3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString5" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceString3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive2" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testReplaceStringCaseUnsensitive5" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata1" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata3" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata4" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata5" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata6" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testNormalizePostdata7" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetBooleanProperty" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection1" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection2" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testGetSection3" time="0.0"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testBooleanParameter" time="0.0010"></testcase>
<testcase classname="org.apache.wiki.TextUtilTest" name="testTrimmedProperty" time="0.0010"></testcase>
<system-out><![CDATA[]]></system-out>
<system-err><![CDATA[]]></system-err>
</testsuite>
At line 356 added 3 lines
%%
/%
/%
At line 107 changed 3 lines
Here are a couple of examples of queries we could run.
! Overall statistics
! all testsuites per tag having errors or failures
At line 111 changed 16 lines
mysql> select tag,sum(tests),avg(time),sum(time) from testsuiteresult group by tag order by tag;
+--------------+------------+-----------+-----------+
| tag | sum(tests) | avg(time) | sum(time) |
+--------------+------------+-----------+-----------+
| 2.8.2-svn-13 | 948 | 1.9197143 | 174.694 |
| 3.0.0-svn-17 | 944 | 5.5338652 | 492.514 |
| 3.0.0-svn-71 | 1050 | 4.4532762 | 467.594 |
| 3.0.0-svn-72 | 1055 | 4.5185849 | 478.970 |
| 3.0.0-svn-73 | 1057 | 4.6632617 | 498.969 |
| 3.0.0-svn-76 | 1033 | 4.5757476 | 471.302 |
| 3.0.0-svn-80 | 950 | 4.3344433 | 420.441 |
| 3.0.0-svn-85 | 949 | 3.0273196 | 293.650 |
| 3.0.0-svn-93 | 948 | 2.7866327 | 273.090 |
| 3.0.0-svn-96 | 948 | 2.8197959 | 276.340 |
+--------------+------------+-----------+-----------+
10 rows in set (0.06 sec)
mysql> select tag,name,tests,errors,failures from testsuiteresult where errors>0 or failures > 0 group by tag,name ;
+--------------+-------------------------------------------------+-------+--------+----------+
| tag | name | tests | errors | failures |
+--------------+-------------------------------------------------+-------+--------+----------+
| 2.8.2-svn-13 | com.ecyrd.jspwiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 2.8.2-svn-13 | com.ecyrd.jspwiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
+--------------+-------------------------------------------------+-------+--------+----------+
5 rows in set (0.00 sec)
At line 129 removed 195 lines
! Number of testsuites having errors or failures, grouped by tag
There is also a [daily refreshed version|http://www.computerhok.nl/tmp/jspwiki-testresult.html]
{{{
mysql> select tag as version,max(timestamp) as date ,sum(tests) as tests ,sum(errors) as errors ,sum(failures)/sum(tests)*100 as 'error %',sum(failures) as failures, sum(failures)/sum(tests)*100 as 'failure %' from testsuiteresult group by tag order by timestamp;
+---------------+---------------------+-------+--------+---------+----------+-----------+
| version | date | tests | errors | error % | failures | failure % |
+---------------+---------------------+-------+--------+---------+----------+-----------+
| 3.0.0-svn-71 | 2009-02-19 19:21:30 | 1050 | 5 | 0.0952 | 1 | 0.0952 |
| 2.8.2-svn-13 | 2009-02-19 20:14:21 | 948 | 0 | 0.2110 | 2 | 0.2110 |
| 3.0.0-svn-17 | 2009-02-22 13:00:45 | 944 | 0 | 0.1059 | 1 | 0.1059 |
| 3.0.0-svn-72 | 2009-02-24 19:37:49 | 1055 | 5 | 0.1896 | 2 | 0.1896 |
| 3.0.0-svn-73 | 2009-02-25 20:21:18 | 1057 | 1 | 0.1892 | 2 | 0.1892 |
| 3.0.0-svn-76 | 2009-03-01 19:04:10 | 1033 | 1 | 0.0968 | 1 | 0.0968 |
| 3.0.0-svn-80 | 2009-03-06 20:41:24 | 950 | 45 | 7.6842 | 73 | 7.6842 |
| 3.0.0-svn-85 | 2009-03-18 18:07:45 | 949 | 46 | 8.6407 | 82 | 8.6407 |
| 3.0.0-svn-93 | 2009-04-05 17:26:52 | 948 | 53 | 12.1308 | 115 | 12.1308 |
| 3.0.0-svn-96 | 2009-04-06 17:09:47 | 948 | 70 | 10.8650 | 103 | 10.8650 |
| 3.0.0-svn-102 | 2009-04-16 18:28:20 | 952 | 50 | 11.6597 | 111 | 11.6597 |
| 3.0.0-svn-159 | 2009-09-30 19:07:11 | 998 | 37 | 3.2064 | 32 | 3.2064 |
| 3.0.0-svn-161 | 2009-10-08 17:55:33 | 1018 | 37 | 4.7151 | 48 | 4.7151 |
+---------------+---------------------+-------+--------+---------+----------+-----------+
13 rows in set (0.07 sec)
}}}
! Errors / failures by class / tag
{{{
mysql> select tag,name,errors,failures,time from testsuiteresult where failures>0 or errors > 0 order by name,tag;
+--------------+------------------------------------------------------------+--------+----------+---------+
| tag | name | errors | failures | time |
+--------------+------------------------------------------------------------+--------+----------+---------+
| 3.0.0-svn-80 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 0 | 1.092 |
| 3.0.0-svn-85 | org.apache.wiki.action.DeleteActionBeanTest | 0 | 3 | 1.123 |
| 3.0.0-svn-93 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 0 | 1.058 |
| 3.0.0-svn-80 | org.apache.wiki.action.RenameActionBeanTest | 0 | 6 | 13.108 |
| 3.0.0-svn-85 | org.apache.wiki.action.RenameActionBeanTest | 0 | 4 | 11.771 |
| 3.0.0-svn-93 | org.apache.wiki.action.RenameActionBeanTest | 0 | 4 | 11.249 |
| 3.0.0-svn-80 | org.apache.wiki.action.ViewActionBeanTest | 0 | 2 | 5.597 |
| 3.0.0-svn-80 | org.apache.wiki.action.WikiContextFactoryTest | 0 | 1 | 6.216 |
| 3.0.0-svn-80 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 1 | 0 | 1.032 |
| 3.0.0-svn-85 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 1 | 1.097 |
| 3.0.0-svn-93 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 0 | 1 | 1.666 |
| 3.0.0-svn-80 | org.apache.wiki.auth.AuthorizationManagerTest | 1 | 0 | 5.174 |
| 3.0.0-svn-93 | org.apache.wiki.auth.AuthorizationManagerTest | 0 | 2 | 4.960 |
| 3.0.0-svn-80 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.343 |
| 3.0.0-svn-85 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.470 |
| 3.0.0-svn-93 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 0 | 1 | 3.194 |
| 3.0.0-svn-80 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.225 |
| 3.0.0-svn-85 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.316 |
| 3.0.0-svn-93 | org.apache.wiki.auth.UserManagerTest | 0 | 1 | 2.111 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 0 | 1.236 |
| 3.0.0-svn-72 | org.apache.wiki.content.ContentManagerTest | 4 | 0 | 1.243 |
| 3.0.0-svn-85 | org.apache.wiki.content.ContentManagerTest | 1 | 0 | 1.261 |
| 3.0.0-svn-93 | org.apache.wiki.content.ContentManagerTest | 1 | 0 | 1.388 |
| 3.0.0-svn-93 | org.apache.wiki.content.EnglishPluralsPageNameResolverTest | 0 | 1 | 0.310 |
| 3.0.0-svn-80 | org.apache.wiki.content.PageRenamerTest | 17 | 3 | 7.174 |
| 3.0.0-svn-85 | org.apache.wiki.content.PageRenamerTest | 18 | 3 | 7.533 |
| 3.0.0-svn-93 | org.apache.wiki.content.PageRenamerTest | 18 | 3 | 7.391 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 0.103 |
| 3.0.0-svn-72 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 0.989 |
| 3.0.0-svn-73 | org.apache.wiki.dav.AttachmentDavProviderTest | 0 | 1 | 3.377 |
| 3.0.0-svn-80 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 0 | 27 | 68.912 |
| 3.0.0-svn-85 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 1 | 28 | 67.451 |
| 3.0.0-svn-93 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 2 | 52 | 61.415 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.CounterPluginTest | 3 | 0 | 1.925 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.CounterPluginTest | 3 | 0 | 1.708 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.IndexPluginTest | 0 | 1 | 0.413 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.InsertPageTest | 0 | 2 | 2.137 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.PluginManagerTest | 15 | 0 | 6.208 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.RecentChangesPluginTest | 2 | 1 | 1.448 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.RecentChangesPluginTest | 0 | 3 | 3.612 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.RecentChangesPluginTest | 0 | 3 | 1.243 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 2 | 1.311 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 3 | 1.326 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.ReferredPagesPluginTest | 0 | 3 | 1.323 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferringPagesPluginTest | 1 | 3 | 3.605 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.ReferringPagesPluginTest | 0 | 6 | 3.553 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.ReferringPagesPluginTest | 0 | 7 | 3.520 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 2.926 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 3.001 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.TableOfContentsTest | 0 | 5 | 2.874 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.837 |
| 3.0.0-svn-85 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.836 |
| 3.0.0-svn-93 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 0 | 2 | 0.893 |
| 3.0.0-svn-80 | org.apache.wiki.ReferenceManagerTest | 1 | 1 | 19.646 |
| 3.0.0-svn-85 | org.apache.wiki.ReferenceManagerTest | 14 | 2 | 15.744 |
| 3.0.0-svn-93 | org.apache.wiki.ReferenceManagerTest | 2 | 13 | 15.591 |
| 3.0.0-svn-85 | org.apache.wiki.render.RenderingManagerTest | 1 | 0 | 0.359 |
| 3.0.0-svn-80 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 1 | 0.737 |
| 3.0.0-svn-85 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 1 | 0.670 |
| 3.0.0-svn-93 | org.apache.wiki.render.WysiwygEditingRendererTest | 0 | 2 | 0.656 |
| 3.0.0-svn-80 | org.apache.wiki.rss.RSSGeneratorTest | 2 | 0 | 0.948 |
| 3.0.0-svn-80 | org.apache.wiki.search.SearchManagerTest | 4 | 1 | 8.328 |
| 3.0.0-svn-85 | org.apache.wiki.search.SearchManagerTest | 4 | 1 | 8.068 |
| 3.0.0-svn-93 | org.apache.wiki.search.SearchManagerTest | 4 | 0 | 7.556 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.092 |
| 3.0.0-svn-72 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.093 |
| 3.0.0-svn-73 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.479 |
| 3.0.0-svn-76 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.102 |
| 3.0.0-svn-80 | org.apache.wiki.ui.migrator.BundleMigratorTest | 1 | 0 | 0.507 |
| 3.0.0-svn-85 | org.apache.wiki.ui.migrator.JspParserTest | 0 | 1 | 0.060 |
| 3.0.0-svn-93 | org.apache.wiki.ui.migrator.JspParserTest | 0 | 1 | 0.072 |
| 3.0.0-svn-80 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.437 |
| 3.0.0-svn-85 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.384 |
| 3.0.0-svn-93 | org.apache.wiki.ui.stripes.HandlerInfoTest | 0 | 1 | 4.135 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 0 | 1 | 20.025 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 0 | 1 | 37.644 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.495 |
| 3.0.0-svn-72 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.517 |
| 3.0.0-svn-73 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.863 |
| 3.0.0-svn-76 | org.apache.wiki.WikiEngineTest | 0 | 1 | 35.308 |
| 3.0.0-svn-80 | org.apache.wiki.WikiEngineTest | 5 | 13 | 15.016 |
| 3.0.0-svn-85 | org.apache.wiki.WikiEngineTest | 3 | 12 | 15.350 |
| 3.0.0-svn-93 | org.apache.wiki.WikiEngineTest | 4 | 10 | 14.265 |
| 3.0.0-svn-80 | org.apache.wiki.workflow.ApprovalWorkflowTest | 2 | 0 | 1.621 |
| 3.0.0-svn-85 | org.apache.wiki.workflow.ApprovalWorkflowTest | 0 | 2 | 1.587 |
| 3.0.0-svn-93 | org.apache.wiki.workflow.ApprovalWorkflowTest | 0 | 2 | 1.409 |
| 3.0.0-svn-80 | org.apache.wiki.xmlrpc.RPCHandlerTest | 4 | 0 | 1.447 |
| 3.0.0-svn-85 | org.apache.wiki.xmlrpc.RPCHandlerTest | 0 | 2 | 1.525 |
| 3.0.0-svn-93 | org.apache.wiki.xmlrpc.RPCHandlerTest | 1 | 0 | 1.193 |
| 3.0.0-svn-80 | stress.MassiveRepositoryTest | 1 | 0 | 124.826 |
| 3.0.0-svn-85 | stress.MassiveRepositoryTest | 1 | 0 | 0.391 |
+--------------+------------------------------------------------------------+--------+----------+---------+
91 rows in set (0.02 sec)
}}}
! Number of testsuites/testcases per tag (buildlevel)
{{{
mysql> select tag,count(*) from testcaseresult group by tag order by tag;
+--------------+----------+
| tag | count(*) |
+--------------+----------+
| 2.8.2-svn-13 | 948 |
| 3.0.0-svn-17 | 944 |
| 3.0.0-svn-71 | 1050 |
| 3.0.0-svn-72 | 1055 |
| 3.0.0-svn-73 | 1057 |
| 3.0.0-svn-76 | 1033 |
| 3.0.0-svn-80 | 950 |
+--------------+----------+
7 rows in set (0.22 sec)
}}}
! All testsuites per tag having errors or failures
{{{
mysql> select tag,name,tests,errors,failures from testsuiteresult where errors>0 or failures > 0 group by tag,name order by name,tag;
+--------------+---------------------------------------------------+-------+--------+----------+
| tag | name | tests | errors | failures |
+--------------+---------------------------------------------------+-------+--------+----------+
| 3.0.0-svn-80 | org.apache.wiki.action.DeleteActionBeanTest | 3 | 3 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.action.RenameActionBeanTest | 7 | 0 | 6 |
| 3.0.0-svn-80 | org.apache.wiki.action.ViewActionBeanTest | 3 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.action.WikiContextFactoryTest | 5 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.auth.acl.DefaultAclManagerTest | 3 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.auth.AuthorizationManagerTest | 15 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.auth.user.XMLUserDatabaseTest | 11 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.auth.UserManagerTest | 5 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-72 | org.apache.wiki.content.ContentManagerTest | 4 | 4 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.content.PageRenamerTest | 21 | 17 | 3 |
| 2.8.2-svn-13 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-72 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-73 | org.apache.wiki.dav.AttachmentDavProviderTest | 3 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 200 | 0 | 27 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.InsertPageTest | 6 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.RecentChangesPluginTest | 3 | 2 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferredPagesPluginTest | 3 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.ReferringPagesPluginTest | 8 | 1 | 3 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.TableOfContentsTest | 8 | 0 | 5 |
| 3.0.0-svn-80 | org.apache.wiki.plugin.UndefinedPagesPluginTest | 2 | 0 | 2 |
| 3.0.0-svn-80 | org.apache.wiki.ReferenceManagerTest | 18 | 1 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.render.WysiwygEditingRendererTest | 2 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.rss.RSSGeneratorTest | 2 | 2 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.search.SearchManagerTest | 6 | 4 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-72 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-73 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-76 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.ui.migrator.BundleMigratorTest | 8 | 1 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.ui.stripes.HandlerInfoTest | 4 | 0 | 1 |
| 2.8.2-svn-13 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-17 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-72 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-73 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-76 | org.apache.wiki.WikiEngineTest | 44 | 0 | 1 |
| 3.0.0-svn-80 | org.apache.wiki.WikiEngineTest | 34 | 5 | 13 |
| 3.0.0-svn-80 | org.apache.wiki.workflow.ApprovalWorkflowTest | 5 | 2 | 0 |
| 3.0.0-svn-80 | org.apache.wiki.xmlrpc.RPCHandlerTest | 4 | 4 | 0 |
| 3.0.0-svn-80 | stress.MassiveRepositoryTest | 1 | 1 | 0 |
+--------------+---------------------------------------------------+-------+--------+----------+
41 rows in set (0.02 sec)
}}}
At line 326 changed 16 lines
mysql> select tag,name,tests,time from testsuiteresult order by time desc,name,tag limit 10;
+--------------+------------------------------------------------+-------+--------+
| tag | name | tests | time |
+--------------+------------------------------------------------+-------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest | 1 | 84.526 |
| 3.0.0-svn-73 | stress.MassiveRepositoryTest | 1 | 81.273 |
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | 1 | 78.442 |
| 3.0.0-svn-72 | stress.MassiveRepositoryTest | 1 | 76.723 |
| 3.0.0-svn-76 | stress.MassiveRepositoryTest | 1 | 75.437 |
| 3.0.0-svn-17 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 70.827 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | 1 | 69.571 |
| 3.0.0-svn-73 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 68.615 |
| 3.0.0-svn-72 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 67.173 |
| 3.0.0-svn-76 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 66.869 |
+--------------+------------------------------------------------+-------+--------+
10 rows in set (0.03 sec)
mysql> select tag,name,tests,time from testsuiteresult order by time desc limit 10;
+--------------+-------------------------------------------------------+-------+--------+
| tag | name | tests | time |
+--------------+-------------------------------------------------------+-------+--------+
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | 1 | 78.442 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | 1 | 69.571 |
| 3.0.0-svn-71 | org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 | 66.344 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | 6 | 42.688 |
| 2.8.2-svn-13 | com.ecyrd.jspwiki.search.SearchManagerTest | 6 | 40.240 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | 44 | 35.495 |
| 2.8.2-svn-13 | com.ecyrd.jspwiki.WikiEngineTest | 44 | 20.025 |
| 3.0.0-svn-71 | org.apache.wiki.providers.BasicAttachmentProviderTest | 12 | 13.836 |
| 3.0.0-svn-71 | org.apache.wiki.action.UserProfileActionBeanTest | 6 | 12.445 |
| 3.0.0-svn-71 | org.apache.wiki.action.GroupActionBeanTest | 6 | 12.310 |
+--------------+-------------------------------------------------------+-------+--------+
10 rows in set (0.01 sec)
At line 344 removed 25 lines
! Classes with most testcases
{{{
mysql> select distinct name,tests from testsuiteresult order by tests desc limit 15;
+-----------------------------------------------------------+-------+
| name | tests |
+-----------------------------------------------------------+-------+
| org.apache.wiki.parser.JSPWikiMarkupParserTest | 205 |
| org.apache.wiki.parser.CreoleToJSPWikiTranslatorTest | 83 |
| org.apache.wiki.WikiEngineTest | 44 |
| org.apache.wiki.TextUtilTest | 35 |
| org.apache.wiki.TextUtilTest | 34 |
| org.apache.wiki.workflow.WorkflowTest | 24 |
| org.apache.wiki.content.PageRenamerTest | 21 |
| org.apache.wiki.ReferenceManagerTest | 18 |
| org.apache.wiki.auth.AuthorizationManagerTest | 17 |
| org.apache.wiki.htmltowiki.HtmlStringToWikiTranslatorTest | 17 |
| org.apache.wiki.ReleaseTest | 17 |
| org.apache.wiki.plugin.PluginManagerTest | 16 |
| org.apache.wiki.VariableManagerTest | 16 |
| org.apache.wiki.workflow.SimpleDecisionTest | 16 |
| org.apache.wiki.dav.DavPathTest | 15 |
+-----------------------------------------------------------+-------+
15 rows in set (0.05 sec)
}}}
At line 371 changed 21 lines
mysql> select tag,classname,name,time from testcaseresult order by time desc,name,tag limit 15;
+--------------+------------------------------------------+------------------------+--------+
| tag | classname | name | time |
+--------------+------------------------------------------+------------------------+--------+
| 3.0.0-svn-17 | stress.MassiveRepositoryTest | testMassiveRepository1 | 84.308 |
| 3.0.0-svn-73 | stress.MassiveRepositoryTest | testMassiveRepository1 | 81.271 |
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | testMassiveRepository1 | 78.440 |
| 3.0.0-svn-72 | stress.MassiveRepositoryTest | testMassiveRepository1 | 76.721 |
| 3.0.0-svn-76 | stress.MassiveRepositoryTest | testMassiveRepository1 | 75.435 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | testMassiveRepository1 | 69.569 |
| 3.0.0-svn-73 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.724 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.530 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.474 |
| 3.0.0-svn-72 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.433 |
| 3.0.0-svn-17 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.396 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.360 |
| 3.0.0-svn-73 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.349 |
| 3.0.0-svn-76 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.343 |
| 3.0.0-svn-72 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.340 |
+--------------+------------------------------------------+------------------------+--------+
15 rows in set (0.30 sec)
mysql> select tag,classname,name,time from testcaseresult order by time desc limit 15;
+--------------+-----------------------------------------------+-------------------------------------+--------+
| tag | classname | name | time |
+--------------+-----------------------------------------------+-------------------------------------+--------+
| 3.0.0-svn-71 | stress.MassiveRepositoryTest | testMassiveRepository1 | 78.440 |
| 2.8.2-svn-13 | stress.MassiveRepositoryTest | testMassiveRepository1 | 69.569 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch | 10.360 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch2 | 10.322 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testSimpleSearch3 | 10.316 |
| 2.8.2-svn-13 | com.ecyrd.jspwiki.search.SearchManagerTest | testSimpleSearch | 10.070 |
| 2.8.2-svn-13 | com.ecyrd.jspwiki.search.SearchManagerTest | testSimpleSearch2 | 10.029 |
| 2.8.2-svn-13 | com.ecyrd.jspwiki.search.SearchManagerTest | testSimpleSearch3 | 10.029 |
| 3.0.0-svn-71 | org.apache.wiki.providers.RCSFileProviderTest | testMillionChanges | 7.179 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | testExternalModificationRefs | 6.328 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | testExternalModification | 6.327 |
| 3.0.0-svn-71 | org.apache.wiki.WikiEngineTest | testExternalModificationRefsDeleted | 6.327 |
| 3.0.0-svn-71 | org.apache.wiki.search.SearchManagerTest | testTitleSearch | 6.065 |
| 2.8.2-svn-13 | com.ecyrd.jspwiki.WikiEngineTest | testExternalModificationRefsDeleted | 6.039 |
| 2.8.2-svn-13 | com.ecyrd.jspwiki.WikiEngineTest | testExternalModificationRefs | 6.037 |
+--------------+-----------------------------------------------+-------------------------------------+--------+
15 rows in set (0.06 sec)
At line 393 removed 35 lines
! Testsuites that have increased their test time the most between releases
{{{
mysql> select name,(max(time)-min(time))/avg(time)*100 as percdelta,min(time),max(time),avg(time) from testsuiteresult where tag='3.0.0-svn-71' or tag='3.0.0-svn-72' group by name order by 2 desc limit 25;
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
| name | percdelta | min(time) | max(time) | avg(time) |
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
| org.apache.wiki.auth.permissions.PagePermissionTest | 76.92307692308 | 0.004 | 0.009 | 0.0065000 |
| org.apache.wiki.dav.DavPathTest | 73.68421052632 | 0.006 | 0.013 | 0.0095000 |
| org.apache.wiki.auth.permissions.WikiPermissionTest | 66.66666666667 | 0.004 | 0.008 | 0.0060000 |
| org.apache.wiki.util.ClassUtilTest | 66.66666666667 | 0.003 | 0.006 | 0.0045000 |
| org.apache.wiki.workflow.SimpleDecisionTest | 60.00000000000 | 0.007 | 0.013 | 0.0100000 |
| org.apache.wiki.parser.CreoleToJSPWikiTranslatorTest | 49.81412639405 | 0.101 | 0.168 | 0.1345000 |
| org.apache.wiki.PageManagerTest | 47.19887955182 | 4.364 | 7.060 | 5.7120000 |
| org.apache.wiki.util.CommentedPropertiesTest | 46.40000000000 | 0.048 | 0.077 | 0.0625000 |
| org.apache.wiki.ui.migrator.JspDocumentTest | 40.00000000000 | 0.002 | 0.003 | 0.0025000 |
| org.apache.wiki.workflow.TaskTest | 40.00000000000 | 0.006 | 0.009 | 0.0075000 |
| org.apache.wiki.ui.migrator.JspParserTest | 38.46153846154 | 0.042 | 0.062 | 0.0520000 |
| org.apache.wiki.auth.permissions.GroupPermissionTest | 35.29411764706 | 0.007 | 0.010 | 0.0085000 |
| org.apache.wiki.auth.authorize.WebContainerAuthorizerTest | 34.02489626556 | 1.400 | 1.974 | 1.6870000 |
| org.apache.wiki.auth.authorize.GroupTest | 32.66381297333 | 2.541 | 3.533 | 3.0370000 |
| org.apache.wiki.util.PriorityListTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.parser.MarkupParserTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.content.WikiNameTest | 28.57142857143 | 0.003 | 0.004 | 0.0035000 |
| org.apache.wiki.PropertyReaderTest | 25.00000000000 | 0.014 | 0.018 | 0.0160000 |
| org.apache.wiki.attachment.AttachmentManagerTest | 24.69245065935 | 4.952 | 6.347 | 5.6495000 |
| org.apache.wiki.auth.acl.DefaultAclManagerTest | 24.02159244265 | 0.978 | 1.245 | 1.1115000 |
| org.apache.wiki.FileUtilTest | 23.85964912281 | 0.251 | 0.319 | 0.2850000 |
| org.apache.wiki.util.UtilJ2eeCompatTest | 22.22222222222 | 0.004 | 0.005 | 0.0045000 |
| org.apache.wiki.auth.authorize.JDBCGroupDatabaseTest | 21.84782608696 | 1.639 | 2.041 | 1.8400000 |
| org.apache.wiki.util.CryptoUtilTest | 18.18181818182 | 0.005 | 0.006 | 0.0055000 |
| org.apache.wiki.ReleaseTest | 18.18181818182 | 0.015 | 0.018 | 0.0165000 |
+-----------------------------------------------------------+----------------+-----------+-----------+-----------+
25 rows in set (0.03 sec)
}}}
This page (revision-34) was last changed on 23-Apr-2022 17:06 by Harry MetskeTop