Project information
Project: http://drupal.org/project/uts
Status: Google Summer of Code development complete. (related release: uts 6.x-1.0-beta2)
Description
Provide a method of measuring the user experience which has been stated as a very important goal of Drupal. In Dries' keynote he detailed the results of the usability testing and stressed that we should "Continue to make Drupal easier to use." This project will provide a suite of usability testing tools that will allow data to be recorded and analyzed in order to make improvements to Drupal's usability.
Additional Reading:
Project schedule
Design and implement usability unit test creation and review interface, and provide database structure for usability unit tests. (June 14th)Create user testing environment and event capture interface. (June 28th)Design and implement pluggable API for collection of data. (July 12th)Create input plug-ins for necessary data. (July 26th)User pathLive feedbackInput recorder
Design and implement pluggable API for export, post-processing of data, and analysis. (August 9th)Provide documentation on how to use usability testing suite. (August 18th)
Status updates
2008-05-27
Basic interface for creating, editing, and deleting studies is in-place. I have stubbed out a few other features to get a feel for the interface.
I plan to have a somewhat fully featured study management interface within the week so that I can get feedback before going further into the project.
As I implement the interface I have run into several different implementation choices, especially in relation to prerequisites. I have tossed several idea around and will make a proposal in my project's issue queue.
2008-06-03
Coding on project has completely stalled as there has been allot of discussion in regards to the workings of the module. I am hoping to be able to start coding again within the next several days.
After discussion in IRC tonight we have a roadmap and I can begin coding!
I will be gone June 8 - June 15 and possible a few days longer. I should be able to make up for lost time, although combined with this last week of delay it will require some hard work.
2008-06-10
Out of town
2008-06-17
Starting to get back on track as discussions start to conclude. Most of the discussion related to the basic study/task creation interface is done so I can finish those. Hoping to get back on track after much delay with discussions.
Got a basic ideal steps recorder working then found out that wasn't what was wanted.
Started work on tasks management screen and relating them to a study. Need to confirm a few implementation level details, but should be able to wrap up interface within next few days.
2008-06-24
Study/Task management interface has been approved so I have begun work on the next phase of development ("Creating user testing environment and event capture interface").
This involves how users start/stop/interact with a study and the environment that they do it in. As I started working on it I ran into a number of unforeseen issues and start a discussion about them.
I have now completed much of the environment and session creation code as well as the interface that allows a participant to start a study. The next parts are the "Done" button and the interface to move on to the next study, pause, etc.
The project download size has doubled since last update! :)
2008-07-01
Things are moving along smoothly and I am now well into the creating the data collection API. The enabled and supported data plug-ins are enabled on the testing environment and are given the necessary functions to record data.
The data plug-ins can specify client requirements to ensure that the necessary software (ie. screen recorder, mic, etc) is available or that the browser is configured properly. If a plug-in's requirements are not met and it is flagged as a required plug-in then the user will be required to resolve the issues.
As I develop the data collection API I have been creating a live user feedback plug-in to test the API and to be the first data recorder for the UTS. This plug-in is operational in that it records user comments via an AJAX request to the server which provides a seamless interface and does not interrupt the user's testing session.
A necessary component of the proctor (module that oversees the tests) that I have yet to write is the recording of the begin and end timestamps for each task completed so that the data plug-ins can be queried with timestamps. Which leads to the last portion of the data collection API that needs to be written, the data retrieval hooks.
This module is in prime condition for an impressive alpha release, hopefully followed quickly by a beta release!
2008-07-08
I released alpha 1 of UTS and I am very pleased with how much is complete. From the release notes:
This release contains a very functional Usability Testing Suite. Users should be able to create studies and tasks, participate in a study, and analyze the results. The work-flow is a bit interrupted as some of the redirects don't function correctly, but the functionality is there.
This release contains a Live text feedback plug-in that allows participants to enter feedback using an a small dialog and send it to the server via AJAX. The plug-in needs some polishing, but it functions like everything else.
The main things left to be completed are the export/import API which will allow the analysis and data to be exported, cosmetic things like the workflow and notice e-mails, and user path data collection/analysis plugin.
It would be great if others would start writing other data plug-ins to provide feedback on the API and to help jump-start this module into a useful state.
2008-07-16
Coding has come to a stop as I wait for help deciding how to display User path comparison interface. The module is complete other than that, a few cleanup items that I will post shortly, and documentation.
I'm going to try and release a beta very soon. Talking with Bevan and Bojhan about when would be best (or what needs to be done first).
2008-07-22
Introduced base environments which allow UTS Engineers to setup an environment specifically for a study and then have it replicated for each participant. Environments can also be used by multiple studies. A have fixed a number of small annoyances and finally have redirects working which make for a much improved user interface.
I will release an alpha 3 later this week and will most likely be presenting the module at Drupalcamp Denver.
2008-07-29
Presentation went well and the recording should be posted fairly soon. I'm hoping to use part of the demonstration for an instructional video on the project page.
The suite is essential complete and I have called for a final review to see what the mentors think is left to complete or needs changing.
There is some interesting discussion on additional plug-ins that may be added after GSoC.
2008-08-05
My mentor has given a thorough review and others interested have shared their thoughts. I'm in the process of making final changes. Once complete I will update tests and write a bit of documentation.
The module still requires work to be completed after SoC, but what I have written will provide a very strong basis for that.
2008-08-12
I've been a bit busy this week, but I have completed a large portion of the items noted in the review. I hope to finish up the important items, update the tests, and write a bit of documentation before making a final SoC release.
| Attachment | Size |
|---|---|
| proposal.pdf | 174.92 KB |