icbr purdue - testing

"Purdue ICBR has completed testing Wavefront’s system (comprising its hardware and testing and analysis software). Wavefront has advised Nemex that Purdue ICBR was unable to independently validate and report on the Wavefront system performance metrics (such as False Acceptance Rate, False Rejection Rate and Equal Error Rate) without further in-depth analysis of the Wavefront software. Purdue ICBR noted Wavefront’s system software does not provide data output to calculate performance metrics in a format typically reviewed by Purdue ICBR."

- I'am still CONFUSED AS f*!! Why wouldn't Purdue provide WBT with a check-list of all the requirements needed for successful testing?? and for one the MOST IMPORTANT OF THEM ALL - to submit your software in a FORMAT that's typically reviewed by Purdue ICBR!!

Typically, meaning: When something is typical, it is common, regular, expected - AND THEY CALL THIS WORLD CLASS TESTING????

"Wavefront intends to review and amend the system software to ensure it provides data output in a typical format. Wavefront will then re-process data from its previous internal and the recent external testing with a view to undertaking further independent validation at Purdue ICBR."

- Ok, so when i asked the question with Shanny the response i got was we need $$ to further complete the software upgrades for testing! There was f* all mention about how much this was going to COST and WHEN the software was going to be amended for re-submission???

"As previously advised Wavefront’s short-term plans include further significant miniaturisation and performance and usability improvements through enhanced software and algorithm development. Whilst Wavefront considers its multi-modal biometric technology provides a unique solution to human biometric identification, Wavefront has advised these further improvements are required in order to have a competitive product in the rapidly evolving mobile (self-acquisition) market. Wavefront is targeting completion of the next phase of this work in 1H 2016."

- the above information isn't new as we already knew this, WHAT A CHANGE OF SUBJECT!

Below are the fundamentals of what Purdue actually do when testing a product. I'm not sure if anyone has actually seen a report from Purdue before but it's VERY VERY detailed regardless of the outcome!!!!!

1. Understand the operation of biometric systems.

2. Understand how people use biometric systems in operational settings (both controlled and uncontrolled).

3. Understand traditional technology, scenario, and operational testing methodologies.

4. Understand traditional ergonomic and usability testing methodologies.

5. Understand and analyze the limitations of biometric systems.

6. Understand basics of quantitative and qualitative research.

7. Evaluate the issues in designing a biometric system, including but not limited to: the impact of language and culture (instructions and symbols); ergonomics and anthropometrics (heights-angles, positioning); training and habituation or accessibility; affordance and perception.

8. Interpret results from reports on biometric technologies evaluation methods, ergonomic and usability methods, and statistical methods.

9. Appraise and critically evaluate prior scenario and operational test reports and case studies of biometric technologies to examine where the application of Human-Biometric Sensor Interaction.

10. Transfer knowledge and understanding of usability, ergonomic, and usability evaluation methodologies to the testing and evaluate biometric devices and systems. 11. Establish a test methodology and collect data using a Human-Biometric Sensor Interaction based methodology (usability, ergonomic, human factors) to investigate a current problem facing the industry.

12. Perform the appropriate data analysis and report findings in a report.
13. Students will produce final reports, conference papers based on the course project.