Time+Place: Tuesday 27/12/2016 14:30 Room 337-8 Taub Bld.
Title: Requirements for Tools for Hairy Requirements or Software Engineering Tasks
Speaker: Daniel M. Berry - COLLOQUIUM LECTURE https://cs.uwaterloo.ca/~dberry/
Affiliation: University of Waterloo
Host: Yuval Filmus

Abstract:


A hairy requirements or software engineering task involving natural
language (NL) documents is one that is not inherently difficult for
NL understanding humans on a small scale but becomes unmanageable in
the large scale. A hairy task demands tool assistance. Because
humans need far more help in carrying out a hairy task completely
than they do in making the local yes-or-no decisions, a tool for a
hairy task should have as close to 100% recall as possible, even at
the expense of high imprecision. A tool that falls short of 100%
recall may even be useless, because to find the missing information,
a human has to do the entire task manually anyway. Any such tool
based on NL processing techniques inherently fails to achieve 100%
recall, because even the best parsers are no more than 91% correct.
Therefore, to achieve 100% recall in a tool for a hairy task, it
needs to be based on something other than traditional NLP.
The reality is that a tool's achieving exactly 100% recall, which
may be impossible anyway, may not be necessary. It suffices for a
human working with the tool on a task to achieve better recall than
a human working on the task entirely manually.
This talk describes research whose goal is to discover and test a
variety of non-traditional approaches to building tools for hairy
tasks to see which, if any, allows a human working with with the
tool to achieve better recall than a human working entirely
manually. Among the early results is some advice about the correct
F-measure to use to evaluate tools for hairy tasks.


Short Bio:
----------
Daniel M. Berry got his B.S. in Mathematics from Rensselaer Polytechnic 
Institute, Troy, New York, USA in 1969 and his Ph.D. in Computer Science 
from Brown University, Providence, Rhode Island, USA in 1974. He was on 
the faculty of the Computer Science Department at the University of California, 
Los Angeles, California, USA from 1972 until 1987. He was in the Computer Science 
Faculty at the Technion, Haifa, Israel from 1987 until 1999. From 1990 until 1994, 
he worked for half of each year at the Software Engineering Institute at Carnegie 
Mellon University, Pittsburgh, Pennsylvania, USA, where he was part of a group that 
built CMU's Master of Software Engineering program. During the 1998-1999 academic 
year, he visited the Computer Systems Group at the University of Waterloo in
Waterloo, Ontario, Canada. In 1999, Berry moved to the the Cheriton School of 
Computer Science at the University of Waterloo. Prof. Berry's current research
interests are software engineering in general, and requirements engineering and 
electronic publishing in the specific.


=========================================
Refreshments will be served from 14:15
Lecture starts at 14:30