StigFranzen智能交通世界大会ITS智慧城市社区人工智能AI物联网IT报告课件教案.pdfVIP

Can we trust evaluation results? Prof Stig Franzen Chalmers University of Technology, Sweden stigf@chalmers.se IBEC 4 – Is Evaluation Really Used by Decision Makers for Deployment Decisions 2015-10-08 ITS World Congress, Bordeaux Evaluation or not? An example 12 representatives of public transport authorities in Sweden were interviewed in a study (2008/2012) The aim was to identify the motives behind the introduction of real- time information systems in public transport. Some of the motives were: ... to improve the overall quality of public transport ... more efficient fleet management ... it was a trend at the time to introduce ICT in public transport ... extra funding to accomodate to travellers with disabilities No systematic evaluation of the effects of the introduction of ICT was found (as is rather common in the ICT world What is evaluation? A systematic, rigorous application of scientific methods to assess the design, implementation, improvement, or outcomes of a program. It is a resource-intensive process, frequently requiring resources, such as, evaluate expertise, labor, time, and a sizable budget  The critical assessment, in as objective a manner as possible, of the degree to which a service or its component parts fulfils stated goals (St Leger and Wordsworth-Bell). The focus of this definition is on attaining objective knowledge, and scientifically or quantitatively measuring predetermined and external concepts. What is evaluation?  Different objectives of the project or the system to be evaluated There is no ideal case Who is the initiator?  .