{"id":1508,"date":"2018-03-25T18:21:56","date_gmt":"2018-03-25T18:21:56","guid":{"rendered":"http:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?page_id=1508"},"modified":"2018-04-05T13:52:15","modified_gmt":"2018-04-05T13:52:15","slug":"expertknowledge","status":"publish","type":"page","link":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/","title":{"rendered":""},"content":{"rendered":"<div id=\"pl-1508\"  class=\"panel-layout\" ><div id=\"pg-1508-0\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-1508-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-1508-0-0-0\" class=\"so-panel widget widget_mit-pf-wysiwyg widget_mit_pf_wysiwyg panel-first-child\" data-index=\"0\" ><h2 class=\"widget-title\">Expert Knowledge Elicitation to Improve Mental and Formal Models<\/h2><div class=\"textwidget\"><div class=\"page threecol\">\n<div class=\"wrapper1\">\n<div class=\"col2 contentcol\">\n<div class=\"content\">\n<div>\n<p>D. Ford and J. D. Sterman (1997) Expert Knowledge Elicitation to Improve Mental and Formal Models. MIT Sloan School of Management.<\/p>\n<p>DOI:\u00a0https:\/\/doi.org\/10.1002\/(SICI)1099-1727(199824)14:4&lt;309::AID-SDR154&gt;3.0.CO;2-5<\/p>\n<p><strong>Abstract<\/strong><\/p>\n<\/div>\n<div>\n<p>Knowledge intensive processes are often driven and constrained by the mental models of experts acting as direct participants or managers. For example, product development is guided by expert knowledge including critical process relationships which are dynamic, biased by individual perspectives and goals, conditioned by experience, aggregate many system components and relationships and are often nonlinear. Descriptions of these relationships are not generally available from traditional data sources such as company records but are stored in the mental models of the process experts. Often the knowledge is not explicit but tacit, so it is difficult to describe, examine and use. Consequently, improvement of complex processes is plagued by false starts, failures, institutional and interpersonal conflict, and policy resistance. Formal modeling approaches such as system dynamics are often used to help improve system performance. However, modelers face great difficulties in eliciting and representing the knowledge of the experts in these systems so useful models can be developed. Increased clarity and specificity are required concerning the methods used to elicit expert knowledge for modeling. We propose, describe and illustrate an elicitation method which uses formal modeling and three description format transformations to help experts explicate their tacit knowledge. To illustrate the approach we describe the use of the method to elicit detailed process knowledge describing the development of a new semiconductor chip. The method improved model accuracy and credibility in the eyes of the participants and provided tools for development team mental model improvement. We evaluate our method to identify future research opportunities.<\/p>\n<ul>\n<li><span style=\"text-decoration: underline;\">For Access to This Paper<\/span>\u2014If you are a student or faculty at another institution and would like a final copy of this paper, please email my assistant Jocelyn using the button below. Jocelyn will send you a final version of the paper <strong>for your personal use only.<\/strong> When emailing, please include the title and DOI number of the paper you are requesting.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div><div id=\"panel-1508-0-0-1\" class=\"so-panel widget widget_mit_social_widget panel-last-child\" data-index=\"1\" ><h2 class=\"widget-title widget-title--eyebrow\">Request a final version of this paper<\/h2><ul class=\"social\"><li><a href=\"mailto:jcliment@mit.edu\" target=\"_blank\" class=\"vcex-social-link social-link-email\"  title=\"Email\"><span class=\"fa fa-envelope\"><\/span><\/a><\/li><\/ul><\/div><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Expert Knowledge Elicitation to Improve Mental and Formal Models D. Ford and J. D. Sterman (1997) Expert Knowledge Elicitation to Improve Mental and Formal Models. MIT Sloan School of Management. DOI:\u00a0https:\/\/doi.org\/10.1002\/(SICI)1099-1727(199824)14:4&lt;309::AID-SDR154&gt;3.0.CO;2-5 Abstract Knowledge intensive processes are often driven and constrained by the mental models of experts acting as direct participants or managers. For example, product [&hellip;]<\/p>\n","protected":false},"author":126,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"class_list":["post-1508","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v24.0 (Yoast SEO v25.8) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>- John Sterman<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:description\" content=\"Expert Knowledge Elicitation to Improve Mental and Formal Models D. Ford and J. D. Sterman (1997) Expert Knowledge Elicitation to Improve Mental and Formal Models. MIT Sloan School of Management. DOI:\u00a0https:\/\/doi.org\/10.1002\/(SICI)1099-1727(199824)14:4&lt;309::AID-SDR154&gt;3.0.CO;2-5 Abstract Knowledge intensive processes are often driven and constrained by the mental models of experts acting as direct participants or managers. For example, product [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/\" \/>\n<meta property=\"og:site_name\" content=\"John Sterman\" \/>\n<meta property=\"article:modified_time\" content=\"2018-04-05T13:52:15+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/\",\"url\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/\",\"name\":\"- John Sterman\",\"isPartOf\":{\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website\"},\"datePublished\":\"2018-03-25T18:21:56+00:00\",\"dateModified\":\"2018-04-05T13:52:15+00:00\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website\",\"url\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/\",\"name\":\"John Sterman\",\"description\":\"MIT Personal Faculty\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- John Sterman","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/","og_locale":"en_US","og_type":"article","og_description":"Expert Knowledge Elicitation to Improve Mental and Formal Models D. Ford and J. D. Sterman (1997) Expert Knowledge Elicitation to Improve Mental and Formal Models. MIT Sloan School of Management. DOI:\u00a0https:\/\/doi.org\/10.1002\/(SICI)1099-1727(199824)14:4&lt;309::AID-SDR154&gt;3.0.CO;2-5 Abstract Knowledge intensive processes are often driven and constrained by the mental models of experts acting as direct participants or managers. For example, product [&hellip;]","og_url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/","og_site_name":"John Sterman","article_modified_time":"2018-04-05T13:52:15+00:00","twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/","url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/","name":"- John Sterman","isPartOf":{"@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website"},"datePublished":"2018-03-25T18:21:56+00:00","dateModified":"2018-04-05T13:52:15+00:00","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/expertknowledge\/"]}]},{"@type":"WebSite","@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website","url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/","name":"John Sterman","description":"MIT Personal Faculty","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1508","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/users\/126"}],"replies":[{"embeddable":true,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/comments?post=1508"}],"version-history":[{"count":11,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1508\/revisions"}],"predecessor-version":[{"id":3082,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1508\/revisions\/3082"}],"wp:attachment":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/media?parent=1508"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}