{"id":1326,"date":"2018-03-25T16:25:02","date_gmt":"2018-03-25T16:25:02","guid":{"rendered":"http:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?page_id=1326"},"modified":"2018-04-05T13:35:45","modified_gmt":"2018-04-05T13:35:45","slug":"effectsoffeedback","status":"publish","type":"page","link":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/","title":{"rendered":""},"content":{"rendered":"<div id=\"pl-1326\"  class=\"panel-layout\" ><div id=\"pg-1326-0\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-1326-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-1326-0-0-0\" class=\"so-panel widget widget_mit-pf-wysiwyg widget_mit_pf_wysiwyg panel-first-child\" data-index=\"0\" ><h2 class=\"widget-title\">Effects of Feedback Delay on Learning<\/h2><div class=\"textwidget\"><div class=\"page threecol\">\n<div class=\"wrapper1\">\n<div class=\"col2 contentcol\">\n<div class=\"content\">\n<p>Rahmandad, H., Repenning, N. &amp; Sterman, J. (2009).\u00a0Effects of Feedback Delay on Learning.\u00a0<em>System Dynamics Review<\/em>. 25(4), 309-338.<\/p>\n<p>DOI:\u00a0http:\/\/doi.org\/10.1002\/sdr.427<\/p>\n<p><strong>Abstract<\/strong><\/p>\n<p>Understanding barriers to learning is central to understanding firm performance. This paper investigates the role of time delays between taking an action and observing the results in impeding learning. These delays, ubiquitous in real-world settings, can introduce important tradeoffs between long-term and short-term performance. Here we build four learning heuristics, with different levels of complexity and rationality, and analyze their performance in a simple resource allocation task. All four reliably converge to the optimal solution when there are no short delays, and when those delays are correctly assessed by the decision-maker. However, learning is slowed significantly when decision-makers err in assessing the length of delay. In many cases, the decision-maker finds optimal solution wandering in the action space or converging to a suboptimal allocation. Simulation analysis shows errors in estimates of delays can impede learnin significantly regardless of the organization's level of rationality. The proposed heuristics can be applied to a range of problems for modeling learning from experience in presence delays.<\/p>\n<ul>\n<li><span style=\"text-decoration: underline;\">For Access to This Paper<\/span>\u2014If you are a student or faculty at another institution and would like a final copy of this paper, please email my assistant Jocelyn using the button below. Jocelyn will send you a final version of the paper <strong>for your personal use only.<\/strong> When emailing, please include the title and DOI number of the paper you are requesting.<\/li>\n<li><span style=\"text-decoration: underline;\"><a href=\"http:\/\/mitsloan.mit.edu\/shared\/ods\/documents\/?DocumentID=4355\" target=\"_blank\" rel=\"noopener\">Download Supplement<\/a> [Model Documentation]<\/span><\/li>\n<li><span style=\"text-decoration: underline;\"><a href=\"https:\/\/www.dropbox.com\/s\/hx7onj2z1132ayp\/LearningModel-EffectsofFeedbackDelayonLearning.vmf?dl=1\" rel=\"noopener\">Download the Model<\/a> [Vensim]<\/span><\/li>\n<li><a href=\"http:\/\/vensim.com\/download\/\" target=\"_blank\" rel=\"noopener\"><span style=\"text-decoration: underline;\">Download the Vensim Model Reader<\/span><\/a><\/li>\n<\/ul>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div><div id=\"panel-1326-0-0-1\" class=\"so-panel widget widget_mit_social_widget panel-last-child\" data-index=\"1\" ><h2 class=\"widget-title widget-title--eyebrow\">Request a final version of this paper<\/h2><ul class=\"social\"><li><a href=\"mailto:jcliment@mit.edu\" target=\"_blank\" class=\"vcex-social-link social-link-email\"  title=\"Email\"><span class=\"fa fa-envelope\"><\/span><\/a><\/li><\/ul><\/div><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Effects of Feedback Delay on Learning Rahmandad, H., Repenning, N. &amp; Sterman, J. (2009).\u00a0Effects of Feedback Delay on Learning.\u00a0System Dynamics Review. 25(4), 309-338. DOI:\u00a0http:\/\/doi.org\/10.1002\/sdr.427 Abstract Understanding barriers to learning is central to understanding firm performance. This paper investigates the role of time delays between taking an action and observing the results in impeding learning. These [&hellip;]<\/p>\n","protected":false},"author":126,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"class_list":["post-1326","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v24.0 (Yoast SEO v25.8) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>- John Sterman<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:description\" content=\"Effects of Feedback Delay on Learning Rahmandad, H., Repenning, N. &amp; Sterman, J. (2009).\u00a0Effects of Feedback Delay on Learning.\u00a0System Dynamics Review. 25(4), 309-338. DOI:\u00a0http:\/\/doi.org\/10.1002\/sdr.427 Abstract Understanding barriers to learning is central to understanding firm performance. This paper investigates the role of time delays between taking an action and observing the results in impeding learning. These [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/\" \/>\n<meta property=\"og:site_name\" content=\"John Sterman\" \/>\n<meta property=\"article:modified_time\" content=\"2018-04-05T13:35:45+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/\",\"url\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/\",\"name\":\"- John Sterman\",\"isPartOf\":{\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website\"},\"datePublished\":\"2018-03-25T16:25:02+00:00\",\"dateModified\":\"2018-04-05T13:35:45+00:00\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website\",\"url\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/\",\"name\":\"John Sterman\",\"description\":\"MIT Personal Faculty\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- John Sterman","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/","og_locale":"en_US","og_type":"article","og_description":"Effects of Feedback Delay on Learning Rahmandad, H., Repenning, N. &amp; Sterman, J. (2009).\u00a0Effects of Feedback Delay on Learning.\u00a0System Dynamics Review. 25(4), 309-338. DOI:\u00a0http:\/\/doi.org\/10.1002\/sdr.427 Abstract Understanding barriers to learning is central to understanding firm performance. This paper investigates the role of time delays between taking an action and observing the results in impeding learning. These [&hellip;]","og_url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/","og_site_name":"John Sterman","article_modified_time":"2018-04-05T13:35:45+00:00","twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/","url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/","name":"- John Sterman","isPartOf":{"@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website"},"datePublished":"2018-03-25T16:25:02+00:00","dateModified":"2018-04-05T13:35:45+00:00","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/effectsoffeedback\/"]}]},{"@type":"WebSite","@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website","url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/","name":"John Sterman","description":"MIT Personal Faculty","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1326","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/users\/126"}],"replies":[{"embeddable":true,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/comments?post=1326"}],"version-history":[{"count":25,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1326\/revisions"}],"predecessor-version":[{"id":2994,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1326\/revisions\/2994"}],"wp:attachment":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/media?parent=1326"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}