{"id":1284,"date":"2018-03-25T15:45:37","date_gmt":"2018-03-25T15:45:37","guid":{"rendered":"http:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?page_id=1284"},"modified":"2018-04-05T13:29:09","modified_gmt":"2018-04-05T13:29:09","slug":"reportingguidelines","status":"publish","type":"page","link":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/","title":{"rendered":""},"content":{"rendered":"<div id=\"pl-1284\"  class=\"panel-layout\" ><div id=\"pg-1284-0\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-1284-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-1284-0-0-0\" class=\"so-panel widget widget_mit-pf-wysiwyg widget_mit_pf_wysiwyg panel-first-child\" data-index=\"0\" ><h2 class=\"widget-title\">Reporting Guidelines for Simulation-based Research in Social Sciences<\/h2><div class=\"textwidget\"><div class=\"page threecol\">\n<div class=\"wrapper1\">\n<div class=\"col2 contentcol\">\n<div class=\"content\">\n<p>Rahmandad, H. and John Sterman (2012). Reporting Guidelines for Simulation-based Research in Social Sciences. System Dynamics Review.\u00a0\u00a0<\/p>\n<p>DOI:\u00a0http:\/\/dx.doi.org\/10.1002\/sdr.1481<\/p>\n<p><strong>Abstract<\/strong> <\/p>\n<p>Reproducibility of research is critical for the healthy growth and accumulation of reliable knowledge, and simulation-based research is no exception.\u00a0 However, studies show many simulation-based studies in the social sciences are not reproducible. Better standards for documenting simulation models and reporting results are needed to enhance the reproducibility of simulation-based research in the social sciences. We provide an initial set of Reporting Guidelines for Simulation-based Research (RGSR) in the social sciences, with a focus on common scenarios in system dynamics research. We discuss these guidelines separately for reporting models, reporting simulation experiments, and reporting optimization results. The guidelines are further divided into minimum and preferred requirements, distinguishing between factors that are indispensable for reproduction of research and those that enhance transparency. We also provide a few guidelines for improved visualization of research to reduce the costs of reproduction. Suggestions for enhancing the adoption of these standards are discussed at the end.<\/p>\n<ul>\n<li><u>For Access to This Paper<\/u>\u2014If you are a student or faculty at another institution and would like a final copy of this paper, please email my assistant Jocelyn using the button below. Jocelyn will send you a final version of the paper\u00a0<strong>for your personal use only<\/strong>. When emailing, please include the title and DOI number of the paper you are requesting.<\/li>\n<li><a href=\"https:\/\/www.dropbox.com\/s\/5pfw2lb7wakfbpb\/Sterman_JN_2013_Reporting%20Guidelines%20for%20Simulation-based%20Research%20in%20Social%20Sciences%20Supplemental..zip?dl=1\" target=\"_blank\" rel=\"noopener\"><span style=\"text-decoration: underline;\">Download Models and Documentation<br \/><\/span><\/a><\/li>\n<\/ul>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div><div id=\"panel-1284-0-0-1\" class=\"so-panel widget widget_mit_social_widget panel-last-child\" data-index=\"1\" ><h2 class=\"widget-title widget-title--eyebrow\">Request a final version of this paper<\/h2><ul class=\"social\"><li><a href=\"mailto:jcliment@mit.edu\" target=\"_blank\" class=\"vcex-social-link social-link-email\"  title=\"Email\"><span class=\"fa fa-envelope\"><\/span><\/a><\/li><\/ul><\/div><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Reporting Guidelines for Simulation-based Research in Social Sciences Rahmandad, H. and John Sterman (2012). Reporting Guidelines for Simulation-based Research in Social Sciences. System Dynamics Review.\u00a0\u00a0 DOI:\u00a0http:\/\/dx.doi.org\/10.1002\/sdr.1481 Abstract Reproducibility of research is critical for the healthy growth and accumulation of reliable knowledge, and simulation-based research is no exception.\u00a0 However, studies show many simulation-based studies in the [&hellip;]<\/p>\n","protected":false},"author":126,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"class_list":["post-1284","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v24.0 (Yoast SEO v25.8) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>- John Sterman<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:description\" content=\"Reporting Guidelines for Simulation-based Research in Social Sciences Rahmandad, H. and John Sterman (2012). Reporting Guidelines for Simulation-based Research in Social Sciences. System Dynamics Review.\u00a0\u00a0 DOI:\u00a0http:\/\/dx.doi.org\/10.1002\/sdr.1481 Abstract Reproducibility of research is critical for the healthy growth and accumulation of reliable knowledge, and simulation-based research is no exception.\u00a0 However, studies show many simulation-based studies in the [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/\" \/>\n<meta property=\"og:site_name\" content=\"John Sterman\" \/>\n<meta property=\"article:modified_time\" content=\"2018-04-05T13:29:09+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/\",\"url\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/\",\"name\":\"- John Sterman\",\"isPartOf\":{\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website\"},\"datePublished\":\"2018-03-25T15:45:37+00:00\",\"dateModified\":\"2018-04-05T13:29:09+00:00\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website\",\"url\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/\",\"name\":\"John Sterman\",\"description\":\"MIT Personal Faculty\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- John Sterman","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/","og_locale":"en_US","og_type":"article","og_description":"Reporting Guidelines for Simulation-based Research in Social Sciences Rahmandad, H. and John Sterman (2012). Reporting Guidelines for Simulation-based Research in Social Sciences. System Dynamics Review.\u00a0\u00a0 DOI:\u00a0http:\/\/dx.doi.org\/10.1002\/sdr.1481 Abstract Reproducibility of research is critical for the healthy growth and accumulation of reliable knowledge, and simulation-based research is no exception.\u00a0 However, studies show many simulation-based studies in the [&hellip;]","og_url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/","og_site_name":"John Sterman","article_modified_time":"2018-04-05T13:29:09+00:00","twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/","url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/","name":"- John Sterman","isPartOf":{"@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website"},"datePublished":"2018-03-25T15:45:37+00:00","dateModified":"2018-04-05T13:29:09+00:00","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/reportingguidelines\/"]}]},{"@type":"WebSite","@id":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/#website","url":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/","name":"John Sterman","description":"MIT Personal Faculty","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1284","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/users\/126"}],"replies":[{"embeddable":true,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/comments?post=1284"}],"version-history":[{"count":23,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1284\/revisions"}],"predecessor-version":[{"id":2958,"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/pages\/1284\/revisions\/2958"}],"wp:attachment":[{"href":"https:\/\/mitmgmtfaculty.mit.edu\/jsterman\/wp-json\/wp\/v2\/media?parent=1284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}