Validation of Wargaming Simulation Models – Confusion !!

[Clinton Reilly has been a regular commentator on this blog. We present here a guest blog post from him]

Originally, I was heartened to read in your blog that the U.S. Congress is setting up a committee to oversee the validation of wargaming models, which were seen to be of doubtful validity. Validation is obviously a ‘good thing’ as it enhances models and so they produce more useful and reliable results. Your blog has put forward several articles to this effect.

I hastened to communicate this to a senior member of the Australian Defence Science and Technology (DST) group expecting an enthusiastic response, in anticipation of the Australian government following suit. However, much to my surprise, the said member addressed the MORS Modelling and Simulation Community of Practice (CoP) saying that this was a matter of some concern as the testing and validation may not be tailored to the objectives of the individual models. Members were asked to comment on this alarming prospect. There was no comment.

While this is a possibility, it seems to me that in such a rational field the logical argument that tests must be tailored to objectives would prevail. It seems hardly worth saying!

So, I replied with a more heartening email to CoP members that validation was only to be seen as a boon and should be welcomed and encouraged. Wargames would be improved. I also emailed the MORS Wargaming CoP with a similar message, again asking for comment on the posts in the MORS Modelling and Simulation CoP.

Now this is where the confusion sets in. In the weeks since the emails were sent no one has replied. There has been no direct comment to me either. Why I ask? In a military community where modelling and wargaming is a central activity – why has no one replied on either the validity of current models or the need for greater validation?

I am submitting this to your blog in the hope that someone in the worldwide wargaming community has an opinion. Is there a problem with extensive validation of existing models? Is a program of validation needed to improve a low level of validity?  Does anyone care about the standard of current models and their outputs?

Does anyone reading this blog have a comment?

Clinton Reilly

Managing Director

Computer Strategies Pty Ltd

Sydney, Australia

Share this:
Christopher A. Lawrence
Christopher A. Lawrence

Christopher A. Lawrence is a professional historian and military analyst. He is the Executive Director and President of The Dupuy Institute, an organization dedicated to scholarly research and objective analysis of historical data related to armed conflict and the resolution of armed conflict. The Dupuy Institute provides independent, historically-based analyses of lessons learned from modern military experience.

Mr. Lawrence was the program manager for the Ardennes Campaign Simulation Data Base, the Kursk Data Base, the Modern Insurgency Spread Sheets and for a number of other smaller combat data bases. He has participated in casualty estimation studies (including estimates for Bosnia and Iraq) and studies of air campaign modeling, enemy prisoner of war capture rates, medium weight armor, urban warfare, situational awareness, counterinsurgency and other subjects for the U.S. Army, the Defense Department, the Joint Staff and the U.S. Air Force. He has also directed a number of studies related to the military impact of banning antipersonnel mines for the Joint Staff, Los Alamos National Laboratories and the Vietnam Veterans of American Foundation.

His published works include papers and monographs for the Congressional Office of Technology Assessment and the Vietnam Veterans of American Foundation, in addition to over 40 articles written for limited-distribution newsletters and over 60 analytical reports prepared for the Defense Department. He is the author of Kursk: The Battle of Prokhorovka (Aberdeen Books, Sheridan, CO., 2015), America’s Modern Wars: Understanding Iraq, Afghanistan and Vietnam (Casemate Publishers, Philadelphia & Oxford, 2015), War by Numbers: Understanding Conventional Combat (Potomac Books, Lincoln, NE., 2017) and The Battle of Prokhorovka (Stackpole Books, Guilford, CT., 2019)

Mr. Lawrence lives in northern Virginia, near Washington, D.C., with his wife and son.

Articles: 1455

6 Comments

  1. Every time I click on comments I find this page asking me to leave a reply instead of comments. Are there none?

  2. Thank you for the prompt reply. However, still no joy. I did scroll down to the end of the article and saw no comments, just this place to leave a reply. And when I clicked on the comments on the right side of the blog, again no joy, only linked to your posts.

    The situation is a bit like looking for validation of war games–sometimes the roll of the dice, the things not planned for shouldn’t be ignored. I’ll check for the problem at my end–probably a software update either from the OS or the computer’s manufacture.

    I enjoy your blog, and that enjoyment isn’t lessened by not being able to read comments by others, although I’m sure I’d find them interesting.

Leave a Reply

Your email address will not be published. Required fields are marked *