Category Ardennes Campaign Simulation Data Base

Presentations from HAAC – Fitting Lanchester Equations

The third presentation of the first day was given by Dr. Tom Lucas of the Naval Post-Graduate School (49 slides):  Fitting Lanchester equations to time-phased battle data

The two of the databases used for this work were the Ardennes Campaign Simulation Data Base (ACSDB) and the Kursk Data Base (KDB). I was the program manager for both of these efforts.

———-

We had a total of 30 presentations given at the first Historical Analysis Annual Conference (HAAC). We have the briefing slides from most of these presentations. Over the next few weeks, we are going to present the briefing slides on this blog, maybe twice a week (Tuesdays and Thursday). In all cases, this is done with the permission of the briefer. We may later also post the videos of the presentations, but these are clearly going to have to go to another medium (Youtube.com). We will announce when and if these are posted.

The briefings will be posted in the order given at the conference. The conference schedule is here: Schedule for the Historical Analysis Annual Conference (HAAC), 27-29 September 2022 – update 16 | Mystics & Statistics (dupuyinstitute.org)

The conference opened with a brief set of introductory remarks by me. The seven supporting slides are here: Opening Presentation

It was then followed by a briefing by Dr. Shawn Woodford on Studying Combat; The “Base of Sand” Problem: 20220927 HAAC-Studying Combat

The second presentation of the first day was given by me. It is here (45 slides): Data for Wargames (Summary) – 2. 

Vincent B. Hawkins has passed away

I just heard that Vincent Hawkins, former HERO and DMSI employee, passed away yesterday. Born in August 1955 he was 66 years old.

He came to work for Trevor Dupuy’s HERO/DMSI around 1986 and was there when I arrived. Always outgoing and welcoming, he had a master’s degree in history, was fluent in German and led the German research team for the Ardennes Campaign Simulation Data Base (ACSDB). He was the co-author of one chapter in Trevor Dupuy’s Understanding Defeat.

He continued at DMSI until around 1991, when it closed down. He was the editor for weekly defense newsletter they were doing, which I thought was a worthwhile effort. He then did some historical research for George Kuhn’s casualty estimation efforts at LMI.

Always outgoing and humorous, Vince was a good friend at DMSI. His office was always one of my stops when I took a break for coffee.

Some Background on TDI Data Bases

The Dupuy Institute (TDI) are sitting on a number of large combat databases that are unique to us and are company proprietary. For obvious reasons they will stay that way for the foreseeable future.

The original database of battles came to be called the Land Warfare Data Base (LWDB). It was also called the CHASE database by CAA. It consisted of 601 or 605 engagements from 1600-1973. It covered a lot of periods and lot of different engagement sizes, ranging from very large battles of hundreds of thousand a side to small company-sized actions. The length of battles range from a day to several months (some of the World War I battles like the Somme).

From that database, which is publicly available, we created a whole series of databases totaling some 1200 engagements. There are discussed in some depth in past posts.

Our largest and most developed data is our division-level database covering combat from 1904-1991 of 752 cases: It is discussed here: The Division Level Engagement Data Base (DLEDB) | Mystics & Statistics (dupuyinstitute.org)

There are a number of other databases we have. They are discussed here: Other TDI Data Bases | Mystics & Statistics (dupuyinstitute.org)

The cost of independently developing such a database is given here: Cost of Creating a Data Base | Mystics & Statistics (dupuyinstitute.org)

Part of the reason for this post is that I am in a discussion with someone who is doing analysis based upon the much older 601 case database. Considering the degree of expansion and improvement, including corrections to some of the engagements, this does not seem a good use of their time., especially as we have so greatly expanded the number engagements from 1943 and on.

Now, I did use some of these databases for my book War by Numbers. I am also using them for my follow-up book, currently titled More War by Numbers. So the analysis I have done based upon them is available. I have also posted parts of the 192 Kursk engagements in my first Kursk book and 76 of them in my Prokhorovka book. None of these engagements were in the original LWDB. 

If people want to use the TDI databases for their own independent analysis, they will need to find the proper funding so as to purchase or get access to these databases. 

My articles on other blogs

Col. General Wolfram Baron von Richthofen, 1942 (Bundesarchive Bild 101I-452-0985-36)

While there are 783 blog posts that I have made to the Mystics and Statistics blog, I do have seven other articles written on other sites, all in 2015 and 2016.

History News Network

  1. How Military Historians Are Using Quantitative Analysis — And You Can Too
  2. Did the Pentagon Learn from Vietnam?
  3. Did I Just Write the Largest History Book Ever?
  4. Are Russians Really Long-Suffering?
  5. What Are Historians Supposed to Make of Quotes Reported by the Discredited Historian and Holocaust Denier David Irving?

While I was writing this blog post a week ago, I noticed a message from nine months ago on the History New Network to this last article. It was from Dr. Andrew Arthy of Australia. Turns out he has a copy of the Wolfram von Richthofen’s notes from a discussion he had with Generaloberst Jeschonnek on 25 May 1943. So finally got confirmation that this was indeed a valid quote from David Iriving.

Small Wars Journal

  1. Airpower: Just Part of the Counterinsurgency Equation

Aberdeen Book Store

  1. Did I Just Write the Largest History Book Ever?

This is the complete article. The article with the History News Network was abbreviated.

The U.S. Army Three-to-One Rule

Various Three-to-one rules of thumbs have existed in the U.S. Army and in writings possibly as early as the American Civil War (1861-1865). These are fine as “rules of thumb” as long as one does not take them seriously and understands what they really mean. But, unfortunately, we have now seen something that is a loose rule of thumb turned into a codified and quantified rule. This is annoyingly overstating its importance and as given in U.S. Army manuals, is patently false.

The U.S. Army has apparently codified the “three-to-one rule” in its documentation and has given it a value. In the 2014 edition of FM 6-0, paragraph 9-103, it states that “For example, historically, defenders have over a 50 percent probability of defeating an attacking force approximately three times their equivalent strength.” This statement, on the surface, simply is incorrect. For example, the following table from my book War by Numbers is drawn from a series of 116 division-level engagements in France in 1944 against the Germans (see War by Numbers, page 10) They show the following relationship between force ratio and outcome:

European Theater of Operations (ETO) Data, 1944

 

Force Ratio………………..Result…………………Percent Failure…Number of cases

0.55 to 1.01-to-1.00………Attack Fails…………………..100%……………….5

1.15 to 1.88-to-1.00………Attack usually succeeds……21%………………..48

1.95 to 2.56-to-1.00………Attack usually succeeds……10%………………..21

2.71-to-1.00 and higher…Attacker Advances…………….0%……………….. 42

 

Now these engagements are from fighting between the U.S., UK and Germany in France and Germany in 1944. These are engagements between forces of roughly equal competence. As can be seen, based upon 42 division-level engagements, in all cases of attacks at three-to-one (more specifically 2.71-to-1 and greater), the attacker advanced. Meaning in all cases of attacks at three-to-one, the attacker won. This directly contradicts the statement in FM 6-0, and contradicts it based upon historical data.

This is supplemented by the following two tables on the next page of War by Numbers. The first table shows the German performance when attacking Soviet units in 1943.

Germans attacking Soviets (Battles of Kharkov and Kursk), 1943

 

Force Ratio………………..Result………………….Percent Failure…Number of cases

0.63 to 1.06-to-1.00………Attack usually succeeds……..20%……………………..5

1.18 to 1.87-to-1.00………Attack usually succeeds……….6%……………………17

1.91-to-1.00 and higher…Attacker Advances……………….0%……………………21

 

The next table shows the Soviet performance when attacking German units in 1943:

Soviets attacking Germans (Battles of Kharkov and Kursk), 1943

 

Force Ratio………………Result…………………..Percent Failure…Number of cases

0.40 to 1.05-to-1…………Attack usually fails…………70%……………………10

1.20 to 1.65-to-1.00…….Attack often fails…………….50%……………………11

1.91 to 2.89-to-1.00…….Attack sometimes fails…….44%……………………..9

 

These charts are from the fighting around Kharkov in February, March and August of 1943 and the fighting during the Battle of Kursk in July 1943. It is 73 engagements between the German and Soviet armies.

Now, there is a clear performance difference between the German and the Soviet armies at this time. This is discussed in considerable depth in War by Numbers and will not be addressed here. But, what it amounts to is that the German Army has an advantage in the casualty exchange and that advantage also shows up in the outcomes of the battles, as show above. If they attacked at two-to-one odds are greater, they would win. The Soviets attacking at the same odds would win only 56 percent of the time. Clearly, at the division-level, in a unit to unit comparison, the Germans were two or three times better than their Soviet opponents.

Still, even in the worse case, which is the Soviets attacking the Germans, we do not get to the claim made in FM 6-0, which is the defender won 50% of the time when attacked at three-to-one. In fact, the Soviets managed to win 50% of the time when attacking at 1.20 to 1.65-to-1. Something is clearly wrong with the statement in FM 6-0.

Now, at the time I wrote War by Numbers, I was not aware of this sentence planted in FM 6-0 and so therefore did not feel a need to respond to the “three-to-one rule.” It is a rule of thumb, not completely without value, that had been discussed before (see Dupuy, Understanding War, pages 31-37). I thought this issue was properly understood in the U.S. analytical and defense community, therefore I did not feel a need to address it further. It turns out that I do. So, I will take a moment to tap into our databases and properly address this using all the resources at my disposal. This will be in subsequent blog posts.

U.S. Senate and Model Validation – Comments

This is a follow-up to our blog post:

Have They Been Reading Our Blog?

This rather significant effort came out of the blue for us, and I gather a whole lot of others in the industry. The actual proposed law is here:

U.S. Senate on Model Validation

Some people, we gather, are a little nervous about this effort. On the other hand, Clinton Reilly, an occasional commenter on this blog and the Managing Director of Computer Strategies Pty Ltd, Sydney Australia, nicely responds to these concerns with the following post:

I would not be too concerned by the prospect of more rigorous validation. I am sure it represents a major opportunity to improve modelling practices and obtain the increased funding that will be required to support the effort.

One of the first steps will be the development of a set of methodologies that will be tailored to testing the types of models required. I am sure that there will be no straight jacketing or enforced uniformity as it is obvious the needs served by the models are many and varied and cannot be met by a “one size fits all” approach.

Provided modellers prepare themselves by developing an approach to validation that is required by their user community they will be in a good position to work with the investigating committee and secure the support and funding needed.

In the end, validation is not a “pass-fail” test to be feared, it is a methodology to improve the model and improve confidence in the model results, and to fully understand the strengths and weaknesses of a model. This is essential if you are going to be using the model for analytical uses, and practically essential even if you are using it for training.

So this is an opportunity not a threat. It is a much needed leap forward.

Let us begin work on developing an approach to validation that suits our individual modelling requirements so that we can present them to the review committee when it asks for input.

Now, my experience on this subject, which dates back to managing the Ardennes Campaign Simulation Data Base (ACSDB) in 1987, is that many of the U.S. Military Operations Research community will not see it as “…an opportunity, not a threat.” We shall see.

Million Dollar Books

Most of our work at The Dupuy Institute involved contracts from the U.S. Government. These were often six digit efforts. So for example, the Kursk Data Base was funded for three years (1993-1996) and involved a dozen people. The Ardennes Campaign Simulation Data Base (ACSDB) was actually a larger effort (1987-1990). Our various combat databases like DLEDB, BODB and BaDB were created by us independent of any contractual effort. They were originally based upon the LWDB (that became CHASE), the work we did on Kursk and Ardennes, the engagements we added because of our Urban Warfare studies, our Enemy Prisoner of War Capture Rates studies, our Situational Awareness study, our internal validation efforts, several modeling  related contracts from Boeing, etc. All of these were expanded and modified bit-by-bit as a result of a series of contracts from different sources. So, certainly over time, hundreds of thousands have been spent on each of these efforts, and involved the work of a half-dozen or more people.

So, when I sit down to write a book like Kursk: The Battle of Prokhorovka (based off of the Kursk Data Base) or America’s Modern Wars (based on our insurgency studies) or War by Numbers (which used our combat databases and significant parts of our various studies), these are books developed from an extensive collection of existing work. Certainly hundreds of thousands of dollars and the work of at least 6 to 12 people were involved in the studies and analysis that preceded these books. In some cases, like our insurgency studies, it was clearly more than a million dollars.

This is a unique situation, for me to be able to write a book based upon a million dollars of research and analysis. It is something that I could never have done as a single scholar or a professor or a teacher somewhere. It is not work I could of done working for the U.S. government. These are not books that I could have written based upon only my own work and research.

In many respects, this is what needs to be norm in the industry. Research and analysis efforts need to be properly funded and conducted by teams of people. There is a limit to what a single scholar, working in isolation, can do. Being with The Dupuy Institute allowed me to conduct research and analysis above and beyond anything I could have done on my own.

Summation of our Validation Posts

This extended series of posts about validation of combat models was originally started by Shawn Woodford’s post on future modeling efforts and the “Base of Sand” problem.

Wargaming Multi-Domain Battle: The Base Of Sand Problem

This post apparently irked some people at TRADOC and they wrote an article in the December issue of the Phalanx referencing his post and criticizing it. This resulted in the following seven responses from me:

Engaging the Phalanx

Validation

Validating Attrition

Physics-based Aspects of Combat

Historical Demonstrations?

SMEs

Engaging the Phalanx (part 7 of 7)

This was probably overkill…..but guys who write 1,662 page books sometimes tend to be a little wordy.

While it is very important to identify a problem, it is also helpful to show the way forward. Therefore, I decided to discuss what data bases were available for validation. After all, I would like to see the modeling and simulation efforts to move forward (and right now, they seem to be moving backward). This led to the following nine posts:

Validation Data Bases Available (Ardennes)

Validation Data Bases Available (Kursk)

The Use of the Two Campaign Data Bases

The Battle of Britain Data Base

Battles versus Campaigns (for Validation)

The Division Level Engagement Data Base (DLEDB)

Battalion and Company Level Data Bases

Other TDI Data Bases

Other Validation Data Bases

There were also a few other validation issues that had come to mind while I was writing these blog posts, so this led to the following series of three posts:

Face Validation

Validation by Use

Do Training Models Need Validation?

Finally, there were a few other related posts that were scattered through this rather extended diatribe. It includes the following six posts:

Paul Davis (RAND) on Bugaboos

Diddlysquat

TDI Friday Read: Engaging The Phalanx

Combat Adjudication

China and Russia Defeats the USA

Building a Wargamer

That kind of ends this discussion on validation. It kept me busy for while. Not sure if you were entertained or informed by it. It is time for me to move onto another subject, not that I have figured out yet what that will be.

Face Validation

The phrase “face validation” shows up in our blog post earlier this week on Combat Adjudication. It is a phrase I have heard many times over the decades, sometimes by very established Operation Researchers (OR). So what does it mean?

Well, it is discussed in the Department of the Army Pamphlet 5-11: Verification, Validation and Accreditation of Army Models and Simulations: Pamphlet 5-11

Their first mention of it is on page 34: “SMEs [Subject Matter Experts] or other recognized individuals in the field of inquiry. The process by which experts compare M&S [Modeling and Simulation] structure and M&S output to their estimation of the real world is called face validation, peer review, or independent review.”

On page 35 they go on to state: “RDA [Research, Development, and Acquisition]….The validation method typically chosen for this category of M&S is face validation.”

And on page 36 under Technical Methods: “Face validation. This is the process of determining whether an M&S, on the surface, seems reasonable to personnel who are knowledgeable about the system or phenomena under study. This method applies the knowledge and understanding of experts in the field and is subject to their biases. It can produce a consensus of the community if the number of breadth of experience of the experts represent the key commands and agencies. Face validation is a point of departure to determine courses of action for more comprehensive validation efforts.” [I put the last part in bold]

Page 36: “Functional decomposition (sometimes known as piecewise validation)….When used in conjunction with face validation of the overall M&S results, functional decomposition is extremely useful in reconfirming previous validation of a recently modified portions of the M&S.”

I have not done a survey of all army, air force, navy, marine, coast guard or Department of Defense (DOD) regulations. This one is enough.

So, “face validation” is asking one or more knowledgeable (or more senior) people if the model looks good. I guess it really depends on whose the expert is and to what depth they look into it. I have never seen a “face validation” report (validation reports are also pretty rare).

Who’s “faces” do they use? Are they outside independent people or people inside the organization (or the model designer himself)? I am kind of an expert, yet, I have never been asked. I do happen to be one of the more experienced model validation people out there, having managed or directly created six+ validation databases and having conducted five validation-like exercises. When you consider that most people have not done one, should I be a “face” they contact? Or is this process often just to “sprinkle holy water” on the model and be done?

In the end, I gather for practical purposes the process of face validation is that if a group of people think it is good, then it is good. In my opinion, “face validation” is often just an argument that allows people to explain away or simply dismiss the need for any rigorous analysis of the model. The pamphlet does note that “Face validation is a point of departure to determine courses of action for more comprehensive validation efforts.” How often have we’ve seen the subsequent comprehensive validation effort? Very, very rarely. It appears that “face validation” is the end point.
…
Is this really part of the scientific method?
…

A Time for Crumpets

Charles MacDonald published in 1985 A Time for Trumpets, one of the better books on the Battle of the Bulge (and there are actually a lot of good works on this battle). In there he recounted a story of why the German Panzer Lehr Panzer Division, commanded by General Fritz Bayerlein, was held up for the better part of a day during the Battle for Bastogne. To quote:

For all Bayerlein’s concern about that armored force, he himself was at the point of directing less than full attention to conduct of the battle. In a wood outside Mageret, his troops had found a platoon from an American field hospital, and among the staff, a “young, blonde, and beautiful” American nurse attracted Bayerlein’s attention. Through much of December 19, he “dallied” with the nurse, who “held him spellbound.” [page 295]

Apparently MacDonald’s book was not the only source of this story: http://theminiaturespage.com/boards/msg.mv?id=186079

Now, I don’t know if “dallied” means that they were having tea and crumpets, or involved in something more intimate. The story apparently comes from Bayerlein himself, so something probably happened, but exactly what is not known. He was relieved of command after the failed offensive.

Fritz Bayerlein, March 1944 (Source: Bundesarchiv, Bild 146-1978-033-02/Dinstueler/CC-BY-SA 3.0)

When we met with Charles MacDonald in 1989, I did ask him about this story. He then recounted that he was recently at a U.S. veterans gathering talking to some other people, and some lady came up to him and told him that she knew the nurse in the story. MacDonald said he would get back to her….but then could not locate her later. So this was an opportunity to confirm and get more details of the story, but, it was lost (to history). But it does sort of confirm that there is some basis to Bayerlein’s story.

Now, this discussion with MacDonald is from memory, but I believe (the authors) Jay Karamales,  Richard Anderson and possibly Curt Johnson were also at that dinner, and they may remember the conversation (differently?).

Anyhow, A Time for Strumpets Trumpets is a book worth reading.