The ‘digital twin test’ workshop…

[Casey Rutland]

What a session!

Following the initial forum discussion querying the need for a digital twin ‘test’ and the subsequent post asking ‘what’ we should measure if a test is needed, we hosted a workshop to deep dive into the topic.  With great interactivity and engagement with over 40 active contributors from across various roles in the sector, a few common themes surfaced which inspiringly, were echoed by a Digital Twin Fan Club event the following week.

After a brief introduction from the CDBB team, Dan Rossiter of BSI covered the meaning of the word ‘definition’ and ‘test’ before we dived into the workshop session where we asked several questions of the attendees.  The themes covered the following topics:

• Do we need a test for digital twins?
• If there is a test, how should it be ‘scored’?
• What makes a digital twin a ‘real’ digital twin?
• If there is a test, what would it measure?
• And then a quickfire yes/no round to determine if certain ‘things’ are digital twins.
• Mapping of those results on a banded scale. 

 

Spoiler alert! The first topic garnered a resounding ‘yes’. Observations within the group raised concern over digital twins and their use being driven by technology companies rather than the approach we’d rather take which is by purpose-driven solutions (culture, process and technology) to solve current client challenges. With ‘twinwash’ marketing often reaching clients and the supply chain masses before it reaches those with the real experience and capabilities, we really are perilously close to repeating what BIM has been through already – and we’re still battling against that!

 

Scoring was a longer discussion that saw real industry value of a simple yes/no result, but through the workshop, it became evident that being able to see how one particular digital twin compared to another was perhaps a useful checklist for the ‘lesser’ version.

 

Quote

So, what makes a digital twin ‘real’?

We were steering clear of defining ‘what’ a digital twin is, that work is being undertaken in other CDBB workstreams.  What we wanted to unearth was, for each attendee, for their particular use case, what made a digital twin ‘real’… needless to say that this began the real-time versus right time discussion (also previously discussed here and here on the DTHub)!  There were wide and varied responses about interfaces, connectedness, insights and prediction and these are summarized in the upcoming report.

  

The quickfire round was useful, for a few reasons.  Firstly, attendees were required to answer using their gut instinct.  Secondly because it demonstrated that there is a clear consensus on a few digital twin examples.  Finally, it was useful to expand a little on each of the examples to explore where the differences of opinion lie.  I should point out that the examples used in the quickfire round are all taken from marketing / forums / discussions that are happening out there in the built environment right now… these aren’t examples that we, the workshop facilitators, defined as ‘being’ digital twins.

 The results are as per the attached image and you can clearly see where the common trends sit.  The interesting examples for the overall discussion are the items with a split in opinion… clearly an indicator for the need for a test?

 

The last exercise for the attendees was to place these above examples and their own contributions onto a graded scale, from red (not a digital twin) through amber and to green (real digital twins and ‘unicorn’ digital twins!).  An interesting and revealing exercise, especially when given the opportunity to move the indicators that others had placed.

 

If we’re looking to draw conclusions from the workshop, I’d suggest that the many great conversations over 1.5hrs could have easily lasted several weeks, mainly due to the ‘is it’ or isn’t it’ nature of the discussions.  This leads me to observe that:

Quote

if we, a bunch of digital twin enthusiasts with vested interests in the development of the national digital twin, aren’t always in agreement, how can we expect the layperson to be?

 

As an initial exploratory task to determine the industry’s appetite for a test, linked to an accurate definition, this has been a revealing and thought-provoking exercise and one that I’m keen to continue.

 To that end:  Do you agree with the quick-fire round? Are you adamant about a particular characteristic that a digital twin must have?  Let’s ensure that the workshop is the beginning, not the end, to this discussion!

[iain miskimmin]

I'm presuming (always dangerous!) that red is a no and green a yes?

If that is the case then i'm really not happy with the top two about People Evacuation and Tidal Systems.

I think we can agree that a DT needs value and a purpose? If that is the case, what if the creator of these DT's needs to answer that specific question about the evacuation routes and that they are fit for purpose? This would seem to have both purpose and value..... or am i missing something?

[Ramy]

Good point iain.

It appears to me that workshop participants were expecting a DT to rely on data extracted from an existing real physical system; otherwise, no communication between a real physical system with its digital counter part (a key feature of a DT) would seem to exist.

For the airport evacuation example, prima facie, one can assume that the physical system has not even existed yet, as it states the simulation takes place during design phase. Nonetheless, what if the simulation is based on data extracted from other similar airports, or other existing and operating terminals within an similar context? 

[Guest]

On 03/12/2020 at 21:18, Casey Rutland said:

if we, a bunch of digital twin enthusiasts with vested interests in the development of the national digital twin, aren’t always in agreement, how can we expect the layperson to be?

It will be difficult to form concensus, as people have different context, background, and assumptions. And people join this journey from various places, with different milage.  

A healthy ecosysm should be inclusive enough to accommodate different views, while keep flourishing. Also, I guess views are just some snapshots, TD enthusiasts's view doesn't matter too much (from my point of view). As long as the key decision-makers, practioners, and stakeholders are in agreement, and can move the digital twin that they can influnce forwards. Collatively, everyone in the system will have a say in the national digital twin.

If there is 100% agreement/disagreement for any of the answer, I would be suprised. And I think @iain miskimmin made a valid point, purpose and value 🙂 I would love to vote a green, even if it is not a digital twin yet, but it is a promising one, as it is from design stage (an ambitious one).

 

By the way, I see digital twin as a digital extension of the real world. 

Edited December 6, 2020 by Steven Zhang