Hermann Hänle
7. June 2019 0
Automotive

On-site taming of the data monster

The problem has long been known to science: researchers are producing more data than can be processed. Famous examples of this are the various nuclear research centers, where computer resources operate round the clock to find the needle in the nuclear physics haystack. The evaluation projects have to go into the virtual queue and wait until they are called up. Almost like in a public authority office.

Big data in vehicle development

In 2018 the global digital data volume was estimated at 33 zettabytes – that’s a lot. If you burnt this amount of data to Blu-ray disks, it would make a pile as high as two return journeys to the moon. Quite a nice game of patience and probably a nightmare for the makers of Blu-ray.
The development of automobiles – not just self-driving ones – is also doing its bit to create global data growth: for example, an autonomous automobile produces three terabytes of data in an hour’s drive. Google Waymo cars alone, with their 16 million test kilometers on public roads to date, account for nearly a million TBs, one exabyte. Keyword: Big Data.
The nearer we get to a car being launched in the market, the more urgently necessary driving tests become. Ultimately driving a car is still a physical activity, not a virtual one – even if it has a digital twin. This applies to “normal” automobiles as well – though they don’t produce quite as many bytes. However, plenty of data emerges all the same. But collecting data isn’t even half the battle.
It’s more like a children’s room: if the boys devastate the room, it happens quickly. But when they have to clean it up again, that can take ages. The raw data alone may possibly be valuable (and secret). But its true value only becomes apparent once it’s been calculated using the right models. And to do that requires huge computing capacities. Otherwise the engineer will still be sitting at his computer till the end of time. Huge computing capacities – that cries out for the cloud.

Big data here, the cloud there

But to go places, the data must first be brought to the computing capacities in the cloud. By the way, that’s a challenge that is generally overlooked. To make things easy, let’s stick with our example of the self-driving car that “drives” while creating three TB an hour. If this data has to be transported directly to the cloud, this would mean a transfer rate of 834 megabytes a second. This is quite a serious figure. Especially when testing is performed in out-of-the-way places to measure how the car performs in hot and cold conditions. Network connections north of the Arctic Circle are not particularly great.

Edge computing leaps into the breach

If the mountain doesn’t come to the prophet, then the prophet just has to go to the mountain. In that case, computing resources and evaluation models come to the Arctic Circle where the data is recorded. In a mobile data center. The idea that the computing capacity is transported to the place where the data is generated in order to reduce latencies is called edge computing. In individual cases, especially regarding many industrial IoT topics, edge computing can be a smart addition to cloud computing.
The edge data center takes on the job of calculating the data and sends the results to the cloud backend. Later– after the tests are concluded – the test data can also be stored there so that the OEM has permanent access to it. The benefits of edge computing are obvious: evaluation is dramatically accelerated, results are available to the engineers more quickly, and as a by-product, costs are also reduced.
At the Daimler EDM CAE Forum, we are introducing a network of superclusters that spans the world, and enables Big Data-based signal processing. Why not drop by and have a look?

Leave a Reply

Your email address will not be published.

* Mandatory field

 
 

Twitter

tsystemsCom @tsystemsCom
Caution in times of #Digitization: Read the #TSystems whitepaper to learn more about the 5 most common traps that i… https://t.co/fx7cTEb9OF
This is the end: #DevOps and the #cloud mean the end of QA as you know it. It looks like as if traditional quality… https://t.co/VtwfaJEQ51
By 2020, 90% of companies will have adopted a kind of hybrid #cloud, expects @Gartner_Inc. But what is a… https://t.co/gsyGbCvlM9
Great success for @tsystemscom at @SAPdach Hackathon #Hack2Sol: A new smartphone app connects things from the #IoT https://t.co/gbyqrIAlmX
Make hackers hate you! This is how visibility, detection and the continuous improvement of your #CyberSecurity can… https://t.co/oJPV26jLyL
Big enabler: For many industries, their systems and technology were created up to 30 years ago but the… https://t.co/wLkSf8G1kg
As US government collects more citizen data and cyberattacks increase in frequency, states are hiring chief privacy… https://t.co/xjUZsafCSv
Continued growth ahead for #IoT systems: The number of #smarthome devices shipped will grow from 83M in 2015 to 193… https://t.co/Pjt9SgfelQ
What have we learned from deploying container-based applications to the public clouds? Here are 3 tips for containe… https://t.co/6QMBUVEcfF
Load More...