Lead Machine Pink 160x1200

Lead Machine Pink 160x1200

iTWire TV 705x108

Wednesday, 27 April 2022 17:16

Real-time is marked by a continual march toward the possible

By Manish Devgan, chief product officer, Hazelcast
Hazelcast chief product officer Manish Devgan Hazelcast chief product officer Manish Devgan

GUEST OPINION: There are several reasons why real-time is really taking off, and the rise of event-driven architectures is one of them.

The challenge of doing business in real-time is that it means different things to different people, and the expectation of how quickly things need to occur continues to shift over time.

Everyone understands that latency matters. There's a good understanding generally of the impact that higher ping times have on access to applications and data.

Similarly, organisations understand how data – and faster access to it – can fundamentally change the value proposition they create for customers.

For these organisations, it's no longer sufficient to look at past application usage or purchase patterns as a predictor of future customer behaviour.

Instead, organisations are cognisant they now operate in a "real-time economy," where what matters most is what I – as the user or consumer – am looking at now, combined and enriched with the historical context of my past transactions..

For organisations, it's about making online, not offline, predictions. It's about having the ability to learn and execute while the user is still active and engaged. From a technology perspective, it's the ability to continually learn by updating machine learning models in real-time and incorporating new incoming data.

That's the essence of the real-time challenge that organisations are faced with enabling today.

Time matters

Executing the processing and predictive work while the user is online means that time is always going to be of the essence. More to the point, there's still a lot of 'fuzziness' around how real-time an organisation's capabilities have to be in order to execute on that.

Does it need to occur in seconds, milliseconds, microseconds or nanoseconds?

The short answer is 'yes,' but with a big 'but' as it will largely depend on business SLA. Even within early use cases, such as fraud detection and prevention, personalised offers and gaming, there are differences in what constitutes acceptable, real-time performance.

And that gets to the essence of the challenge around real-time: there's a continuum of options as to the time it takes to execute the process.

Where an organisation starts on that continuum is not an indication of where it'll stay. The goalposts will continually move, and organisations will need to keep pace. Real-time is a journey and may take a few steps to accomplish.

As expectations of what really constitutes real-time shift, it's critical that organisations build real-time applications on a platform that enables them to keep pace with this constant compression of the acceptable time window available for processing and predictive analysis.

It's the only way to ensure they remain real-time and that the applications satisfy the value it creates for the customers.

How we got here

The migration from batch processing and offline behavioural analysis to real-time analysis – while a customer is active online – is a trend that's been a while in the making but is coming of age due to a confluence of factors.

The 'art of the possible' is now orders of magnitude different than it was a decade ago. It wasn't long ago that the recommendation from Netflix was the North Star of what was possible. While the engine is still highly effective – with some reports suggesting it drives 80% of stream time – improvements continue to the engine and its underlying machine learning algorithms.

Yet, other large technology-based organisations have since emerged with engines of their own that significantly advance the state-of-the-art. TikTok is an example of this progression; the data science behind its operations is seen as a key reason for its meteoric rise, and more importantly, why its user base is so obsessive.

What this demonstrates is that the power of the underlying platform is a key factor in the drive to real-time, as well as the ability for more organisations to enable real-time approaches in their operations.

Organisations know data is gold. They understand how data can fundamentally change the value they create for customers and, in turn, change customers' behaviours. However, only a fraction of fresh streaming data is being used today. They also know that the era of real-time is possible because there's now enough compute and storage capacity available to power these ambitions.

Additionally, real-time is made possible by advances on the customers' end as well. Other key enablers for accessing data and services in real-time are the constant march to more powerful edge computing devices, as well as the emergence of powerful, low-latency, highly resilient networks like 5G.

Where real-time goes next

The other reason organisations have gone real-time is because of the emergence of more platform-like solutions to execute this strategic direction.

To enable organisations to build real-time solutions, a set of core capabilities or services are required. These include a way to ingest real-time event and messaging, a way to store and have quick access to the data once ingested, streaming analytics, and real-time machine learning.

The challenge organisations face is that it's still non-trivial to stitch these capabilities together. Not every organisation is the size of a Netflix or TikTok, with the engineering resources to build and continuously improve a real-time application or capability.

That's why application enablement is emerging as a key building block for organisations in this space. To build a real-time business or application, organisations need the support of a modern data platform that has the components and underlying compute to realise their real-time ambitions.

Read 1165 times

Please join our community here and become a VIP.

Subscribe to ITWIRE UPDATE Newsletter here
JOIN our iTWireTV our YouTube Community here


Thoughtworks presents XConf Australia, back in-person in three cities, bringing together people who care deeply about software and its impact on the world.

In its fifth year, XConf is our annual technology event created by technologists for technologists.

Participate in a robust agenda of talks as local thought leaders and Thoughtworks technologists share first-hand experiences and exchange new ways to empower teams, deliver quality software and drive innovation for responsible tech.

Explore how at Thoughtworks, we are making tech better, together.

Tickets are now available and all proceeds will be donated to Indigitek, a not-for-profit organisation that aims to create technology employment pathways for First Nations Peoples.

Click the button below to register and get your ticket for the Melbourne, Sydney or Brisbane event



It's all about Webinars.

Marketing budgets are now focused on Webinars combined with Lead Generation.

If you wish to promote a Webinar we recommend at least a 3 to 4 week campaign prior to your event.

The iTWire campaign will include extensive adverts on our News Site itwire.com and prominent Newsletter promotion https://itwire.com/itwire-update.html and Promotional News & Editorial. Plus a video interview of the key speaker on iTWire TV https://www.youtube.com/c/iTWireTV/videos which will be used in Promotional Posts on the iTWire Home Page.

Now we are coming out of Lockdown iTWire will be focussed to assisting with your webinars and campaigns and assistance via part payments and extended terms, a Webinar Business Booster Pack and other supportive programs. We can also create your adverts and written content plus coordinate your video interview.

We look forward to discussing your campaign goals with you. Please click the button below.


Share News tips for the iTWire Journalists? Your tip will be anonymous




Guest Opinion

Guest Reviews

Guest Research

Guest Research & Case Studies

Channel News