Big Data Market Segment LS
Big Data Market Segment RS
Thursday, 18 November 2021 21:11

Mercury NZ and Databricks shows there is a better way to manage your data


Bryan Campbell, data and analytics platform manager, Mercury NZ presented today at the Databricks Data and AI tour about the gentailer’s journey from costly data to an agile, versatile, objective-meeting data lakehouse.

Databricks held a Data and AI tour for Asia Pacific customers today, hosted by Ali Ghodsi, co-founder and CEO of Databricks. Ghodsi explained Databricks “data lakehouse,” saying “the data lakehouse offers a better path - an integrated and collaborative role-based experienced with APIs.”

Ghodsi explained, "A data lake alone presents challenges," and noted a company’s well-intentioned data lake can easily turn into a data swamp if security, reliability, quality, and performance are not maintained. He noted performance is often a problem with data lakes because the very nature of a data lake is geared towards loading data in structured and unstructured ways, with no specific format.

Instead, Ghodsi said, Databricks lake-first approach builds upon the freshest and most complete data in an organisation, with AI and ML built-in from the ground up, support for multi-cloud and inter-cloud, support for all use cases on a single platform, and built on open source and open standards.

Theory is one thing; Mercury NZ's Bryan Campbell took to the stage to explain his organisation's data journey and what it meant in practice.

Mercury NZ is a "gentailer," meaning the New Zealand-based company is both an electricity generator, and an energy retail business. It generates electricity from 100% renewable resources spanning hydro, geothermal, and wind. It operates nine hydro stations, five geothermal stations, and is currently building NZ’s largest wind farm. The business is listed on both the ASX and NZX and has approximately 800 team members across NZ.

"It's a broad and diverse business, which is great if you love data," Campbell said, explaining the business has complex assets, unpredictable fuels, and wholesale and financial markets to deal with along with a retail arm.

Campbell explained Mercury NZ's internal stakeholders were seeking data and insights around customer lifetime value, risk propensities, and personalised marketing options. Looking further ahead, the company recognised the value of demand and generation forecasting, market pricing risks, digital twins, and asset master data management.

Yet, it was constrained in achieving these good things through a high amount of data redundancy. Then, Campbell said, this was compounded by expense. “Data follows compute, where we were moving data where it was needed. This was expensive in terms of time and cost, and in terms of quality, often being changed along the way.”

Mercury NZ knew there must be a better way, and driven by a need to enable advanced analytics, create a self-service culture, implement technology to attract and retain talent, to scale economically, and be faster-to-market, the company investigated solutions which led it to Databricks and the data lakehouse design.

The solution that was implemented is shown below.


While Campbell noted Mercury NZ was still early in its journey the lakehouse is operational, and the business has already achieved wins. Campbell explained the drivers have been met by the solution Databricks enabled, and the initial needs - customer lifetime value, risk propensities, and personalised marketing - have all been met.

With this under its veritable belt, Mercury NZ is now looking to the future and the next set of items in its list, with a proven and stable data operation that has provided business value, increased efficiency, and reduced cost.


Read 2542 times

Please join our community here and become a VIP.

Subscribe to ITWIRE UPDATE Newsletter here
JOIN our iTWireTV our YouTube Community here


Hybrid cloud promises to bring together the best of both worlds enabling businesses to combine the scalability and cost-effectiveness of the cloud with the performance and control that you can get from your on-premise infrastructure.

Reducing WAN latency is one of the biggest issues with hybrid cloud performance. Taking advantage of compression and data deduplication can reduce your network latency.

Research firm, Markets and Markets, predicted that the hybrid cloud market size is expected to grow from US$38.27 billion in 2017 to US$97.64 billion by 2023.

Colocation facilities provide many of the benefits of having your servers in the cloud while still maintaining physical control of your systems.

Cloud adjacency provided by colocation facilities can enable you to leverage their low latency high bandwidth connections to the cloud as well as providing a solid connection back to your on-premises corporate network.

Download this white paper to find out what you need to know about enabling the hybrid cloud in your organisation.



It's all about Webinars.

Marketing budgets are now focused on Webinars combined with Lead Generation.

If you wish to promote a Webinar we recommend at least a 3 to 4 week campaign prior to your event.

The iTWire campaign will include extensive adverts on our News Site and prominent Newsletter promotion and Promotional News & Editorial. Plus a video interview of the key speaker on iTWire TV which will be used in Promotional Posts on the iTWire Home Page.

Now we are coming out of Lockdown iTWire will be focussed to assisting with your webinars and campaigns and assistance via part payments and extended terms, a Webinar Business Booster Pack and other supportive programs. We can also create your adverts and written content plus coordinate your video interview.

We look forward to discussing your campaign goals with you. Please click the button below.


David M Williams

David has been computing since 1984 where he instantly gravitated to the family Commodore 64. He completed a Bachelor of Computer Science degree from 1990 to 1992, commencing full-time employment as a systems analyst at the end of that year. David subsequently worked as a UNIX Systems Manager, Asia-Pacific technical specialist for an international software company, Business Analyst, IT Manager, and other roles. David has been the Chief Information Officer for national public companies since 2007, delivering IT knowledge and business acumen, seeking to transform the industries within which he works. David is also involved in the user group community, the Australian Computer Society technical advisory boards, and education.

Share News tips for the iTWire Journalists? Your tip will be anonymous




Guest Opinion

Guest Interviews

Guest Reviews

Guest Research

Guest Research & Case Studies

Channel News