Featured IT News

Commbank says online services slowly returning to normal

18 October 2019 in Application Performance

Online banking services at the Commonwealth Bank, which were hit by an outage on Thursday, are returning to normal, the…

Top strategic priorities for 2020

17 October 2019 in CIO Trends

Australia’s global ranking in digital competiveness is slipping. To turn this around, local organisations need to be innovative, people-focused and…

Official Spotify app arrives on Telstra TV

17 October 2019 in Entertainment

Telstra has launched the official Spotify app on Telstra TV, expanding the range of audio content available on our very…

PainChek, Ward MM roll out pain monitoring device in residential aged care

17 October 2019 in Health

Listed Australian healthcare company PainChek is partnering with medication management services provider Ward Medication Management to deliver the national roll-out…

ERM Power improves efficiency, productivity with Rubrik deployment

17 October 2019 in Energy

Energy retailer ERM Power has boosted efficiency and productivity with the deployment of technology from cloud data management vendor Rubrik.

IQOS - is this the revolution cigarette consumption needs?

17 October 2019 in Health

The IQOS cigarette system is a major departure from 'smoking' as it heats rather than burns the tobacco.

Retail, healthcare lead the way in IoT adoption: survey

17 October 2019 in Internet of Things

The retail and healthcare sectors are the two business and industry sectors leading Internet of Things (IoT) adoption around the…

Windows ransomware a major problem for SMBs globally: survey

17 October 2019 in Security

Windows ransomware has become a major problem for small and medium-sized businesses (SMBs), a survey by Datto, a company that…

5G implementation 'faster than expected', says Huawei

16 October 2019 in Telecoms & NBN

Leading European telcos have used Huawei’s Mobile Broadband Forum in Zürich to outline their 5G plans for the next five…

Boomi, Fujitsu form new alliance to boost Australia, NZ market pitch

16 October 2019 in Market

Cloud integration and workflow automation vendor Boomi has formed an alliance with Fujitsu Australia to provide Australian and New Zealand…

CompTIA launches program to teach students technology fundamentals

16 October 2019 in Education

Tech industry trade association CompTIA says it is expanding its commitment to the Australia New Zealand region with the launch…

Telstra, Optus go head-to-head on Google Pixel 4 smartphone sell

16 October 2019 in Business Telecommunications

Rival telcos Telstra and Optus have both launched their mobile plan offerings for the new Google Pixel 4 smartphones, each…

Nutanix boosts Australian market presence, with focus on natural resources sector

16 October 2019 in Strategy

Global enterprise cloud vendor Nutanix has established a new vertical practice in the Australian market focused on the natural resources…

Esports Mogul, Tier One Entertainment ink partnership deal

16 October 2019 in Listed Tech

Listed Australian tournament platform Esports Mogul has inked a partnership agreement with Southeast Asia influencer talent agency Tier One Entertainment.

Target admits ‘may have’ misled consumers over faulty PlayStation complaints: ACCC

16 October 2019 in Games

Retailer Target has admitted to the competition watchdog, the ACCC, that it may have breached Australian Consumer Law by making…

Business confidence declines but scientific, technical & professional services buck the trend

16 October 2019 in Strategy

The scientific & technical and professional services industries were amongst the industry sectors performing well, above the average, in September…

Censorship: ACSC anger over lawyer likening Australian law to China

15 October 2019 in Security

The Australian Cyber Security Centre tried to censor the content of a talk to be given by the partner of…

Telstra’s Penn gets pay increase to $5m, union calls ignored

15 October 2019 in Business Telecommunications

Telstra shareholders have voted to approve a salary increase for CEO Andy Penn, ignoring criticism from the union representing Telstra…

Breaking IT News

30iGala: 2 weeks to go and event oversubscribed - waitlisting now available, plus Aidan Tudehope interview

17 October 2019 in Development

As Peter Coroneos releases the next in a series of video interviews leading up the the big event, with Peter…

FULL LAUNCH VIDEO: Realme, Australia's newest smartphone brand challenges with great features at amazing prices

17 October 2019 in Home Tech

With 120 smartphone brands globally, you need to really stand out to make an impression, and with realme only 17…

CommBank online banking services hit by outage

17 October 2019 in Application Performance

Online banking services at the Commonwealth Bank have come a-cropper, with the bank saying it is "working urgently to restore…

Roots’ RZTO cooling technology increases cannabis yield in high-tech greenhouse by up to 118%

17 October 2019 in Listed Tech

SPONSORED NEWS: Roots Sustainable Agricultural Technologies Limited (ASX: ROO) has increased the yield of dry cannabis flowers by up to…

ANZ workers tend to trust robots more than their managers: claim

17 October 2019 in Business Intelligence

More than half of the Australians and New Zealanders who participated in a survey about artificial intelligence have indicated they…

Online jobs ads fell again in Sept, but less than in August

17 October 2019 in Recruitment

Online job advertisements listed by SEEK fell by 7.4% year-on-year in September, the company says, adding that this represented a…

Britain drops age-verification plan for online porn

17 October 2019 in Entertainment

Three months after it was supposed to come into effect, the British Government has dropped its plans for an age-verification…

Broadband forum calls for standards

16 October 2019 in Telecoms & NBN

5G standards have been introduced, but not fully implemented. Each vendor knows its take on the subject, but the real…

Govt makes 2FA compulsory for porting mobile numbers between providers

16 October 2019 in Security

The government has made the use of two-factor authentication compulsory when porting mobile numbers from one provider to another, in…

Nanomesh drug delivery may help in fight against antibiotic resistance

16 October 2019 in Health

Scientists have found a way of fabricating nanomesh so that it can be used as a drug delivery system for…

MacGibbon, Paitaridis to head new cyber security firm

16 October 2019 in Security

Private equity form BGH Capital has pumped a sizeable amount into the formation of a cyber security firm CyberCX, which…

ACIC first intelligence agency to sign up with archTIS

16 October 2019 in Cloud

ASX-listed Canberra-based cyber security firm archTIS has signed up the Australian Criminal Intelligence Commission as the first intelligence agency to…

VIDEO: 16 days to 30iGala, Matt Tett and Anthony Bodin talk Internet history and innovation

15 October 2019 in Development

The event of the decade approaches as tickets are nearly sold out for this landmark event which will see many…

Eaton unveils new DC power portfolio to meet 5G power demands

15 October 2019 in Data Centres

SPONSORED NEWS: New global range showcased at Data Centre World 2019 in Singapore Sydney, Australia. Power management company Eaton has…

88 Energy on Target for North Alaska Drill Campaign

15 October 2019 in Energy

SPONSORED NEWS: 88 Energy Limited (ASX: 88E) provides the following update related to the upcoming drilling of the Charlie-1 appraisal…

Swinburne, IBM team up to deliver AI study course

15 October 2019 in Education

Swinburne University has partnered with IBM Research Australia to deliver a unit on artificial intelligence (AI) as part of Australia’s…

Review: Aspera Mobile Jazz 2

15 October 2019 in Mobile devices

This budget mobile hits a spot, even though 'premium' buyers are likely to turn up their noses.

Foxtel continues New Experience rollout

15 October 2019 in Entertainment

Broadcaster Foxtel has confirmed the recently released New Foxtel Experience has completed its roll out to iQ4 set top boxes,…

Optus boosts mobile coverage for Shoalhaven region

15 October 2019 in Business Telecommunications

Mobile phone coverage in the city of Shoalhaven in NSW has been boosted with new mobile towers switched on by…

Kleos Space establishes subsidiary to facilitate US market entry

15 October 2019 in Space

Australian-listed Kleos Space has entered the US market with a wholly-owned US subsidiary to integrate and sell its maritime intelligence…

Global online streaming music revenue crossed US$11b mark in 1H2019

15 October 2019 in Entertainment

Revenue from global online music streaming services crossed the US$11 billion mark in the first half of 2019, the technology…

 

Popular News

 

Telecommunications

Subscribe to Newsletter

*  Enter the security code shown:

VENDOR NEWS & EVENTS

REVIEWS

Recent Comments

Thursday, 14 August 2014 17:15

Data lake or data swamp?

By

The 'data lake' concept - storing as much as possible of an organisation's data in one system - seems to be gaining traction. The idea is that it provides economies of scale through consolidation thanks to better utilisation and simpler management, as well as allowing the data to be used for more purposes without duplication.

For example, storage vendor EMC positioned the Isilon systems it announced last month as the place to store a data lake.

But analyst group Gartner raised a warning flag at the end of July, suggesting its clients should beware of the data lake fallacy.

"The idea is simple: instead of placing data in a purpose-built data store, you move it into a data lake in its original format. This eliminates the upfront costs of data ingestion, like transformation. Once data is placed into the lake, it's available for analysis by everyone in the organisation," explained research director Nick Heudecker.

But the most important risk surrounding data lakes "is the inability to determine data quality or the lineage of findings by other analysts or users that have found value, previously, in using the same data in the lake. By its definition, a data lake accepts any data, without oversight or governance. Without descriptive metadata and a mechanism to maintain it, the data lake risks turning into a data swamp. And without metadata, every subsequent use of data means analysts start from scratch," according to a Gartner statement.

"The fundamental issue with the data lake is that it makes certain assumptions about the users of information," said Mr Heudecker. "It assumes that users recognise or understand the contextual bias of how data is captured, that they know how to merge and reconcile different data sources without 'a priori knowledge' and that they understand the incomplete nature of datasets, regardless of structure."

Gartner subscribers can access the company's report The Data Lake Fallacy: All Water and Little Substance.

The industry is naturally more optimistic - see page 2.


EMC Isilon division CTO for APJ Charles Sevior told iTWire that organisations typically purchase storage to support a particular workload, and then find they can use the data with another application. The trick is to do that without disturbing the original application and without duplicating the data - hence the idea of a data lake that's accessible to multiple applications.

People are realising there is value in 'digital exhaust' - the massive data sets of call records, log files, surveillance video and much more - if they have the ability to extract useful and meaningful information from it.

But there's no substitute for human intelligence and curation, said Mr Sevior, adding that if he ran a business that depended on data, consulting a data scientist would be high on his agenda, if only for a preliminary investigation that would reveal how the data could be brought to bear on the business's processes.

"We are getting tremendous support" for the data lake concept, he claimed, as people wanted an easier way into this type of analysis than Hadoop offers.

Amr Awadallah, co-founder and CTO of Hadoop vendor Cloudera told iTWire that "governance and innovation go against each other." With a traditional system, a business user that needs an additional data column for a particular analysis has to go through all sorts of hoops to get approval, and then plenty of technical work is needed behind the scenes to make it happen. This makes the change difficult to justify as its value cannot be known until the new analysis has been performed - it could prove worthless, or it might lead to millions of dollars of new revenue.

Cloudera's concept of the enterprise data hub appears to be the equivalent of a data lake.

This approach makes it easy for that user to access the data he or she needs, and at the same time "our SQL is good enough for 90% of the workloads in the enterprise."

Organisations need to be agile and innovative as well as efficient and well-governed, Mr Awadallah observed.

Image: incorporates a public domain photograph via Wikimedia Commons

BUSINESS WORKS BETTER WITH WINDOWS 1O. MAKE THE SHIFT

You cannot afford to miss this Dell Webinar.

With Windows 7 support ending 14th January 2020, its time to start looking at your options.

This can have significant impacts on your organisation but also presents organisations with an opportunity to fundamentally rethink the way users work.

The Details

When: Thursday, September 26, 2019
Presenter: Dell Technologies
Location: Your Computer

Timezones

QLD, VIC, NSW, ACT & TAS: 11:00 am
SA, NT: 10:30 am
WA: 9:00 am NZ: 1:00 pm

Register and find out all the details you need to know below.

REGISTER!

ADVERTISE ON ITWIRE NEWS SITE & NEWSLETTER

iTWire can help you promote your company, services, and products.

Get more LEADS & MORE SALES

Advertise on the iTWire News Site / Website

Advertise in the iTWire UPDATE / Newsletter

Promote your message via iTWire Sponsored Content/News

Guest Opinion for Home Page exposure

Contact Andrew on 0412 390 000 or email [email protected]

OR CLICK HERE!

Stephen Withers

joomla visitors

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.