Thursday, 14 January 2021 12:40

Fujitsu announces breakthrough in AI recognition of complex actions Featured

Complex pattern recognition - a Fujitsu breakthrough Complex pattern recognition - a Fujitsu breakthrough

Fujitsu has announced the development of an AI based technology that can recognise and analyse complex human movements.

The technology, developed by Fujitsu Laboratories, utilises deep learning to recognise the positions and connections of adjacent joints in complex movements or behaviour in which multiple joints move in tandem. This makes it possible to achieve greater accuracy in recognising, for example, when a person performs a complex task like removing objects from a box.

Fujitsu says the technology has achieved the world's highest accuracy in behaviour recognition, with significant gains over the results achieved using conventional technologies which don't make use of information on neighbouring joints.

Fujitsu says the technology can be used to perform checks of manufacturing procedures or unsafe behaviour in public spaces. Fujitsu scientists have presented the details of this technology at the 25th International Conference on Pattern Recognition (ICPR 2020), which is being held online until Friday 15 January.

“In recent years, advances in AI technology have made it possible to recognise human behaviour from video images using deep learning,” said Fujitsu Lab researchers Yuya Obinata Takuma Yamamoto, who presented a paper on the technology at the conference.

“In general, human behaviour recognition utilising AI relies on temporal changes in the position of each of the skeletal joints, including in the hands, elbows, and shoulders, as identifying features, which are then linked to simple movement patterns such as standing or sitting.

“With this new time series behaviour-recognition technology we have developed, we have successfully realised highly-accurate image recognition using a deep learning model that can operate with high-accuracy even for complex behaviours in which multiple joints change in conjunction with each other.”

Complex movements like unpacking involve hand, elbow, and shoulder joints moving in tandem with the arm bending and stretching. Fujitsu has now developed a new AI model for such processes, using a graph consisting of edges connecting adjacent joints based on the structure of the human body with the joint position as a node, or vertex.

By training this model in advance using the time series data of joints, the connection strength (weight) with neighbouring joints can be optimised, and effective connection relationships for behaviour recognition can be acquired.

“With conventional technologies, it was necessary to accurately grasp the individual characteristics of each joint,” said the researchers. “With an AI model that has already been trained, the combined features of the adjacent joints that are linked can be extracted, making it possible to achieve highly-accurate recognition for complex movements.”

The technology was evaluated against the world standard benchmark in the field of behaviour recognition using skeleton data, and in the case of simple behaviours such as standing and sitting in the open data set, the accuracy rate was maintained at the same level as that of conventional technology that does not use information on neighbouring joints.

But in the case of complex behaviours like a person unpacking a box or throwing an object, the accuracy rate improved greatly, to achieve an overall improvement of more than 7% over the conventional alternative to reach the world's highest recognition accuracy.

By adding the newly developed AI model for recognising complex behaviours obtained with this technology to the 100 basic behaviours already accommodated by Fujitsu's behavioural analysis technology Actlyzer, Fujitsu says it will become possible rapidly deploy new, highly-accurate recognition models.

Subscribe to ITWIRE UPDATE Newsletter here


The much awaited iTWire Shop is now open to our readers.

Visit the iTWire Shop, a leading destination for stylish accessories, gear & gadgets, lifestyle products and everyday portable office essentials, drones, zoom lenses for smartphones, software and online training.

PLUS Big Brands include: Apple, Lenovo, LG, Samsung, Sennheiser and many more.

Products available for any country.

We hope you enjoy and find value in the much anticipated iTWire Shop.



iTWire TV offers a unique value to the Tech Sector by providing a range of video interviews, news, views and reviews, and also provides the opportunity for vendors to promote your company and your marketing messages.

We work with you to develop the message and conduct the interview or product review in a safe and collaborative way. Unlike other Tech YouTube channels, we create a story around your message and post that on the homepage of ITWire, linking to your message.

In addition, your interview post message can be displayed in up to 7 different post displays on our the site to drive traffic and readers to your video content and downloads. This can be a significant Lead Generation opportunity for your business.

We also provide 3 videos in one recording/sitting if you require so that you have a series of videos to promote to your customers. Your sales team can add your emails to sales collateral and to the footer of their sales and marketing emails.

See the latest in Tech News, Views, Interviews, Reviews, Product Promos and Events. Plus funny videos from our readers and customers.


Graeme Philipson

Graeme Philipson sadly passed away in Jan 2021 and a much valued senior associate editor at iTWire. He was one of Australia’s longest serving and most experienced IT journalists. He is the author of the only definitive history of the Australian IT industry, ‘A Vision Splendid: The History of Australian Computing.’He was in the high tech industry for more than 30 years, most of that time as a market researcher, analyst and journalist. He was founding editor of MIS magazine, and is a former editor of Computerworld Australia. He was a research director for Gartner Asia Pacific and research manager for the Yankee Group Australia. He was a long time weekly IT columnist in The Age and The Sydney Morning Herald, and is a recipient of the Kester Award for lifetime achievement in IT journalism. Graeme will be sadly missed by the iTWire Family, Readers, Customers and PR firms.

Share News tips for the iTWire Journalists? Your tip will be anonymous




Guest Opinion

Guest Reviews

Guest Research

Guest Research & Case Studies

Channel News