arrow Products
Glide CMS image Glide CMS image
Glide CMS arrow
The powerful intuitive headless CMS for busy content and editorial teams, bursting with features and sector insight. MACH architecture gives you business freedom.
Glide Go image Glide Go image
Glide Go arrow
Enterprise power at start-up speed. Glide Go is a pre-configured deployment of Glide CMS with hosting and front-end problems solved.
Glide Nexa image Glide Nexa image
Glide Nexa arrow
Audience authentication, entitlements, and preference management in one system designed for publishers and content businesses.
For your sector arrow arrow
Media & Entertainment
arrow arrow
Built for any content to thrive, whomever it's for. Get content out faster and do more with it.
Sports & Gaming
arrow arrow
Bring fans closer to their passions and deliver unrivalled audience experiences wherever they are.
Publishing
arrow arrow
Tailored to the unique needs of publishing so you can fully focus on audiences and content success.
For your role arrow arrow
Technology
arrow arrow
Unlock resources and budget with low-code & no-code solutions to do so much more.
Editorial & Content
arrow arrow
Make content of higher quality quicker, and target it with pinpoint accuracy at the right audiences.
Developers
arrow arrow
MACH architecture lets you kickstart development, leveraging vast native functionality and top-tier support.
Commercial & Marketing
arrow arrow
Speedrun ideas into products, accelerate ROI, convert interest, and own the conversation.
Technology Partners arrow arrow
Explore Glide's world-class technology partners and integrations.
Solution Partners arrow arrow
For workflow guidance, SEO, digital transformation, data & analytics, and design, tap into Glide's solution partners and sector experts.
Industry Insights arrow arrow
News
arrow arrow
News from inside our world, about Glide Publishing Platform, our customers, and other cool things.
Comment
arrow arrow
Insight and comment about the things which make content and publishing better - or sometimes worse.
Expert Guides
arrow arrow
Essential insights and helpful resources from industry veterans, and your gateway to CMS and Glide mastery.
Newsletter
arrow arrow
The Content Aware weekly newsletter, with news and comment every Thursday.
Knowledge arrow arrow
Customer Support
arrow arrow
Learn more about the unrivalled customer support from the team at Glide.
Documentation
arrow arrow
User Guides and Technical Documentation for Glide Publishing Platform headless CMS, Glide Go, and Glide Nexa.
Developer Experience
arrow arrow
Learn more about using Glide headless CMS, Glide Go, and Glide Nexa identity management.

NLP AI order word understand does not

A shortcut our brains learn to understand language is beyond even the most advanced AIs, new research shows.

Published: 18:23, 19 January 2021

Last updated: 14:20, 20 January 2021
Natural Language Processing

Artificial Intelligence systems using Natural Language Processing to understand language are left flummoxed by changes as small as changing word order in sample text, researchers have shown.

Research from Alabama's Auburn University, in conjunction with publishing heavyweights Adobe, looked at AIs using Google's BERT language model. They discovered AIs would regard sentences with the same words, but different word orders, as identical.

You can download the research paper here (PDF, opens a new tab).

NLP AI is seen as a step toward true AI-driven content creation, predicted as a potentially game-changing development in publishing - good or bad, depending on your take. 

Using the 'GLUE' benchmark - the General Language Understanding Evaluation, a standard set of tasks designed to prove language comprehension - the researchers randomly assorted the words in a given sentence and noted that the AIs would report them as duplicates.

Read into the GLUE benchmark at this link (opens new tab).

While many situations can benefit from such logic, such as where a human mistypes a query,  the research team noted that this "superficial" behaviour was not useful in reaching the finer and deeper understanding of language that AI teams are pushing hard for.

Previously, research has shown that changing the word order in a sentence or conversation with advanced chatbots did not alter the response the chatbots gave.

A recommendation from this latest research is that NLP AIs are trained more extensively on tasks where word order matters, such as grammar tasks, and so reduce the "short cut" that NLP AIs are making by focusing on a few key words in any given dataset. 

This short cut comes out of the "self attention" logic popular in such NLP AIs, which trains the AI to focus on the "important" parts of any given series of words.

According to the team: "It is important to design benchmarks that truly test machine capability in understanding and reasoning. Our work also revealed how self-attention, a key building block in modern NLP, is being used to extract superficial cues to solve sequence-pair GLUE tasks even when words are out of order."