Notice: Array to string conversion in /mnt/web508/c0/89/510666389/htdocs/LONE_website_2020/WordPress_02/wp-content/plugins/wp-optimize-premium/minify/class-wp-optimize-minify-front-end.php on line 512 Warning: Illegal offset type in isset or empty in /mnt/web508/c0/89/510666389/htdocs/LONE_website_2020/WordPress_02/wp-content/plugins/wp-optimize-premium/minify/class-wp-optimize-minify-front-end.php on line 706 Notice: Array to string conversion in /mnt/web508/c0/89/510666389/htdocs/LONE_website_2020/WordPress_02/wp-content/plugins/wp-optimize-premium/minify/class-wp-optimize-minify-front-end.php on line 711 Warning: Illegal offset type in isset or empty in /mnt/web508/c0/89/510666389/htdocs/LONE_website_2020/WordPress_02/wp-content/plugins/wp-optimize-premium/minify/class-wp-optimize-minify-front-end.php on line 801

IT-Development: Natural Language Processing (NLP)

NLP-applications become increasingly interesting for handling big sets of data with written or spoken texts. Finding patterns in data and numbers, texts and images is becoming increasingly comprehensive and faster.

What is Natural Language Processing - other than a language assistant addressing me?

Natural language processing (NLP) is often mentioned together with one related buzz word and one brand name which have their overlaps but cannot be used as synonyms. The related buzz word is “AI” (Artificial Intelligence), often used when people talk about “Machine Learning”. Machine Learning is a statistical approach to “learn” patterns based on so-called training data. It is true that statistical approaches are widely used in NLP, yet it is not its only mainstay.

by Sarah Holschneider

Voice Assistants are popular KI devices and need to handle Natural Language Processing
Voice assistants are pupular AI devices and have to understand the meaning of orders via Natural Language Processing.

Brand names, jump out at us when we think of “language” and “computer”: “Alexa”, “Google home” or “Siri” – all language wizards use NLP. But the rapidly growing field of applications for Natural Language processes can do much more.

As an intersection between linguistics and computer science, Natural Language Processing investigates the interaction between computers and natural languages, i.e. human languages as opposed to programming languages.

Since the late 1980s and mid-1990s, much natural language processing research has relied heavily on machine learning (which might be the reason why so many people only see that aspect). Machine Learning algorithms are able to learn rules automatically through the analysis of large corpora (huge collections of texts) of typical examples.

Three different systems that build the staircase to AI-applications
An Expert System, Machine Learning and Deep Learning are the three different systems that with less and less human involvement build the staircase to AI-applications

What looks like an easy way to automize and solve text-related issues at first sight, might need many pre-processing steps by people with a certain level of linguistic knowledge. In some cases, native speakers can already help (sufficient motivation provided). In other cases you need a deeper knowledge of linguistic dependencies and computational linguists.

Systems based on machine-learning algorithms have many advantages over manually written rules. They offer possibilities of automatic learning and, as they focus on the most common cases, they do not get entangled in exceptions. However, in order to let statistics do its magic, you need a sufficiently big data set. Rule-based systems are often less scalable but can close the gap if you must work with small amounts of data.

Sarah Holschneider has been working on the development of NLP solutions for L-One Systems for three years, since March 2020 as head of the NLP department.

Depending on your case, a rule-based system might work better if you have a fixed set of cases which need to be solved. Imagine you want to translate boilerplate text on a PowerPoint template that your company is using. A simple string.replace() might do the trick and investing in a statistical approach for machine translation might be way more time as well as cost-intensive.

»Defining your individual use case as specific as possible is more than half the battle.«

Sarah Holschneider

You realize, some of these use cases already sound like grammar class. Therefore we include linguists during the whole development of NLP-related projects at L-One Systems. As you would not code a calculator without knowing about algebra, you should not code NLP-applications without a deep understanding of language.

Video L-One Systems Interview with Lionel Born & Feras Tanan
Connecting external software developers for efficient software development – Video (1:59 min.).

Let’s take off

We are looking for new project partners. Not many but those who fit best with us. Let’s find out whether your project matches the way we team up. 

Find out about how we work and tell us, how we can accelerate your software development … 

Notice: Constant WP_USE_THEMES already defined in /mnt/web508/c0/89/510666389/htdocs/LONE_website_2020/WordPress_02/index.php on line 14