« Back to Glossary Index

Definition and Types of N-grams
– An n-gram is a sequence of adjacent symbols in a particular order.
– The symbols can be adjacent letters, syllables, or whole words in a language dataset.
– N-grams can also be adjacent phonemes extracted from a speech-recording dataset or adjacent base pairs from a genome.
– Latin numerical prefixes are used to name n-grams of different sizes, such as unigram, bigram, trigram, etc.
– Greek numerical prefixes or English cardinal numbers are used in computational biology for polymers or oligomers of a known size, called -mers.

N-grams in Language Models
– N-grams allow bag-of-words models to capture information such as word order.
– They are used in NLP to capture contextual information.
– N-grams help in capturing the sequence of words and their relationships.
– Traditional bag-of-words models do not consider word order, but n-grams can overcome this limitation.
– N-grams are essential for building language models that generate coherent and contextually relevant text.

Examples of N-grams
– Example sequences and their corresponding 1-gram, 2-gram, and 3-gram sequences are shown in Figure 1.
– Word-level 3-grams and 4-grams from the Google N-gram corpus include ceramics collectables collectibles (55) and serve as the independent (794).
– N-grams provide insights into word combinations and their frequencies.
– They can be used to analyze patterns and trends in large text corpora.
– N-grams help in understanding the co-occurrence of words and their semantic relationships.

– Broder, Andrei Z., et al. ‘Syntactic clustering of the web.’ Computer Networks and ISDN Systems 29.8 (1997): 1157–1166.
– Alex Franz and Thorsten Brants. ‘All Our -gram are Belong to You.’ Google Research Blog. Archived from the original on 17 October 2006. Retrieved 16 December 2011.
– Christopher D. Manning and Hinrich Schütze. ‘Foundations of Statistical Natural Language Processing.’ MIT Press, 1999.
– Owen White, et al. ‘A quality control algorithm for DNA sequencing projects.’ Nucleic Acids Research 21.16 (1993): 3829–3838.
– Frederick J. Damerau. ‘Markov Models and Linguistic Theory.’ Mouton, The Hague, 1971.

Further Reading and External Links
– ‘Foundations of Statistical Natural Language Processing’ by Christopher D. Manning and Hinrich Schütze.
– ‘A quality control algorithm for DNA sequencing projects’ by Owen White, et al.
– ‘Markov Models and Linguistic Theory’ by Frederick J. Damerau.
– ‘Contextual Language Models For Ranking Answers To Natural Language Definition Questions’ by Alejandro Figueroa and John Atkinson.
– ‘Authorship Verification for Short Messages Using Stylometry’ by Marcelo Luiz Brocardo, et al.
Google Ngram Viewer: A tool to explore n-gram frequencies in Google Books.
– Ngram Extractor: A tool that provides the weight of n-grams based on their frequency.
– Googles Google Books -gram viewer and Web -grams database (September 2006): A database to explore n-gram frequencies.
– STATOPERATOR N-grams Project Weighted: A project that assigns weights to n-grams based on their frequency.

n-gram (Wikipedia)

An n-gram is a sequence of n adjacent symbols in particular order. The symbols may be n adjacent letters (including punctuation marks and blanks), syllables, or rarely whole words found in a language dataset; or adjacent phonemes extracted from a speech-recording dataset, or adjacent base pairs extracted from a genome. They are collected from a text corpus or speech corpus. If Latin numerical prefixes are used, then n-gram of size 1 is called a "unigram", size 2 a "bigram" (or, less commonly, a "digram") etc. If, instead of the Latin ones, the English cardinal numbers are furtherly used, then they are called "four-gram", "five-gram", etc. Similarly, using Greek numerical prefixes such as "monomer", "dimer", "trimer", "tetramer", "pentamer", etc., or English cardinal numbers, "one-mer", "two-mer", "three-mer", etc. are used in computational biology, for polymers or oligomers of a known size, called k-mers. When the items are words, n-grams may also be called shingles.

Six n-grams frequently found in titles of publications about Coronavirus disease 2019 (COVID-19), as of 7 May 2020

In the context of NLP, the use of n-grams allows bag-of-words models to capture information such as word order, which would not be possible in the traditional bag of words setting.

« Back to Glossary Index

Submit your RFP

We can't wait to read about your project. Use the form below to submit your RFP!

Gabrielle Buff
Gabrielle Buff

Just left us a 5 star review

Great customer service and was able to walk us through the various options available to us in a way that made sense. Would definitely recommend!

Stoute Web Solutions has been a valuable resource for our business. Their attention to detail, expertise, and willingness to help at a moment's notice make them an essential support system for us.

Paul and the team are very professional, courteous, and efficient. They always respond immediately even to my minute concerns. Also, their SEO consultation is superb. These are good people!

Paul Stoute & his team are top notch! You will not find a more honest, hard working group whose focus is the success of your business. If you’re ready to work with the best to create the best for your business, go Stoute Web Solutions; you’ll definitely be glad you did!

Wonderful people that understand our needs and make it happen!

Paul is the absolute best! Always there with solutions in high pressure situations. A steady hand; always there when needed; I would recommend Paul to anyone!

Vince Fogliani

The team over at Stoute web solutions set my business up with a fantastic new website, could not be happier

Steve Sacre

If You are looking for Website design & creativity look no further. Paul & his team are the epitome of excellence.Don't take my word just refer to my website "stevestours.net"that Stoute Web Solutions created.This should convince anyone that You have finally found Your perfect fit

Jamie Hill

Paul and the team at Stoute Web are amazing. They are super fast to answer questions. Super easy to work with, and knows their stuff. 10,000 stars.

Paul and the team from Stoute Web solutions are awesome to work with. They're super intuitive on what best suits your needs and the end product is even better. We will be using them exclusively for our web design and hosting.

Dean Eardley

Beautifully functional websites from professional, knowledgeable team.

Along with hosting most of my url's Paul's business has helped me with website development, graphic design and even a really cool back end database app! I highly recommend him as your 360 solution to making your business more visible in today's social media driven marketplace.

I hate dealing with domain/site hosts. After terrible service for over a decade from Dreamhost, I was desperate to find a new one. I was lucky enough to win...

Paul Stoute has been extremely helpful in helping me choose the best package to suite my needs. Any time I had a technical issue he was there to help me through it. Superb customer service at a great value. I would recommend his services to anyone that wants a hassle free and quality experience for their website needs.

Paul is the BEST! I am a current customer and happy to say he has never let me down. Always responds quickly and if he cant fix the issue right away, if available, he provides you a temporary work around while researching the correct fix! Thanks for being an honest and great company!!

Paul Stoute is absolutely wonderful. Paul always responds to my calls and emails right away. He is truly the backbone of my business. From my fantastic website to popping right up on Google when people search for me and designing my business cards, Paul has been there every step of the way. I would recommend this company to anyone.

I can't say enough great things about Green Tie Hosting. Paul was wonderful in helping me get my website up and running quickly. I have stayed with Green...