Python – Extracting Email Addresses from Text To extract email addresses from text, we can use regular expressions. In the following example, we use the regular expression package to define a pattern for email IDs and then use the findall()…
Python – Reformatting Paragraphs When processing large amounts of text and presenting them in a visually appealing format, we need to format our paragraphs. We might want to print only lines of a specific width, or perhaps increase the indentation…
Python – Replacing Words In text processing, replacing a string completely or partially is a frequent requirement. The replace() method returns a copy of a string where all occurrences of the old string are replaced with the new string, optionally…
Python – Token Segmentation In Python, tokenization is essentially breaking a larger text into smaller lines, words, or even tokens for non-English languages. The various tokenization functions built into the nltk module can be used in programs like the one…
Python – Text Translation With websites targeting international audiences, the need to translate text from one language to another is becoming increasingly common. The Python package that helps us do this is called “translate.” This package can be installed as…
Python – PDF Processing Python can read PDF files and extract text content from them for output. To do this, we must first install the required module, PyPDF2. Below are the commands to install this module. You should already have…
Python – Removing Stop Words Stop words are words such as the, he, and have that have no real meaning in an English sentence and can be ignored without affecting the meaning of the sentence. These words have been named…
Python – Chunking and Classification Classification-based chunking involves classifying text into groups of words rather than individual words. A simple scenario is tokenizing text into sentences. We will use a corpus to demonstrate classification. We have chosen the conll2000 corpus,…
Python – Part-of-Speech Tagging Tag is a fundamental feature of text processing, marking words into grammatical categories. We create tags for each word using word segmentation and the pos_tag function. import nltk text = nltk.word_tokenize("A Python is a serpent which…
Python – Chunks and Chinks Chunking is the process of grouping similar words together based on their properties. In the following example, we generate chunks by defining a grammar. The grammar suggests the order of phrases, such as nouns and…