NLP Notes: Difference between revisions

From Adam Colton
Jump to navigation Jump to search
No edit summary
Line 3: Line 3:
==Basic Text Processing==
==Basic Text Processing==
===Regular Expressions===
===Regular Expressions===
A formal language for specifying text strings. We will be using [[http://regexpal.com/]]
*Disjunctions - square brackets or pipe
*Negation - ^ right after bracket
*? - previous character is optional
* * 0 or more
* + 1 or more
* . any single character
* ^begin of line
* $end of line
* \ for escaping
False Postiives - Type I errors and False Negatives Type II errors.
===Regular Expressions in Practical NLP===
===Regular Expressions in Practical NLP===
===Word Tokenization===
===Word Tokenization===

Revision as of 02:57, 21 March 2012

Lectures

Basic Text Processing

Regular Expressions

A formal language for specifying text strings. We will be using [[1]]

  • Disjunctions - square brackets or pipe
  • Negation - ^ right after bracket
  • ? - previous character is optional
  • * 0 or more
  • + 1 or more
  • . any single character
  • ^begin of line
  • $end of line
  • \ for escaping

False Postiives - Type I errors and False Negatives Type II errors.

Regular Expressions in Practical NLP

Word Tokenization

Word Normalization and Stemming

Sentence Segmentation