Wednesday, October 1, 2014

My notes on week 1


A corpus is a methodology of language....If you have a theory of language, you may want to use a corpus to put it to test with your data....A corpus can be used in combination with other methodologies...

A corpus must be a large body of text representative of language or a genre of language.-- often annotated with additional linguistic information (grammatical codes)

Tony McEnery gives a brief overview of how corpus texts may be enriched with additional information to ease analysis. Note that this type of additional information may be called ‘mark up’, ‘annotation’, or ‘tagging’. All three terms are near synonyms. Annotation usually refers to linguistic information encoded in a corpus - however, the encoding is achieved using a mark-up language. Similarly, the annotation itself is usually undertaken by putting so called tags - short codes to indicate some linguistics feature - into a text. Hence, while the terms can be separated, they can also be used inter-changeably! One final note - an xml tag finishes with a forward slash rather than a back slash. XML stands for 'extensible markup language'. It tells the computer, basically, what belongs to your data, and what is the data about the data (metadata), e.g. date, time, author.

1. Specialised corpus a) genre-- language of newspapers b) time -- 2005 until today c)place-- texts published in China 2. General corpus-- much larger, millions of words.... BNC 3) Multilingual corpus..eg Spanish and English 4. Parallel corpus eg English and Spanish, exactly the same texts translated-- the CRATER corpus 5. Learner corpus --language use created by people learning a language-- the International Corpus of Learner English 6. Historical or diachronic corpus eg from 500 to 1500 AD 7. Monitor Corpus-- continually being added to eg The Bank of English developed by Birmingham university

How was the CRATER corpus (parallel corpus) compiled? Tony McEnery: It was compiled from data made available from the International Telecommunications Union (believe it or not!). There are lots of parallel and comparable corpora available now. See this news article, for example: http://cass.lancs.ac.uk/?p=1397

Frequency data, concordances and collocation Tony McEnery explores the value of frequency data in corpus linguistics and takes a first look at a key concept in corpus linguistics - collocation. This lecture mentions the idea of normalised frequencies per million. What are these? Imagine you have two corpora, one of two million words and another of three million words. You look in each for the word ‘dalek’ and find 20 examples in the first and 30 examples in the second. That does not mean that the word is more frequent in the second corpus - remember it is bigger. One way of the making this issue apparent, and making the numbers more comparable, is to normalise the frequencies. To normalise per million, you are in essence asking the question ‘if my corpus was only one million words, how many examples would I expect to find?’. Our first corpus is two million words - so to normalise the frequency of ‘dalek’ to one million words, we would divide by two, giving us 20/2=10. The second corpus is three times as large as one million, so to normalise per million we would divide the results from the second corpus by three giving 30/3=10. This shows clearly that we have no reason to claim that the word ‘dalek’ is more frequent in one of the corpora than the other. concordance--- key word in context

Corpora and Language teaching The effect has been profound and widespread.....TEXTBOOKS, DICTIONARIES, CLASSROOM EXERCISES, TESTS, LEARNER CORPORA

tHINGS THAT CAN'T BE DONE WITH CORPORA: 1. corpus data can't tell us if something is well-formed or possible 2. Generalisations are just deductions, not facts 3. corpora give evidence but no explanations 4. corpora give us language out of context-- no visual info, eg pictures, fonts... Tony in his talk pointed out the fact that almost all dictionaries in the UK produced / published at the moment are based on corpus data.... I wonder if there will be a time in the future when there will be the need to produce dictionaries not based on corpora, but on other methodologies, or even on intuition.....Just a thought :)

QUIZ What is a corpus? A theory of language. A collection of texts stored on a computer. An electronic database similar to a dictionary. Any large collection of words such as a collection of books, newspapers or magazines. What is the main reason for using corpora? Other methods of language analysis are not reliable. Computers can confirm our intuitions about language. Computers can help us discover interesting patterns in language which would be difficult to spot otherwise. With corpora we can answer all research questions about language. What is corpus annotation? Adding an extra layer of information to the text to allow for more sophisticated searches. Separating text into sentences. Manual coding of text for parts of speech. Adding critical comments to a text. What is a specialised corpus? A corpus that is used for historical language investigations. A corpus that is composed of a large variety of genres. A corpus that is used by language specialists. A corpus that focuses on e.g. one type of genre, one period, one place etc. Which of these is NOT a type of corpus? Multilingual corpus Learner corpus Diachronic corpus Observer corpus What is the BNC? A large general corpus of British English. A corpus of different genres of English writing. A large spoken corpus of British English. A specialised corpus representing the language of newspapers. Q7 Which of these statements is NOT true about a monitor corpus? It is frequently updated. The Bank of English is an example of a monitor corpus. The BNC is an example of a monitor corpus. It is used to monitor rapid change in language. What is a concordance? Information about word frequencies normalised per million words. Listing of examples of a word searched in a corpus with some context on the right and some context on the left. An alphabetical list of words that appear in a text. A list of words and their frequencies that can be used for identifying important words in a text. What is collocation? The tendency of speakers to talk over each other. The tendency of words to co-occur with one another. The tendency of words to appear in unique, different contexts each time. The tendency of sentences to create meaning. What is a frequency distribution in a corpus? Information about how frequent a word is in a corpus. Information about the frequency of use of a term across a number of different texts, corpus sections, speakers etc.__the answer Information about how frequent a word is per million words. Sociolinguistic information about the gender of the speakers that are represented in a corpus.

Brown and LOB These corpora are sometimes referred to as ‘snapshot’ corpora - their design is such that they try to represent a broad range of genres of published, professionally authored, English. Their goal is to capture the language at one moment in time, hence the term ‘snapshot’. Of course, as with any snapshot there are things you see and things you do not see. So, in this case, we are looking at professionally authored written English - not speech and not writing of a more informal variety. We are also only looking at certain genres. As with any snapshot, it was taken at a certain point of time in a certain place - Brown is America in the early 1960s, LOB is the UK in the early 1960s. Such corpora are often used to compare and contrast varieties of a language - in this case two varieties of English. They can also be looked at on their own to explore either variety of English in its own right. The Brown corpus is so named because it was developed at Brown University in the US. LOB is an acronym, standing for Lancaster-Oslo-Bergen, the three Universities that collaborated to build that corpus. Back to the snapshot metaphor! The two corpora can be compared because they are composed in the same way - the subject is the same, if you like. They look at broadly the same genres. Those genres are represented by similarly sized and numbers of chunks of data. Also, of course, the data was gathered in roughly the same time period. The genres covered in the two corpora are outlined below. Note the letter code for each genre - that is important, as it shows you which genre is associated with which file in the corpus. Following the letter code is a description of the type of data in the category, followed by two numbers in parentheses - the first is the number of chunks of data in that category in Brown, the second is the number of chunks of data in that category in LOB. There are five hundred chunks of data in each corpus. Each chunk is approximately 2,000 words in size, giving a rough overall corpus size of 1,000,000 words each. A Press: reportage (44, 44) B Press: editorial (27, 27) C Press: reviews (17, 17) D Religion (17, 17) E Skills, trades and hobbies (36, 38) F Popular lore (48, 44) G Belles lettres, biography, essays (75, 77) H Miscellaneous (documents, reports, etc.) (30, 30) J Learned and scientific writings (80, 80) K General fiction (29, 29) L Mystery and detective fiction (24, 24) M Science fiction (6, 6) N Adventure and western fiction (29, 29) P Romance and love story (29, 29) R Humour (9, 9)

No comments:

Post a Comment