This content was uploaded by our users and we assume good faith they have the permission to share this book. If you own the copyright to this book and it is wrongfully on our website, we offer a simple DMCA procedure to remove your content from our site. Start by pressing the button below!
Noizean behin itsaso aldetik Donostiako Ondarreta hondartzara enbata iristen da.
<w id='w1' sameAs='Xw1' type=‘BEG_CAP'>Noizean <w id='w2' sameAs='Xw2'>behin <w id='w3' sameAs='Xw3'>itsaso <w id='w4' sameAs='Xw4'>aldetik <w id='w5' sameAs='Xw5' type=‘BEG_CAP'>Donostiako <w id='w6' sameAs='Xw6' type=‘BEG_CAP'>Ondarreta <w id='w7' sameAs='Xw7'>hondartzara <w id='w8' sameAs='Xw8'>enbata <w id='w9' sameAs='Xw9'>iristen <w id='w10' sameAs='Xw10'>da <w id='w11' sameAs='Xw11' type='PUNCT_FSTOP'>.
Morphosyntactic Analysis
.lem.xml ...
...
.lemlnk.xml
EUSLEM
Chunker
Dependencies
.sint.xml
dep.xml
...
.sintlnk.xml
...
Deplnk.xml
Figure3: Output of the different tools coded in XML.
Figure 3: Output of the different tools coded in XML
Deplib.xml
The construction of EPEC 8.
13
Future work
The lexical information gathered in the lexical database (EDBL), which is the basis for several NLP tools in our research group, is constantly being renewed. New entries from diverse sources are periodically added to the database. Moreover, new tools such as multiword units, named entities, or postposition recognisers have been developed. These changes must be reflected in the corpus, so we must review it regularly. Therefore, in the near future, we intend to update EPEC with new information. This will be done semiautomatically, so that only the new information needs to be reviewed. 9.
Acknowledgements
This research is supported by the University of the Basque Country (9/UPV00141.226-14601/2002), the Ministry of Industry of the Basque Government (project XUXENG, OD02UN52), the Interministerial Commission for Science and Technology of the Spanish Government (FIT-150500-2002-244), and the European Community (MEANING project, IST-2001-34460). Notes 1
The concept of dependency-syntax has a long tradition in grammatical analyses since the Greco-Roman era. More recently, within the application of formalisms to syntactic theory, among others we find Tèsniere (1959), Hays (1964) and Mel’cuk (1988), the ones who have recovered dependency-syntax in theoretical terms.
2
This ambiguity was estimated taking into account the syntactic functions of a subset of 200 common words.
3
Finite auxiliary verb, non-finite auxiliary, finite main verb, non-finite main verb…
4
In this research line, our group is taking part in the project entitled “The IXA group, tools for an automatic treatment of Basque: creating a database composed of syntactic-semantic trees” (See ‘acknowledgments’)
5
nczobj would be equivalent to the English nciobj (non-clausal indirect object).
References Aduriz I., Agirre E., Aldezabal I., Alegria I., Ansa O., Arregi X., Arriola J.M., Artola X., Díaz de Ilarraza A., Ezeiza N., Gojenola K., Maritxalar A., Maritxalar M., Oronoz M., Sarasola K., Soroa A., Urizar R., Urkia M.
14
Aduriz et al.
(1998), A Framework for the Automatic Processing of Basque. Proceedings of the First International Conference on Language Resources and Evaluation, Granada. Aduriz I., Aldezabal I., Aranzabe M., Arrieta B., Arriola J., Atutxa A., Díaz de Ilarraza A., Gojenola K., Oronoz M., Sarasola K. (2002), Construcción de un corpus etiquetado sintácticamente para el euskera. Actas del XVIII Congreso de la SEPLN, Valladolid, Spain. Aldezabal I., Ansa O., Arrieta B., Artola X., Ezeiza A., Hernández G., Lersundi M. (2001), EDBL: a General Lexical Basis for the Automatic Processing of Basque. IRCS Workshop on Linguistic Databases, Philadelphia (USA). Alegria I., Aranzabe M., Ezeiza A., Ezeiza N., Urizar R. (2002) Robustness and customisation in an analyser/lemmatiser for Basque. Proceedings of Workshop on "Customizing knowledge in NLP applications ". Third International Conference on Language Resources and Evaluation, Las Palmas de Gran Canaria (Spain). Armstrong S., Russell G., Petitpierre D., Robert G. (1995) An Open Architecture for Multilingual Text Processing. Proceedings of the 7th Conference of the European Chapter of the Association for Computational Linguistics, Dublin, Ireland, pp. 101-106. Artola X., Díaz de Ilarraza A., Ezeiza N., Gojenola K., Hernández G., Soroa A. (2002) A Class Library for the Integration of NLP Tools: Definition and implementation of an Abstract Data Type Collection for the manipulation of SGML documents in a context of stand-off linguistic annotation. Proceedings of the Third International Conference on Language Resources and Evaluation, Las Palmas de G 1 ran Canaria, Spain. Carroll J., Briscoe T., Sanfilippo A. (1998) Parser evaluation: a survey and a new proposal. Proceedings of the International Conference on Language Resources and Evaluation, Granada, Spain, pp. 447-454. Carroll J., Minnen G., Briscoe T. (1999) Corpus Annotation for Parser Evaluation. Proceedings of Workshop on Linguistically Interpreted Corpora, EACL´99, Bergen. Church K. W. (1998) A Stochastic Parts Program and Noun Phrase Parser for Unrestricted Text. Proceedings of the Second Conference on Applied Natural Language Processing, Québec, Canada, pp. 136-143. Civit M., Martí M. (2002) Design Principles for a Spanish Treebank. Proceedings of the Treebanks and Linguistic Theories (TLT2002), Sozopol, Bulgaria. Cutting D., Kupiec J., Pederson J., Sibun P. (1992) A Practical Part-of-speech Tagger. Proceedings of the Third Conference on Applied Natural Language Processing, Philadelphia, USA, pp. 133-140. Ezeiza, N. (2003) Corpusak ustiatzeko tresna linguistikoak. Euskararen etiketatzaile sintaktiko sendo eta malgua. PhD thesis, University of the Basque Country. Hays D. C. (1964) Dependency theory: a formalism and some observations. Language 40, pp. 511-525.
The construction of EPEC
15
Karlsson F., Voutilainen A., Heikkila J., Anttila A. (1995) Constraint Grammar: Language-independent System for Parsing Unrestricted Text. Mouton de Gruyter, Berlin. Koskenniemi K. (1983) Two-level Morphology: A general Computational Model for Word-Form Recognition and Production. University of Helsinki, Department of General Linguistics. Publications 11. Mel’cuk I. (1988) A Dependency Syntax: Theory and Practice. State University of New York Press. Oflazer K., Zeynep D., Tür H., Tür G. (1999) Design for a Turkish treebank. Proceedings of Workshop on Linguistically Interpreted Corpora, at EACL, Bergen. Sarasola K. (2000) Strategic priorities for the development of language technology in minority languages. Proceedings of Workshop on "Developing language resources for minority languages: re-usability and strategic priorities". Second International Conference on Language Resources and Evaluation, Athens, Greece. Skut W., Krenn B., Brants T., Uszkoreit H. (1997) An Annotation Scheme for Free Word Order Languages. Fifth Conference on Applied Natural Language Processing, Washington, DC, USA, pp. 88-95. Tapanainen P., Voutilainen A. (1994) Tagging Accurately-Don´t guess if you know. Proceedings of the 4th Conference on Applied Natural Language Processing, Washington. Tesnière L. (1959) Eléments de Syntaxe Structurale, (2nd ed.) Paris, Klincksieck. Voutilainen A., Järvinen T. (1995) Specifying a shallow grammatical representation for grammatical purposes. Proceedings of the 7th Conference of European Association of Computational Linguistics, Dublin.
This page intentionally left blank
The mood of the (financial) markets: In a corpus of words and of pictures Khurshid Ahmad, David Cheng, Tugba Taskaya, Saif Ahmad, Lee Gillam, Pensiri Manomaisupat, Hayssam Traboulsi and Andrew Hippisley Department of Computing, University of Surrey Abstract Corpora of texts are used typically to study the structure and function of language. The distribution of various linguistic units, comprising texts in a corpus are used to make and test hypotheses relevant to different linguistic levels of description. News reports and editorials have been used extensively to populate corpora for studying language, for making dictionaries and for writing grammar books. News reports of financial markets are generally accompanied by time-indexed series of values of shares, currencies and so on, reflecting the change in value over a period of time. A corpus linguistic method for extracting sentiment indicators, e.g. shares going up or a currency falling down, is presented together with a technique for correlating the quantitative time-series of values with a time series of sentiment indicators. The correlation may be used in the analysis of the movement of shares, currencies and other financial instruments.
1.
Introduction
Financial markets are places where financial instruments are bought and sold. These instruments include shares, currencies, bonds: there are shares traded for individual organisations and traders take options – slang bet – on the aggregate value of key shares e.g. Financial Times Stock Exchange (FTSE). Some of these instruments are traded in millions, others in thousands and yet others in hundreds: the prices of instruments change frequently during single trading or over a longer trading horizon. A set of buying / selling prices of instruments, ordered in time, is usually referred to as a (quantitative) time series. In the financial pages of newspapers, and now on specialised web sites, these time series are either displayed independently or as graphical illustrations within (long) texts. The buying and selling of instruments in itself causes changes in their value: too many buyers for a share and its value goes up, too many sellers and the value goes down. The so-called efficient market hypothesis (EMH) suggests that the (trading in a) financial market is the sole arbiter of the price of an instrument. Despite the preponderance of the EMH, newspapers and financial web sites regularly report the reactions of individuals, acting on their own or on behalf of organisations or governments: some web sites display results of polls of financial experts. The experts report whether they are either ‘bearish’ – or shy to buy or
18
Ahmad et al.
sell, or ‘bullish’ – too eager / aggressive to buy or sell, and indeed some of them are neutral. These polls are conducted at regular intervals and the sentiments of experts are displayed as a time series. And then there are some who ‘correlate’ the time series comprising the bearish / bullish / neutral voting figures with the time series of financial instruments. The correlation is then used as a cipher for buying or disposing of an instrument. The sentiment of the market traders – or market sentiment for short – is shaped by, and in turn shapes, the value of a financial instrument usually in the short term and perhaps in the long term as well. Much as the sentiment of a trader influences others, others also influence him. The view of the others is typically communicated through press statements. One can argue that (financial) news stories may affect the trader’s sentiment, or more precisely, his or her attitude towards an instrument. Ergo, positive news stories may persuade people to invest in the market thereby driving the prices of instruments up: conversely negative or gloomy stories force prices down. Note that the physical prepositions (up/down) used to describe the position/location of a physical object, are also used to describe the change in value of an abstract financial instrument during a fixed time period. News stories and people’s conversation about the financial markets extend these spatial metaphors further by talking in terms of state change – one sees a change in the value of an instrument in terms of rising or falling. The use of literary allusions, including bear/bull, vibrant/anaemic, and more colourful slang, including the phrase dead cat bounce, to describe that the upward movement of stock is much like a lifeless object merely moving because of the laws of gravity, shows a creative use of language in the specialist field of financial trading (Ahmad 2002). The sentiment of a trader toward the market may change by reading a news story in that bullish stories may cheer him or her up, and bearish stories may depress him or her and in turn depress the market (Knowles 1996). We wish to explore whether it is possible to extract the sentiment from a news story through linguistic analysis. It is possible to use the literature on buying/selling in semantic theory (Jackendoff 1991) as a framework for analysing the meaning of the news stories. The literature on natural language processing (Simmons et al 1984) and on knowledge representation suggests that frame semantics has been used to build systems that can, in principle, analyse, extract and disseminate the meaning (intent?) of a specialist news report. Frame semantics has a number of limitations, and a prominent one is the need for a lexicon that is rich and extensive in terms of meaningful data. What about a purely lexical approach? Recall, Quirk et al.’s (1985) observation that relates frequency of a lexical item to the acceptability of that item by an
The mood of the (financial) markets
19
educated-native speaker of the language. Stretching this dictum to financial markets, one can argue that higher frequency of phrases that express positive sentiment suggests that all is well in the market. Similarly, a predominance of negative phrases might suggest that all is not well in the market and that it may have fallen or is about to fall. We have analysed three year’s output of Reuters financial news comprising over 10 millions tokens published during 2000-2002.
1.1 rose fell 1
FTSE 100
0.9
Normalised Value
0.8
0.7
0.6
0.5
0.4
0.3
0.2 Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Month
Figure 1: Monthly variation of “rose”, “fell” and FTSE 100 Figure 1 shows the variation in the frequency of two verbs rose and fell over a one-year period (Ahmad et al. 2002). Also plotted is the value of FTSE-100 at the close of daily trading during 2002. There appears to be an encouraging numerical correlation amongst the sentiment verbs and FTSE-100. One further exploration of the above hypothesis that sentiment may correlate with frequency of phrases that may express positive and negative sentiment used to describe changes in the value of an instrument, requires an understanding of the following: How do we analyse texts such that frequent phrases hypothetically related to a sentiment are indeed used in a sentence or in many sentences to express the
Ahmad et al.
20
sentiment? The ambiguity of language does play a significant part in confusing the sense of these phrases, for example, rose, as in something rising, with that of a flower or indeed the name of a person. We show how simple cues related to the grammatical categories of phrases in the neighbourhood of the potential sentiment laden word ensure that the word rise quite x suggests that the value of a financial instrument is rising. How do we use the time series of sentiment word frequency in conjunction with the time series of the values of an instrument either to predict stability or chaos in the market, or to discover the ‘turning point’ in the value of an instrument? The turning point is the point in time when the value of the instrument stops decreasing and starts to increase or vice versa. How do we organise texts in a diachronic corpus such that these texts may be added or omitted according to the pragmatic attributes of the texts? This is important if the market movements and sentiment analysis are required for a specific instrument (e.g. US$, Euro, BT stocks, FTSE derivative) traded in a certain country or group of countries. 2.
Sentiment words and their frequency
2.1
A note on up-and-down phrases
Amongst the many different phrases chosen to describe the changes in the actual or potential values of financial instruments the phrases up, down, rise and fell have an intuitive prominence. Other related phrases and synonyms are also used: growth, slump, jump and drop are good examples. The British National Corpus (BNC) shows the preponderance in the general language of these up-and-down phrases: Table 1: BNC frequencies obtained from the on-line version of the corpus; for rose and fell we restricted the query to verbs only (NBNC = 100,106,008) Token
fBNC
Token
fBNC
up growth rose
207709 12794 5566
Down Fell Slump
92285 9563 632
The BNC shows that there is more ‘positive’ sentiment in the corpus than, say, the ‘negative’. However a much more detailed analysis is required before any serious conclusion can be drawn from these literally raw figures. A similar analysis of financial news texts shows the dominance of the phrases up and down but with a somewhat different distribution of the other four phrases. Consider a
The mood of the (financial) markets
21
sample from Reuters UK-financial News for the month of November 2002 (comprising 400,000 or so tokens): Table 2: Frequencies of ‘positive’ and ‘negative’ sentiment phrases based on Reuters UK-financial News November 2002. This is an untagged sample and homographic conflicts (e.g. rose as noun or verb) have not been resolved (NReuters=402089) Token
fReuters
Token
fReuters
up growth rose
1435 650 424
down fell slump
716 391 73
The rank order of the three ‘positive’ sentiment phrases and that of the ‘negative’ sentiments is preserved when the register changes from the BNC – a corpus which largely comprises general language texts (c. 62% texts are drawn from fiction, leisure, world affairs, the arts, belief and thought) – to the specialist financial news which wholly comprises, what the BNC compilers would call, commerce and finance texts (the BNC has just under 8% of such texts in its composition). However, the relative distribution of the different phrases within the ‘positive’ and ‘negative’ sentiment categories is substantially different: Table 3: Relative distribution of “positive” and “negative” sentiment phrases across BNC and Reuters UK-financial News November 2002. Token
fBNC
Up growth Rose Total
207709 12794 5566 Positive =226069 N BNC
fBNC / 91.8 5.66 2.46 100%
Positive N BNC
fReuters 1435 650 424 Positive N Re uters = 2509
fReuters /
Positive N BNC
57.2 25.9 16.9 100%
The predominance of up and down is reduced by about one-third and the more domain-specific growth and rose increase dramatically when we change the register from general language to special language: from 6% in the BNC to about 26% in Reuters for growth and from under 3% to about 17% for rose. Similar results can be obtained for negative sentiment words. Financial journalists typically express rise and fall in percentage terms: this perhaps gives their story a quantitative and objective look and feel. A concordance of Reuters UK-financial News (November 2002) containing the phrases rose shows a varied usage of the pattern:
Ahmad et al.
22
º ª » « by » X percent rose « «only/nearly» » « to ¼ ¬
Some examples of these patterns include: enterprise shares Volatile mortgage payments , home loan repayments , 152 pence, logica Property companies -last week house prices
rose rose rose rose rose rose
2.83 by 0.1 to 2.3 over eight nearly seven only 1.4
percent percent percent percent percent percent
to 584 pence in on the month to in the year to and cmg climbed 6 to 1,235 last month - -
A further analysis of the stories published by Reuters, under the UK-financial rubric throughout the calendar year 2002, shows that not all the above patterns are used as frequently and that one pattern, rose X percent, tends to dominate – or, in other words was used preferentially by the journalists in the year 2002. Table 4: Variations of sentiment rose across year 2002, where fx denotes the raw frequency of the phrases Patterns frose X% by X % to X % over X % Nearly X % by over X % only X % frose [phrase] % Proportion of rose [phase] %
Jan 417 58.0% 2.2%
Feb 369 52.0% 7.0% 4.1%
0.5% 0.3%
284
238
Mar 245 49.4% 0.8% 1.6% 0.8%
Apr 263 58.2% 1.1% 1.5%
0.4%
143
174
May 376 57.4% 1.9% 1.6% 0.8%
Jun 245 53.1% 1.6%
Jul 427 50.1% 1.9%
0.4%
1.4%
0.3%
0.4%
0.5%
0.3%
149
0.2% 254
0.6% 217
238
Aug 351 51.3% 2.8% 0.3%
Sep 357 44.8% 3.6% 0.3% 0.6%
0.3% 190
Oct 342 59.4% 2.9% 2.3% 0.6%
Nov 424 50.7% 3.8% 2.8% 1.4%
0.6%
0.7%
0.0% 0.0% 236
0.2% 0.7% 256
Dec 231 63.6% 3.5% 0.4%
175
68.1% 64.5% 58.4% 66.2% 63.3% 60.8% 59.5% 61.8% 53.2% 69.0% 60.4% 75.8%
For example, in January 2002, of all the patterns rose [phrase] X percent, over 58% were rose X percent, followed by 2.2% comprising rose by X percent and just under 1% comprising rose over X percent. During the year 2002, the frequency of pattern rose by X % was above 50% for all months except March and September where it was 49.4 % and 44.8 % respectively (the average value was 54%). Table 4 shows the monthly variation in the various patterns comprising the verb rose. The rise/fall and up/down metaphor may be expressed through other related words and through synonyms. Textbooks on ‘report writing’ suggest that without
The mood of the (financial) markets
23
losing accuracy, one may use related words/synonyms instead of repeating the same words. Indeed, slump instead of fall, and jump/climb instead of rise appear to be good candidates for not only improving writing style but also may make the news report more sensational. We looked into Roget’s Thesaurus (1980) and the WorldNet online to find related words/synonyms for the rise/fall we have discovered in Tables 2 – 4 thus far. It appears that the frequency of the related words/synonyms is much lower (Table 5). Table 5: Related words/synonym sets of rise and fall
3.
Lemma fall, inc. fell, falling
fReuters 875
rise, inc. rose, rising, risen
1004
Related words/Synonyms drop slump strike jump climb lift
fReuters 155 69 53 133 75 33
Sentiments and lexico-grammatical patterns?
The domination of one word form over others with related meanings shows perhaps the precision, which came from a lack of imagination some would argue, in the language of financial journalists. This is good news for people interested in information extraction – a branch of computing dedicated to the extraction of meaning from natural language text. The initial results related to the preponderance of one word form over others (Table 5) together with a preponderant lexico-grammatical pattern in which the word form is found (Table 4), suggests to us that when the word forms rise and fall, or rather rose and fell, are used, especially followed by a number and ‘percentage’, then they indicate an upward or downward movement in the value of some part of the financial market – this being true of shares, aggregate share index of one business section (cf. Property companies, telecommunications) and house prices. This still could be an ambiguity though: the report telling us that ‘mortgage defaulters fell by X percent’ is bad news except if you are in the debt collection business. Zellig Harris and his pupil Maurice Gross (1991) have been keen to suggest that in certain types of text one may find local grammars in operation: certain phrase structures that occur more frequently in one type of text, or one set of text fragments than in the language as a whole. Harris illustrated this point by citing examples of recursive noun-phrases used in biochemical literature to either refer to complex biochemical compounds or complex biochemical processes. Gross (1993) focussed on how we specify time and date and showed cardinal numbers used to denote time and calendrical expressions (day / month / year, century) embedded in their own local grammar. Barnbrook and Sinclair have used this notion to argue that dictionary definitions are also written in a local grammar (1993). Local grammars and the Hallidayan term ‘lexico-grammatical’ patterns
24
Ahmad et al.
have a certain resonance, and this we have used to explore the grammatical environment of market-sentiment indicating words. The sentences comprising rose and fell embedded in the patterns shown in Table 4 were analysed using a reliable part-of-speech tagger – CLAWS. The local grammar of the two-sentiment indicators rose/fell comprises these patterns (also see):
VVD
° ° ® ° ° ¯
Ø
PRP
½ ° ° ¾ ° ° ¿
AV0 AVP DT0
CRD
NN0
VVD
AV0
^
DT0
`
CRD
VVD
PRP
^
AT0
`
CRD
NN0 NN0
Here VVD = verb; CRD = cardinal; NN0 = numeral; DT0 = determiner; AV0 = adverb; AVP = adverb particle; PRP = preposition. Table 6: Grammatical properties of the lexico-grammatical patterns Pattern rose X % rose by X % rose to X % rose over X % rose nearly X % rose by over X % rose only X %
4.
Grammar VVD CRD NN0 VVD PRP CRD NN0 VVD PRP CRD NN0 VVD AV0 CRD NN0 VVD AV0 CRD NN0 VVD AVP AV0 CRD NN0 VVD AV0 CRD NN0
“Virtual Corpora”
The designers of individual corpora have discussed the organisation of the text files within a corpus. The early corpora divided texts into informative/imaginative types (cf. Lancaster-Oslo Bergen and Brown Corpora, c.1960s), the texts were then divided into genre, topic and other pragmatic attributes. The subsequent ones took two different approaches: first, genre-based classification was used by some, where texts were classified into books, magazines, personal correspondence and so on (cf. Collins-COBUILD, c.197080s); second, topic-based classification was used by the designers of LancasterLongman corpus (c.1980s) wherein texts were divided into subject topics (science, world-affairs, news and so on). The other pragmatic attributes were included as well. The LOB and Brown corpora were developed for the study of
The mood of the (financial) markets
25
(English) language in general and the Collins-CoBuild and Longman-Lancaster for lexicographical purposes. The more ambitious British National Corpus extended the list of pragmatic attributes, and perhaps made the attributes more explicit. The texts can be selected for analysis through a complex query language or by selecting the texts from a file store. For us, there is a hierarchical structure that drives the design of a given text corpus. The selection of the top-level features drives the selection of the other features – these are “doable” tasks if you know the organisation of the corpus you are using. The user of the computerbased corpus must know how the corpus is structured and what is more desirable is the use of ‘logical’ (attribute-oriented) features of the text. The organisation of a corpus of news reports suggests that sometimes there would be a need to analyse the corpus diachronically, focusing on a given individual/organisation, financial instrument, and at other times there is a need to conduct a synchronic analysis, for example, the analysis of news about all organisations within a given industry sector or all members of a political party. The analysis may be required based on a query comprising (a number of) keyword(s) that may be used in the indexation of a set of news reports. The permutations of the pragmatic and lexical attributes of a given text are numerous. It is possible that individual users of a text corpus may like to organise the texts according to their own needs. In order to have a user-configurable corpus, the notion of a virtual corpus was introduced (Holmes et al. 1994) for analysing technical and scientific texts. The notion of virtual corpus is similar to that of a virtual machine: there is in reality only one corpus, but the users can arrange the text attributes in a hierarchy of their choice based on a physically extant set of texts, for the duration of their use. This configurable hierarchy will have to be made available through the agency of a program, within a suite of corpus management programs, for producing this virtual corpus. The notion of virtual corpus introduces a shift from the usual pre-defined and explicit corpus hierarchical approach, in that it allows the definition of virtual hierarchies. Texts can then be retrieved by navigating through an organisation – the virtual hierarchy – specified by the user. We have designed a corpus for use in the automatic extraction of financial information from newspaper texts. The principal source of this corpus are the Reuters News Agency texts – in NewsML format , which is an extension to XML for enriching news stories, conceived by Reuters, developed and ratified by the International Press and Telecommunications Council (IPTC). Atkins, Clear and Ostler (1992) discussed criteria for corpus design. Based on this, and with attributes available in NewsML, news can be organized using the six major (pragmatic) attributes shown in Table 7 below.
Ahmad et al.
26
Table 7: Pragmatic attributes used for organising NewsML texts Publisher
Name; Place of Publication; Source of Publication; Date of Publication; Date of Origination
Availability
Copyright Status; Copyright Duration; Copyright Owner; Usage Restriction
Text
Title/Headline; Dateline; Text Type(book, newspaper, journal, etc), Text Mode (written, spoken?), Text Entry (electronic, transcribed?)
Language
Language Name; Regional Variant
Author
Byline; Reporter Nationality; First Language; Editor
Category
Industry Code; Topic Code
From the above set of pragmatic attributes, a news database management system, Virtual Corpus Manager (VCM) was developed at Surrey. VCM can be used to organise texts; to share and retrieve texts; to navigate through (content of) the corpus and to impose integrity and security checks on texts. We have used six different types of constraints. Each constraint allows the user to choose one set of inter-related attributes at a time. For example, the users can choose as many major attributes and for each attribute can choose the sub-attributes. One example in the use of VCM is selecting UK-specific financial texts from Reuters daily news stream for a given year. 5.
Visualising the mood of the market
Time series analysis is one of the established and persuasive branches of statistics. This analysis is used extensively for analysing ‘a sequence of data indexed by time, often comprising uniformly spaced observations’ in science, engineering, economics, commerce, biology and in almost every subject. Financial news reports are usually illustrated with a time series of the instrument that is being reported: the share price of a company at the opening or closing of a day’s trading plotted over a financial (calendar) year shows the perception of the traders of the financial health (another metaphor) of the company. There are time series, which include both opening/closing and day’s highs/lows – the Japanese candlestick patterns as they are called in the trade. There are time series of the geometric mean of major organisations whose shares are traded in the market – FTSE-100 share index is the geometric mean of the share prices of 100 leading organisations at the close of daily trading, and there is FTSE index, which is the geometric mean of all-shares traded in the London Stock Exchange at the close of trading. We similarly have DAX-30 for Germany and CAX-100 for France, and there is Dow-Jones Industrial Average (DJIA) in the USA. Financial traders, having sought opinion from statisticians, tend not to deal with the ‘raw’ data value, but use other statistical measures related to the value of the instrument(s): typically used indices are those of volatility – a measure based on the standard deviation of closing price from its average value in
The mood of the (financial) markets
27
the past few days/hours/minutes; the moving average; and return value, which is the (logarithmic) difference between the value of the instrument at time t-1 and at time t. The use of other statistical measures of the quantitative changes in the value of instrument(s) are important for us as we try to attempt to incorporate the use of sentiment indicators – or rather changes in sentiment – in an overall financial analysis framework. One such attempt has involved helping the traders to correlate the quantitative signal, either in its raw form or the derived forms (return and volatility measures), with the movement of sentiment indicating phrases. The traders typically use two sophisticated computer systems almost simultaneously during a trading session: one screen dedicated to the value of financial instruments, sometimes resolved at 50 values per minute, and the other screen dedicated to news streams supplied by Reuters, Bloomberg and others. A typical trader looks from one to the other and then makes his or her decision. This, rather simplistic view of financial trading has led to the development of SATISFI – which can simultaneously display, or help to visualise the news, the value of an instrument, and the changes in the frequency of sentiment indicators. Table 8 and Table 9 below show the two most frequent sentiment words used in generating the positive and negative sentiment time series respectively. Table 8: Dominant Sentiment words rose and up
Rose Up Total
Jan 87.80 117.48 205.28
Feb 79.81 135.81 215.62
Rose Up Total
Jul 63.27 99.89 163.16
Aug 86.09 134.09 220.18
Relative Frequency (10-5) Mar Apr May 57.94 64.51 85.39 109.40 88.97 96.87 167.34 153.48 182.26 Relative Frequency (10-5) Sep Oct Nov 58.28 62.26 63.67 96.92 94.71 99.98 155.2 156.97 163.65
Jun 58.41 69.78 128.19 Dec 67.25 80.70 147.95
Table 9: Dominant Sentiment words fell and down
Fell Down Total
Jan 62.45 84.09 146.54
Feb 88.53 100.94 189.47
Fell Down Total
Jul 63.02 91.92 154.94
Aug 75.38 87.28 162.66
Relative Frequency (10-5) Mar Apr May 69.28 27.06 68.89 68.88 74.89 61.71 138.16 101.95 130.6 Relative Frequency (10-5) Sep Oct Nov 51.53 48.81 51.73 101.22 81.78 67.65 152.75 130.59 119.38
Jun 69.78 92.51 162.29 Dec 68.40 85.31 153.71
28
Ahmad et al.
Figure 2: SATISFI prototype shown with one-year FTSE index based on monthly data with upward and downward movement indicator series SATISFI has four major components that have been fully integrated as shown in figure 2. i) Time Series Display: SATISFI can display three time series at a time. These time series comprise of FTSE-100 close index values, upward movement indicators and downward movement indicators. As discussed above, upward and downward movement indicators are the quantification of the market sentiment expressed in financial news. Over 70 terms each have been identified for conveying ‘good’ and ‘bad’ news. For example upward movement indicators would contain terms like ‘up, rise, growth’ etc. while downward movement indicators would contain terms like ‘down, fall’ etc. The movement indicator time series are synthesized by counting these movement indicator terms within the financial news published for a particular day. Each time series is normalised for proper display purposes. SATISFI is capable of displaying the above time series in three forms: (1) Raw form denotes the original time series. (2) Return form refers to the logarithmic difference between two consecutive values. (3) Volatility (historical volatility) is the relative rate at which the time series moves up or down. ii) Time Series Correlation: Correlation is a measure of the degree of linear relationship between two time series. SATISFI provides the
The mood of the (financial) markets
29
user the facility of cross-correlating two series in any form (raw, return, volatility). Any series can be shifted forward or backward and the cross correlation recalculated to determine whether the market is followed by the news or vice versa. iii) Document Display: This is comprised of two parts: (1) Document Titles: Clicking a dot (date) on any of the time series displays the corresponding date’s news titles. (2) Document Content: The content of any document title can be viewed by clicking that news title. iv) Document Analysis: Whenever a document title is selected from the news list, the extracted sentiment keywords along with the frequencies are displayed in “Document Keywords” area. Positive sentiment keyword analysis details appear under the title “Upward Movement Indicators” and negative sentiment keyword analysis details appear under the title “Downward Movement Indicators”. 6.
Finding ‘meaningful’ patterns
6.1
A case study: Movements in 2002
The year 2002 has seen its ups and downs like many other years and the movements in financial markets worldwide have been in the downward direction. Or, at least, the geometric mean of the value of the shares of the major corporations in North America, Japan, and the European Union, with some exceptions, has reduced substantially. The UK FTSE-100 shows mainly downward movements interspersed with small periods of upward movements, which unfortunately, could not compensate for the previous reduction in the value of the index. In time-series analysis literature one finds techniques that tend to separate the so-called trends from cyclical movements in the series: the cyclical movements may be due to factors like holidays, trading patterns that may be seasonal and so on (Tino et al. 2001). The trends, it is claimed, show a change that is caused because the basic structure of the market has changed. Techniques like fractal analysis and the related chaotic systems methods help in disentangling the trends from the cycles. Another related and robust technique is the wavelet analysis (Rioul et al. 1991): a wave comprises oscillations of a number of different frequencies and trends and wavelet analysis suggests ways in which these could be disentangled. We have used wavelet analysis on the FTSE-100 data for 2002 together with the time series of upward and downward indicating phrases, in Reuters Financial News for the same year. Figure 3a shows the raw figures for the daily trading data for the FTSE-100. Figure 3b shows the longterm trend in the time series (downwards) while figure 3c shows the short-term trend and hence some cyclical behaviour. Note the turning points in the cyclical data (marked by arrows in figure 3c). There is, as noted earlier, a considerable
30
Ahmad et al.
interest in identifying these turning points. The system SATISFI is being extended to generate a textual description of the turning points. Figure 33a shows a time series of the frequency of a number of upward movement indicators, including rise, growth and other less frequent phrases indicating upward movement. There is a corresponding long-term decay in the time-series of upward movement indicators (figure 33b) as found in the raw FTSE-100 data (figure 3b). The cyclical movements are much more pronounced (figure 33c) but a comparison with eye suggests that there is a similar pattern in figure 33c as in figure 3c. The downward movement indicators show that for the first six-months or so of 2002 the frequency of downwards indicators increases rapidly but shows a decay in the latter half of 2002 (figure 33b). The sentiment indicating time-series has to be refined and much more work is required before we may use it to predict the actual mood of the market. However, our approach is perhaps amongst the first of the explorations, which investigate how the quantitative movements in a financial market are influenced by the news stories, some influencing the market and others showing the influence of the market. Afterword We have attempted to build a system from various linguistic, visual and mathematical components that allows us to explore the behaviour of the traders, and to attempt to model this behaviour. The purpose of the system is to assist the trader by reducing the amount of textual and numeric data that the trader needs to assimilate to form a view of the market. In terms of corpus linguistics, the analysis of qualitative data available in collections of news texts organised by descriptive metadata (through XML and Reuters codes), combined with text processing techniques to determine key patterns, proper-noun analysis to determine key entities and the use of terminology collections for reducing the understanding overhead necessary for the text, and for automatic classification of the text, shows early benefits. This work is directly relevant to the potential for Information Extraction techniques to be adopted across domains, an issue that is being investigated also in a related EPSRC-sponsored project Scene of Crime Information System (SOCIS). The integration of techniques in corpus linguistics with other forms of analysis including mathematical analysis and image analysis provides a supporting environment for future projects that do not focus on a single medium of communication. Experts do not generally rely on the text medium alone; this work provides evidence of the kinds of information fusion that financial experts carry out many, many times each day.
The mood of the (financial) markets
31
Figure 3: Acknowledgements The work described in this paper has been supported by the EU IST Programme’s Generic Information Decision Assistant (GIDA IST 2000-31123). Based on papers presented at two workshops: LREC Event Modelling Workshop (Spain 2002) and Financial News Analysis Workshop, 11th International Terminology and Knowledge Engineering Congress (France 2002). References Ahmad, K. (2002), Events and the causes of events: the use of metaphor in financial texts, in Proceedings of the workshop at the International Conference on Terminology and Knowledge Engineering. Nancy, France. Atkins, S., J. Clear and N. Ostler (1992), Corpus Design Criteria, Literary and Linguistic Computing 7(1): 1-16. Barnbrook, G. and J. Sinclair (1995), Parsing CoBuild Entries, in J. Sinclair; M. Hoelter and Peters, C (eds.), The Languages of Definition: The Formalization of Dictionary Definitions for Natural Language Processing.
32
Ahmad et al.
Luxembourg: Office for Official Publications of the European Communities. pp. 13-58. Gross, M. (1993), Local Grammars and their Representation by Finite Automata, in M. Hoey, (ed.), Data, Description, Discourse: Papers on the English Language in Honour of John McH Sinclair. HarperCollins Publishers. pp. 26-38. Harris, Z. (1991), A Theory of Language and Information: A Mathematical Approach. Clarendon Press, Oxford. Holmes-Higgin, P., S. Abidi and K. Ahmad (1994), ‘Virtual’ Text Corpora and their Management. In Proc. of Sixth EURALEX International Congress on Lexicography, Amsterdam. Jackendoff, R. (1991), Semantic Structures. Cambridge (USA) & London: The MIT Press. Knowles, F. (1996), ‘Lexicographical Aspects of Health Metaphors in Financial Texts’, in: M. Gellerstam et al (eds.), Euralex96 Proceedings (Part II). Göteborg, Sweden: Göteborg University. pp. 789-796. Maybury, M. (1995), Generating Summaries from Event Data. Information Processing and Management 31(5): 735-751. Quirk, R., S. Greenbaum, G. Leech and J. Svartvik (1985), A comprehensive Grammar of the English Language. Longman. Rioul, O. and M. Vitterli (1991), Wavelets and Signal Processing, IEEE Signal Processing Magazine, pp. 14-38. Robert A. (eds) (1980), Roget’s Thesaurus. Great Britain, Longman. Simmons, R. F. (1984), Computations from the English: A Procedural Logic Approach for Representing and Understanding English Texts. Englewood Cliffs, NJ: Prentice Hall. Tino, P., C. Schittenkopf and G. Dorffner (2001), Volatility Trading via Temporal Pattern Recognition in Quantized Financial Time Series, Pattern Analysis and Applications. Reuters NewsML Showcase: http://about.reuters.com/newsml/ Tagger: http://www.comp.lancs.ac.uk/computing/research/ucrel/claws/trial.html System Quirk: http://www.computing.surrey.ac.uk/ai/SystemQ WordNet: http://www.cogsci.princeton.edu/~wn/
Towards a methodology for corpus-based studies of linguistic change: Contrastive observations and their possible diachronic interpretations in the Korpus 2000 and Korpus 90 General Corpora of Danish Jørg Asmussen
1
Society for Danish Language and Literature Abstract The Korpus 90 and Korpus 2000 Corpora of Danish were both designed and compiled at the Society for Danish Language and Literature (DSL). The joint web-based query interface of the two corpora enables immediate comparative studies. This paper focuses on examples of contrastive observations and their possible diachronic interpretations. It discusses whether observable differences of word frequency, inflection, collocation, connotation, and word order reflect real changes in the Danish language, or whether they reflect differently compiled corpora. Finally, the paper proposes prerequisites for a methodology of comparative corpus investigation and the determination of diachronic corpus similarity. In this context, the concept of invariant textual features is introduced.
1.
Background: The Korpus 2000 and Korpus 90 General Corpora of Danish
The Korpus 2000 and Korpus 90 General Corpora of Danish were both designed and compiled at the Society for Danish Language and Literature (Det Danske Sprog- og Litteraturselskab, DSL). DSL, which is a type of academy, was founded in 1911 with the aim of publishing scholarly editions of Danish works of linguistic or literary importance, including dictionaries. During the 1990s, the design and compilation of corpora and other electronic linguistic resources of the Danish language has become an important activity for DSL. Today, DSL is regarded as the main public institution 2 in Denmark within the fields of development and compilation of dictionaries and corpora 3 of the Danish language. DSL’s long-term goal is to combine dictionaries and corpora to yield a unique language information system – a bank of Danish language. Korpus 2000 (K2000) holds 28 million text words and is composed of text material from the years 1998-2002, covering a wide variety of genres. The objective of the Korpus 2000 project was to compile a general corpus in order to document written Danish language around the turn of the millennium. Korpus
34
Jørg Asmussen
2000 has been made publicly accessible on the Internet, one of the main purposes of the project being to increase laymen’s awareness of the advantages of a corpus as an extension to dictionaries. Korpus 90 (K90) is a 28-million-word subset of the 40-million-word Corpus of The Danish Dictionary (Den Danske Ordbog). Spoken material, as well as texts with certain copyright restrictions, has been excluded from this subset. The Corpus of The Danish Dictionary, holding text material from the decade 19831992, was compiled by DSL in the early 1990s. 4 It served as a major source in the compilation of The Danish Dictionary, an entirely new, written-from-scratch dictionary of contemporary Danish to be published in six volumes by DSL during 2003-2004. As part of the Korpus 2000 project, K90 was made publicly accessible on DSL’s website 5 , where it serves as an approximately 10-year-older counterpart to K2000. Both K2000 and K90 are morphosyntactically tagged with the Constraint Grammar-based DanPars-tagger 6 and are accessible through a joint query interface 7 that enables immediate comparisons of certain linguistic aspects. The following section will provide some examples of contrastive observations made through this interface, as well as possible diachronic interpretations – and misinterpretations – of them. 2.
Problem: Contrastive interpretation
observations
and
their
diachronic
Query results such as frequencies and collocates are presented in the K2000 interface in contrastive tables showing results for K2000 and K90. Hence the user can compare frequency figures and collocates immediately, and hopefully get an idea of what kinds of changes in vocabulary, inflectional forms, or collocates (semantics) have taken place in the years between the compilation of K90 and K2000. However, the contrastive presentation of query results has its shortcomings as well, since it may seduce some users into making faulty generalisations about language change. Below, we will present some examples of these pitfalls and sketch some possible ways to avoid them, some of which could be implemented in the user interface as a diachronic interpretation facility. 2.1
Vocabulary
A comparison of the frequencies of all words in K2000 and K90 reveals, not surprisingly, that some words are significantly more frequent in one corpus than the other. Assuming that each of the two corpora reflects Danish language usage during a given period of time (1983-1992 and 1998-2002), we might interpret these frequency differences as changes in the incidence of words in the Danish language as a whole.
Towards a methodology for corpus-based studies of linguistic change
35
Figure 1 (below) shows how the frequencies for the noun regn (rain) are presented in the user interface: the first column lists the possible inflectional (and orthographic) forms of the lemma, the second column indicates the frequency of each form in K2000, and the third column the frequency in K90. The form listed in the bottom row is the lemma itself with all its inflectional forms; i.e., it is the total of all of the forms listed above the bottom row. 8 Frequency is not shown in absolute decimal figures, but as a logarithmic score 9 represented by a number (07) of bullets. Experimentally, it has been established that this logarithmic score apparently follows general intuitions on word frequency quite well, such that words with 1-2 bullets are less frequent, e.g. entomologi (entomology), words with 6-7 bullets are very frequent, e.g. i (in) and og (and), and middle-range words with 3-5 bullets are of average frequency, e.g. regn. As the table shows, there do not appear to be any striking differences in the use of these forms between K2000 and K90, with one exception - the indefinite genitive form regns (rain’s), which does not occur at all in K2000, but scores one bullet in K90. The raised thumb indicates that this form is “interestingly” more frequent in K90 than in K2000 - which in this case means that it occurs at least twice as often as the corresponding form in the other corpus. 10 This does not necessarily mean that the difference is statistically significant as well. Especially with low frequency words, the significance may be skewed. However, the phenomenon may have some linguistic relevance, and our intention, therefore, was to highlight this in the frequency table - a practice which may have confused users, as it turns out. Clicking on one of the magnifying glasses yields the KWIC concordance for the corresponding form, together with the number of occurrences. For regns, we get three occurrences in the 28-million-word K90.
Figure 1: Frequency table for the noun regn (‘rain’) The total frequency of all inflectional variants of the lemma mobiltelefon (mobile phone) is about 25 times higher in K2000 (1,486 occurrences) than in K90 (59 occurrences). Assuming that the vocabulary of a language reflects general changes in society, and keeping in mind technological changes from the eighties to the late nineties, it seems evident that this frequency observation could be interpreted as a general change in the vocabulary of the Danish language. Similar
36
Jørg Asmussen
examples are biltelefon (car phone) and benchmarking; biltelefon, which is five times more frequent in K90 (51 occurrences) than in K2000 (9 occurrences), denotes a technical device that by and large has been replaced by mobile phones. Benchmarking does not occur at all in K90, whereas it occurs 34 times in K2000, which might indicate that this word is new to Danish vocabulary. Jarvad (1999), whose dictionary of new words in Danish is based on good old-fashioned “manual” language excerpts, dates the first occurrence of this word in Danish to 1996 - an observation which might support the assumption that this word is new. All these examples appear to indicate that the two corpora reflect changes in language use as a result of general changes in society. A less frequent word such as kambrium (Cambrium) occurs four times in K90, but not at all in K2000, and is therefore marked with a raised thumb in the K90 column. A somewhat naive, but not entirely impossible, interpretation of this could be that the incidence of this word in the Danish language is decreasing. However, a closer look at the word reveals that it only occurs in a single text on geology, a scientific domain which appears to have been covered unevenly in the two corpora. So, in certain cases, raw frequency comparisons turn out to be unreliable: they indicate different corpora compositions rather than diachronic changes in the vocabulary of the language in question. In the case of kambrium, the introduction of some measure of word dispersion in the corpus would probably mitigate against misinterpretation; thus dispersion could be used to correct the use of raw frequency to measure incidence. However, the disadvantage of this method is that it generally diminishes the weight of linguistically interesting, infrequent words, such as new words. Yet the implementation of this method in the K90/2000 user interface would prevent users who are unfamiliar with quantitative linguistic methods from misinterpreting words such as kambrium. 2.2
Inflection
A comparison of the inflectional forms of particular words will at first glance show some striking differences between K2000 and K90. Looking at our previous example, regn, we already have noted some differences between K2000 and K90 for the indefinite genitive form regns (rain’s), which occurs three times in K90, but not at all in K2000. 11 For the definite genitive form regnens (the rain’s), the table does not indicate any quantitative differences, but if one looks at the corresponding concordances, one will observe that this genitive form occurs twelve times in K90 and nine times in K2000. The same picture emerges again: fewer genitives in K2000. Elbro 2002 reports on observations from K90 and K2000 that genitives of certain frequently used nouns appear to be less prevalent in K2000 than in K90. This, he suggests, might indicate a general tendency in Danish towards replacing genitive constructions by prepositional phrases, probably as a result of the influence of English. Thus, for example, bilens ejer (the car’s owner), which is considered the canonical norm in Danish, is often re-
Towards a methodology for corpus-based studies of linguistic change
37
placed by ejeren af bilen (the owner of the car). This assumption is further supported by Elbro’s (2002) observation of increased frequencies of certain prepositions in K2000. Apparently, the absolute number of genitive forms of some nouns in K2000 is significantly lower than in K90. For instance, the noun bil (car) has a total of 393 genitive forms in K2000, as opposed to 586 in K90. Similar results are observed for other nouns denoting common objects, such as cykel (bicycle) and hus (house). A closer look at bil reveals that the lemma, including all its inflectional variants, occurs 10,360 times in K90, as opposed to 8,354 times in K2000, an observation which hardly - even among laymen - would yield an interpretation such as “the word bil is replaced by other words”, or even “the denoted object is about to disappear from our lives” - interpretations that appeared obvious for a word such as biltelefon, as discussed above. Furthermore, an examination of the relative numbers of genitive forms of the lemma bil in K90 and K2000 shows 5.7% and 4.7% respectively - a difference too weak to support conclusions about radical linguistic change. Other examples that may disprove the hypothesis of decreasing genitive forms include land (land, country) and the proper noun Danmark (Denmark). The lemma land occurs 28,222 times in K2000, the genitive proportion being 22.3%, against 21,478 times in K90, with a genitive proportion of 16.7%, thus showing the opposite tendency of what was reported above. Danmark occurs 30,730 times in K2000, against 22,243 times in K90, with 15.1% genitive forms in K2000 and 15.7% in K90. Once again, no alarming differences in the use of genitives can be observed. However, what might be alarming is the fact that some words, such as land and Danmark, which we intuitively would expect to have a constant prevalence in the language over ten years, show these astonishing frequency differences, despite their identical logarithmic score. This could be another indication of two differently-composed corpora, K2000 probably containing a larger amount of newspaper text than K90. The examples given above suggest that one presumably cannot account for general inflectional change merely by examining randomly-selected frequent words, since the result of the comparison will be too arbitrary to enable us to make any general conclusions. If one wishes to investigate this kind of linguistic change, one should examine the phenomenon in question throughout the corpus. Thus, in the case of the genitive forms, one should at least compare the total ratio of genitives forms of all nouns in each corpus, and probably also the relative number of nouns compared with other parts of speech in each corpus.12 2.3
Collocation
The K2000 query system can display collocates as either frequently or typically co-occurring collocates. The former are mainly made up of co-occurring function words, whereas the latter are determined by means of mutual information, I(worda;wordb) = P(worda,wordb)/P(worda)P(wordb). 13 In order to prevent infrequent words from popping up among the typical collocates, some intuitively
38
Jørg Asmussen
defined noise-reducing, and process time-reducing, conditions have been set up: the corpus frequencies of both examined words worda and wordb must be greater than 30, the collocate candidate’s frequency must exceed a threshold t = (log10(fk))2/10, where fk is the frequency of the collocator, i.e. the word for which we want to determine the collocates. Moreover, the collocation itself must occur at least twice, and the resulting (non-logarithmic) mutual information score must be greater than 20. The collocation window is set to two words to the left and two to the right of the collocator. The resulting collocates are presented in a table consisting of four lists, a left-hand and a right-hand list for each corpus. The lists are sorted in descending order according to their mutual information score, which is not explicitly stated in the list, but instead converted into a degree (1-5) of mutual attraction d = round(log10(I)-1), where I is the non-logarithmic mutual information score. The resulting degree of mutual attraction is expressed by a corresponding number of bullets in front of each collocate, where one bullet may be interpreted as a weak - but significant - mutual attraction between the given words, and the maximum of five bullets as a very strong attraction. Figure 2 shows, as an example, a collocation table for the lemma terrorist.
Figure 2: Typical collocates for the noun terrorist In K2000, we find to the left of the noun terrorist adjectival forms that denote either a general quality or state (hensynsløse (ruthless), eftersøgte (wanted), fængslede (imprisoned), islamiske (Islamic), internationale (international)) or a (national) origin or location. On the right-hand side, we note a couple of proper nouns. In K90 we also find eftersøgte (wanted) and palæstinensiske (Palestinian) to the left, and furthermore vesttyske (West German); finally, we find dræbt (killed) to the right. The result may be interpreted as follows: one of the characteristics of a terrorist that remains constant over time is that he is wanted or Palestinian, whereas West German is no longer a significant attribute, but, instead, many other nationalities, a certain religious orientation, or even international. In K2000, terrorists furthermore have names or belong to certain organisations, whereas in K90 they
Towards a methodology for corpus-based studies of linguistic change
39
either killed or were killed. The greater number of collocates in K2000 may indicate that terrorist has become a more frequently used word, and, in fact, the lemma occurs nearly twice as often in K2000 (477) as in K90 (253). Or perhaps this is just another indication that the corpora are composed differently, K2000 probably containing more newspaper material than K90. Yet the results and their interpretation seem reasonable to some extent in that they resemble general tendencies in Danish society related to this topic. Our historical knowledge helps us to understand these collocates and helps us to understand the constants and changes in the collocational behaviour of this word. A word which ought not to have changed its collocational behaviour over ten years is jul (Christmas) because its use is most likely embedded in a strong traditional context, and, accordingly, the majority of the listed collocates are to be found in both corpora, such as glædelig (happy), fejre (celebrate), or, on the right-hand side, nytår (New Year). However, what is conspicuous is that the number of collocates is somewhat greater in K90, indicating that jul occurs more often in this corpus (2,196) than in K2000 (1,275), which might be taken as another indication of compositional differences between the corpora. Thus, for example, hvid (white) does not occur as a collocate to jul in K2000, even if the collocation hvid jul occurs twice in K2000 and, of course, still is a valid collocation in Danish. Unfortunately it has been blocked by the noise-reduction measures. This example shows that incidental differences in frequency of a (normally) quite frequently used word, such as jul, may have a serious impact on the determination of collocates. Thus, comparing collocates derived from words with remarkably different frequencies in the two corpora does not necessarily give a correct impression of changes in their general collocational behaviour. Even if a word is used less frequently, it may still keep its well-established collocates, but they may not appear in collocational statistics any longer. What might appear, in some cases, are candidates that intuitively do not count as collocates. Looking up collocates for the word juletræ (Christmas tree), one will, as expected, find pynte (decorate) and danse [rundt=om] (dance [around]), but in K2000 we also find talende (speaking) - and this as the most significant collocate for this corpus, scoring four bullets on the degree of mutual attraction scale. On closer examination, it appears that all examples of the talende juletræ come from one single text, a strange story of a speaking Christmas tree. Thus, also when determining collocations, some kind of dispersion-based correction of the raw frequencies of the words involved would help diminish these odd findings. 2.4
Semantics
Closely related to collocation is the phenomenon of semantic prosody, 14 the ability of words to establish certain flavours of meaning contextually, e.g. positive, negative, ironic, etc. Consider the word sideeffekt (side effect), an English loanword, which is not registered by Jarvad (1999), but occurs 11 times
40
Jørg Asmussen
in K90 and 22 times in K2000. One might argue that, as a word, sideeffekt is superfluous in Danish because another word, bivirkning, already exists with exactly the same meaning. Approximately half of the examples in K90 are used in a clearly negative context, indicating that sideeffekt is something unwanted and harmful, and thus the semantics of this word appears to be very close to that of bivirkning. The picture has changed in K2000, where the majority of examples clearly show sideeffekt as something still unwanted, but quite good, and some examples are explicitly preceded by the adjective positiv (positive), as shown in Figure 3.
Figure 3: Indications of changed semantic prosody for sideeffekt in K2000. The question is whether these examples empirically justify the conclusion that sideeffekt in Danish has indeed changed its semantic prosody and found a semantic niche. How many examples of a type of semantic change do we need in order to exclude corpus compositional bias and to be able to make conclusions about a language in general? 2.5
Syntax
We will give one example of syntax that shows some topological differences for the negation ikke (not) which one can observe between K90 and K2000. In main clauses, the negation is placed after the finite verb: Peter drikker ikke te (‘Peter drinks not tea’), whereas the negation is placed before the finite verb in relative clauses: Anne serverer kaffe fordi Peter ikke drikker te (‘Anne serves coffee because Peter not drinks tea’). Main clause word order in subordinate clauses is generally considered substandard Danish. However, evidence of this usage can be found in both corpora. Intuitively, we would expect this non-canonical word order to be more frequent in current Danish, and we therefore would expect to find more examples of this in K2000 than in K90. However, a comparison shows more examples of the incorrectly placed ikke in K90, some of which are shown in Figure 4. Does this prove our intuition wrong, or does it indicate that K2000 contains more professional - and thus more ‘correct’ - language? Or is it the case that the corpus evidence is not convincing enough because of methodological shortcomings?
Towards a methodology for corpus-based studies of linguistic change
41
Figure 4: Examples of non-canonical word order in K90. 3.
Towards a methodology of corpus-based comparative studies
The examples above demonstrate that our contrastive corpus observations in some cases may yield dubious interpretations and generalisations on linguistic change. In order to improve the quality of our comparative corpus investigations, we need to establish (i) a framework for the way we examine our data, i.e. a declaration of the analytical methods applied, and (ii) a method of describing and classifying our data, i.e. the corpus. To ensure that others can repeat our investigations on other data with analogous results, we would probably even want to standardise our procedures or create a general methodology for corpus-based studies of linguistic change. To be able to handle different scenarios of investigation, the analytical methods should at least cover the fields of vocabulary, morphology (inflection), collocation, semantic prosody, and syntax. Based on the examples given in section 2, we can list the following preliminary prerequisites for these analytical methods. 3.1
Prerequisites for a methodology of comparative corpus investigation
The underlying word concept is important in comparisons based on vocabulary. In order to make these comparisons, we propose a word definition based on lexicalised units which include fixed multiword units, i.e. a word is defined as a lemma. Hence, what is comparable across corpora, when investigating vocabulary, are lemmas, not types. Furthermore, for vocabulary comparisons, measures other than raw lemma frequencies should be applied. A score based on different quantitative characteristics of a lemma in the corpus appears to be better suited to describing the prevalence of that lemma. These characteristics should at least include raw frequency and dispersion. To date, the field of vocabulary comparison appears to have attracted the most attention in corpus linguistic research, and a considerable number of statistical methods have been proposed.15 With regard to morphology, the comparison of the frequency of inflectional variants of a lemma must be handled differently from vocabulary comparison. As has been shown above, comparisons based on type can yield misleading results. First of all, one has to determine whether one wants to investigate a certain inflectional category within a lemma - for example changes
42
Jørg Asmussen
in the quantity of plural forms of a noun - or if one wants to examine probable quantitative changes of a grammatical category as a whole throughout the corpus - for example the relative quantity of genitive forms of all nouns in the corpus. In the first case, the ratio of an inflectional variant of a lemma contrasted with all other inflectional variants should be compared with the ratio of the same inflectional variant of the same lemma in another corpus. To ensure that potential changes are lemma-specific, and not just part of a general diachronic shift, the observations should be contrasted with an investigation of the examined inflectional category as a whole throughout the corpus. In the second case, the inflectional category in question should be investigated throughout the corpus. In both cases, statistical methods of determining the significance of proportional changes must be developed and applied. The comparison of changes in the frequency of collocations in two different corpora appears to be more complex than plain lemma-based vocabulary comparison. Statistical methods of the mutual information type are probably not suitable in a comparison context; their strength is mainly found in detecting statistically salient collocations. Once a collocation has been detected, one can compare its number of occurrences across corpora. However, collocations should not be compared as if they were words by merely applying one of the methods for vocabulary comparison, since the frequencies of the collocations themselves also depend on the words involved. Hence, if one observes significant differences in the frequency of one of the words involved in a collocation when comparing two corpora, these differences will also be reflected in all collocations that involve this word. In these cases, it is not necessarily the frequency of the collocation, or its prevalence in the language, that has changed. Comparisons of collocations might therefore best be treated as composite vocabulary comparisons of the words involved in a collocation, in conjunction with the frequency scores of the collocations themselves. Within the field of semantic prosody, some kind of semantic tagging, or at least grouping of contextual words, is indispensable. Changes will often affect new loanwords, and thus relatively infrequent words that are semantically vague at first, but find a semantic niche after some years. The number of words that show these characteristics is normally quite limited, and hence the comparative statistical methods must be adjusted in these special circumstances. The number of observable instances will decrease as the complexity of a certain linguistic phenomenon increases, i.e. when it is composed of several words or linguistic constituents. This applies to most observable linguistic phenomena above the word level, e.g. collocations, semantic prosody, and - perhaps most saliently - syntax, and it will have implications on the statistics used in these cases.
Towards a methodology for corpus-based studies of linguistic change
43
For other fields of linguistic comparisons between corpora, similar prerequisites have to be established. Common to all of these prerequisites should be the principles of (i) contrasting a phenomenon with its potential alternatives within one corpus, and comparing this contrast ratio with that of another corpus, and (ii) determining appropriate comparison statistics for linguistic phenomena of varying complexity. 3.2
Prerequisites for a methodology of measuring corpus similarities over time
Apart from the development of analytical methods to be applied, one needs a method to describe and classify the data, i.e. the corpus. Although considerable efforts have been made to describe what is in a corpus and why, and although corpora usually are designed in accordance with some idea of representativeness, the problem remains that corpus descriptions are generally founded on relatively vaguely defined, intuitively applied textual categories. Classifying texts by intuition is necessarily imprecise because intuitions may differ from compiler to compiler, and a single compiler may even apply different criteria of classification according to extra-textual circumstances. However, this problem does not seem to be critical, as long as the majority of corpus-based linguistic research refers to the same well-established corpus, e.g. the BNC, or, in the case of Danish, K2000 or K90. Statistical methods for determining corpus differences (Garside and Rayson 2000) and corpus similarities have been proposed, mainly based on vocabulary (Kilgarriff 2001). But what happens if one wants to compile a corpus designed exactly like an existing one, e.g. a new BNC, holding a similar mixture of, e.g., texts that are ten years more recent? In this case, the definition of a concept of similarity might become quite intricate because differences are explicitly desired as long as they are the result of diachronic language change, but they must definitely not be the result of differently composed corpora. How can one compile an updated version of a well-established corpus that is absolutely comparable to the existing one in its composition, so that the linguistic differences detected by comparing the corpora truly and only can be explained diachronically - and not as a result of compositional bias? A solution to this problem of corpus composition is a measure, a quantitatively established figure, or - more likely - several figures, characterising the overall textual composition of a corpus. Corpora with the same characteristics, then, would probably hold the same mixture of text types and would hence be comparable. So far, this approach is not different from the (implicitly) synchronic similarity measuring approaches proposed by Kilgarriff 2001. The difference is that the required measure should be based on positively invariant features of language, i.e. features that do not change (significantly) over time.
44
Jørg Asmussen
Within a synchronic context, the linguistic features to compare almost may be chosen by chance. They may be, and often are, based on vocabulary, but other features - such as part-of-speech, syntactic constituents, sentence length, word length, maybe even the distribution of character n-grams, etc. - may to some extent be useful as well. If statistics show that the two corpora have matching features, they may be expected to be of a similar type or composition. Within a diachronic context, however, many of these features may not be suitable because an ongoing general linguistic change might affect one or more of them; hence keeping them constant across corpora and over time might obscure the detection of possible changes. Linguistic features based on grammar or semantics have the disadvantage of requiring morphosyntactically or semantically tagged corpora. The task of tagging a corpus before one can determine its compositional characteristics introduces a certain amount of interpretation, as one has to apply a grammatical tradition or semantic framework that does not necessarily capture the possible, subtle linguistic changes that occur as a language develops over time. Furthermore, the task of tagging increases the degree of methodological complexity, since one does not only need a tool for determining the compositional characteristics of the corpus, but also tagging tools. To ensure that the measurement of the compositional characteristics can be easily achieved in different settings, all tools that are involved have to be well documented and maintained. Slight modifications in tagging algorithms or tag sets may have farreaching implications on the reliability of this approach. For these reasons, one should try to keep the number and complexity of the tools involved as low as possible, as well as the setting itself. We therefore propose that corpus similarity should be determined on untagged corpora only, and that any introduction of linguistic theory into this process should be avoided. The mere physical, orthographic surface of the corpus should suffice, since its recurrent symbols yield structures of varying complexity that resemble the overall textual composition of the corpus. It is beyond the scope of this chapter to try to determine the required invariant linguistic features. However, a couple of candidates will be briefly discussed. Belica (1998) gives an account of some statistical diachronic investigations of vocabulary and collocations in the German “Wendekorpus”. 16 He seems to be quite aware of the corpus compositional problem dealt with in this paper and points at the distribution of different collocations of selected function words 17 as a candidate for an invariant feature, but does not give any examples or further details. However, it does not seem evident that this type of collocation should remain stable over time. A more appropriate candidate for an invariant linguistic feature seems to be the frequency and dispersion of words belonging to a defined semantic core vocabulary. Ruus (1995) attempts to determine a core vocabulary for Danish which she believes constitutes the basic lexical norm of the language. The core vocabulary, which Ruus determines, includes semantically vacuous, but
Towards a methodology for corpus-based studies of linguistic change
45
highly frequent function words, whereas the semantic core vocabulary, which we shall suggest as a candidate, excludes them. The remainder should be relatively frequent, semantically well-established words of the jul (Christmas) type mentioned above. This semantic core vocabulary can be expected to remain grammatically and semantically stable over time and thus may prove quite useful in our context. Further experimental work will show whether it is possible to derive such a constant semantic core vocabulary from a large amount of text material, 18 and whether it really can serve as an appropriate invariant linguistic feature. 4.
Conclusion
In this paper, we have discussed examples of comparative investigations on two general language corpora of Danish, K90 and K2000, the former reflecting Danish language usage around 1990, the latter one around 2000. We have argued that some of the interpretations of the observed differences in vocabulary, collocation, semantics, and grammar were not necessarily the result of general changes in language usage, but rather a likely consequence of differentlycomposed corpora. 19 This observation led us to the conclusion that a framework for comparative diachronic corpus investigation is needed, and we sketched some prerequisites for a methodology of diachronic corpus comparison. With regard to comparative corpus investigation, we found that standardisable approaches are required to account for the complexity of the observed linguistic phenomena, as well as the quantitative relationship between a linguistic realisation and its potential variants. In further work, such approaches should be concretised and evaluated. With regard to the data material, i.e. the corpora to be compared, we argued that in order to determine the similarity of corpora comprising material from different time periods, the approach must allow a certain degree of dissimilarity for those linguistic characteristics which are likely to change over time. Therefore, we proposed to base this approach on invariant textual features, the semantic core vocabulary of a language being an initial candidate for investigation in further work. Generally, we find that the determination of invariant features appears to be a conceptual, or hermeneutic, challenge rather than a mere statistical one.
Notes 1
Thanks to my colleagues Britt Keson and Allan Ørsnes for their valuable comments on the manuscript.
46
Jørg Asmussen
2
Legally DSL is a semi-public institution under the jurisdiction of the Danish Ministry of Culture, and its activities are financed in part by the Danish Government and in part by private and public foundations.
3
Among other corpora compiled or distributed by DSL are the Danish PAROLE Corpus (compilation and distribution, cf. Keson 1998) and the Bergenholtz DK87-90 Corpus (distribution, cf. Bergenholtz 1988). An overview of Danish corpora is given in Asmussen (2001).
4
A comprehensive account of the background and the design of the Corpus of the Danish Dictionary is given in Asmussen & Norling-Christensen (1998).
5
Accessible at http://www.dsl.dk/korpus2000.
6
Developed by E. Bick under the VISL project, University of Southern Denmark, http://visl.sdu.dk.
7
The query tool being CQP (Christ 1994) in conjunction with a special web interface developed in the Korpus 2000 project. For details on Korpus 2000 and its web-based user interface cf. Andersen et al. (2002).
8
The smiling face indicates that the lemma is spelt in accordance with official Danish orthography.
9
The score s is computed as follows: s = round(0.5 + log10(f)), for f>0, and s = 0, for f=0, where f is the computed average number of occurrences in one hundred million words of text.
10
This rule has been arbitrarily defined.
11
Even if this is by no means statistically significant, a user who is not aware of this might make a comparison based on these raw frequencies.
12
As noted by Elbro himself.
13
Cf. Church & Hanks (1989); a modification is that their log2 function is not applied here.
14
For a brief description, some examples, and further references cf. Rundell (2002).
15
For a comprehensive overview and discussion cf. Kilgarriff (2001).
16
Institut für deutsche Sprache, Mannheim, http://www.ids-mannheim.de.
17
"die Verteilung von verschiedenen Funktionswörter" (p. 35).
Kollokationen
ausgewählter
Towards a methodology for corpus-based studies of linguistic change
47
18
DSL stores approximately 400 million words of text material in its text bank. The material covers a time span of approximately 20 years and constitutes the raw material for other DSL corpora. A part of this material is - to date - seven years of newspaper data from a Danish daily newspaper (Berlingske Tidende), approximately 25 million words per year. A first step could be to determine the common vocabulary to be found in each year (or each month or day), and to use this as a basis for further investigations.
19
In fact, there is a compositional difference between these two corpora as K2000 holds approximately 2/3 of newspaper text as opposed to approximately 1/3 in K90.
References Andersen, M.S., Asmussen, H., Asmussen, J. (2002), ‘The Project of Korpus 2000 Going Public’, in: A. Braasch and C. Povlsen (eds.) Proceedings of the Tenth EURALEX International Congress, EURALEX (2002), Copenhagen. Asmussen, J. (2001), Korpus 2000. Et overblik over projektets baggrund, fremgangsmåder og perspektiver. NyS 30. Nydanske studier & almen kommunikationsteori, Copenhagen. Asmussen, J. and O. Norling-Christensen (1998), ‘The Corpus of The Danish Dictionary’, in: Lexikos 8, Afrilex Series 8:1998, Stellenbosch, pp. 223242. Belica, C. (1998), Statistische Analyse von Zeitstrukturen in Korpora. Teubert W. (ed.): Neologie und Korpus. Tübingen. Bergenholtz H. (1988), DK87: Et korpus med dansk almensprog. Hermes, Journal of Linguistics 1, Århus, pp. 229-237. Christ, O. (1994), A modular and flexible architecture for an integrated corpus query system. COMPLEX’94, Budapest. Church, K. and P. Hanks (1989), Word association norms, mutual information and lexicography. ACL Proceedings, 27th Annual Meeting, Vancouver. Elbro, C. (2002), Ift, ifm, mht, mhp og andre uspecifikke præpositioner. Mål og Mæle 3:2002, Copenhagen, pp. 17-23 Garside, R. and P. Rayson (2000), Comparing corpora using frequency profiling. Proceedings of the workshop on Comparing Corpora, held in conjunction with the 38th annual meeting of the Association for Computational Linguistics (ACL 2000). 1-8 October 2000, Hong Kong, pp. 1 - 6.
48
Jørg Asmussen
Jarvad, P. (1999), Nye Ord. Ordbog over nye ord i dansk 1955-1998. Copenhagen. Keson, B. (1998). Documentation of The Danish Morphosyntactically Tagged PAROLE Corpus. Society for Danish Language and Literature, DSL, Copenhagen, http://korpus.dsl.dk/e-resurser/parole-doc.rtf Kilgarriff, A. (2001), Comparing Corpora. International Journal of Corpus Linguistics, 2001, vol. 6, no. 1, 2001, pp. 97-133. Rundell, M. (2002), ‘Good Old-fashioned Lexicography: Human Judgment and the Limits of Automation’, in M-H. Corréard (ed.) Lexicography and Natural Language Processing. A Festschrift in Honour of B.T.S. Atkins. EURALEX 2002. Ruus, H. (1995), Danske Kerneord. Centrale dele af den danske leksikalske norm. Copenhagen.
Synchronic and diachronic variation: the how and why of sociolinguistic corpora. Kate Beeching University of the West of England
Abstract This paper aims to illustrate the potential of (spoken) sociolinguistic corpora for research studies in both synchronic and diachronic variation, with reference to French, and to suggest ways in which useful research corpora may be established for future generations of scholars. Spoken corpora and corpus tools are an excellent heuristic in charting distributional frequencies or probabilistic factors. Andersen (2000) suggests that the upsurge of innit and like in the COLT Corpus of adolescent English may be more than age-grading. The present paper will present broad-brush preliminary evidence with respect to the evolution of selected pragmatic particles in French.
1.
Introduction
The title of my paper on sociolinguistic corpora has put the how? before the why? This raises a very interesting methodological issue relating to corpus collection and corpus-based research. Generally speaking, linguistic research design which includes data collection focuses very precisely on the nature of the data required for the research project in question. You start with the why? and move on to the how? A hypothesis is formulated and the data collection is specifically designed to test that hypothesis. The nature of corpus design is quite the opposite: very large amounts of data are collected from a representative sample of the population, both written and spoken, and - as was the case for the Survey of English Usage - the corpus designer decides which genres are to be included as being those which are most typical of the language at any one time. Inevitably, the composition of the corpus influences the findings which may be made and bias may creep in. For a long time, for example, the spoken language was considered to have been underrepresented in the British National Corpus and, even now, if we compare how much time the average British English speaker spends speaking and listening as opposed to reading or writing, corpora are generally weighted in favour of the written language. The time-consuming nature of transcription plays a major role in the relative paucity of spoken material. Should researchers wish to chart distributional frequencies in the spoken as opposed to the written language, they are at liberty to select sub-corpora. Inevitably, too, the corpus may not include the precise register of the language which the researcher is interested in. In Beeching
50
Kate Beeching
(1997), I provide an apology for the small home-grown corpus which focuses on, in this case, the type of spoken French most needed by horticulturalists (a group of learners I happened to be teaching at the time and for whose needs no specifically-designed corpus was available). At the University of the West of England, Bristol, we are currently engaged in a Joint Project collecting samples of learner English/French/German and Spanish at a number of levels. Already the methodological questions are being posed: what level of detail will be required in transcription? Does the method of data collection fit the individual research aims of the staff involved? How best can we collect data which it will be subsequently of interest to interrogate for studies which may be as diverse as morphological development, lexical richness and so on. The how? and the why? questions bedevil the collection of corpus material in a very large number of fields. The key factor about corpus investigations is size: millions of words are considered to be required to gauge the use of lexical items, even those which are not particularly rare. For studies focusing on variation, large is necessary but insufficient. In the case of spoken data requiring transcription, large means long hours of work by trained personnel - in other words, funding. Corpus Linguistics is a field where individual researchers, public and private funding, universities, libraries, publishers and government need to pull together, as has been most spectacularly demonstrated by the success of the BNC. A collaboration of this sort has, unhappily, not occurred for French. For studies focusing on variation, large is necessary, but insufficient, because samples must be accompanied by particular demographic data to allow investigations to be meaningful. And opinions differ on exactly how data should be collected and collated for reasonable conclusions to be drawn. In this paper, my remarks relate to the type of corpus which lends itself to the study of semantico-pragmatic change. On the one hand, the why? logically precedes the how? On the other hand, most empirical research papers place the methodology section before the results section. It is for this reason that I have positioned the how? before the why? in this paper, though the latter part of the paper serves as justification for the methods described in the former. The questions to be raised are: How reasonable is it for sociolinguists to ask for specific information about speakers to be included in the data set along with transcriptions when corpora are compiled? And what sort of information and what degree of detail is useful? 2.
The how?
Examining data collection methods which have been used in the past is one way to explore best practice for the future. Two outstanding examples of existing sociolinguistic corpora for French are the Etude Sociolinguistique d’Orléans (collected between 1966-1970) and the VALIBEL Corpus. The latter is the largest electronic corpus of spoken French, with 400 hours of recordings or about
Synchronic and diachronic variation
51
4 million words, and hopes to be representative of the “communauté linguistique Wallonie-Bruxelles” (Francard et al. 2002). Each interview is accompanied by demographic information covering the following six parameters: sex, age, geographical location, place of birth, educational background and the socioprofessional situation of the informant. More information is accessible at http://valibel.fltr.ucl.ac.be. The VALIBEL centre focuses on variation studies (lexical, syntactic, phonetic and prosodic). Despite the excellence of this corpus, it is of little use for my exploration of hexagonal French, as its focus is entirely on Belgian French. As yet nothing similar is available for hexagonal French though the Orléans Corpus is an excellent model. My own very small Bristol Corpus is available on-line and the “reference corpus of spoken French” currently the responsibility of Mireille Bilger (Université de Perpignan: [email protected]) holds great promise. The Orléans Corpus, the collection and transcription of which was supported by grants from the DES, the French Embassy in London, BELC in Paris, the CRDP in Orléans, the CMPP in Orléans, INSEE in Orléans and the French Centre for European Sociology is an invaluable resource. As the authors explain in their catalogue, the origins of the ESLO (Etude Sociolinguistique d’Orléans) go back to 1966, the era of the ‘audio-visual revolution” in language teaching. There was an acute need for non-literary and everyday samples of authentic spoken French. The aim, then, of the corpus was to collect a body of recordings of spoken French from an urban environment, the choice of subjects being governed by sociological criteria in order to ensure that the corpus was representative of French speakers of the time. The corpus was to be transcribed and made available to researchers in linguistics, sociology and pedagogy and was to be used as the basis for teaching materials. The resulting electronic corpus comprises approximately 109 hours of spoken French, 902,755 words of which have been orthographically transcribed with a further 13 hours of phonetic transcription. These transcriptions are available at: http://bach.arts.kuleuven.ac.be/elicop. Each interview is accompanied (in the catalogue) with very full background information, including not only the six parameters favoured by VALIBEL but the initials of the interviewer, the date of the interview and date and place of birth of the interviewee, the INSEE coding of the interviewee, their marital status, political leanings, the length and quality of the recording and some indication of the topics covered. Most interviews covered a pre-determined set of questions, but the speakers appear relaxed and informal in their mode of response. This imaginative yet rigorously managed project is a treasure-house of historical evidence on the French language, the first and, as yet, virtually the only French corpus in existence which is freely available on-line. The Bristol Corpus also had its origins in language pedagogy. Supported by small grants and advances from OUP and CUP, I spent 10 years from 1980 to 1990 as a freelance French textbook writer, collecting, transcribing and preparing pedagogical materials for French (e.g. Beeching, 1985, 1986, 1989, Beeching &
52
Kate Beeching
Page, 1988, Beeching & Le Guilloux, 1990, 1993). All were based on and had an accompanying cassette containing authentic taped spoken interviews with French people from all walks of life and from a number of urban and provincial parts of France. A selected sub-section of the interviews recorded during these years was transcribed as part of my PhD thesis, an abridged version of which was published in 2002. These interviews now make up the Bristol Corpus which comprises 17.5 hours of orthographically transcribed speech, or 155,000 words, involving 95 speakers, aged 7 to 90 years with a balanced range of educational backgrounds. The Corpus may be accessed at http://www.uwe.ac.uk/facults/hlss/languages/ research/staff/CORPUS.pdf. The file contains some demographic information about the speakers: their sex, age (in 3 age bands: 0-20; 21- 40; 41+) and level of education (in 3 bands: no bac, bac but no university degree, bac + university degree(s)). Bilger (2002) presented the “Reference Corpus of spoken French” the constitution of which was proposed in 1998 by the GARS teams and the CNRS ESA 6060 team directed by C.Blanche-Benveniste. Currently the DELIC team led by J. Veronis is completing the corpus. Bilger regretted that the corpus did not fulfil all of the criteria which Sinclair suggests characterise a ‘reference’ corpus as not all speech situations are included and a number of usages of the language are missing. She suggests that this is but a first step in a vaster project. An attempt has been made to capture a representative sample of common, current usage. The corpus is 400,000 words long, the interviews were recorded in 40 towns and three speech situations have been favoured: “private” speech, professional speech and public speech. Bilger did not mention in detail what background notes accompany the transcriptions. To sum up, a reference corpus which is useful for sociolinguistic research must attempt to provide samples which are representative of all members of the society in question talking at a similar level (or levels) of formality in order for comparisons to be made and variation discerned. A minimum of information should accompany each interview: the sex, age and educational background of the speakers. 3.
The why?
Reference corpora which are allied with demographic information can be used, not only to look at synchronic variation and the way that social hierarchies and power may be enshrined in language use (see Beeching, forthcoming a) but also to investigate diachronic variation (see Beeching, forthcoming b). This is the most exciting new development. Though change may conceivably occur because of the written language, it is generally recognised that most changes occur in face-to-face interaction. In the past, language change has been studied with some difficulty: written documents of various sorts have been scrutinised to find
Synchronic and diachronic variation
53
evidence of what might have been happening in the spoken language at a particular stage (an excellent example of such an investigation at the phonological level is Sampson, 2002). The fact that we now have what amount to historical documents in the form of tape-recordings and, if we are lucky, transcriptions of those tape-recordings, means that, from now on, we will be able to monitor change as it occurs. Corpus evidence allows us to quantify shifts, gauge reversals, and check distributional frequencies. Electronic search facilities and statistical packages can alleviate much of the drudgery entailed. We can refine not only our descriptions of linguistic change but also our hypotheses about the causes and effects of such changes. Linguists have traditionally favoured language-internal causes of linguistic change. The advent of sociolinguistics and sociolinguistic evidence allows us to put forward a very strong argument for the importance of language-external, social factors. As Croft (2000: 4) remarks ‘the real entities of language are utterances and speakers’ grammars. Language change occurs via replication of these entities not through inherent change of an abstract system’. There is considerable evidence that synchronic and diachronic variation are inextricably linked and that language items which begin as one variant of a variable or one sense of a polyseme gradually gain the upper hand. A new formfunction configuration can eventually obscure the original one as, becoming more frequent, it is routinised. As Heine, Claudi and Hünnemeyer (1991:261) remark with reference to grammaticalisation, language change and synchronic variation are inextricably interlinked: Grammaticalization has to be conceived of as a panchronic process that presents both a diachronic perspective, since it involves change, and a synchronic perspective, since it implies variation that can be described as a system without reference to time. Jakobson (1952/1963:37) made a similar point when he said Pendant un certain temps, le point de départ et le point d’aboutissement de la mutation se trouvent coexister sous la forme de deux couches stylistiques différentes...Un changement est donc, à ses débuts, un fait synchronique 1 . Grammaticalisation is a term which is generally applied to nouns and verbs which come to serve grammatical functions and then continue to develop new grammatical functions. Classic examples include the development of LatinRomance articles, auxiliaries and indefinite pronouns. Whilst much focus has traditionally been placed on what Givón has famously referred to as ‘Today’s morphology is yesterday’s syntax’, it could be argued that the emphasis on morphology reflects the neogrammarians’ preoccupation with this area rather than giving a just view of a process or phenomenon which extends to semantic and pragmatic areas, not solely purely ‘grammatical’ ones. In order for a lexical
54
Kate Beeching
or content word to gain in currency and become a function or grammatical word, it must of necessity lose the particular lexical meaning which ties it to specific contexts and become desemanticised. This ‘bleaching’ has been regarded as a somewhat negative fate for words though some researchers point up that we should not consider the desemanticisation as ‘loss’ but as an enriching or multiplying of meaning. In addition, desemantisation is a sine qua non for a term to become grammaticalised or gain in currency, to change from a ‘content’ to a ‘function’ word, as Haspelmath (1999:1062) explains: Semantic generalization or bleaching is usually a prerequisite for use in a basic discourse function, that is, for the increase in frequency that triggers the other changes. The semantic generalisation which is so often observed in the development of a lexical category to a functional one appears, then, to be not a consequence of routinisation but a pre-requisite for it. This “bleaching” and “gaining in currency” is not a phenomenon which restricts itself to morphology but is omnipresent, not least in cases of pragmatico-semantic change. In Beeching (forthcoming b) I argue precisely this and I posit that, along with the formal changes which appear to accompany grammaticalisation (desemantisation, fusion, coalescence), what we are witnessing in all cases of language change, is a process of pragmaticalisation which I define as follows: Pragmaticalisation is the manner in which words, used in context, shift in meaning or attract a new social semiotic, become habituated in that usage and are propagated because of the new fashion or prestige which is attached to them. Pragmaticalisation occurs during human interaction and human interaction is always heavily overlaid with connotations which may be most readily explored using politeness theory. Kasper (1990) distinguishes between two trends in the conceptualisation of politeness: politeness as strategic conflict-avoidance and politeness as social indexing. Both are involved in a consideration of pragmatic particles such as like and innit in British English or enfin, hein or quoi in hexagonal French. All are used to encourage speaker involvement, and they are part of the means whereby speakers downtone assertions, avoid presenting themselves as the expert and thus they are a means of avoiding conflict and managing face needs. But they are often words, too, which are stigmatised in “polite” circles, they are familiar, colloquial, only used in the spoken language, in informal contexts or by an easily identifiable subset of the population. Quotative like for example is much more frequent on the lips of younger speakers. Hein, and, to an even greater extent, quoi, are characteristically used to a much greater extent by working class speakers. Frequent use of such terms, then, contains a social semiotic, resulting in social indexation.
Synchronic and diachronic variation
55
The underlying processes of language innovation and language diffusion appear to me to reside in the conventionalisation of generalised invited inferences, some of which may be cognitively motivated metaphorical or metonymic interpretations, but many of which are motivated by considerations of politeness in its broadest sense including both notions of sociability and face and of social indexation (see Eeelen, 2001, and Beeching, 2002: 25-27). On the one hand, Croft (2000: 178) intimates the usefulness of politeness theory in helping to explicate the directionality of the transmission of variants, an aspect not accounted for in the Milroys’ weak-tie model. On the other hand, drawing on Levinson (2000), Traugott and Dasher (2002) posit an Invited Inferencing Theory of Semantic Change (IITSC). This theory suggests that historically there is a path from coded meanings (Ms) to utterance-token meaning (IINs) to utterance-type, pragmatically polysemous meanings (GIINs) to new semantically polysemous (coded) meanings. Their arguments for the role of conceptual metonymy are persuasive. My theory of pragmaticalisation builds on the IITSC but places it firmly in the context of politeness theory and of Milroyan sociolinguistic theory and methodology. Both Croft (2000) and Givón (2002) draw out the parallels between adaptive behaviour in biology and linguistic phenomena, with variation seen as the indispensable tool of learning, change and adaptation and this in the context of the sociability, co-operation and communicative way of life rooted in a hunting-and-gathering society. The primacy of sociability, the bid for conflictavoidance in human interaction and the equally prevalent urge for social indexation promote not only a high rate of usage of politeness markers but also their differential usage in different identity groups. Moreover, because such particles are both frequent and highly polysemous, they are subject to change. Hence the fascination they hold for scholars of synchronic and diachronic variation. The techniques and tools of Corpus Linguistics are formidable allies when exploring the relative distributional frequencies of old and new forms coexisting in synchrony. Though linguists have generally focused on change and, in particular, on the beginning and end of a change, the far commoner and more ubiquitous situation is that of stable sociolinguistic and stylistic variation, out of which change may, or may not, emerge. As Hopper and Traugott (1993: 95) point out: Changes do not have to occur. They do not have to go to completion, they do not have to move all the way along a cline ..[....] the outcome of grammaticalization is quite often a ragged and incomplete subsystem that is not evidently moving in some identifiable direction. Polysemy and synchronic variation are far commoner than diachronic change and, coupled with social stratification, they constitute the raw material without which change is not possible. Distributional frequencies may fluctuate, depending upon fashion and prestige, a form-function association may dwindle and even die
56
Kate Beeching
and, in those relatively rare cases, change may be said to have occurred. There appears to be a probabilistic aspect to the spread of a new form, the now famous S-curve, whereby after a slow start a new form surges forward at an accelerated pace and then falls backs as it stabilises. In Beeching (forthcoming a), I have attempted to capture the numerous complexities involved in the sociolinguistic promotion and demotion of a new form in the disarmingly simple formula l = p n, where l is the likelihood of spread, p are the positive aspects of the (changed) form-function configuration and n are the negative ones in the mind of the speaker involved. This formula allows for the fact that not all forms are positive for all members of a speech community and that attitudes to a form may change over time. In highly stratified societies, the n value of a stigmatised form entirely eclipses its p value. Only if strata become less rigid and identification with the life-style associated with the form rises can the n value drop. A measurement of the distributional frequencies of a form in speech samples from similar speech communities at two points in time may indicate the ‘l’ and help us to chart fluctuations over a large speech population. In this respect, the usefulness of large corpora of transcribed spoken language coupled with the demographic information classically associated with sociolinguistic studies - the age, sex and socioeconomic background of speakers - can hardly be exaggerated. In Beeching (forthcoming b), I survey the evolution of four pragmatic particles, as evidenced in a comparison of their usage in the (1966-1970) Orléans Corpus and the (1980-1990) Bristol Corpus. Many caveats must be issued concerning the conclusiveness of the data presented. The corpora are small by many standards. The Orléans Corpus is restricted to only one town in France, whereas the Bristol Corpus covers a number of different towns and regions. Although a similar amount of speech is examined in each corpus (around 155,000 words), ninetyfive speakers are surveyed in the Bristol Corpus while only twelve have been studied in detail in the Orléans Corpus, two men and two women from each of the three education groups which I have designated here as WC, LMC and MC. As a means of illustrating the ‘why?’ of sociolinguistic corpora, I wish now to focus on only two of the particles studied in Beeching (forthcoming b): hein and quoi. Hein and quoi both occur in an utterance-, or at the very least, tone-groupterminal position and are mildly stigmatised (they do not occur in formal written discourse and are highly unlikely to occur in formal spoken French). Quoi remains perhaps slightly more stigmatised than hein. Both, however, could be said to serve social/interactional purposes in maintaining hearer-involvement and in hedging or downtoning remarks which a speaker or hearer might consider over-assertive. Hein is generally translated into English by a tag question or by you know?, while quoi may be rendered ‘as it were’, ‘so to speak’, ‘know what I mean’, ‘like’ ‘sort of’, ‘kind of thing’, ‘you know’ or even ‘of course’. Oui, peut-être mais ça dépend aussi, hein? Yes, perhaps, but it depends, too, doesn’t it?
Synchronic and diachronic variation
57
ne pas avoir que des contraintes dans dans sa vie, quoi, hein? not just to have obligations in in one’s life, as it were, you know? Hein and quoi appear, thus, to function in both of the manners in which politeness is conceptualised. They serve both to flag social indexation (they are nonstandard, stigmatised forms) and to mediate sociability. While quoi seems to have one core function or meaning (it flags tentativeness concerning the adequacy of one’s expression), Beeching (2002) charted two main functions or meanings of hein: a Hyperbolic function, where hein underscores an emphatic remark, and a Discoursal function, where hein is used as a backchannel device to maintain hearer involvement. Results in Beeching (2002) based on an analysis of the Bristol Corpus suggested a shift in distributional frequencies from the Hyperbolic to the Discoursal usage and, simultaneously a change in social semiotic: the Discoursal usage of hein was favoured by female speakers. 140
120
100
80
Mean HRANDQR
60
CLA SS
40
WC 20 MC 0
LMC Bristol
Or léans
CORPUS
Figure 1: Mean rates of hein and quoi usage in the Bristol and the Orléans Corpus As Beeching (forthcoming b) shows, rates of hein usage are similar overall in both corpora. The class distribution of usage differs dramatically, however. In the later, Bristol, Corpus, the middle class speakers have adopted hein and working class rates are proportionately smaller. Rates of quoi-usage have, by contrast, doubled in the intervening years, with extremely high rates amongst working class speakers but much higher rates, too, amongst middle class speakers.
58
Kate Beeching
Figure 1 charts the distributional frequencies of the sum of the means of hein and quoi rates per 10,000 words in the Bristol and Orléans Corpora subdivided for educational background. (It should be noted that the corpora had to be screened in the case of quoi to focus only on occurrences of it in tone-group-terminal function: quoi has of course a number of other more canonical pronominal uses in interrogative and relative constructions - de quoi parles-tu? il n’y a pas de quoi rire etc.) The most striking aspect of this figure is the increase in the usage of hein and quoi amongst middle class speakers. There appears to have been a slight dropping of in lower-middle-class usage of these stigmatised forms in the Bristol Corpus and a very slight increase in working class usage but the increase in usage overall is amongst middle-class speakers. Table 1 demonstrates the role played by the speaker’s sex in the increased rates of hein/quoi usage. Table 1: Rates of hein/quoi usage per 10,000 words in the Orléans and Bristol Corpora, subdivided by sex and class (N= the sum of the raw number of occurrences of hein and quoi). Male Orléans Corpus (1966) Bristol Corpus (1990)
Female
WC
LMC
MC
WC
LMC
MC
65.61 N=200 57.91 N=271
62.54 N=191 27.69 N=53
15.03 N=37 24.33 N=22
22.94 N=69 46.89 N=150
13.92 N=51 33.96 N=108
15.84 N=29 35.98 N=54
In the Orléans Corpus, hein/quoi usage is a predominantly male WC and LMC phenomenon. The female speakers observe the same reticence concerning hein/quoi usage as the MC males. In the Bristol Corpus, however, rates are a great deal more evenly distributed. Though the highest rates belong to WC speakers, this is true of both the men and the women. Indeed, the female LMC and MC rates exceed those of their male equivalents. It seems that hein and quoi are becoming less stigmatised and that it may be women who are leading this change in social semiotic. In Beeching (forthcoming a), I discuss the relationship between politeness and power and the maintenance of hierarchies through asymmetrical language-usage. It is too early to make any conclusive remarks and replications of the study, drawing on more data from the invaluable Orléans Corpus and also from the more recent Reference Corpus, is advisable. However, it seems possible that, if middle class speakers are beginning to adopt stigmatised ‘working class’ speech forms, there has been a democratisation, a shift in the hierarchical nature of French society. Our study of distributional frequencies of pragmatic particles may inform
Synchronic and diachronic variation
59
us not only about linguistic usage but also about the structure of society. It is the inter-relationship between the two which may bring about linguistic change. 4.
Conclusion
In this brief chapter, it has been impossible to do full justice to either of my main foci: the usefulness of sociolinguistic corpora and the way that diachronic change may be charted through differences in distributional frequencies (synchronic variation) noted at different points in time. As Macaulay (2002, 298) points out, there are many variables that affect samples of speech. He claims, however: Yet we need not despair. One way forward is in replication. As more studies are carried out, the influence of accidental factors may be easier to detect. Macaulay makes a number of very useful practical suggestions concerning the way that replication may be made more reliable. For one thing, researchers need to show rates of occurrence in a standardised way which will allow comparisons to be made e.g. how many occurrences per 10,000 words. He recommends the amassing of comparative data. When collecting corpus material, I urge fellow researchers to append as much information as possible concerning the date and place of collection, the sex, age, place of birth and educational and socioeconomic background of the speaker, the nature of the relationship between the interviewer and interviewee (or speakers, if a ‘fly-on-the-wall’ recording). Macaulay stresses, too, the usefulness of the computer, a point of view which I whole-heartedly support. One is forced, however, to recognise that linguists do not look set to be put out of their job by a computer: the polysemy and multifunctionality of certain terms, the subtlety of invited inferences and the continuum along which terms travel towards coded meanings pose a formidable challenge to the computer programmer. Finally, as any researcher who has collected and transcribed spoken material knows only too well, transcription is fantastically time-consuming. It has become obvious to me, however, that when we transcribe, what we are engaged in is not only a record and research base for the study of contemporary forms. What we are engaged in is the creation of a historical archive of spoken language which was impossible for our less technologically-advantaged forebears. To aid our understanding of the nature of language, of the way that it is structured and how that structure reflects social phenomena, of its variation, both synchronic and diachronic, every attempt should be made to take samples which are representative and to accompany our hard-won transcriptions with detailed demographic information. In this way, we allow others to stand on our shoulders and the fruits of our efforts are redoubled.
60
Kate Beeching
Notes 1
For a while the departure and arrival point of the change coexist in the form of two different stylistic layers.... a change is thus, in its beginnings, a synchronic phenomenon.
References Andersen G. (2000), Pragmatic Markers and Sociolinguistic Variation. A relevance-theoretic approach to the language of adolescents. Amsterdam/Philadelphia: John Benjamins. Beeching, K. (1985), Vrai de vrai! Oxford: Oxford University Press. Beeching, K. (1986), A vrai dire. Oxford: Oxford University Press Beeching, K. (1989), Actifrance. Oxford: Oxford University Press Beeching, K. (1997), French for specific purposes: the case for spoken corpora. Applied Linguistics. (1997). 18, 3, 374-394. Beeching K. (2002), Gender, Politeness and pragmatic particles in French. Amsterdam/Philadelphia: John Benjamins. Beeching K. (Forthcoming a), Pragmatic particles - polite but powerless? Tonegroup terminal hein and quoi in contemporary spoken French. To appear in one of the first two editions of Multilingua 2004. Beeching, K. (Forthcoming b), Pragmaticalisation, politeness and linguistic change: synchronic evidence from French. Beeching K., & I. le Guilloux. (1990), Ça se dit et ça s'écrit. Oxford: Oxford University Press. Beeching K. & I. le Guilloux. (1993), La passerelle. Cambridge: Cambridge University Press. Beeching K., & B. Page. (1988), Contrastes. Cambridge: Cambridge University Press. Bilger M. (2002.), Présentation du “corpus de référence de français parlé”. Paper given at the ATALA Conference, “Constitution et exploitation de corpus du français parlé” 25 May 2002. Croft, W. (2000), Explaining Language Change. An Evolutionary Approach. Harlow: Longman. Eelen, G. (2001), A critique of politeness theories. Manchester: St. Jerome Publishing. Francard M., G. Geron, V. Giroul, P. Hambye, A.C.Simon, and R.Wilmet (2002), Le centre de recherche Valibel: des corpus oraux au service d’un observatoire du français en Belgique. Paper given at the ATALA Conference, “Constitution et exploitation de corpus du français parlé” 25 May 2002.
Synchronic and diachronic variation
61
Givón, T. (2002), Bio-linguistics. The Santa Barbara lectures. Amsterdam: John Benjamins. Haspelmath, M. (1999), Why is grammaticalization irreversible? Linguistics, 376: 1043-1068. Heine, B., U. Claudi, and F. Hünnemeyer. (1991), Grammaticalization: a conceptual framework. Chicago: University of Chicago Press. Hopper, P. J. & E.C.Traugott. (1993), Grammaticalization Cambridge: Cambridge University Press. Jakobson, R. ([1952] 1963), Essais de linguistique générale. Paris: Éditions de minuit. Kasper, G. (1990), Linguistic politeness: current research issues. Journal of Pragmatics 14: 193-218. Levinson, S. (2000), Presumptive Meanings: the theory of Generalized Conversational Implicature. Cambridge, MA: MIT Press, Bradford. Macaulay, R. (2002), Discourse Variation. In Chambers, J K, Schilling-Estes, N The handbook of language variation and change. Oxford: Blackwell, pp. 283-305. Sampson, R. (2002), A transient vowel in early modern French: i nasal, in: R. Sampson and W. Ayres-Bennett (eds.) Interpreting the history of French. A Festschrift for Peter Rickard on the occasion of his eightieth birthday. Amsterdam/New York: Rodopi. Traugott, E. and R. Dasher. (2002), Regularity in Semantic Change. Cambridge: Cambridge University Press.
This page intentionally left blank
Statistical analysis of the source origin of Maltese Roderick Bovingdon Angelo Dalli University of Sheffield Abstract This paper presents the results of the first ever large-scale statistical analysis of Maltese using the newly formed Maltilex Corpus. Traditional etymological and categorical analyses were supplemented with data mining techniques to provide accurate results with reduced effort. Statistics about the relationship between etymology and word classes were analysed from different viewpoints. Maltese grammar and morphology remain to this day largely Arabic, but with distinct Romance and English morphological accretions. Italian lexical influence upon present day Maltese has exceeded the Arabic content in a quantitative sense, enriching Maltese from a purely root based morphology with additional productive Romance features.
1.
Introduction
The most recent theory relating to the origin of the Maltese language points to a direct Sicilian-Arabic connection. This claim, by Dionisius Agius (Agius, 1990; Agius, 1993; Agius,1996) and Joseph Brincat (Brincat, 1994), although supported by significant research findings by other contemporary scholars from different disciplines 1 , remains inconclusive (Bonanno, 1988; Borg and Alexander, 1978; Borg and Alexander, 1994). In the light of the prevailing knowledge of his times, Joseph Aquilina was on the right track when he proposed the Arabic of the Muslim Aghlabids of the Maghreb, as the most likely original source for the Maltese language (Aquilina, 1959). Even at this early stage Aquilina does not rule out a possible SicilianArabic link (Aquilina, 1988). In contrast to Aquilina’s thesis, the current Siculo-Arabic school of thought presents a revolutionary twist. It repositions the original source of Maltese from a direct northern African origin to an offshoot of Sicilian Arabic. This theory reinforces the notion that the form of Arabic which was adopted in Malta, as the forerunner of today’s Maltese, was already tainted with non-Arabic Language influences from its very inception (Agius, 1996; Brincat, 1995). Whilst considerable language convergence exists between Maltese and Siculo-Arabic
64
Roderick Bovingdon and Angelo Dalli
(Agius, 1996), there still remain significant unexplained aspects of inquiry into early Maltese 2 . The answers to most unexplained lines of inquiry, as sparse as the remaining evidence may be, may very well be laying dormant within the more subtle and distant aspects of early Maltese. The grammar and morphology of modern Maltese remain to this day Arabic, with distinct Romance and English morphological, and increasingly lexical, accretions (Aquilina, 1979; Mifsud, 1995). A thorough combing of European, North African and Turkish depositories as well as of private Maltese collections, has the potential of uncovering major revelations, as given in the relatively recent contributions in Wettinger and Fsadni (1968), Cassola (1992 and 1996), and Brincat (1995). Scholarship of Maltese has taken great strides forward by way of research, both within the spheres of linguistics as well as from a purely historical perspective (Cassola, 1992; Mifsud, 1995). Wettinger’s exposure of Vatican Manuscript 411 deserves closer scrutiny as a possible significant link between medieval Maltese and Arabic, as well as being a valuable pointer to the existence of other similar contemporary documents elsewhere, including possible links to Hebrew (Wettinger, 1979). The quantity and significance of recent documentary discoveries relating to medieval Maltese, are highly suggestive of even earlier records of written Maltese. Such exciting finds could provide scholars with the elusive missing linguistic links, bridging the gap between the pre-Arabic and Arabic beginnings. This need not necessarily conflict with Agius’ and Brincat’s postulations, as there is already ample evidence of the strong Siculo-Arabic connection. Agius openly claims, in his major work on Siculo Arabic, that Maltese is a direct offshoot of Siculo-Arabic with no connections to the north African littoral 3 . Brincat (1994) emphasises the lack of a substrate for the pre-Arabic period. The distinct possibility of remnants of a pre-Arabic substrate concealed within the later Siculo-Arabic strata is suspected.
2.
Non-Arabic linguistic influences on contemporary Maltese
Traditionally the Romance element in Maltese was thought to commence with the coming of the Normans from 1049 onwards. Nowadays the year 1127 is perceived as a more realistic date in historical terms (Cassar, 2000). The preNorman Arabic content appears to have been heavily Sicilian based (Brincat, 1995). Brincat’s contention that the lack of a substrate is the strongest pointer to a Siculo-Arabic genus 4 holds much merit along with Agius’ extensive approach to such origins.
Statistical analysis of the source origin of Maltese 2.1
65
Knights of St. John of Jerusalem
The more overt lexical and the later morphological Romance additions to Maltese, had to wait for the arrival of the religious Order of the Knights of St. John of Jerusalem, circa 1530, before any significant inroads began to become apparent. The Arabic-oriented populace of Malta, left to its own devices, continued to interact harmoniously for a long period of time, within a Muslim 5 , Christian 6 and Jewish milieu. Under the Knights, direct rule was introduced 7 , with the consequent imposition of the foreigners’ will and culture. During this long period in Malta’s history between 1530 and 1798, the Maltese came under more direct and imposing influence from the Romance element, due to the comparatively large numerical presence of Knights 8 , with an increasing quantity of Romance words and phrases from different regions of the Italian mainland (especially from the northern regions of Italy) being absorbed into Maltese. The increased social interaction with the local populace through this direct rule was an overriding force impinging on every aspect of the indigenous Maltese way of life, not least the language admixture. The Order’s rule over Malta lasted for over two centuries. During this vibrant period in the archipelago’s history, this considerably increased interaction between the rulers, the Knights, and the general populace, consisted for the most part in a master-subordinate relationship. It is important to note this point, as such social interaction between the overlords and the general populace meant that several aspects of the rulers’ culture, not least their predominantly Romance languages, imprinted their influences on the mainly peasant indigenous stock. After the Order was ousted from the islands by the French under Napoleon in 1798 – who in turn saw their demise after only two years’ occupation – the British rule took possession for the next century and a half. 2.2
Modern Italian
Ironically, the greatest linguistic inroads from the Italian mainland occurred during the early days of the British rule 9 . Owing to the political turmoil aroused on the Italian mainland, during the unification of Italy many political refugees sought and were granted political asylum in the British protectorate of Malta. These émigrés, who included a number of prominent Italian intellectuals and politicians, banded together and formed a strong political lobby of their own. With Malta’s long tradition of strong political, cultural, administrative, religious and linguistic influence from the Italian mainland as well as from Sicily, these émigrés found many sympathisers amongst the local population (Friggieri, 1979). A considerable number of newspapers in the Italian language flourished on the island, stimulating the adoption and spread of modern Italian Language influence
66
Roderick Bovingdon and Angelo Dalli
on both the Maltese idiom, as well as Maltese thought 10 . The infamous Language Question of the late 1920s and early 1930s, when the British colonial power squeezed out Italian from officialdom, saw the insertion of Maltese as the language of common parlance, while English took the coveted functionality of Italian. This political manoeuvring marked a phase when Italian linguistic influence suffered a temporary though prolonged lull (Fuccio, 1933; Hull, 1993). Modern Italian has since made vast inroads into contemporary Maltese, mostly through the influence of Italian television, which enjoys a wide following in Malta. So strongly has this new influx been felt that the large quantity of Italian lexemes entering Maltese has affected the morphology of the language – a phenomenon indicated by the statistics presented in this study. Contemporary Italian borrowings can be distinguished with ease from those previously adopted during the much earlier pre-British period 11 . These additional and more significant Italian influences have markedly shaped Maltese with distinctly European traits. Such trend emanates from the intellectual class which consistently borrows new terminology, mostly from Italian, with increasing inclusions from other European languages; these being the dominant language sources whence contemporary intellectual, scientific and technological innovations originate. This study clearly shows that Italian lexical influence on present-day Maltese, if only by way of numerical representation, has surpassed the Arabic content. Italian morphological influences have taken hold to such an extent that the updating of Maltese grammars to include this aspect is being considered. Such development has evolved Maltese from a purely root-based morphology, as a typological feature of its Semitic past (Schweiger, 1994), with the additional productive Romance feature of catenation (Mifsud, 1995). 2.3
English
The most recent linguistic influence on Maltese is English. English has steadily and increasingly affected Maltese, adding another language facet to the overall structure of Maltese (Mifsud, 1995). Interestingly enough, despite these recent accretions from English and the vastly different morphological structure of the two languages, the assimilation of English lexemes into a Maltese mould, occurs with the least possible disturbance to Maltese morphological structure. By comparison, contemporary Arabic, under the influence of similar pressures of modern life, as well as the ever-changing world political scene, when borrowing from English and American-English, is adopting similar assimilative patterns as Maltese (Holes, 1995). In the case of Maltese, this is especially so with verbs, where the basic structure of the English word is left intact while other morphemes in the form of mainly prefixes and suffixes take over (i.e. the stem does not change its internal make-up).
Statistical analysis of the source origin of Maltese
67
Other linguistic devices, also of a Semitic nature, such as gemination of the initial radical in the case of verbs that are frequently preceded with a euphonic i, are also at work (Mifsud, 1995). Furthermore, as a result of this linguistic enrichment and infusion, Romance affixes assimilate naturally with both Semitic and English lexemes as an intrinsic part of standard Maltese grammatical structure. 3.
Statistical and analytical results
The data used in this statistical analysis has been sampled from the Maltilex Project’s corpus as of November 2001. The Maltilex Project is a joint effort between the Department of Computer Science and AI and the Institute of Linguistics at the University of Malta. Its aim is to produce the first national collection of computerised language resources for Maltese (Rosner et al., 1999; Rosner et al., 2000). The Maltilex corpus is made up of a representative mixture of newspaper articles of different kinds, including local and foreign news coverage, sports articles, political discussions and others, together with transcripts of radio shows, official government publications and some novels. When this statistical analysis was performed the corpus had 1.8 million words consisting of almost 70,000 different word forms. 3.1
Selection methodology and analysis tools
A representative sample of 1,000 words was needed for the purpose of this study. The sample was selected using a strictly random process to ensure the validity of our statistical results. A chaotic function was used to assign a random number to all 70,000 unique word forms in the corpus, permitting a randomly ordered list of words to be created. This list was then examined and the following modifications were made: 1. Spelling Mistakes – Spelling mistakes were immediately corrected. Words that were spelled ambiguously were excluded from the list. This kind of modification and filtering is statistically sound since no attempt is made to influence the contents of the list. During the cleaning process the data was also converted into Unicode format to be universally accessible by all analysis tools. 2. Hapax Words – The word occurrence frequency in the corpus was examined for every word and all hapax words were automatically removed. This process removed most superfluous and arcane words that were accidentally inserted in the corpus and that appeared in the sample. This process can be statistically justified since hapax words can be seen as
68
Roderick Bovingdon and Angelo Dalli outliers that can be safely removed without affecting the validity of the resulting analysis.
The etymology and class was noted down for every word in the sample. When a word had more than one class, the word entry was duplicated and a single category was entered for every word. In order to maintain accurate statistics, a weight was added to every entry representing the number of classes associated with a particular word. Thus every entry of a word having n classes was assigned a weight of 1/n. A total of 1034 entries were thus obtained, representing all possible etymology/word class pairs for the sample word forms. The data matrix that was obtained was analysed using a custom-written data mining tool to extract statistics about the relationship between etymology and word classes in Maltese. Overall statistics about the source language origins of Maltese together with the most commonly occurring word classes was also extracted. The use of a data mining tool enabled us to analyse the data from two different perspectives – word class distribution for every etymological class and vice-versa. 3.2
Etymology
In our data sample, most of the words derived from Italian, Arabic and English.
Source Origin of the Maltese Language
It 54%
Other 5%
Eng 4% Eng>Dutch 0%
Ar 41%
Eng>It 1%
Ar Eng Eng>Dutch Eng>It It
Figure 1: Source Origin of the Maltese Language There were also some isolated cases of Italian and Dutch etymons 12 finding their way into Maltese through English. In the analysis these languages are denoted by
Statistical analysis of the source origin of Maltese
69
the codes It, Ar and Eng respectively. The isolated cases are denoted as Eng > It and Eng > Dutch respectively. Figure 1 shows the source origin of the Maltese Language, with Italian words forming the majority of the words at 54%, Arabic at 41% and English at 5%. Table 1 shows a summary of the etymological analysis data 13 , showing the exact number of word forms pertaining to every etymological class. Table 1: Maltese Language Etymology Summary Etymology Ar Eng Eng>Dutch Eng>It It
Count 411 36 1 9 543
Following this summary analysis we then split up the data set according to the three main source languages and further analysed the source languages’ contribution in terms of word classes. The following abbreviations were used to denote different word classes: adj – adjective; adv – adverb; conj – conjunction; demon – demonstrative; interj – interjection; n – noun; pers – personal; poss – possessive; pp. – participle; prep – preposition; pron – pronoun; v – verb. The word classes were further annotated with m, f, pl and dual to denote masculine, feminine, plural and dual forms of word class respectively.
Arabic Grouped Word Classes
n 21%
adv 2% pp 4% Other 9%
v 66%
Figure 2: Arabic Word Classes
adj 2% pron 2% prep 2% conj 1%
v n pp adv adj pron prep conj
70
Roderick Bovingdon and Angelo Dalli
Figure 2 shows the summary results for Arabic word classes, showing this language source as a significant contribution in terms of verbs, and to a lesser extent, nouns.
Italian Grouped Word Classes
v 29%
adj pp 11% 9% adv 3%
interj 0% conj 0%
n 48%
Other 0%
n v adj pp adv interj conj
Figure 3: Italian Word Classes Figure 3 shows the summary results for Italian word classes, showing Italian’s significant contribution in terms of nouns, and to a lesser extent, verbs. This further mirrors the significant contribution of Arabic. Figure 4 shows the summary results for English word classes. The relatively low percentage of English words (5% of the total) is consistent with established Maltese literary convention. This result seems to underestimate the percentage of English words in common Maltese parlance. From a purely lexical viewpoint Standard Maltese comprises 41% from Arabic origins, 54% from Italian and 9% from English as illustrated in Figure 1. Linguistically this points to a predominantly Italian influence with English slowly edging its way into the Maltese mould. The Arabic content, on the other hand, at surface value appears to be waning to a marked degree, bearing in mind that Maltese is still looked on as belonging to the Semitic fold. A deeper analysis justifies the continued classification of Maltese with the Semitic family of languages. Table 2 presents percentage data formed from the comparison of the word classes in each of the three source language groups, illustrated in Figures 2, 3 and 4.
Statistical analysis of the source origin of Maltese
71
.
English Grouped Word Classes
pp 7%
n 63%
v 22%
adj n pp v
adj 8%
Figure 4: English Word Classes
Table 2: Word Class Composition Class Verbs Adverbs Nouns Adjectives Participles Pronouns Prepositions Conjunctions
Arabic 66% 2% 21% 2% 4% 2% 2% 1%
Italian 29% 3% 48% 11% 9% 0% 0% 0%
English 22% 0% 63% 8% 7% 0% 0% 0%
The following insights can be obtained from Table 2: 1. Smaller word classes in the category of pronouns, prepositions and conjunctions are not favoured either from the Italian or the English lexicon. This trend attests to their stronger adherence to their older Arabic origins. Considering the sparse use of adverbs in the older (Arabic) Maltese, this word class appears to have no preference for English with a minor inclination towards Italian borrowings. 2. The major word classes impinging on Maltese from both Italian as well as English are the two main classifications consisting of the Verbs class together with the Nouns/Adjectives/Participles class.
72
Roderick Bovingdon and Angelo Dalli
These latter results strongly suggest that Maltese morphology, when borrowing from Italian, exhibits a distinctly stronger preference towards the nominal lexicology than the verbal portion, while English displays quite the opposite. Italian borrowings from the Nouns/Adjectives/Participles class show 68% nominal borrowings as opposed to English’s 78%. On the other hand, the Italian verbal borrowings from the Verbs class are not that much higher at 29% than their English counterpart of 22%. Considering the far lengthier historical-political connection with Italian mainland compared to the relatively recent and much shorter British connection, this result shows that verbal borrowing from English is increasing. 3.3
Word Classes
The contribution of the source languages to different word classes in the Maltese language necessarily entailed an etymological analysis. The data mining tool used for the analysis enabled us to split the data set according to word classes. This allowed us to analyse the composition of different word class groups according to the source languages. Figure 5 shows a summary of the word category classes in Maltese with verbs (43%) and nouns (37%) making up 80% of all words.
Word Categories of the Maltese Language v 43%
Other 5%
adv 3%
pp 7%
conj 1% interj 0%
n 37%
adj 7%
prep pron 1% 1%
adj adv conj interj n pp prep pron v
Figure 5: Word Categories of the Maltese Language Table 3 presents the normalized counts of all word classes in Maltese. The counts are not all integers since the actual counts are based on the 1,034 word sample that was created by duplicating word entries having multiple word classes, as previously explained. The count was then normalised to 1,000 words.
Statistical analysis of the source origin of Maltese
73
Table 4 presents the percentage data for the word classes in standard Maltese, as illustrated in Figure 5. Table 4 shows that an obvious preponderance of verbs over nouns in Standard Maltese, exceeding them by 6%. As such variation is not strong enough to indicate a distinct characteristic, it suggests that Maltese is a less concrete and a more conceptual language than formerly assumed. It therefore appears that contemporary Maltese, under the influence of its two main language sources, especially of recent times, is developing more abstract means of expression than it was previously able to impart. Table 3: Maltese Word Category Classes – Normalized Counts Word Class adj adv conj interj n pp prep pron v
Counts 73.5 26.83 5 1 368.5 68 6.83 8 442.34
A comparison of Table 2 and Table 4 points to a consistent trend towards the Maltese linguistic structure relying more heavily upon verbs and nouns than other word classes. The shifting from a purely root-based morphology to that of a more diversified form with the addition of concatenation is perhaps the most significant evolutionary device Maltese has adopted in recent times. Table 4: Maltese Word Category Classes – Percentages Word Class Verbs Adverbs Nouns Adjectives Participles Pronouns Prepositions Conjunctions
Percentile 43% 3% 37% 7% 7% 1% 1% 1%
74
Roderick Bovingdon and Angelo Dalli
Note 1
Including, amongst others, works by Arnold Cassola, Girolamo Caracausi, Adalgisa De Simone, Alberto Varvaro, Stanley Fiorini and Godfrey Wettinger.
2
A prime example is Alexander Borg’s investigation of the imaala phenomenon in Maltese, whose erratic behaviour is still left without a definitive explanation.
3
“..., my hypothesis is that contemporary Maltese, containing a mixture of Arabic and Romance, is directly linked with the Siculo-Arabic and not with North African dialects as has been so far believed.” (Agius, 1996, p.432)
4
There still lingers the remote possibility of linking Maltese to earlier origins than the current Siculo-Arabic claim. In this paper, the term Semitic includes, along with Arabic, the Berber element, owing to the long standing association of the Berber language with Arabic, both in Sicily as well as during much earlier times, along the North African littoral, with the considerable interchange between the two lexicons. Also such term is intentionally applied as an all-inclusive reference to any remote possible language influences from the wider Semitic language group. In similar manner, the terms Romance and Italian, for the scope of this study, include medieval and modern Sicilian and Italian, with all their dialectal and regional variations, as well as French and Andalusian Spanish with its own Arabo-Berber influences included.
5
The population of the Maltese Islands in 1240 consisted of the following family distribution: 836 Saracens (Muslims), 250 Christians and 33 Jewish (Wettinger, 1968, pg. 33).
6
According to the official report by the Apostolic Delegate Dusina in 1574, the Christian population of Malta, including the clergy, was lax in the extreme. Thus, at this relatively late date, one might be inclined to contemplate a religious belief and custom predominated by the numerically stronger Muslim presence.
7
Prior to the Knights, Malta’s affairs were handled from the occupying power's overseas quarters.
8
Mainly Italian, Portuguese, Spanish and French. The German Knights do not appear to have exerted any influence either upon the Maltese language or the culture of the populace (Aquilina, 1976).
9
Prior to British rule, Maltese had not acquired the status of a literary language. The main Romance linguistic influence made its entry mainly
Statistical analysis of the source origin of Maltese
75
through the spoken idiom rather than literary texts or formal learning methods. Hence the Romance lexical material entering Maltese was of the most basic type, enabling it to become molded within Maltese Semitic morphology with relative ease. In contrast, during the British rule, the learning of Italian was formally imposed upon the populace through the educational system, as well as the general culture of the local ecclesiastical authorities, the administration, the law courts and the press. 10
Dormant notions of nationhood and nationalism were stimulated, resulting in the first formations of formal and popular political agitation with the resultant linguistic bent towards an Italianate mode of linguistic expression.
11
The early Romance element in Maltese became intrinsically integrated into the basic language structure, while the more modern and erudite forms of Italian, with increasingly less input from Sicilian and Southern Italian, tended to resist full assimilation.
12
Like fissuri (fissures) and jott (yacht).
13
In this case, word duplications due to a word having multiple word classes were not included, hence the sample size of 1,000 words.
References: Agius, D. (1990), ‘Il-Miklem Malti: A contribution to Arabic lexical dialectology’, British Society of Middle Eastern Studies Bulletin, 17:2. Agius, D. (1993), ‘Reconstructing the Medieval Arabic of Sicily’, Languages of the Mediterranean, Msida: University of Malta. Agius, D. (1996), ‘Siculo Arabic’, Kegan Paul International, 12. Aquilina, J. (1959), The Structure of Maltese, Valletta: University of Malta. Aquilina, J. (1979), Maltese-Arabic Comparative Grammar. Libya: Socialist People’s Libyan Arab Jamahiriya Press. Aquilina, J. (1988), ‘Criteri di etimologia siculo-maltese’, Malta e Sicilia: Contiguita e Continuita Linguistica e Culturale. Catania: Gruppo Linguistico Catanese. Aquilina, G. (1988), ‘Il lessico agricolo e meteorologico nel maltese e le sue fonti arabe e siciliane’, Journal of Maltese Studies. Malta: University of Malta. 17-18. Bonanno, A. (1988), ‘Contiguita e continuita culturale e linguistica fra Sicilia e Malta in eta prearaba’, Malta e Sicilia: Contiguita e Continuita Linguistica e Culturale. Catania: Gruppo Linguistico Catanese.
76
Roderick Bovingdon and Angelo Dalli
Borg, A. (1978), A historical and comparative phonology and morphology of Maltese. M.A. Thesis, Msida: University of Malta. Borg, A. (1994), ‘On some Mediterranean influences on the lexicon of Maltese’, Blaustein Institute for Desert Research and Ben Gurion. Israel: University of Beer Sheeva. Brincat, G. (1994), ‘Gli albori della lingua maltese: il problema del sostrato alla luce delle notizie storiche di al-Himyari sul periodo arabo a Malta (8701054)’, Languages of the Mediterranean. Msida: University of Malta. Brincat, J. (1995), ‘Malta 870-1054: Al Himyari's Account and its Linguistics Inplications’. Msida: University of Malta. Cassola, A. (1992), The Bibliotecha Vallicelliana Regole per la Lingua Maltese. Egypt: Said International. Cassola, A. (1996), Il Mezzo Vocabolario Maltese-Italiano del '700. Egypt: Said International. Cassar, C. (2000), Society, Culture and Identity in Early Modern Malta. Msida: Mireva Publications. Friggieri, O. (1979), Storja tal-Letteratura Maltija. Malta: Klabb Kotba Maltin. Fuccio, G. (1933). ‘Il Conflitto Anglo-Maltese’, Quaderni dell'Istituto Nazionale Fascista di Cultura, Treves-Treccani-Tumminelli, 3:8. Holes, C. (1995), Modern Arabic: Structures, Functions and Varieties. London: Longman Linguistics Library. Hull, G. (1993), The Malta Language Question. Egypt: Said International. Mifsud, M. (1995), Loan Verbs - A Descriptive and Comparative Study. Leiden: Brill. Schweiger, F. (1994), ‘To what extent is Maltese a Semitic Language?’, Languages of the Mediterranean. Malta: University of Malta. Rosner, M., R. Fabri, J. Caruana, M. Lougraïeb, M. Montebello, D. Galea and G. Mangion. (1999), Maltilex Project. Malta: University of Malta. Rosner, M., R. Fabri and J. Caruana. (2000), ‘Maltilex: A Computational Lexicon for Maltese’. Msida: University of Malta. Wettinger, G. (1973), ‘Arabo-Berber Influences in Maltese: Onomastic evidence’, Proceedings of the First Congress on Mediterranean Studies of AraboBerber Influence. Msida: University of Malta. Wettinger, G. (1979), ‘Late Medieval Judaeo-Arabic Poetry in Vatican MS411: Links with Maltese and Sicilian Arabic’, Journal of Maltese Studies. Msida: University of Malta. 13. Wettinger, G. and M. Fsadni. (1968), Peter Caxaro's Cantilena: A Poem in Medieval Maltese. Valletta: University of Malta.
Discovering regularities in non-native speech Julie Carson-Berndsen1, Ulrike Gut2 and Robert Kelly1 University College Dublin 1 University of Bielefeld 2 Abstract This paper presents ongoing collaborative research which focuses on the application of computational linguistic techniques to the analysis of a corpus of native and non-native speech. The aim of this research is to use computational tools for modelling phonological acquisition and representation to identify regularities and sub-regularities between different speaker groups. The corpus is being collected and annotated at different levels as part of ongoing research into the acquisition of prosody by non-native speakers at the University of Bielefeld. The computational tools have been designed and implemented at University College Dublin as part of a development environment for modelling, testing and evaluating phonotactic descriptions of lesser-studied languages.
1.
Introduction
It is a well-known and easily observable fact that non-native speakers sometimes produce syllables in their speech which violate the phonological rules of the foreign or target language. This can have various causes: the simplest is that a speech sound is produced which does not exist in the language being learned. Alternatively, a sequence of sounds may be produced which is not permissible in the target language. This constitutes a violation of the phonotactic rules of the language. Many explanations have been put forward to explain the occurrence of these types of errors, of which the claim that speakers transfer phonological rules of their native language to their productions in the target language is the most popular one. The majority of studies on the acquisition of phonotactic rules are based on small numbers of participants, which reflects the time-consuming nature of a manual analysis of this kind of data. There are two specific aspects which motivate the work presented here. The first, a more computational linguistic motivation, is primarily concerned with the acquisition and evaluation of phonological structure that can be usefully employed in speech technology. The second motivation, a more theoretical linguistic motivation, is concerned with the application of the comparative methodology in the context of the phonological analysis of non-native speech. Each of these motivations is now addressed in turn in sections 2 and 3. Section 4 discusses a specific representation of phonotactic constraints and section 5 presents a set of finite state tools which are used to learn regularities from a phonological corpus. In section 6, a particular corpus containing data from non-
78
Julie Carson-Berndsen, Ulrike Gut and Robert Kelly
native speakers of German with two different native languages, Italian and Polish, is used for a study of phonotactic errors found in non-native speech. Section 7 concludes with a discussion of future work. 2.
Ubiquitous Acquisition of Phonotactic Constraints
Ubiquitous language technology concerns the development of language technologies for different purposes on different platforms so that they can be made available to everybody at all times rather than to a select group for specific purposes. Clearly this is a long-term goal which involves a rethinking of current approaches to speech and language technologies combined with an enhancement based on information of varying levels of granularity paving the way for the development of robust multilingual applications which are easily scalable. One immediate prerequisite to this is the provision of a methodology which can be applied to numerous languages in order to accumulate descriptions which can be reused with varying speech technologies. One particular technology to which this approach is being applied is based on the Time Map Model (Carson-Berndsen, 1998). This model defines the constraints on permissible combinations of sounds in a language in terms of a phonotactic automaton. The advantage of this approach is that each sound in the language is described with respect to the structural context (both preceding and following) in which it can occur (see section 4). The phonotactic automaton thus models all possible syllables of a language and in this way caters for native speaker intuitions about the wellformedness of phonological representations. This paper presents an innovative methodology for automatic analysis of the phonotactics of spoken language based on a suite of finite state tools which have been developed primarily for use in multilingual ubiquitous speech technology. We are primarily concerned with the phonotactic level of description, which is employed in a computational linguistic approach to speech recognition and synthesis. We present an XML-based representation of various types of information defined with respect to the phonotactic context. This representation can be learned automatically from a phonemically labelled data set and can be processed to provide analyses of the phonological regularities which have been found. We demonstrate how this methodology can be applied to the task of phonotactic analysis of non-native speech. 3.
Phonotactics in Non-Native Speech
The term “phonotactics” refers to language-specific rules and constraints for how sounds can be combined in a syllable. A German syllable (ı) consists of three parts: an onset, a nucleus, and a coda (e.g. Wiese 1996). The nucleus constitutes the centre of all syllables and consists of one or two vowels (V). The onset comprises all prevocalic consonants (C) and can be filled with between zero and
Discovering regularities in non-native speech
79
four consonants. All postvocalic consonants form the coda. In German, a sequence of up to five consonants can occur in this position. Figure 1 illustrates this with the word springt’ jumps’. It has the three consonants [6S^] in the onset position, the vowel [,] as the nucleus and the two consonants [1W] in the coda position.
Figure 1: The syllable structure of the German word springt. Two kinds of syllable types can be distinguished in German (Carson-Berndsen, 1998): non-reduced and reduced syllables. Non-reduced have between zero and three consonants in the onset position, a short or a long full vowel (or diphthong) and up to four consonants in the coda position. Reduced syllables contain an optional single initial consonant, a weak vowel /l/ and an optional single final consonant. Reduced syllables are never accented. The occurrence and the ordering of consonants and consonant clusters in onset and coda is constrained by the phonotactics. An example of an occurrence constraint in German is for example that the phoneme /1/ is not permitted in the onset position and that voiced stops and fricatives such as /d/ and /v/ are not permitted in the final consonant position of the coda. Ordering constraints apply to the sequence of consonants within either onset or coda. The consonant cluster /lp/ for example is not permissible in the onset, but can occur in the coda position, as in the word Kalb [kalp] (see Kohler, 1995). It has often been observed that learners of a foreign language produce “illegal” consonant clusters in both the onset and the coda position. These differences between native and non-native speakers of a language are systematic and are therefore assumed to form part of the non-native speakers’ interlanguage, i.e. their current representation of the grammar of the target language. Several reasons for systematic phonotactic errors have been proposed: Carlisle (2002) claims that some onset consonant clusters in words are more marked (i.e. occur less frequently in all languages of the world) than others and that foreign language learners always acquire the less marked onsets before the marked ones. Similarly, Eckman (1991) proposed that the reduction of English final consonant
80
Julie Carson-Berndsen, Ulrike Gut and Robert Kelly
clusters by native speakers of Cantonese, Japanese and Korean follows universal principles, that is, they are reduced from more marked to less marked forms. These approaches assume that the non-native speakers’ interlanguage is governed by universal principles. Other researchers find influence of native language phonotactic rules in the productions of non-native syllables. Broselow (1984) examined the consonant cluster simplifications in English produced by Arabic native speakers and concluded that they directly reflect the phonotactic rules of their native languages. The underlying assumption is that the interlanguage of non-native speakers contains phonological rules of their native language. Due to the time-consuming character of phonetic analyses, many of these studies are based on a small number of speakers only. However, in order to test hypotheses about the nature of interlanguage structure and the cause of systematic errors, large-scale studies are necessary (cf. Carlisle, 2002). The object of this paper is to present tools for automatic analysis of non-native speakers’ production of syllable types which allows processing of large data resources and suggests a model for interlanguage representations. 4.
Representing Phonotactic Constraints
The underlying assumption in this paper is that phonotactic constraints for any language can be represented in terms of finite state automata which define acceptable sequences of sounds within a syllable or word domain. A subsection of a phonotactic automaton describing CC-clusters in English syllable onsets is depicted in Figure 2. The complete phonotactic automaton for English syllables allows for a distinction to be made between well-formed and illegal structures, i.e. although the word blick does not exist in English, the sequence of sounds is permissible and would be recognised as well-formed by a native speaker of the language, whereas the form bnick will always be rejected by native speakers of English as a possible word. A phonotactic automaton is language-specific and can be developed for each individual language. A multilingual time map (Carson-Berndsen, 2002) extends the functionality of a phonotactic automaton by combining language-specific information at various levels of granularity represented as a multilevel finite state transducer. The advantage of this representation, as with the phonotactic finite state automaton, is that it is declarative, bi-directional, efficient to process, and can be easily learned. The multilevel finite state transducer can be viewed as an extension of the phonotactic automaton to include (at least) the following levels: graphemes, phonemes, allophones, canonical form, features, constraints on overlap relations, average duration, frequency and probability. Each arc specifies information on all of these levels (although some of this information may not be available in all cases; however, the transducer can be readily updated at any time). This representation serves as the basis for the learning, analysis and comparison tools
Discovering regularities in non-native speech
81
which are presented in the next section. For the specific case study presented below, only the phoneme and canonical form levels are relevant to the discussion.
Figure 2: Subsection of phonotactic automaton depicting CC- onset in English. A multilingual time map is represented in XML with a visualisation in terms of a directed graph. A subsection of a German multilingual time map depicting two consonant clusters in onset position is visualised in Figure 3. The full information is shown for only one arc.
Figure 3: CC- onset in German.
82 5.
Julie Carson-Berndsen, Ulrike Gut and Robert Kelly Finite State Tools
This section presents a suite of finite state tools which have been developed for use in computational phonology applications motivated by the developments in linear and nonlinear finite state phonology (e.g. Kaplan & Kay, 1994; Bird & Ellison, 1994). The suite of tools is centred around two main programs GTI and PAL, which are described firstly in terms of their general functionality. At the end of this section the specific ways in which these programs underpin the finite state tools for phonotactic analysis are summarised. 5.1
The Generic Transducer Interpreter
The Generic Transducer Interpreter, GTI, is a program designed to read the structure of a finite state transducer (FST) and using this structure test a set of sequences of tokens for acceptance by that FST. FST structures are stored in XML marked up form. A FST consists of a set of states and state transitions. A single start state is defined and a subset of the states is designated as final states. The state transitions of a FST may have any number of tapes defining different transductions between tapes. A sequence of tokens is accepted by a FST if a path can be traced from the start state of the FST to a final state of the FST for that sequence. Starting with the initial state as the current state a path is traced by examining each successive token in the sequence to determine if a state transition can be applied from the current state. A state transition can be applied at a given state for a given token if there is a state transition in the state transition set having a source state matching the current state and transition symbols matching the current token. Test sequences are currently stored in text files in which sequences must be specified in a particular format. For GTI to test a set of sequences it must have specific tapes of state transitions in the FST defined as input tapes. Any number of input tapes can be specified (up to the number of tapes in the state transitions). Input tapes are those tapes of state transitions used to match the tokens of sequences against in order to determine if a state transition can be applied. Thus, each token of a test sequence is an item of input for the FST. If L tapes of state transitions have been specified as input tapes then each token in a test sequence must have L tapes also. If GTI detects that there are an incompatible number of tapes in any token of any sequence in the test file then an error is flagged. It is also possible to specify which tapes of state transitions are to be treated as output tapes. Output tapes are those tapes for which the result of a transduction is required. When a sequence is accepted on the input tapes of a multi-tape FST there will be associated outputs, namely the concatenation of the sequences of symbols present on non-input tapes. It may be necessary to examine the output produced by any one of these output tapes. Again, any number of output tapes can be specified (up to the number of tapes in the state transitions).
Discovering regularities in non-native speech
83
The names of both the FST file and the test sequence file together with input and output tapes are passed to GTI via the command line. If the FST file is in the correct format without error then GTI will create the FST as specified. As GTI tests each sequence, it reports whether the sequence was accepted or not when applied to the FST on the specified input tapes. Also, if output tapes are specified then the outputs are displayed for each output tape. Note that if the FST is nondeterministic that more than one acceptance path may be traced. In this case, the outputs for all successful acceptance paths are reported. It is also possible to output the actual trace(s) of state transitions for each accepted sequence. 5.2
The Phonotactic Automaton Learner
The Phonotactic Automaton Learner, PAL, is a program that takes a set of training sequences of symbols and learns the structure of a stochastic finite state transducer (SFST) that accepts the training sequences. The training sequences to be used by PAL are stored in a text file in which sequences must be specified in a particular format. The training sequences may have multiple tapes and in this case all tokens of all sequences must have the same number of tapes specified or an error will be flagged. Once learned, the SFST representation is as an XML marked-up form. The PAL program uses the ALGERIA machine induction algorithm (Carrasco & Oncina, 1999) to learn the structure of the required SFST. The algorithm works in two stages. First, a prefix-tree SFST is built from the specified training sequences. A prefix-tree SFST has a single start state with a single path from the start state to a final state for each of the training sequences. For each token in each training sequence there is a state transition between states along the unique path for that sequence. Also, if two training sequences share a prefix then there is a single path in the prefix-tree SFST for that prefix. The path diverges into distinct state transitions for the distinct postfixes after the final state transition in the common prefix. Each state transition in the prefix-tree SFST has a frequency of traversal dependent on the number of training sequences that share that state transition. The frequencies of state transitions are then used to identify the canonical SFST based on state merging. The state merging process is the second stage of the ALGERIA algorithm. Two states are merged into a single canonical state if the language generated from that point on is statistically identical (i.e. for each continuation path emanating from the first state there is a matching continuation path emanating from the second, both of which have a statistically identical frequency). If two states are merged then all state transitions in the prefix-tree SFST that refer to either of the two merged states, now refer to the newly created merged state. By the process of comparing each state with each other state in the prefix-tree SFST the canonical SFST is identified. The ALGERIA algorithm has an associated confidence level. This confidence determines how rigorous the learning of SFSTs is. The lower the confidence the less likely it will be that the learned SFST is absolutely correct, that is, the less
84
Julie Carson-Berndsen, Ulrike Gut and Robert Kelly
likely it will be that the learned SFST will accept only the training sequences. There is a default confidence which has been found by experimentation to be sufficient for effective learning, however, an alternative confidence can be specified. PAL accepts the name of a training sequence file and a destination for writing the learned SFST to as well as an optional confidence through a command line interface. In summary, GTI and PAL are used specifically in the context of the tools for phonotactic analysis of non-native speech as follows: The Learning Tool uses PAL to learn a deterministic finite state automaton from a phonemically labelled data set. This automaton defines the phoneme level of the multilingual time map and can be output as XML. A canonicalisation step allows each phoneme on each arc in the multilingual time map to be supplemented by its canonical form in terms of V or C. The final output is thus a two-level transducer. The Analysis Tool uses GTI to transduce from one level to another (e.g. phoneme to canonical form or vice versa). The Comparison Tool uses GTI to partition the data into accepted and rejected forms. An analysis summary shows how many forms were accepted or rejected. 6.
The study of phonotactic errors in non-native speech
This section is concerned with the application of the computational linguistic tools presented in section 5 to the corpus-based analysis of the phonotactics of non-native speech. The corpus used in this study is being collected and annotated at different levels as part of ongoing research into the acquisition of prosody by non-native speakers at the University of Bielefeld (see Milde & Gut, 2002). 6.1
Participants
The data are taken from the LeaP corpus 3 , which consists of prosodically annotated non-native speech of more than 70 speakers. For the study, three data sets were used consisting of speech produced by German, Italian and Polish native speakers. The German natives are all speakers of Hochdeutsch (Standard High German). The Italian native speakers were between 21 and 31 years old when they were recorded and had been living in Germany for between two months and five years. They all studied German at school or at University level for up to six years prior to their arrival in Germany. The Polish speakers were between 22 and 29 years old at the time of recording and had been living in Germany for a period of between eight months and six years. They all have a University degree in German from their home country, where they studied German for between four and six years. All speakers were intermediate to advanced speakers of German and had no active knowledge of German phonotactic rules.
Discovering regularities in non-native speech 6.2
85
The Data
Recordings consisted of three parts. First, a short interview (approximately ten minutes) was conducted with the non-native German speakers, in which various questions about their language learning history such as age at first contact with German and length of formal instruction were asked. Second, the participants were asked to read out a short story. Third, they re-told the story in their own words and without reference to the written text. All recordings were carried out in Bielefeld in either a sound-treated or a quiet room. Only the readings were analysed for this study. The first set, German_Read, consists of three readings of a story by German native speakers. The second set, Italian_Read, consists of five readings (total of 624 syllables) of the same story by Italian speakers of German. The third set, Polish_Read, consists of five readings (total of 618 syllables) of the same story by Polish speakers of German. The acoustic analysis of the data was carried out using ESPS/waves+ and Praat and was done by one trained phonetician and four students with extensive training and experience in phonetic analysis. The data was annotated at a number of linguistic levels such as the level of the intonational phrase, the word, the syllable, and the skeletal (CV) structure, and comprises annotations of the prosodic structures of intonation and pitch range. The syllable level was then selected from the prosodic annotation as the relevant input for the finite state tools. All syllables were transcribed phonetically in SAMPA. Transcription was fairly broad but included processes such as nasalisation, unreleased stops and aspiration. In case of ambisyllabic consonants, half of the ambisyllabic consonants was considered to belong to the preceding syllable and half to the subsequent one. 6.3
Corpus-based investigation of non-native speech errors
The finite state tools described in section 5 were applied to the data sets described above in order to identify regularities in the phonotactic errors produced by Italian and Polish speakers of German. In each case a specific phonotactic automaton for each data set was constructed using the learning tool, PAL. In order to be able to filter the phonotactic errors, it was necessary to identify which forms produced by the Italian and Polish speakers adhere to the phonotactics of German. For this a complete manually constructed phonotactic automaton for German (from Carson-Berndsen, 1998) was used; this automaton is referred to as Phono_German_Comp.fsm below. The procedure involved the application of the learning tool, the analysis tool and the comparison tool as follows. The Learning Tool was applied to the German_Read data set to generate a finite state representation of the phonotactic forms used in the read speech of the German native speakers. The output of this was termed Phono_German_Read.fsm. The phonemic forms contained in the
86
Julie Carson-Berndsen, Ulrike Gut and Robert Kelly
Italian_Read data set were then compared against the Phono_German_Read.fsm using the Comparison Tool and the rejected forms were then compared against the Phono_German_Comp.fsm. This ensured that all forms which corresponded to the phonotactics of native speakers of German (the target language) were filtered and that any remaining forms in the data set corresponded to phonotactically ill-formed structures which had been produced by Italian native speakers of German. The Learning Tool was once again applied to these forms to produce an automaton representation of the ill-formed structures, termed Italian_Rejected.fsm. The Analysis Tool was applied to this data in order to map from the phonemic representations to the canonical CV form. This resulted in the data set, Italian_Read_Canonical, which characterised the canonical forms of all the phonotactically ill-formed structures in the Italian_Read set. Finally, the Comparison Tool was reapplied to associate all phonemic realisations with a canonical form so that particular phonotactic anomalies and regularities with respect to the target language could be identified. The flowchart for the application of the tools in this task is depicted in Figure 4 with respect to the Italian data.
Figure 4: The application of the finite state tools to the Italian data. An analogous procedure was followed for the analysis of the Polish_Read corpus. The results are presented in the next section. One point to be noted here is
Discovering regularities in non-native speech
87
that whilst the learning tool does, of course, generalise to some extent over these forms, there is no notion of complete coverage as defined in the data set, although currently we are investigating projection techniques to cater for gaps caused by the lack of data which would allow for a distinction to be made between idiosyncratic gaps and systematic gaps. This can be based on the notion of natural classes of sounds which function similarly in a particular phonotactic context. 6.4
Results
Table 1 lists the percentage and absolute number of syllables in Italian_Read and Polish_Read which were rejected after comparing them first to Phono_German_Read and then to Phono_German_Comp. Only syllable types were considered, that is, if a rejected syllable occurred more than once it was only counted as one rejection. Thus, after two rounds of application, a total of 54% of the syllables produced by the Italian non-native speakers and 48.7% of the syllables produced by the Polish non-native speakers were rejected. Table 1: % of rejected syllables.
% of syllable tokens rejected by Phono_German_Read
% of syllable tokens rejected by Phono_German_Complete
Italian
Polish
67% (418 of 624)
59.5% (368 of 618)
80.6%
81.7%
The results of the application of the Learning Tool to the remaining syllables were then classified manually into a) phonemic inventory errors (phonemes that do not occur in German were produced) b) onset consonant cluster errors c) coda consonant cluster errors Table 2 summarizes the results for the Italian and Polish speakers. Distinct differences between the phonotactic violations produced by the Italian and the Polish speakers can be seen. On the whole, the Polish speakers produce fewer errors; different types of illegal initial consonant clusters occur in the two speaker groups, and the postvocalic r (which is produced as an a-schwa in German) constitutes the major problematic area for the Italian speakers.
Julie Carson-Berndsen, Ulrike Gut and Robert Kelly
88
Table 2: Error analysis of Italian and Polish speakers of German.
Italian
Polish
7.
Phoneme inventory Errors 6 consonants, 5 monophthongs, 16 diphthongs
Onset consonant cluster errors
Coda consonant cluster errors
10 types, predominantly [nd], [mb]
2 types, 14 final voiced consonants, 27 postvocalic r
4 consonants, 3 monophthongs, 24 diphthongs
6 types, 2 initial consonants [x, N]
1 type, 11 final voiced consonants, 1 postvocalic r
Conclusion
In this paper we demonstrated how a suite of finite state tools can be applied to study the phonotactics of different varieties of spoken language. The results imply that research in second language acquisition can potentially benefit enormously from this methodology as it allows a rapid analysis of large corpora. While the corpus described in this study was relatively small, to perform a manual analysis of this data would have been a laborious task. Future work involves employing the tools to analyse phonotactic differences among other non-native speech groupings using the LeaP corpus. Currently this corpus consists of 253 annotated recordings of between 2 and 30 minutes’ duration by 88 different speakers with 21 different native languages. Since the corpus is annotated at a number of linguistic levels as described above, inter-level analyses are possible. For the application of the finite state tools, each level of annotation is viewed as a tier, analogous to the representations of autosegmental phonology (Goldsmith, 1990). Analysis can take place either with respect to individual tiers or with respect to an associated set of tiers. In the latter case, one tier is chosen as the primary tier and the others are associated with it in terms of overlap and precedence relations between the units as suggested in Carson-Berndsen (1998: 60). Using the computational linguistic tools, finite state automaton and finite state transducer representations of the tiers are extracted automatically from the annotated corpus. Regularities in the data are then identified either with respect to a single tier or with respect to an associated set of tiers. In addition to identifying phonotactic errors with respect to one non-native speakers of one particular language, we are also currently applying this methodology to the investigation of the phonotactics of typologically different languages, in particular spoken Yoruba and Igbo. Note 1
This work was part funded by an Enterprise Ireland Resreach Innovation Fund grant (no. IF/2001/021) and an Enterprise Ireland International Collabortaion grant (no. IC/2002/053).
Discovering regularities in non-native speech
89
2
The LeaP project is funded by the MSWF (Ministry for Education of North-Rhine Westphalia, Germany).
3
http://www.spectrum.uni-bielefeld.de/LeaP/
References Bird, S. & T. M. Ellison (1994), One - level phonology: autosegmental representations and rules as finite state automata, Computational Linguistics 20: 55-90. Broselow, E. (1984), An investigation of transfer in second language phonology. International Review of Applied Linguistics 22 (4), 253-269. Carlisle, (2002), The Acquisition of Two and Three Member Onsets: Time III of a Longitudinal Study. Proceedings of New Sounds 2000, pp. 42-47. Carrasco, R. C. & Oncina, J. (1999), Learning deterministic regular grammars from stochastic samples in polynomial time, ITA, Vol.33, No.1, 1-19. Carson-Berndsen, J. (2002), Multilingual time maps: portable phonotactic models for speech technology. In Proceedings of the LREC 2002 workshop on Portability Issues in Human Language Technology. Carson-Berndsen, J. (1998), Time map phonology. Dordrecht: Kluwer. Eckman, F. (1991), The structural conformity hypothesis and the acquisition of consonant clusters in the interlanguage of ESL learners. Studies in Second Language Acquisition 13, 23-42. Goldsmith, J. (1990), Autosegmental and Metrical Phonology, Cambridge, Mass: Basil Blackwell. Kaplan, R. & M. Kay (1994), Regular models of phonological rule systems, Computational Linguistics 20:331-378. Kohler, K. (1995), Phonetik des Deutschen. Berlin: Erich Schmidt. Milde, J.-T. & Gut, U. (2002), A prosodic corpus of non-native speech. In: B. Bel & I. Marlien (eds.) Proceedings of the Speech Prosody 2002 conference, 11-13 April 2002. Aix-en-Provence: Laboratoire Parole et Langage, pp. 503-506. Wiese, R. (1996), German phonology. Clarendon: Oxford.
This page intentionally left blank
Tracking lexical changes in the reference corpus of Slovene texts Vojko Gorjanc University of Ljubljana Abstract The text focuses on lexical borrowings from English, introduced into Slovene in the last decade of the 20th century. Using the FIDA corpus, a reference corpus of Slovene, new lexical items can be tracked over the last decade: by means of corpus analysis, we can determine when a word entered in the Slovene language and how it established itself in the language. Corpus analysis reveals great creativity of Slovene language speakers; in addition to loan words, original Slovene coinages occur almost invariably. Corpus data shows a great deal of variability originating from the desire of the speakers of Slovene to coin new expressions, but after a few years, the data begin to reveal the prevailing variant.
1.
Introduction
With the help of a corpus, we can track lexical changes quickly and reliably, and also observe the response of a selected language to new lexical items introduced into it from other languages, e.g. English, or some other language with which the selected language has direct contact, in the case of Slovene, these are Italian, German, Hungarian or Croatian. This paper focuses on lexical items introduced into Slovene in the last decade of the 20th century. The starting point for the comparison with the state in the corpus of the Slovene language is John Ayto’s list of English lexical items from the 1980s and 1990s (Ayto 1999); the subsequent corpus analyses focus on lexical items from the fields of the Internet and computer science. With corpus investigations, we will try to determine how the Slovene language reacts to lexical items introduced into Slovene from English. Using the corpus, we can track the new lexical items through the last decade, and observe their characteristics in the corpus. 2.
The Corpus
The Corpus of the Slovene Language, called FIDA, is a reference corpus of Slovene compiled by a consortium of four project partners: University of Ljubljana (Faculty of Arts), Jozef Stefan Institute Ljubljana, DZS Publishing House and Amebis software company (http://www.fida.net). The corpus is composed of contemporary Slovene texts, the majority of which were published
Vojko Gorjanc
92
in the 1990s. The corpus contains just over 100 million words, encompassing a broad variety of language variants and registers. It is composed of written texts and texts originally produced as written-to-be-spoken. The transcripts of Slovene parliamentary proceedings are the only spoken component of the corpus. The basic corpus characteristics according to taxonomic corpus parameters are (in %): Medium
spoken electronic written
Text type
1.97 0.03 98.00
literary technical other
Linguistic proofreading
5.94 18.46 75.60
yes no unknown
63.92 3.13 32.95
The FIDA corpus is lemmatised and morpho-syntactically tagged, but all the tagging was done automatically without the possibility of disambiguation in cases where double or even multiple lemmas were possible. Since Slovene is a morphologically complex language, double or triple lemmas are frequent, which makes statistical data from the corpus unreliable to some extent. In the last few years, some significant steps were taken to solve the problem, both by testing the existing language-independent tools and by developing new ones (Džeroski and Erjavec, 2000; Mladeniü, 2002) but the situation is still far from ideal. Although less acute, the lemmatisation of non-lemmatised words is another problem waiting for the improvement of text processing tools for Slovene. The lemmatisation of the FIDA corpus was based on the lexicon developed by the software company involved in the project. Experiences show that in certain cases non-lemmatised words skew the results of statistical analysis, so all these have to be taken into account when interpreting the corpus data (Gorjanc and Krek, 2001). 3.
Methodology
Using a wordlist from the Slovene corpus, we will obtain information on the lexical items from Ayto's list relevant for the Slovene language. By means of corpus analysis, we will determine when a word occurs in the Slovene language and how it establishes itself in the language, and by means of statistical analysis, we will determine the possible collocations of the selected word and their changes from the first occurrence of the word until the end of the decade. Since pairs of synonyms or strings often occur with new expressions, we will try to determine how they occur in the corpus and how they disappear. With the help of markers of semantic relations already identified for the Slovene language by corpus analysis, we will identify pairs of synonyms and strings within the corpus. We will focus on the distribution of synonyms within the corpus regarding the time of their
Tracking lexical changes in the reference corpus of Slovene texts
93
occurrence, and consider when and why one of the synonyms becomes dominant in the language while the other variants disappear. 3.1
Extracting collocations
For extracting collocations, the MI3 value introduced by McEnery et al. with information on the probability of a word pair occurring together or separately will be used (McEnery, Langé, Oakes and Véronis 1997). The MI3 value has turned out to be sound information for content words in Slovene. On the other hand, with this value it is hard to determine function words as part of collocations; in particular, in the case of collocators of verbs and nouns with prepositional phrases. For instance, to detect propositional words, raw statistics provide more valuable information. After detection, a noun + propositional word pair, for example, the MI3 value for the whole pair is calculated to extract the string of collocators. The comparison of results between T, MI and MI3 values for the Slovene corpus shows that MI3 is the most effective of the three. MI introduced in Church and Hanks (1989) is far less effective, since the frequency of corpus elements is underestimated and a single co-occurrence of two elements in the corpus gives high scores which can diminish the importance of more frequent lexical units (Manning and Schütze, 1999). This fact is even more relevant in the case of the FIDA corpus, since specific forms of non-lemmatised words are attributed high MI scores. To some extent, MI3 neutralises the effects of low frequency of a corpus element which is why it gives better results for collocations. The noun raþunalnik (Engl. computer) with collocators according to MI and MI3 values in the FIDA corpus (frame 3) MI3 raþunalnik oseben (Engl. personal) (Engl. computer) prenosen (Engl. portable) na (Engl. on) vaš (Engl. your) biti (Engl. to be) z (Engl. with) in (Engl. and) v (Engl. in) poznavanje (Engl. knowing) za (Engl. for) delo (Engl. work) moj (Engl. my) uporabljati (Engl. to use) zmogljiv (Engl. high capacity) zagnati (Engl. to start)
MI =uporablja =appleov =deskpro =skreširani =pomeþite =nnnn =gxi =upsajo =85prenosni =megatronski =macintosch =optiplex =sprojektiram =blagajniþarska =dlanþni
94
Vojko Gorjanc internet (Engl. Internet) ki (Engl. which) uporaba (Engl. useage) =windows* delati (Engl. to work) * = non-lemmatised
=brskalnemu =vseuporabljajo =pc486 izklopitev =ignororajo
By using MI3 values, we obtain relevant results for collocations, while the highest MI values are generally non-lemmatised words, mostly spelling errors. From the point of view of non-lemmatised words the results are interesting, since they reveal some of the problems the speakers of Slovene have with forming new words, e.g. the adjective derived from the name Apple; in Slovene there is an attempt to use the suffix -ov, appleov. 3.2
Identifying markers of semantic relations
Semantically related words – synonyms, hyper- and hyponyms, abbreviations often collocate or appear in similar contexts and it is usually possible to identify the domain of a word on the basis of its textual environment. When we want to explain the relations between concepts within the reality portrayed, we often use explicit linguistic structures or phrases, such as X is defined as Y, X is an instance of Y, There are several types of X, for example A, B, C etc. So, if we, for example, identify the pattern “A, also known as B” to indicate complete or near synonymy, we can extract the noun phrases linked by the pattern as pairs of synonyms. Similar methods are proposed by several authors in the field of terminology, either for the purpose of an automatic construction of knowledge databases (Bowden et al., 1996), conceptual sampling for terminography (Meyer et al., 1999) or simply a search for synonyms in a corpus (Pearson, 1998). For Slovene the most frequent markers were identified by analysing the FIDA corpus. For synonymy, these markers are ali (Engl. or), ali tudi (Engl. also), imenujemo tudi (Engl. we also refer to it as), imenovan* tudi, (sinonim _) (Engl. also referred to as), je sinonim za (Engl. is a synonym for), znan* tudi kot (Engl. also known as), znan* tudi pod imenom (Engl. also familiar as), z drugim imenom (Engl. also called), ... (Vintar and Gorjanc 2000). For the purpose of this paper, these findings were used to extract pairs or strings of synonyms of selected words. Internet ali medmrežje, kot so ga izvirno poslovenili /.../, že dolgo ni veþ neznanka povpreþnemu Slovencu. Pair of synonyms: internet medmrežje
Tracking lexical changes in the reference corpus of Slovene texts 4.
95
Corpus analysis
In this analysis, we will focus on some key lexical elements, from the field of the Internet, which have undergone the process of being accepted into the Slovene language. Keeping the loan words unchanged, the most passive response of recipient-language users is confirmed as temporary and it leaves open the possibility for coining new terms; it turns out that if the new terms are formed in a way which is acceptable to users, no problems arise in introducing the Slovene variant. Let us illustrate this, using the example of the term World Wide Web, and its Slovene variant, svetovni splet (the graph below is in %).
100 80 60 40 20 0 1994
1995
1996
world wide web
1997
1998
1999
svetovni splet
Figure 1: Occurrences of World Wide Web, and its Slovene variant, svetovni splet in the FIDA corpus between 1994 and 1999 In the two years after its first appearance, only the loan word occurs in the corpus, but when the Slovene variant appears, it immediately becomes a successful rival and the use of the loan word gradually decreases. In texts, the dominance of the Slovene synonym over the loan word is even more obvious in the case of another key word from the field of the Internet, i.e. home page. After eliminating corpus noise related to proper names of pages, it turns out that the Slovene term has dominated completely (91.8% of corpus occurrences). In addition to the calque domaþa stran (Engl. home page), there is also a new term predstavitvena stran (Engl. web presentation page) coined in Slovene, but it seems that the calque from English is more acceptable. The fate of the following term from the field of IT is quite different. The English term screen saver entered the Slovene language in the 1990s.
Vojko Gorjanc
96
100 80 60 40 20 0 1
2
3
4
1 screen saver; 2 varþevalnik zaslona; 3 ohranjevalnik zaslona; 4 ohranjevalec zaslona Figure 2: Occurrences of screen saver, and its Slovene variants, varþevalnik zaslona, ohranjevalec zaslona and ohranjevalnik zaslona in the FIDA corpus After the loan word, the calque varþevalnik zaslona occurs next, but a later Slovene term formed by using attribute ohrajeva- (Engl. keep) turns out to be more acceptable. At first, there are two variants, but later the adjective with the suffix -ik dominates. While it is true that in Slovene a new word varþevalnik (Engl. saver) is derived from the verb varþevati (Engl. save), it seems that the semantic link is not strong enough for the speakers. In the corpus, the verb varþevati (Engl. save) tends to collocate with words such as banka (Engl. bank), denar (Engl. money); zaþeti (Engl. start), splaþati (Engl. worth). It thus covers a semantic field which the speakers do not associate with new terminology from the field of IT. The term Internet itself has become fully integrated into the Slovene language; this is partly due to its everyday use. As a noun, it occurs as a premodifier in noun phrases: e.g., internet storitev (Engl. Internet service), internet naslov (Engl. URL), internet povezava (Engl. Internet connection), internet ponudnik (Engl. Internet service provider), internet stran (Engl. Web page), internet raþun (Engl. Internet account), internet protokol (Engl. Internet protocol). In the Slovene language, the new type of noun phrase with a noun functioning as a premodifier is becoming increasingly common. This type of noun phrase is formed under the
Tracking lexical changes in the reference corpus of Slovene texts
97
influence of the English language, in Slovene the premodifier in a noun phrase had to be an adjective. The noun as the premodifier appears frequently, even though there is also the possibility of forming the noun phrase with an adjective as the premodifier. The noun Internet happens to be extremely prolific in terms of word formation, since it forms adjectives using the suffixes -ni, -ski and -ov: internetni, internetski, internetovski, internetov in Adjective+Noun combinations; the adverb internetsko using the suffix -o in Adverb+Verb combinations, and newly derived nouns using the suffixes -ar and -ec: internetar; internetovec, as well as new compound nouns, e.g. internetdžanki (Engl. Internet junkie). In adjectives, the relatively high variability indicates that the newly formed words have not yet been fully accepted. The collocations of an individual adjective show that the collocators of the adjectives internetni, internetski and internetovski overlap /service, page, search engine, business, shop, bookseller, service provider.../, so that it is impossible to determine the specific dependent links between words. Therefore, it seems that the use is very optional and different variants of the adjective are possible with the same headword. In the case of the adjective internetov, which is the least common of the adjectives listed above, the link to the headword is completely dispersed; this indicates that the suffix variant -ov is not integrated and consequently inappropriate for the classifying character of the adjective, generally expressed by the adjectival suffixes -ni and -ski in Slovene. The frequent use of the classifying adjective with the suffix -ni shows a prevalence of this variant, and its only real rival is the classifying adjective with the suffix -ski. 60 50 40 30 20 10 0 1
2
3
4
1 internetski; 2 internetni; 3 internetov; 4 internetovski Figure 3: Occurrences of adjectives Internet using the Slovene suffixes -ni, -ski and -ov in the FIDA corpus On the other hand, Slovene term medmrežje, introduced when the term internet was already fully accepted, has very low corpus frequency (corpus occurrences
98
Vojko Gorjanc
medmrežje : internet = 2.2% : 97.8%) and in terms of word formation it is not productive. Despite the fact that the speakers of Slovene did not accept the Slovene term medmrežje, there are still constant but unsuccessful attempts to force medmrežje instead of internet by normativist linguists. In assigning terms to concepts, the Internet has stimulated the formation of two strings of newly formed terms, which seem to be growing in prolificacy with the development of the Internet, i.e., terms of the type e-mail and terms of the type kiber- and cyber-. Among the latter, a great variability in spelling can be observed in Slovene: the new terms can be spelled as two words kiber prostor (Engl. cyberspace), cyber kavarna (Engl. cyber-café), or as one word, with or without a hyphen, e.g., kiber-kiþ (Engl. cyber-kitsch), cyber-kultura (Engl. cyber-culture) and kibersvet (Engl. cyberworld), cyberfolk (Engl. cyberfolk). The spelling of these terms is an important point of dispute among Slovene grammarians at the moment, with the question of the influence of the English pattern being particularly prominent. New terms of the type e-Noun, e-Adjective have already been presented and show a very open series (Jakopin, 2001); here, let us consider the trends in Slovene with kiber- and cyber-. At first glance, the results of the corpus are extremely dispersed; the process is very productive, and both the loan element as well as the Slovene element are prolific. With the loan element, the tendency to write the new terms as two separate words can be observed; the one-word spelling is reserved for a limited number of complete loan words, e.g. cyberspace, cybersex, cybercash. However, as there are so many new terms coined and cyber- generally occurs with a Slovene second element, the new term is generally spelled as two separate words, e.g., cyber otroški vrtec (Engl. cyber-kindergarten), cyber jasli (Engl. cybercréche), cyber kavarna (Engl. cyber-café), cyber umetnost (Engl. cyber-art). Consequently, the two-word spelling is used with loan words as well, e.g. cyber café, cyber space. The pattern is quite open and this can be seen in the possibility of the hyphenated spelling for both complete loan words as well as for the combinations of a loan element and a Slovene element, e.g. cyber-space, cyberpunk; cyber-gostilniþar (Engl. cyber-innkeeper), cyber-klobasica (Engl. cybersausage). The hyphenated spelling is particularly common with adjectives, e.g. cyber-totalitarni (Engl. cyber-totalitarian), cyber-kavbojski (Engl. cybercowboy). On the other hand, there is a tendency for one-word spelling with the Slovene version kiber, the spelling change thus only enables the formation process in Slovene. The one-word spelling is also a consequence of the fact that the adjectives kibernetiþni in kibernetski (Engl. cybernetic) assume the attributive function. The greater assimilation of kiber into the Slovene language is confirmed by the terms coined for the male and female representatives of the cyberworld: kibernetnica, kibernetniþar and kibernetniþarka, and it also occurs in the root of the verb kiberseksati (Engl. to have cybersex).
Tracking lexical changes in the reference corpus of Slovene texts
99
In this case, the almost unbelievable range of terms reveals a dynamic process of assigning terms to concepts in Slovene, while the corpus indicates that the new terms with kiber- prevail (over 60%). The use also shows that the lexical elements kiber and cyber are extremely popular. In Slovene, it seems that the speakers accept the lexical term as semantically emptied, as something very fashionable at the moment. Thus, as we have seen, the collocations may be rather unusual. 5.
Conclusion
In its observation of the process of accepting new lexical items into Slovene, the corpus analysis reveals the great creativity of Slovene language speakers; in addition to loan words, original Slovene expressions occur almost invariably. Corpus data shows a great deal of variability, linked above all to the desire for original expressions. However, after a few years, the data begin to reveal the prevailing variant. The question of which variant is eventually fully accepted, though, remains open. Full acceptance of a variant is conditioned by a series of linguistic and even more non-linguistic factors. It is very important that the new terms emerge spontaneously in the language community and are not introduced into the language by linguistic intervention. If the speakers of Slovene even begin to suspect that the term is an attempt at linguistic intervention, they will probably reject it. In order for a variant to be fully accepted in Slovene today, it should have an appropriate semantic basis, so that the speakers of Slovene can identify it as “sexy” and “cool”. References Ayto, J. (1999), 20th Century Words. Oxford, Oxford University Press. Bowden P., P. Halstead and T Rose (1996), Extracting Conceptual Knowledge from Text Using Explicit Relation Markers. In Proceedings of EKAW-96, Nottingham, pp. 147-162. Church K. and P. Hanks (1989), Word association norms, mutual information and lexicography, in: Proceedings of the 27th Annual conference of the Association of Computational Linguistics, pp. 76-82. Džeroski S. and T. Erjavec (2000), Learning to lemmatise Slovene words, in: J. Cussens and S. Džeroski (eds), Learning Language in Logic. Berlin, Springer, pp. 69-88. Gorjanc V. and S. Krek (2001), A corpus-based dictionary database as the source for compiling Slovene-X dictionaries, in Proceedings of the COMPLEX 2001 6th Conference on Computational Lexicography and Corpus Research, Birmingham, pp. 41-47. Jakopin P (2001) Words and nonwords as basic units of a newspaper text corpus, in: Proceedings of the COMPLEX 2001 6th Conference on Computational Lexicography and Corpus Research, Birmingham, pp. 49-65.
100
Vojko Gorjanc
Manning C., and H. Schütze (1999) Foundations of Statistical Natural Language Processing. Cambridge MA: The MIT Press. McEnery T., J. Langé, Oakes, M. and J. Véronis (1997), The exploration of multilingual annotated corpora for term extraction, in R. Garside, G. Leech, A. McEnery (eds.), Corpus Annotation. Linguistic Information from Computer Text Corpora. London, Longman. Meyer, I., Mackintosh K., Barriere, C. and T. Morgan (1999), Conceptual sampling for terminological corpus analysis, in Sandrini (ed.), Proceedings of TKE ’99. Vienna, TermNet, pp. 256-267. Mladeniü D. (2002), Automatic word lemmatisation, in: T. Erjavec and J. Gros (eds.), Jezikovne tehnologije, Language Technologies. Ljubljana, Institut Jozef Stefan, pp. 153-159. Pearson J. (1998), Terms in Context. Amsterdam, John Benjamins. Vintar Š, and V. Gorjanc (2000) Identifying markers of semantic relations in Slovene. http://www2.arnes.si/vinta/telri.rtf
Relating linguistic units to socio-contextual information in a spontaneous speech corpus of Spanish José María Guirao Universidad de Granada Antonio Moreno Sandoval, Ana González Ledesma, Guillermo de la Madrid, Manuel Alcántara Universidad Autónoma de Madrid Abstract This chapter shows the application of statistical tests to a corpus of spontaneous spoken Spanish. Our goal is to find representative differences between different parts of the corpus. To this end, we tagged n-grams in the corpus with features related to the speaker (age, gender, etc.), or the context (dialogue, monologue, media, etc.), and applied the loglikelihood test (Dunning, 1993) in order to find the most distinctive lexical or grammatical items for each specific socio-contextual feature. This chapter is divided in three sections. In the first, the characteristics of the spoken corpus are shown. The second section is devoted to the explanation of the computational tool. In the third section, a first rough estimate of the results obtained is given, as well as possible applications of the model.
1.
The Spanish corpus of the C-ORAL-ROM project.
C-ORAL-ROM is a multi-lingual corpus of spontaneous speech for the main four Romance languages, French, Italian, Portuguese and Spanish (Cresti et al. 2002). The project is funded by the EU under the V Framework Programme (IST-200026228) and the consortium consists of 9 partners, co-ordinated by the University of Florence. The remarkable feature of C-ORAL-ROM is its spontaneity: texts have been recorded in their actual context and without any script. Each subcorpus is made up of 300,000 words with the same text distribution to assure comparability and sufficient register representation. The resource will be delivered in several formats: an orthographic transcription, an xml-tagged version, and the aligned audio source. Partial linguistic annotation will be provided, as well as some programs to handle the resources and quantitative studies. This paper shows preliminary results with respect to the Spanish corpus.
102 1.1
Guirao et al Differences between a speech database and a corpus of spontaneous speech
When discussing spoken resources, a preliminary distinction has to be made. Most linguistic resources currently available are speech databases: collections of high-quality recordings and detailed phonetic transcriptions of speech set up in controlled environments (typically telephone services). These speech databases are mostly used for training and testing speech systems and they are developed by and for the language engineering industry. They aim to serve as a basis for recognizing and producing speech in restricted, predictable domains. In most cases, those databases contain many samples of the same word (that is, many tokens of the same type). Usually, the utterances are prepared and pronounced by professional speakers. The acoustic quality of the recording is essential. Speech databases usually provide detailed phonetic descriptions, including disfluencies, noises and other sounds. In general, those databases reflect the standard register, and distant variants (dialects, jargons) are poorly represented. Instances of those are SpeechDat (LRE-63314, Infrastructure for Spoken Language Resources), SpeechDat II (LRE2-4001, Speech Databases for the Creation of Voice Driven Teleservices), which have set up a standard for this type of resource. On the other hand, corpora of spontaneous speech are typically collections of a wide variety of spoken registers and non-scripted speech. Those corpora are collected mainly for linguistic analyses and applications (language teaching, grammars and dictionaries). In such corpora the acoustic quality is not essential. What is important is that the texts reflect as much variation as possible and the speaker behaves in a spontaneous manner. In some cases, those corpora are only concerned with a given register, for instance, a dialect or children’s speech. An important difference with respect to speech databases is the transcription: spontaneous spoken corpora usually are less precise in the acoustic and phonetic parts. On the contrary, they include detailed information about the context and the speakers. These corpora are used mainly for sociolinguistic, text-typologic, or psycholinguistic analyses. Examples are CHILDES and London-Lund. C-ORAL-ROM is a corpus of spontaneous speech, but it also shows some distinctive features: Multilingual: the main goal is to compare the four languages, on the same grounds, and provide comparative studies at different linguistic levels. Acoustic quality: in order to be re-usable by the speech industry, sufficient samples of digital recordings, media and phone conversations are included. Alignment of the transcription and the original sound: this is useful both to verify the accuracy of the transcription and for teaching and other applied investigation purposes.
Relating linguistic units to socio-contextual information
103
The main limitation of C-ORAL-ROM is its size. 300,000 words per language is not a sufficient number for stating classifications and statistically significant analyses. We believe that this corpus will show the relevancy and usefulness of an approach that pays as much attention to the acoustic quality of the register as to the linguistic annotation. 1.2
Multi-lingual comparability
Cross-linguistic comparison can provide two complementary perspectives: comparing a given feature or features across languages, and comparing a given register or text type across languages (Biber, 1995). On the C-ORAL-ROM project different traditions and experiences have interacted. On the practical side, the teams came to an agreement around two basic points: a text distribution (or sampling design) and a unified format for the transcription. 1.2.1 Text distribution In order to compare the linguistic features of the four languages, the same common sampling criteria and the same proportion of each type in the four subcorpora are needed. There is a long tradition in sociolinguistics and in corpus linguistics (Labov, 1966; Biber, 1988; Biber et al., 1999; Miller & Weinert, 1999) in determining the relevant non-linguistic parameters. Basically, authors agree with a series of socio-situational parameters, such as register and genre variation, sociological features of the speakers (sex, age, education, occupation, origin), and dialogic structure (monologue, dialogue, conversation). The disagreement is in how to combine these parameters. C-ORAL-ROM has chosen the design of the Spoken Dutch Corpus (http://lands.let.kun.nl/cgn/ehome.htm). The sampling design is different in both sub-corpora: Informal register is organised according to social context (familiar-private vs. public) and dialogic structure (monologue vs. dialogue-conversation). Formal register is organised according to channel (media, telephone, natural context). In addition, media texts and formal in natural context are grouped by genre (see table below). Sociological features have not been taken into account for text selection, but they are explicitly marked in the metadata section of the transcription. Male/Female distinction has been the only feature to be balanced. With respect to the text length, some decisions have been made. Only three types of size are allowed: short (1,500 words), medium (3,000 words) and large (4,500 words). Texts shorter than 1,500 words have allowed in genre types like meteorological reports, but always compounding segments of 1,500 words.
104
Guirao et al
Tables 1 and 2 show the distribution design of the informal and formal subcorpora for each language. Table 1: Informal sub-corpus Private/Familiar Context 113,000 words Monologue Dialogue 33,000 words 80,000 words
Public Context 37,000 words Monologue 6,000 words
Dialogue 31,000 words
Table 2: Formal sub-corpus Formal in Natural Context 65,000 words Political Speech Political Debate Preaching Teaching Professional Explanation Conferences Business Law
Formal in Media Context 60,000 words News Meteo Interviews Reportage Scientific Press Sport Talk Show Political Thematic Explanation Talk Show Culture Talk Show Science
Telephone 25,000 words Private Dialogues Phone to Call Services
1.2.2 Common format To ensure a valid comparison, it is also necessary to use a consistent annotation framework. The consortium developed the C-ORAL-ROM format, which is based in the known CHAT format. A conversion to XML is provided. The xmltagged version guarantees easy interpretation though the corresponding DTD. The combined use of XML and DTD ensures that every text in each corpus complies with the same requirements. In this way, textual uniformity are obtained throughout and between the four corpora. The format is divided into the header (with the meta-data) and the transcription. Most features in the header are compulsory, therefore a rich information is provided for every text. The transcription is divided into turns, where applicable. Each turn is marked by a three-letter code identifying the speaker. An orthographic transcription is provided, along with some tags marking disfluencies, noises, overlapping, and prosodic units. Morpho-syntactic tagging will be supplied in a separate tier. Figure 1 shows a fragment of a text. A large selection of fragments from the four languages can be consulted on the official webpage of the project, along with the sound source.
Relating linguistic units to socio-contextual information
105
@Title: Raquel @File: efamdl04 @Participants: PAT, Patricia, (woman, B, 2, hairdresser, participant, Madrid) ROS, Rosa, (woman, B, 3, English teacher, participant, Madrid) @Date: 10/03/2001 @Place: Madrid @Situation: chat between friends at home, not hidden, researcher observer @Topic: friends, movies and future Use’s works @Source: C-ORAL-ROM @Class: informal, familiar/private, dialogue @Length: 7’ 58’’ @Words: 1509 @Acoustic_quality: A @Transcriber: Guillermo @Revisor: Manuel; Guillermo, Jesús and Manuel (prosody) @Comments: *PAT: si ya han [/] han decidido ir con ellos / y la conocen ... *ROS: ya / pero si yo no [/] si a mí me da igual / si yo no digo nada de Use y Nuria / yo digo que la peña es un / poco egoísta // *PAT: <no> // *ROS: [<]
Other relevant aspects
C-ORAL-ROM is compliant with the state of the art in spoken corpora. These aspects are briefly summarised in the following paragraphs. 1.3.1 The legal issue During the 1990s legislation on Copyright and Privacy changed in many European countries. In spoken language corpora, the law is applied when recording individuals or using sound documents from the mass media. In the first case, speakers retain their right to preserve privacy, and have to give their express authorisation in order to their speech will be transcribed and published. In order to preserve spontaneity, which is essential for our purposes, the procedure is to ask each participant to sign an authorisation after the recording. If a speaker refuses his/her consent, then the recording is discarded. The right to privacy applies to every recording in a private context, but not to ones in a public situation (a lecture, a political speech, a sermon).
106
Guirao et al
On the other hand, many texts in the corpora are copyrighted, not only the media recordings but also those in which the speaker creates knowledge in the form of ideas or structure of contents. Typically, this is true of lectures and professional talks. We obtained the written authorisation from the authors or the copyright holders for all the texts included in the Spanish corpus. 1.3.2 The acoustic quality The Spanish corpus of C-ORAL-ROM has been collected from scratch, although other teams in the project have reused part of their previous texts. In our case, we preferred to make new recordings because, on one hand, we did not have the written consent for our previous texts and, on the other hand, the acoustic quality of the analogical tapes was poor. Most texts have been recorded with a DAT Tascam (model DA-P1) and two unidirectional microphones. The source has been converted into a WAV file, mono, 16 bit, 22.050 Hz, through a SPDIF port in a Sound Blaster Live Platinum 5.1, using the software Creative Recorder. In public places, when possible, the DAT recorder has been connected to the sound system. The media recordings either have been provided directly by the broadcasting station or recorded by a computer connected to the receiver. Acoustic quality is essential for the application in speech technologies and language engineering. 1.3.3 The linguistic annotation Corpora increase in value depending on the annotation layers provided. Tagging a spontaneous speech corpus is a task slightly different to the same for written corpora (Uchimoto et al., 2002). The difference is not in the tagged information but in the lesser efficiency of the taggers when applied to spoken corpora. For instance, some POS taggers are usually trained on written texts, which show a quite stable and determined word order. On the contrary, corpora of spontaneous speech are highly flexible in word order. In addition, they show repetition, restartings, overlapping, and other features of spoken syntax which have to be trained specifically. The lexicon is also different. One can find many words that are not included in printed dictionaries, because they are innovations, or belong to an informal register, or simply because they are mispronunciations. A complete lemmatization and POS tagging is provided. Moreno and Guirao (2003) report the development of a POS tagger and unknown words recogniser for morphosyntactic annotation of the Spanish corpus. The results provided by the lemmatizer are used in this paper (see section 3).
Relating linguistic units to socio-contextual information
107
1.3.4 The validation To verify the reliability of data has become a fashionable topic in the recent years. Users of linguistic resources want to know how the resources have been collected and their accuracy. C-ORAL-ROM passes two types of evaluation. An internal validation is carried out by the team itself. Each text passes through five steps: transcription, first revision, prosodic tagging, second revision, and sound-text alignment. At least, three linguists transcribe/revise each text. A program verifies format errors, blanks, typos, badly formed tags, etc. Therefore, content and form have been validated exhaustively, guaranteeing that the transcription is accurate to the sound source. We want to stress that the alignment of sound and text is the best guarantee for validation of a spoken text: any discrepancy between the actual speech and its transcription will be easily detected. An external validation will be done by experts at the end of the project. 2.
The computational tool
We have developed computational tools for transforming the C-ORAL-ROM format into a more suitable tagging scheme in order to relate meta-data with lexical items, and compute the appropriate statistics. We will divide this section into three sections. 2.1
Using xml-tagged corpus for relating meta-data and linguistic features
The original C-ORAL-ROM annotation has been designed for registering a wide range of features, including acoustic ones (prosodic marks, noises, etc.) which will be used by the speech technology community. An example of an xml-tagged file is shown:
108
Guirao et al
Our goal in this experiment is to seek out lexical units peculiar to each subcorpus. The first step was to remove the non-lexical information from the original xml tagging. In particular, we wanted to capture two types of information: i) The words that every speaker says, and ii) The split of every turn into utterances in order to prevent ill-formed word clusters. This task is similar to tokenisation in written corpora. This division into utterances is also needed for delimiting the context that the POS tagger uses for disambiguation. A Perl script generates a new tagged corpus with only two tags: one for TURN, with attributes for speaker and file, and another for UTTERANCE:
Tokens for the category 182832 134693 9519
Total number of tokens 327044 327044 327044
Percentage 55.9 % 41.2 % 2.9 %
The “X” value is assigned when the sex of the speaker is unknown (typically in a media recording). The procedure can be applied to any type of information derived from the corpus. For instance, we tagged it with POS and lemma, using a POS tagger for spoken Spanish developed in our laboratory (Moreno & Guirao, 2003). We show the previous example after lemmatization and POS tagging. Lemmas are shown in uppercase.
Relating linguistic units to socio-contextual information
109
Lemmatisation
P AUX
Extracting word clusters
If we calculate statistics directly on every unit, the result will not be correct, since multi-words units will not be included in this count. Discourse markers as frequent as “por ejemplo” (for instance), “es decir” (in other words) or “o sea” (that is) will not appear if we work on single word units. To solve this, we developed an algorithm based on n-grams in order to extract multi-word candidates. We took out all n-grams with three or more occurrences, for n = 4, 3, and 2. Next, a filter is applied for discarding all n-grams that start or end with a determiner or auxiliary. Finally, multi-words are selected by hand. Every multiword is regarded as a lexical unit, equivalent to the simple/single words. 2.3
Applying the statistics of surprise
In order to identify the distinctive words, lemmas or POS for a given sub-corpus, we have employed the log-likelihood ratio test proposed by Dunning (1993). This method does not assume normal statistical distributions of units in a corpus. Instead, the log-likelihood ratio O assumes a binomial distribution more appropriate for rare but distinctive words. “Texts are composed largely of such rare events” (Dunning, 1993). In addition, this test does not need balanced subcorpora for comparison.
110
Guirao et al
This method has been successfully applied for finding collocations (Dunning, 1993) and terms (Daille, 1994). In order to test the method for finding distinctive units in specific domains, we can work on two hypotheses: i) Two registers (or sub-corpora) show no difference in distinctive units (Null hypothesis) ii) For a given sub-corpus, we can find out distinctive units (Alternative hypothesis). We applied the test to two well-defined sub-corpora, meteorological reports and law, in order to discard one of the hypotheses. Results are shown in Table 4. The critical value for one degree of freedom is 7.88. Table 4: Dunning Test applied to well-defined sub-corpora Meteo -2 log O 165 160 145 128 97 91 80 69 69 64
Freq 50 38 27 6466 16 19 19 12 12 92
Lemmas norte fuerza viento en componente temperatura noroeste oeste nube zona
Law -2 log O 200 200 116 113 101 84 83 78 77 65
Freq 58 289 85 45 22 31 26 50 69 17
Lemmas policía persona derecho contrato judicial delito delincuente ley determinar cometer
Results confirm the alternative hypothesis and the suitability of the Dunning test for the task. Most of the “top 10” lemmas in both domains have a low occurrence, but all are typical terms in its domain. 3.
Preliminary results
Our goal is to show a range of possibilities for the application of this method. We will show here a very incomplete set of data. Currently, there is a disproportion of social and register features with respect to annotated linguistic features. The linguistic annotation is being carried out this year (2003). Comprehensive results will be delivered with the final version of the four corpora, including a crosslinguistic comparison. In this paper, the only linguistic features that will be taken into account are: words and multi-words lemmas POS tags.
Relating linguistic units to socio-contextual information
111
First, we show the 10 most frequent word types in our corpus of spontaneous speech for three professions: a consumers’ association manager, a football coach and a computer system administrator. Notice that words and multi-words are regarded as equivalent units. Table 5: Most characteristic words in three professions Consumers’ association manager -2 log O 110 establecimiento 107 establecimientos 106 encuesta 103 cesta 65 política de precios 45 marcas 44 precios 44 índice 42 consumidor 41 insisto
Football coach -2 log O 31 30 28 25 18 17 16 16 16 16
Computer system administrator -2 log O directiva 91 tío club 48 grabando Real Madrid 41 web rueda de prensa 33 yo qué sé director general 33 no sé no 30 joder estabilidad 30 linux confianza 28 cabrón hombre yo creo que 28 detectan Y que 26 barato
The procedure can be extended to any profession registered in the corpus, as a means of detecting sociolectal information. Now we will provide the results of the Dunning test on formal and informal registers, approximately 150,000 words each: Table 6: More characteristic words in formal and informal registers Formal -2 log O 134 91 62 61 60 55 49 49 47 46
de es decir su en gobierno en este momento desarrollo general nuestra países
Informal -2 log O 422 279 238 231 231 222 182 179 173 171
si ah sabes claro me tía yo no sé no ya
Another interesting comparison is to find out which POS are more typical in male and female registers. This table shows the results. In our corpus, men prefer to use nouns and women prefer clearly pronouns. Finally, after lemmatization, we can show the 10 most frequent verbs in general, male and female sub-corpora.
112
Guirao et al
Table 7: POS in male and female registers General Total occurrences 47052 42531 38210 32284 31404 30737 25044 17418 12611 10112
Male
V N PREP ART ADV C P AUX ADJ Q
-2 log O 515 422 399 382 80 34 34
Female
N ADJ ART PREP DEM Q REL
-2 log O 1327 524 243 149 126 28 16 16 4
P ADV C MD INTJ V POSS AUX NPR
Table 8: Most frequent verb lemmas in male and female registers General Total occurrences 3398 2973 2579 2067 1046 1026 995 802 779 577
4.
Male
ir tener decir hacer poder saber ver dar querer creer
-2 log O 28 28 26 23 23 23 22 22 20 20
Female
Escuchar Recordar Aparecer Llegar contemplar caminar intentar Amar juntar superar
-2 log O 159 154 112 99 86 47 46 42 36 36
ir decir saber venir dar mirar comprar gustar quedar contar
Conclusions and future work
Here, we have shown the relevance of this procedure as an empirical method for the validation of sociolinguistic hypotheses in spoken language, as well as for determining register typology. The method correlates linguistic with socio-contextual data applying Dunning’s Statistics of Surprise. In order to achieve this, a rich linguistic-tagged corpus and the use of xml have been essential. The preliminary results are promising and have not been shown previously for Spanish. However, extracting conclusions and interpretations for these figures is premature, since the corpus is clearly not sufficient. For this reason, we will apply the method to CORLEC corpus, also developed by the LLI-UAM (see Moreno 2002 for an overview). The combination of C-ORAL-ROM and CORLEC corpora will contain over 1,500,000 words of spontaneous spoken Spanish.
Relating linguistic units to socio-contextual information
113
We also wish to find out more about the correlation between linguistic and sociocontextual features, when complete morphosyntactic annotation will be finished. For instance, verb tenses, number, gender, persons in pronouns, etc, will be tagged. Biber (1988, 1995) provides a rich catalogue of linguistic features that can be traced. Finally, a cross-linguistic comparison between the four Romance languages in CORAL-ROM will be made, based on the same text distribution. References Biber, D. (1988), Variation across speech and writing. Cambridge: CUP. Biber, D. (1995), Dimensions of register variation. Cambridge: CUP. Biber D., S. Johansson, G Leech, S. Conrad and E. Finegan (eds.) (1999), The Longman grammar of spoken and written English. London: Longman. Cresti, E. et al. (2002) `The C-ORAL-ROM project. New methods for spoken language archives in a multilingual romance corpus’, in: Proceedings of LREC 2002. Las Palmas de Gran Canaria. Daille, B. (1994), Combined approach for terminology extraction: lexical statistics and linguistic filtering. Ph.D. Thesis, Paris 7. Dunning T. (1993), ‘Accurate methods for the statistics of surprise and coincidence’. Computational Linguistics 19(1): 61-74. Labov W. (1966), The social stratification of English in New York City. Washington: Center for Applied Linguistics. Miller J. and R. Weinert (1999) Spontaneous spoken language. Oxford: Clarendon. Moreno A. (2002), ‘La evolución de los corpus de habla espontánea: la experiencia del LLI-UAM’, in: Proceedings of II Jornadas de Tecnologías del Habla, Granada, Spain. Moreno A. and J. M. Guirao (2003), ‘Tagging a spontaneous speech corpus of Spanish’, in: Proceedings of Recent Advances in NLP (RANLP-2003) Borovets, Bulgaria. Uchimoto K., C. Nobata, A. Yamada, S. Sekine and H. Isahara, (2002), ‘Morphological Analysis of the Spontaneous Speech corpus’. In: Proceedings of Conference of Computational Linguistics (COLING 2002) Taipei, Taiwan
This page intentionally left blank
An analysis of lexical text coverage in contemporary German Randall L. Jones Brigham Young University Abstract One of the many practical applications of corpus studies is the generation of word frequency information. It makes sense that for the teaching of vocabulary in a second language, lexical frequency should play a significant role in the selection of vocabulary to be included in pedagogical materials. Using the concept of “lexical text coverage”, a study based on the BYU/Leipzig Corpus of Contemporary German has shown that a basic vocabulary of 3,000 high frequency words can account for between 75% and 90% of the words in the text, depending on the register. 1.
Vocabulary and second language learning
How many words must a learner know in order to read and understand a German novel, a newspaper, an academic text, or to understand a German television broadcast or a conversation? Which words are most important, i.e. which ones should be learned first? Is the vocabulary used in the above-mentioned registers about the same, or are there substantial differences? And what is a word and what does it really mean to know a word in a second language? These questions lie at the very root of second language vocabulary learning. To begin with the question of which words should be learned first, it is important to look at vocabulary frequency, as the frequency of the various words in a typical text differs significantly. Some occur numerous times and some occur only once. By focusing first on learning the most frequently occurring words, it would seem that the process of learning to read or comprehend speech in a second language would become more systematic and therefore more efficient. But again the question arises, what are the most frequently occurring words in German and how many does one have to learn? 2.
The concept of lexical text coverage
Work by scholars such as Nation (2001) and others has helped us immeasurably in understanding the nature of vocabulary frequency and its relation to vocabulary learning in a second language. For a learner to read and have some comprehension of a German text, a minimum or threshold vocabulary is
116
Randall L. Jones
necessary. Nation suggests that an understanding of a 2,000 to 3,000 word family level is a minimum for reading an unedited English text (2001: 146). He has introduced the notion of “word token coverage” and applied it to various types of English texts (2001: 17, 147). The notion of “word token coverage” means the degree to which a defined level of high-frequency vocabulary from a text covers or accounts for all the words in the text. For example, what percentage of a given text is covered by the 1,000 most frequently occurring words? What about the next 1,000, and how many words does it take to achieve a coverage of, say, 90%? The procedure for determining this is quite straightforward. i) Generate a word frequency list for a text. ii) Construct word families from the n most frequent words. iii) Match that word family frequency list against the original text to determine what percentage is covered by the words in the list. Nation uses what he calls word families instead of simple words, i.e. all words that are related to and recognisable from a base word. For example, the base word agree also includes inflected verb forms as well as associated nouns and adjectives: agreed, agreeing, agreement, agreements, agrees, agreeable, disagree, disagreements, disagreeable, disagreed, disagreeing, disagreement, disagrees, a total of 14 word tokens in three word classes. It is assumed that by understanding the verb agree, one will also understand other morphological permutations. The decision is, of course, somewhat arbitrary, i.e. it is assumed that at an early stage of vocabulary learning one understands regular verb conjugation and has a knowledge of the meaning of simple affixes such as dis-, -ment, -able. Table 1 shows Nation’s analysis of text coverage by the 1,000 and 2,000 most frequent words in four English texts registers. The highest level of coverage for 1,000 words was for conversation (84.3%), while the lowest was for academic texts (73.5%). An additional 1,000 words increases the coverage by only a few percentage points. Each additional 1,000 words results in an increasingly smaller addition to the coverage. It is important to stress that we are dealing with coverage of word tokens, not word types. In a running text of 100,000 words of the conversation sub-corpus for example, about half of the words will occur more than once, and some of them numerous times. If the 2,000 most frequently occurring words in the text were compared with each running word in the text, about 90% of the