Professional Documents
Culture Documents
Prepared by
1
Table of Contents
0. INTRODUCTION ...................................................................................................... 3
1. OBJECTIVES OF SCRIPT GRAMMAR .................................................................. 4
2. END USERS FOR SCRIPT GRAMMAR ................................................................. 5
3. SCOPE ........................................................................................................................ 6
4. TERMINOLOGY ......................................................................................................... 7
5. PHILOSOPHY AND UNDERLYING PRINCIPLES................................................ 11
6. SCRIPT GRAMMAR STRUCTURE ...................................................................... 12
6.1. PERIPHERAL ELEMENTS OF THE SCRIPT GRAMMAR .............................. 13
6.2. CONFORMITY TO THE SYLLABLE STRUCTURE ........................................ 14
6.3 SCRIPT GRAMMAR PROPER ............................................................................. 18
6.3.1. The Character Set of Marathi. ......................................................................... 18
6.3.2. Consonant Mtr Combinations. ................................................................... 24
6.3.3. The Ligature Set of Marathi. .......................................................................... 31
6.3.4 The Collation Order of Marathi. ..................................................................... 37
6.3.5 Cardinal Numbers used in Marathi language................................................... 38
7. REFERENCES ......................................................................................................... 40
8. ANNEXURES .......................................................................................................... 41
Annexure 1: Names of experts who have contributed to the script grammar ............... 41
Annexure 2: Unicode Table of Devangar ................................................................. 42
2
0. INTRODUCTION
The term script grammar refers to the behaviour pattern of the writing system of a given
language. Languages which have written representations do not use a haphazard manner
of storing the information within the system, but use a coherent pattern which is similar
to the linguistic grammar of a given language. With the help of specialists (not
necessarily linguist) who work in the area of the written representation of the language,
the manner in which the shapes of the characters of the language and the representation
of the conjunct forms is provided. In other words the Script Grammar deals with the
surface structure of the language and tries to provide the best possible fit for shapes
and their representation. Since this is a highly subjective issue, the shapes provided here
are recommendations at the best and conform to the perception of the mandating
body/evaluators who consensually arrive at the best possible fit which is acceptable to
a majority of users. An example will make the above clear. Although Marathi and Hindi
share the same script Devangar, not only do they not share the same character inventory
but in addition the representation of certain characters is different. Thus the Marathi /la/
is different from the Hindi /la/ in so far as the placement of the stem is concerned Hindi
Marathi . This ensures that the Script Grammar conforms to the language in question
and provides the character shapes acceptable to a given user community. It should be
noted that this does not mean monotony. The Hindi and Marathi /la/ can have a variety of
forms once the intrinsic structure of the character is determined.
3
1. OBJECTIVES OF SCRIPT GRAMMAR
The Objectives of the script grammar for each language can be divided into two major
parts:
Societal:
Provide a visual representation of shapes that are deemed to be in conformity with
the perception of a given community
Technical:
Classify the language in terms of its ISO and also whether it belongs to the Abjad,
Akshar (Alphasyllabary) class.
Provide an inventory of the characters pertinent to the language and classify the
same in terms of their taxonomy.
Since Brahmi is written from left to right, and since certain characters do not
follow the linear L to R order, provide an inventory of displaced catenators i.e.
characters such as Mtrs that concatenate to the Consonant
Propose the best shape representation of the individual characters as well as of the
ligatures used within a given script. As a corollary request the expert(s) to identify
the largest possible strings of such ligatures.
Finally provide the collation order pertinent to that script/language, which would
be of great utility to high-end NLP as well as to CLDRs in the pertinent
language. The collation order for Marathi is different from Hindi although both
languages share the same script. Thus in Marathi are placed at the end of
the consonant inventory i.e. after in the sort order. In Hindi is sorted along
with and with
4
2. END USERS FOR SCRIPT GRAMMAR
The script-grammar specific to a given language can be used by a large number of users.
Certain features of the script grammar such as the shapes can also be used for
testing OCR and OHWR. Similarly information regarding Ligatures as well as
collation order can help in high-end NLP work such as detecting invalid
combinations, correct implementation of syllable structure, prediction routines to
name a few. Information regarding collation and character sets can be also used
for CLDR.
They allow the font designer to design a font which is in compliance with the
norms and standards of that particular script. A major problem which will be dealt
with in the template is one of ligatures. The final list of ligatures defined by the
script grammar allows the font designer to write specific rules for such glyphs.
It permits the software developer to design and implement the keyboard and the
input mechanism which will meet the requirement of the particular linguistic
community.
The collation or sort order as described in a Script Grammar permits the software
developer to write software functions/ routines for sorting data in all applications.
Script Grammars are equally important for keyboard design, especially when
supplemented by frequency data from a corpus.
As can be seen the script grammar has a wide range of use and can be of utility to font
developers, Indian language developers and linguists in the area of computation.
5
3. SCOPE
This script grammar document contains following information about the language and
the script used for writing the language.
6
1
4. TERMINOLOGY
Abjad: A writing system in which each symbol always or usually stands for a consonant.
The long vowels are indicated. However the short vowels are rarely marked and the
reader needs to supply these. Example: Urdu written in Perso-Arabic Script is an example
of this writing system.
Allo-Script: The term relates to languages which share a common script. Thus
Devangar is used to write 9 official languages. However these languages do not use the
same set of characters. Thus Marathi uses the retroflex lla [U+ 0933] which Hindi
does not use. Flaps used in Hindi [U+095C] [U+095D] are not used in Konkani.
These sub-sets of scripts based on a single matricial script are termed as allo-scripts.
Alphabet: A set of letters used in writing a language. Example: The English Alphabet.
Aspirated consonant: A consonant which is pronounced with an extra puff of air coming
out at the time of release of the oral obstruction. This has a sound of an extra "h".
Basic alphabet: The minimal set of letters which can be used for uniquely encoding
every word of a language. The basic alphabet for English consists of only the upper-case
letters A-Z
Conjunct: The Indic scripts are noted for a large number of consonant conjunct forms
that serve as orthographic abbreviations (ligatures) of two or more adjacent letterforms.
This abbreviation takes place only in the context of a consonant cluster.Under normal
circumstances, a consonant cluster is depicted with a conjunct glyph if such a glyph is
available in the current font. In the absence of a conjunct glyph, the one or more dead
1
As in the case of the BIS Document, in order to make the terminology accessible for all readers, examples
have been chosen from English/Latin scripts, wherever possible. Some definitions have been excerpted
from the BIS ISCII91 document and suitably modified where necessary.
2 Wikipedia definition
7
consonants that form part of the cluster are depicted using half-form glyphs. In the
absence of half-form glyphs, the dead consonants are depicted using the nominal
consonant forms combined with visible virama signs.3
Consonant: A letter representing a speech sound in which the breath is at least partly
obstructed,
Diacritic:A mark added to a letter which distinguishes it from the same letter without a
mark, usually having a different phonetic value or stress.
Displaced Catenator: (see Catenator) Within the Brahmi script, the writing system is
linear and moves from left to right. However in the case of some catenators this rules is
not observed and the catenator (wholly or partially) is placed to the right of the consonant
to which it relates. The short vowel I in Devangar is an example of a displaced
catenator.
Display composing: The process of organizing the basic shapes available in a font in
order to display (or print) a word.
Display rendition: The process by which a string of characters is displayed (or printed).
In this process several consecutive characters may combine with each other on the screen.
The sequence of display of the characters may become different.
Eyelash ra: The eyelash ra is used in Konkani, Nepali and Marathi. It is treated as
different from the (repha) by certain linguists. While the former is treated as a flap, the
latter is a continuant trill (cf., Kalyan Kale and Anjali Soman. 1986). There are cases in
Marathi of minimal pairs such as: to the teacher vs. to the cook
or /darya/ ocean vs. /darya/ valleys.
Font: A set of symbols used for display or printing of a script in a particular style.
Latin alphabet: The alphabet used for writing the language of ancient Rome. Also
known as the Roman alphabet. The alphabet is used today for writing English and
European languages.
Letter: A character representing one or more of the simple or compound sounds used in
speech. It can be any of the alphabetic symbols.
3
Unicode 6.0 Chapter 9.0 pp 6-7
8
Ligature: (see Conjunct)
Nasal consonant: A consonant pronounced with the breath passing through the nose.
Example m n in English.
Nasalized vowel: A vowel pronounced with the breath passing both through the nose and
the mouth. In Indian scripts this is denoted by a Chandrabindu and gives the vowel/vowel
modifier over which it placed a nasal value. Example:
Phonetic alphabet: An alphabet which has direct correspondence between letters and
sounds Example: The International Phonetic Alphabet..
Pure consonant: A consonant which does not have any vowel implicitly associated with
it.
Roman script: The script based on the ancient Roman alphabet, with the letters A-Z and
additional diacritic marks. Used for writing a language which is not usually written in the
Roman alphabet.
Script: A distinctive and complete set of characters used for the written form of one or
more languages.
Script numerals: The 0 to 9 digits in a script, which have shapes distinct from their
international counterparts.
9
Vowel: A letter representing a speech sound made with the vibration of the vocal cords,
but without audible obstruction
10
5. PHILOSOPHY AND UNDERLYING PRINCIPLES
1. The Grammar aims to depict the surface grammar of the written language: the
manner in which characters as well as conjuncts are depicted
3. Corollary to the above the result is a script and allo-scripts i.e. a given script
shared by many languages is not uniformly deployed across all the languages
but is subject to variations and modulations.
5. The Grammar is limited to its synchronic use i.e. the manner in which a given
language as of today admits a character set within the script used to write it. It
is not diachronic or historical in nature and does not study the evolution of the
given script across centuries.
4
It is recommended that such variations be culled by placing the Grammars of different scripts in public
review.
11
6. SCRIPT GRAMMAR STRUCTURE
Part 6.1. deals with peripheral elements such as the ISO of the language, the writing
system used: (Alphasyllabic) Abugida or Abjad.
Part 6.2. treats of the syllabic structure. It verifies whether the character set of the
language complies with the ISCII syllabic structure and if not which cases are not
compliant.
Part 6.3 is the script grammar proper and describes the character set as well as the
conjunct shapes of the given script along with the collation order
12
6.1. PERIPHERAL ELEMENTS OF THE SCRIPT GRAMMAR
These constitute the elements that are peripheral to the Script Grammar. The main
parameters considered are the mnemonic and name of the language (needed for CLDR
and also for language tags), the writing system used to inscribe the language and
wherever possible a short history of the language.
6.1.1. Name of the language and its representation in the 3 letter mnemonic as per
ISO 639.1. & 639.3
6.1.2. Identification of the writing system(s) used to inscribe the given language
All scripts derived from Brahmi are Abugidas i.e. syllabary driven systems. The main
features of Abugidas are as under:
The consonant has an implicit vowel built-in which is normally the schwa.
The inherent vowel can be modified by the addition of other vowels or
muted by a diacritic termed as a Virama or Halanta
Vowels can be handled as full vowels with a vocalic value
When two or more consonants join together they form ligatures which can
be recognized by their shape or alternatively form an entirely new shape
= .
Abugidas/Alphasyllabaries because of their syllabic structure require a special
description which is the subject of the discussion in 6.2. below.
13
6.2. CONFORMITY TO THE SYLLABLE STRUCTURE
Marathi language complies with the syllable (akshar) structure described above. It
can admit up to h consonant clusters.
Alphasyllabaries are determined by the notion of the syllable or the Akshar. The
compositional grammar of the syllable determines it well-formedness. This is through a
series of formal constraints based on a Backus-Naur Formalism which is given below.
The syllable (akshar), first defined in the ISCII document (1991), identifies the following
character sub-sets for the purposes of identifying the syllable (akshar). In what follows
the syllable analysis will be restricted to Marathi.
(C) Consonants
(D) Diacritics
14
example, This falls under aspirate category
: Avagraha For extra length with long
(H):Halanta - Halant used in most writing systems of the Indian subcontinent to signify
the lack of an inherent vowel.
Each of these sub-types has its restrictions in terms of what can precede or follow it
within a syllable (akshar), as shown in the table below:
C can be preceded by H or no subtype and followed by any one of the following: M,D,H
V can be preceded by no subtype and followed by D but not by another sub-type.
M can be preceded by C and followed by D.
D can be preceded by C, V, M and followed by no other subtype. It closes the syllable
(akshar).
H can be preceded by C alone and followed only by C and no other sub-set.
The formalism defines the syllable (akshar) in terms of both what can constitute a
syllable (akshar) and what cannot. A valid syllable (akshar) as per this definition can be
of only two types:
The three other subsets viz. Mtrs, Diacritics, Halanta cannot constitute a syllable
(akshar) by themselves or in combination among themselves.
5
The nukta is a small dot placed under a character in certain scripts to show that they are flapped or for
deriving 5 other consonants required for representing Urdu loans ,,,,
15
6.2.1.1. The Vowel syllable (akshar) is of the following types:
A total number of 16 theoretical syllables is therefore possible. It will be seen that the
written syllable (akshar) is not very different in structure from the phonetic syllable and
that the movement from the written to the spoken levels is made feasible by application
of certain rules.
6
This character represents phonetically the weak implicit vowel, termed as schwa and often shown as /a/
also.
16
This formal structure of the syllable (akshar) explained above is common to all Brahmi
based scripts (with a few variations). It will form the basis of an exhaustive description of
the characters as well as their ligatural representations.
17
6.3 SCRIPT GRAMMAR PROPER
This section lays down in detail the different parameters of the Script Grammar for
Marathi. These are:
This section provides detailed information about the characters in the language and the
list of the same and also more importantly shows the manner in which the character is to
be written. Each subsection comprises therefore two parts: the basic character set and the
shape each character should have, as mandated by the experts who have designed the
script grammar of Marathi.
18
Other consonants
The exact shapes as desired by the experts are provided in the table below:
-voiced -voiced +voiced +voiced Nasal
-aspirated +aspirated -aspirated +aspirated
Velar
Palatal
Retroflex
Dental
B-labial
Other consonants
DEVANGAR LETTER AA
DEVANGAR LETTER I
DEVANGAR LETTER II
DEVANGAR LETTER U
DEVANGAR LETTER UU
19
DEVANGAR LETTER E
DEVANGAR LETTER AI
DEVANGAR LETTER O
DEVANGAR LETTER AU
The vowel is retained for display purposes, although in principle it is only the Mtr
form which is used
20
9. Devangar sign AI (There can not be + =
any matra on this)
10.Devangar sign O + =
11. Devangar sign AU + =
12. Devangar sign Candra E + =
13. Devangar sign Candra O + =
RAFARS
Top rafar: Example.
21
RAKARS
1. Bottom rakar
2. Side rakar
3. Eyelash RA
The eyelash ra is appended only to two consonants: and
Examples of words where Rakars are used in Marathi language are given below:
Bottom rakar , ,
Side rakar , ,
Eyelash RA ,
6.3.1.6. Diacritics
These are as under in the case of Marathi:
: - Anuswar
: - Halant
- Visarga
: - For extra length with long vowels e.g. / /
Chandrabindu is not part of the Marathi character set and is used only to denote a +
and + as in
6.3.1.7. Numerals
Following are the numbers used in Marathi language. Use of English numerals occurs in
handwritten text as well as some of the official documents. The English (Latino-Arabic
set: 0,1,2,3,4,5,6,7,8,9) is used only in books on mathematics where complicated
equations and computations have to be shown. Here also, a few primary school books use
the Devangar set.
22
Devangar Digit
Three
Devangar Digit
Four
Devangar Digit
Five
Devangar Digit
Six
Devangar Digit
Seven
Devangar Digit
Eight
Devangar Digit
Nine
The shapes of some of these numbers vary depending upon the user.
23
12. Double quotation mark ""
13. Single quotation mark
14. Cross XXX
15. As Above --"--
16. Round Brackets ()
17. Square Brackets []
18. Curly Brackets {}
19. Abbreviation Sign ()
20. Devangar Danda |
21. Devangar Double Danda ||
Due to constraints of space and also clarity, for each class a series of 3 tables are
provided.
Table 1:
Table 2:
Table 3:
Wherever there is an X it implies that the combination does not exist. For the font
developer this is an indication that for this particular combination which is not possible in
the language but needs to be accommodated in the font table, a simple linear combination
be provided. As far as possible all such dead combinations have been identified.
e.g. Although the combination of +Mtr is theoretically not possible it needs to be
handled at the font level in the anticipation that a user could type this combination. The
font would show the following:
24
The classes are as under:
6.3.2.1. refers to a simple concatenation of Consonant and Mtr combinations.
6.3.2.2. refers to a concatenation of Consonant and Mtr + Nasal marker combinations.
Other diacritics such as avagraha and visarga have been avoided, since these are linear in
nature, are adjoined to the combination and do not in any way modify the structure of the
shapes.
Remark 1- and are rarely used only as the first members of clusters and mostly as
or alternatives of
25
Remark 2 - is used only with in the combination which means
but primarily the meaning is implied
This set is in continuation of set 1 which shows consonant and Matra combinations.
26
Consonant and Mtr combinations Set 3
This set is in continuation of set 2 which shows consonant and Matra combinations.
27
6.3.2.2 Consonant and Mtr +Nasal combinations.
This set refers to a Consonant and Mtr + Nasal marker combinations.
28
Consonant and Mtr +Nasal combinations - Set 2
This set is in continuation of set 1 above which shows combinations of Consonant and
Mtr + Nasal marker
29
Consonant and Mtr +Nasal combinations - Set 3
This set is in continuation of set 2 above which shows combinations of Consonant and
Mtr + Nasal marker
30
6.3.3. The Ligature Set of Marathi.
Marathi has a large set of ligatural forms. These are combinations of
Consoanant+Halanta+Consonant (CHC) or CHCHC or even rarer CHCHCHC. The CHC
combinations which are the most frequent are arranged in the shape of a matrix: the
abscissa or horizontal axis refers to the Consonant which constitutes the ligature and the
ordinate or vertical axis shows the consonant which forms the ligature and which is
followed by a halanta.
As in 6.3.2. the ligature sets are divided into the following
6.3.3.1 CHC (in a matrix)
6.3.3.2 CHCHC
6.3.3.3.CHCHCHC
31
32
The following set shows a combination of two consonants. To know how particular
combinations forms, select one consonant from the first column and second from first
row. For eg. Combination of consonant .
33
34
CHC( combination of two consonanats) - Set 3
35
6.3.3.2 CHCHC ( combination of three consonants)
These are not as frequent as the CHC combinations. Only the major are listed below.
alternative form
alternative form=
alternative form
alternative form
8
The combination is used in Maharashtra to represent Sanskrit
36
6.3.3.3.CHCHCHC ( Combination of four Consonanats)
This is rare and is found only in the following:
9
In Sanskrit the Avagraha which is basically a vowel lengthener is placed after the full vowel
37
6.3.5 Cardinal Numbers used in Marathi language
38
English numerals/ digits are used in Marathi language but in mathematics books.
This indicates that there are differences of opinion on this.
39
7. REFERENCES
1. http://www.unicode.org
2. ISCII91
40
8. ANNEXURES
Annexure 1: Names of experts who have contributed to the script grammar
41
Annexure 2: Unicode Table of Devangar 10
10
The Unicode chart provided is for version 5.1 since the Script Grammar was prepared at that time. No
considerable change in the script grammar can be seen in the updated versions of Unicode insofar as
Marathi is concerned, with the possible addition of the Rupee Sign U+02B9
42
43
44