Professional Documents
Culture Documents
27
Introduction
Many engineering companies are today undergoing a paradigm shift from product
delivery to through life service support. The responsibility for supporting equipment from
supply to disposal is increasingly moving from equipment owners to equipment suppliers,
to minimise the capital investment required by the procurer, to reduce whole life
costs and to improve the control of the supplier over the service element of the supply.
(Davies et al., 2003; IfM, 2003). The shift applies across a range of different sectors,
including defence, healthcare, aerospace, automotive and construction. There are a
number of drivers for this change including changing procurement policies in the public
and private sectors (HM Treasury, 2000), extensive market segmentation, the need to
control spares and support activities and pressures to reduce environmental impact
(McAloone, 2003). The change to a product-service model has substantial potential
benefits as it encourages greater efficiency and more sustainable approaches to
engineering by improving the scope for supply-side innovation. For example, in
aerospace the emergence of power by the hour as a service has challenged traditional
engine suppliers to rethink their technology offering which will in turn lead to a
revision of the design rules developed over the past 30 years (IfM, 2003; Deloitte, 1999).
The shift presents a significant opportunity to integrate design and manufacture with
ongoing aspects of in service operation such as facilities and asset management.
Engineering companies have always been required to retain key information in
support of the equipment that they supply through life and beyond, both to enable the
effective support of the equipment and to comply with contractual, legal and regulatory
requirements. The move to the product-service model makes the maintenance of detailed
and easily accessible records particularly important, as a core aspect of companies
businesses depend on these records. The situation is complicated, however by the
progressive move to electronic ways of working, with current methods dictating that
28
almost all data is now created, stored and used electronically. The ability of companies to
support equipment and remain compliant with legal, statutory and contractual conditions
is critically dependent on being able to locate and use information and cope with changes
in information access arrangements and processes. Organisations are faced with
understanding how information can most effectively be created, managed, stored,
accessed and if necessary recreated through many generations of information technology
and systems, and potentially spanning many decades.
There are very many aspects to the effective creation and through life management of
engineering information, which we will term Through Life Information Management
(TLIM). Engineering model representation issues are concerned with the modelling of
the product design, including the storage of product lifecycle management (PLM) data in
a suitable form for long term access and capture of such issues as design rationale,
decision outcomes and design process. Systems issues include the longevity of digital
hardware and storage media and the development of strategies for the archiving of digital
data over several generations of computer hardware and software. Data organisation
issues are concerned with how large collections of information can be organised to assist
information access and retrieval by diverse communities over long timescales, and with
issues such as security and information provenance. Management and human issues are
concerned with the strategic and organisational approaches to TLIM adopted by
organisations and throughout the value chain, with the way people and communities work
with information collections and with how working practices may change in the future.
The intention of this paper is to review developments in each of these areas and to
suggest elements of a possible research agenda.
Engineering model representation issues address the questions of firstly how the
outcomes of the design process should be recorded in the most appropriate way to
communicate design intent to all concerned, and secondly how design information should
be communicated, given the diverse proprietary data formats that are used in the design
process. The first question involves topics of engineering representation such as computer
aided design (CAD) and other computer aided engineering formats used in PLM, but also
involves such concerns as what should be captured of the inputs to the design process
(design requirements, information upon which design decisions are made and so on) and
what should be captured concerning the activities and reasoning of the design process
itself. The second question is predominantly concerned with the exchange and
interoperability of PLM data produced during the design process.
29
The increasing use of product representations that are extended by such capabilities
as parametric and variational modelling (Shah and Mntyl, 1995), design by
features (ibid), associative systems and by recording the history of the steps in
model construction make issues of dependence on proprietary software and of model
interoperability and persistence much more severe.
Product life cycle management (PLM) allows the extension of product representation
beyond modelling of the product geometry, bill of materials etc. to encompass a broader
range of aspects of the product, including sourcing and procurement, supply chain
management and customer relationship management (CRM). PLM also extends to the
30
end of the product life cycle in terms of service and warranty and product retirement
details, and its ultimate expression lies in portfolio management, the highest level
decision making about adding and removing assets across a company's entire product line
(Ericson, 2001). But while PLM is an important enabler in distributed and real time
collaboration, knowledge sharing, and assisting better decision making in product life
cycle management. (Nnaji et al., 2004), sustaining the data stored in PLM systems over
long product lifetimes will be a significant challenge.
31
The issues of viewpoint dependency and low semantic content in product models.
The level of abstraction used in product models is too low for automatic
manipulation of those models. Extraction of viewpoint specific information is still
problematic. The semantic expressiveness of models captured by data exchange
standards is low.
Product models continue to capture what characteristics a product should have, but
largely fail to capture why a product has the characteristics it has. In TLIM it may be
very important to be able to revisit the basis of design decisions, together with the
process carried out by the engineering team and the information that has gone into
that process.
There is significant potential, therefore, for research to develop approaches to the capture
of extended models of product designs, including records of design tradeoffs, results of
negotiation, evidence of decision making, details of successful and unsuccessful designs
and rationale for design choices. In addition to identifying how extended models of
product designs may be captured, research is needed to identify what is needed
(and perhaps as important what is not needed) to record different activities at different
stages in the product life cycle.
Systems issues
If information in digital form is to be made available over long time spans, then strategies
must be put into place to enable long term, robust storage and management of such
information. The notion of curatorship, or curation as it is more commonly known, has
typically been associated with the activity of long term storage and management of items
of specific, individual importance, such as antiquities and pieces of art. In the modern
organisation, information is arguably one of the most important company resources, and
hence efforts to maintain this information in a digital form are referred to as digital
curation (JISC, 2003). Digital curation encompasses both the processes of digital
archiving and preservation as well as the accompanying management issues. Such
management issues comprise more than simply facilitating the archiving and preservation
processes, as digital curation is a complex activity that generally involves interaction
between creators and providers of data, the archivers of data, and most importantly the
consumers of data (JISC, 2003). This facility is vital to TLIM, where stored information
and knowledge will be added to, extracted and evolved over the course of the life cycle of
the product. The field of digital curation is still immature, as evidenced by the
establishment in the UK in 2004 of a Digital Curation Centre (Beagrie, 2004) to
investigate approaches to digital curation in the context of e-Science.
32
Each of these techniques has different merits and demerits. Many do not address the issue
of software obsolescence. Emulation, migration and encapsulation do address this issue
but there is no clear favourite among these, and a hybrid solution is likely to be most
suitable. Notable research in this area, such as the PADI initiative instigated by the
Australian National Library (PADI, 2004) and the CEDARS project initiated by the UK
Joint Information Systems Committee (JISC) (CEDARS, 2002), has hesitated to identify
the most suitable method, and instead has identified a range of possible solutions. It is
highly likely that a hybrid or amalgamated approach will yield best results, as proposed
by Lorist and van der Meer (2001) who posit it is likely that in practice a mixture of
these strategies will have to be used and that there is not a monolithic black or white
solution towards digital longevity. A further point, significant in the context of TLIM,
was raised by Rothenberg (2000) who argued that, in certain situations such as
negligence claims, it is important to be able to understand what another person might
have understood from a document. In this respect it is important to be able to view the
document in exactly the same manner as a previous reader to follow their logic, and
deduce what insights or blind spots they may have had.
A key recent development in the development of digital archiving is the widespread
support for use of the Open Archival Information System (OAIS) Reference Model
(CCSDS, 2002). OAIS is a conceptual framework for an archival system dedicated to
preserving and maintaining access to digital information over the long term, originally
developed by NASA to archive terrestrial and space observation data. This model has
been shaped and adapted within many digital archiving initiatives, for example the
CEDARS project (2002) and the NebLib project initiated by the Koninklijke Biblioteek
(Steenbakkers, 2000). OAIS covers aspects of archiving from document preparation and
submission, through to management and retrieval. It has now been recognised as an
international standard, ISO 14721 : 2003 (ISO, 2003). The prevalence of this standard
33
Magnetic tape
Videotape
Magnetic disc
Optical disc
Table 1 shows an estimate of the life spans for digital media that were commonly
available in 1995. In many cases, engineering artefacts have lives of several decades, and
of the media described, only optical discs have lifetimes of this order, although the
estimated lifespan of 30 years could easily be exceeded by many engineering artefacts.
These estimates are subject to some contention (Harvey, 1995), with suggestions that
they are too conservative; however they clearly indicate the concern being expressed over
the stated lifetimes of digital media.
This limited lifespan affects mainly digital media; only high quality paper, stone
tablet, digital linear tape and microfilm offer life spans above 100 years, and only paper
and microfilm are practical solutions for very long term storage (Twentyman, 2003).
Research suggests that recordable and rerecordable optical discs (CD-Rs and CD-RWs)
suffer from much shorter and generally less predictable life spans than prewritten
CD-ROMs making it difficult to reliably quote a lifespan for such discs (Ross and
Gow, 1999). Adelstein (1999) suggests two reasons for this lack of consistency, the first
is that data obtained by empirical observation rarely considers the environment in which
the disc operates and the second that the use of accelerated ageing methods within
experimentation can apply infeasible conditions to the disc, resulting in the lifespan of the
disc being influenced by factors it would not be subjected to in practice.
The issue of media longevity can therefore be considered to have an impact upon
TLIM, as the life spans of many digital media are perhaps insufficient to provide storage
for the lifespan of a supported product. However, as more and more accurate methods of
life expectancy estimation are developed and better archival practices are undertaken
(e.g., British Standard BS 4783-7 : 1993 (BSI, 1993) specifies recommended methods of
optical disc storage, transportation and maintenance) the risks of sudden, unexpected data
loss through media failure are alleviated. It will then be possible to plan and manage
media degradation as part of a wider ranging archiving operation.
34
Systems issues such as those involved in digital archiving and in media longevity are
crucial to TLIM, and involve unresolved issues, meriting further research. The various
methods of archiving digital information have been pared down to a few choices.
However, it is suggested that a hybrid approach is required and it is argued that, whilst
such research might be undertaken within the library and archiving fields, the unique
challenges of TLIM require that the options should be subject to separate and deliberate
appraisal. Digital curation is suggested to be the overarching objective of digital
archiving and preservation, and the facility of including knowledge within the realm of
digital archiving is essential to TLIM.
organising information
classification schemes: which emphasise the creation and organisation of subject sets
(e.g., subject headings, classification schemes, taxonomies, and categorisation
schemes)
relationship lists: which emphasise not only the creation and organisation of subject
sets, but also the connections between the terms and concepts within them
(e.g., thesauri, semantic networks and ontologies).
35
synthetic classification: in which new classes can be developed for new topics that
are not already listed (logical rules are established for dividing topics into classes,
divisions and subdivisions)
36
are designed to promote interoperability between computer systems and enable advanced,
automated reasoning. The Semantic Web has been proposed as a means of allowing
machines to understand Web documents through the use of semantically enriched
languages and ontologies (Ding et al., 2002; Fensel and Munsen, 2001). Future
developments in TLIM are likely to build on developments in the Semantic Web, in
which the computer-interpretability of data will be extended through the use of metadata
linked to ontologies that will allow the modelling of relationships among data.
Developments may also build on exploitation of understanding the processes and
activities by which information has been created to assist in the retrieval of information,
through links to workflow and to extended process models.
37
These methods of digital document protection must cater for 3 scenarios, copyright
protection, tamper proofing and authentication (Deguillaume et al., 2003). These methods
have slightly competing requirements, where means of copyright protection require a
robust means of identification that will still remain visible to the viewer after any
resizing, reformatting or general manipulation. In cases where the authenticity or the
veracity of the content must be ensured, it is perhaps necessary to use a fragile identifier
which is rendered illegible upon alteration of the original document. There is also an
argument that the depth of information that can be stored as an identifier within a
document is compromised by a need to ensure that the identifier has a degree of
invisibility and robustness to attack (Voloshynovskiy and Pun, 2002). Whilst, on a
cursory level, this is only important in areas of fraudulent copyright abuse, it is feasible
that the identifier might be inadvertently damaged if there is insufficient robustness.
Several approaches have been proposed for digital document protection,
notably digital watermarking, fingerprinting and digital signatures. The first two methods
share many features (and are often confused) where both seek to embed a unique
identifier within the document. These identifiers, if well constructed, may be configured
in such a way as to create no impairment to document use. Fingerprinting extends this
identifier to include information regarding the recipient of a document, thus reducing the
risk of a third party recipient reproducing the document en masse. These two methods
allow for the source (and in the case of fingerprinting, the recipient) to be linked to a
document. Whilst a well designed identifier should not be vulnerable to manipulation,
there is nothing to prevent unauthorised modification to the contents of the document
itself, save for ingraining the identifier within the document in such a way that
manipulation of the document damages the identifier.
Digital Signatures address this shortcoming explicitly, using hashing or other means
of uniquely describing the document coupled with public and private key encryption.
The decision regarding which method of digital document protection to use comes down
to the environment (either enforcement or compliance) in which the document will be
made available. While the exact nature of the environment in which TLIM will operate is
unclear, it is argued, however, that the general use of digital signatures on documents will
act both to provide unique identification of the source and content of a document, and act
to prevent any inadvertent modification of documents that are protected in this manner.
38
In addressing the management and human issues of TLIM, the key is to identify the most
appropriate strategic and organisational approaches both within individual organisations
and throughout the value chain. It is necessary to establish how people and communities
work with information collections, and how working practices may change in the future.
The management and human issues are first and foremost impacted by the change to a
product-service business model, and by the implications of this change. It is noted that
changes to these model imply changes to the governance of projects and of
the relationship between purchaser and supplier, especially in the case of public
procurement. It also implies that issues of product performance assessment become more
important the move to a product/service mode of delivery allows much improved
feedback about product performance and impact to the product designers and producers,
owing to the service relationship. There are two aspects of this feedback that are
important: feedback about the physical performance of the artefact (e.g., the reliability of
the mechanical parts, the behaviour of the fabric of a building) and about the impact of
the artefact on the work patterns and behaviour of the users (e.g., the impact of a building
on those who work in it).
Other impacts of product-service systems are on human resources policy, in particular
issues such as outsourcing and use of contract staff, training and staff development,
professional and occupational roles, and roles and boundaries in the supply chain,
including issues of responsibility, autonomy and authority. New decision support models
will need to be developed to reflect the changed circumstances of through life product
support, and the information system life cycle will have to be considered as well as the
product life cycle, including issues of systems governance and human and cultural factors
in the support and operation of the system.
Finally, two important strategic and managerial issues in TLIM will be risk
management and communication. An important part of the identification of a framework
for through life information planning will be the identification and collation of risks and
opportunities in TLIM, and then application of techniques of risk mitigation and
contingency planning to reduce probability of impact. Contingency plans are triggered
and tradeoffs are identified. Contingency planning will be an important part of a TLIP
framework. During application of the framework, risk monitoring of the identified risks
will take place. Probabilities and impacts will be updated but new risks will arise,
existing risks will be eliminated and trigger events will be monitored. The risk
monitoring activity in turn contributes to the next cycle of risk identification,
prioritisation and monitoring, so closing the feedback loop. The research in risk
management for TLIM will principally involve aspects of the risk identification and
contingency planning, together with the incorporation of risk into the framework.
Minneman (1991), Bucciarelli (1994) and Henderson (1999) have studied large scale
engineering processes as participant observers, and conclude that design development
occurs largely through a driven process of negotiation, where information is actively
communicated and made sense of, rather than simply filtering through an organisation.
There may be merit in extending study of issues of team communication in design to
explore communication throughout the product life cycle, in particular feedback from the
product in service to the design process, issues of viewpoint dependency, integrity and
trust, the role of different representations, skill and professional development
requirements and so on.
39
Concluding remarks
The process of full through life support depends crucially upon the integration a network
of organisations (both private and public). The network itself is subject to change and has
a life cycle of its own. In the space of 30 years there is a natural turnover of staff and
organisations; the environment within which the network operates is subject to change,
for example due to evolving customer requirements, environmental contexts and business
needs; and the software and hardware infrastructure upon which both the product and the
network are built is constantly shifting. In the context of this new environment, products
are upgraded, remanufactured and used for different purposes, and, more importantly,
systems are persistent they outlive products and the information associated with
products or particular subsystems is reused for future generations of products. The
challenge is how can products be best designed and supported in this dynamic, network
centric environment. This paper has reviewed the product representation, systems, data
organisation and management issues involved in the provision of through life information
management, and has made suggestions for the research agenda for the future.
Acknowledgements
The authors are grateful for the support of their academic and industrial collaborators in
carrying out the work described in this paper. The funding provided by the UK EPSRC as
part of the Innovative Manufacturing Research Centre (grant GR/R67507/01), and by
members of the UK Council for Electronic Business, is also gratefully acknowledged.
References
Adelstein, P. (1999) The permanence of digital information, International Conference of the
Round Table on Archives XXXIV, October 69, International Council on Archives, Budapest,
Hungary, http://www.ica.org/citra/citra.budapest.1999.eng/adelstein.pdf
Beagrie, N. (2004) The digital curation centre, Learned Publishing, Vol. 17, No. 1, pp.79.
Bracewell, R.H., Ahmed, S. and Wallace, K.M. (2004) DRed and design folders: a way of
caputuring, storing and passing on knowledge generated during design projects, Design
Automation Conference, ASME, Salt Lake City, Utah, USA.
Bronsvoort, W.F., Noort, A., van den Berg, J. and Hoek, G.F.M.. (2001) Product development
with multiple-view feature modelling, CD-ROM Proceedings of the IFIP Conference on
Feature Modelling and Advanced Design-For-The-Life-Cycle Systems, June 1214,
Valenciennes, France.
BSI (1993) BS 4783-7 Storage, Transportation and Maintenance of Media for Use in Data
Processing and Information Storage. Recommendations for Optical Data Disks (CD-ROM),
British Standards Institution, Chiswick.
Bucciarelli, L.L. (1994) Designing Engineers, MIT Press, Cambridge, MA.
CCSDS (2002) Reference Model for an Open Archival Information System, CCSDS650.0-B-1, Blue
Book, Consultative Committee for Space Data Systems, Greenbelt, MD,
http://ssdoo.gsfc.nasa.gov/nost/wwwclassic/documents/pdf/CCSDS-650.0-B-1.pdf
CEDARS (2002) CEDARS Guide to Digital Preservation Strategies, University of Leeds,
Leeds, UK.
40
Chen, H., Houston, A.L., Sewell, R.R. and Schatz, B.R. (1998) Internet browsing and searching:
user evaluations of category map and concept space techniques, Journal of the American
Society for Information Science, Vol. 49, No. 7, pp.582603.
Clarkson, P.J. and Hamilton, J.R. (2000) Signposting: a parameter-driven task-based model of the
design process, Research in Engineering Design, Vol. 12, No. 1, pp.1838.
da Silva, P., McGuiness, D.L. and McCool, R. (2003) Knowledge provenance infrastructure,
IEEE Data Engineering Bulletin, Vol. 26, No. 4, pp.2632.
Davies, A., Brady, T., Tang, P., Hobday, M., Rush, H. and Gann, D. (2003) Delivering Integrated
Solutions, SPRU, CENTRIM, Brighton.
Deguillaume, F., Voloshynovskiy, S and Pun, T. (2003) Secure hybrid robust watermarking
resistant against tampering and attack, Signal Processing, Vol. 83, pp.21332170.
Deloitte (1999) Making Customer Loyalty Real: Lessons from Leading Manufacturers, Deloitte
Research, New York.
Ding, Y., Fensel, D., Klein, M. and Omelayenko, B. (2002) The semantic web: yet another hip?,
Data and Knowledge Engineering, Vol. 41, pp.205227.
Ericson, J. (2001) Pulling PLM together, many owners mean a complex future, Line56,
http://www.line56.com/articles/default.asp?NewsID=3073.
Fensel, D. and Munsen, M.A. (2001) The semantic web: a brain for humankind, IEEE Intelligent
Systems, Vol. 16, pp.24, 25.
Foskett, A.C. (1996) The Subject Approach to Information 5th Edition, Library Association
Publishing, London.
Fox, M.S. and Huang, J. (2003) Knowledge Provenance: An Approach to Modeling and
Maintaining the Evolution and Validity of Knowledge, EIL, University of Toronto, Toronto,
Canada.
Harvey, R. (1995) The longevity of digital media: from digital artefact to digital object, National
Preservation Office Conference, Brisbane, November 2830, Australia.
Henderson, K. (1999) On Line and On Paper, MIT Press, Cambridge, MA.
Hodge, G. (2000) Systems of Knowledge Organization for Digital Libraries: Beyond Traditional
Authority Files, Council on Library and Information Resources report,
http://www.clir.org/pubs/reports/pub91/contents.html
Hoffmann, C.M. and Joan-Ariyo, R. (2000) Distributed maintenance of multiple product views,
Computer-Aided Design, Vol. 32, pp.421431.
IfM (2003) Living without production, if we can, Cambridge Manufacturing Review, Summer,
Institute for Manufacturing, University of Cambridge, http://www.ifm.eng.cam.ac.uk/service/
cmr/03cmrsummer/productionsummer03.pdf.
ISO (2000) ISO 10303-28, Industrial Automation Systems and Integration Product Data
Representation and Exchange Part 28: Implementation Methods: XML Representation of
EXPRESS Schemas and Data. International Organisation for Standardisation, Geneva.
ISO (2003) ISO14721:2003 CCSDS 650.0-B-1: Reference Model for an Open Archival Information
System (OAIS) Blue Book, International Organisation for Standardisation, Geneva.
ISO (2004) ISO 10303-239, Industrial Automation Systems and Integration Product data
Representation and Exchange Part 239: Application Protocol: Product Life Cycle Support,
International Organisation for Standardisation, Geneva.
JISC, (2003) Circular 6/03 (Revised) An Invitation for Expressions of Interest to Establish
a New Digital Curation Centre for Research into and Support of the Curation and
Preservation of Digital Data and Publications, http://www.jisc.ac.uk/uploaded_documents/
6-03%20Circular.doc .
Jones, P, Clarke-Hill, C., Shears, P., Comfort, D. and Hillier, D. (2004) Radio frequency
identification in the UK: opportunities and challenges, International Journal of Retail and
Distribution Management, Vol. 32, No. 3, pp.164171.
41
Landt, J. (2001) Shrouds of Time: the History of RFID, Pittsburgh, Pennsylvania, AIM.
Lorist, H.H.J. and van der Meer, K. (2001) Standards for digital libraries and archives: digital
longevity, 1st International Workshop on New Developments in Digital Libraries, July 67,
Setubal, Portugal, pp.8998.
Mason, H, (2002) ISO 10303 STEP, a key standard for the global market, ISO Bulletin, January,
http://www.iso.org/iso/en/commcentre/isobulletin/articles/2002/pdf/step02-04.pdf
McAloone, T. (2003) Demands for sustainable development. International Conference on
Engineering Design, ICED03, KTH, Stockholm.
McMahon, C.A. (1994) Observations on modes of incremental change in design, Journal of
Engineering Design, Vol. 5, No. 3, pp.195209.
McMahon, C.A. and Browne, J. (1998) CADCAM: Principles, Practice and Manufacturing
Management, 2nd ed., Addison Wesley Longman, Harlow.
McMahon, C.A., Crossland, R., Lowe, A., Shah, T., Williams, S.J. and Culley, S.J. (2002) No zero
match browsing of hierarchically categorised information entities, Artificial Intelligence for
Engineering Design, Analysis and Manufacturing, Vol. 16, pp.243257.
Middleton, P. and McCollum, B. (2001) Management of process improvement by prescription.
Journal of Systems and Software, Vol. 57, pp.919.
Minneman, S.L. (1991) The Social Construction of a Technical Reality: Empirical Studies of
Group Engineering Design Practice, PhD Thesis, Department of Mechanical Engineering,
Stanford University, Stanford, CA, Xerox PARC report SSL-91-22.
NIST (1993) Draft Federal Information Processing Standards Publication 183, Announcing the
Standard for Integration Definition For Function Modeling (IDEF0), National Institute of
Standards and Technology, Gaithersberg, MD.
Nnaji, B.O., Wang, Y. and Kim, K-Y. (2004) Cost-effective product realization service-oriented
architecture for integrated product life-cycle management, 7th IFAC Symposium on Cost
Oriented Automation, June 79, Gatineau/Ottawa, Canada.
PADI (2004) PADI Digital Preservation Strategies, http://www.nla.gov.au/padi/topics/18.html
PDX Standard Group (2004) PDX Standard Group Home Page, http://www.pdxstandard.org/.
Richardson, J., Ormerod, T.C. and Shepherd, A. (1998) The role of task analysis in capturing
requirements for interface design, Interacting with Computers, Vol. 9, pp.367384.
Ross, S. and Gow, A. (1999) Digital Archaeology: Rescuing Neglected and Damaged Data
Resources, HATII, University of Glasgow, UK.
Rothenberg, J. (1995) Ensuring the longevity of digital documents, Scientific American, Vol. 272,
No.1, pp.4247.
Rothenberg, J. (2000) Using Emulation to Preserve Digital Documents, Koninklijke Bibliotheek,
The Hague, http://www.kb.nl/pr/publ/usingemulation.pdf
Rowley, J. and Farrow, J. (2000) Organising Knowledge 3rd edition, Gower Publishing,
Aldershot.
Shah, J.J. and Mntyl, M. (1995) Parametric and Feature-based CAD/CAM: Concepts,
Techniques, and Applications, John Wiley and Sons, New York.
Shaw, S. (1999) Overview of Watermarks, Fingerprints, and Digital Signatures, University of
Edinburgh, JTAP Report 34.
Steenbakkers, J. (2000) Setting up a Deposit System for Electronic Publications, Nedlib
Report Series 5, Koninklijke Biblioteek, The Hague, http://www.kb.nl/coop/nedlib/results/
NEDLIBguidelines.pdf
Suh, N.P. (1990) The Principles of Design, Oxford Series on Advanced Manufacturing, Oxford
University Press, New York.
Taylor, A. (1992) Introduction to Cataloguing and Classification, Libraries Unlimited,
Westport, CT.
42
Treasury, H.M. (2000) Public Private Partnerships: The Governments Approach. The Stationery
Office, Crown Copyright 2000, London.
Twentyman, J. (2003) Durable data, Managing Information and Documents, September/October,
pp.1820.
Vickery, B.C. (1975) Classification and Indexing in Science 3rd Edition,
Butterworth-Heinemann, Oxford.
Voloshynovskiy, S. and Pun, T. (2002) Capacity-security analysis of data hiding technologies,
IEEE International Conference on Multimedia and Expo (ICME2002), August 2629,
Lausanne, Switzerland.