Professional Documents
Culture Documents
30/72-3780-0 EN
Maestro UX
Archiving
Contents:
1 2
2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.7.1 2.7.2 2.7.3 2.7.4 2.7.5 2.8 2.8.1 2.8.2 2.8.3 2.8.4 2.8.5 2.8.6 2.9 2.9.1 2.9.2
3
3.1 3.2 3.3 3.4
Configuration of archiving . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Configuration of the archive object . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configuration of trend archiving . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configuration of message archiving . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configuration of log archiving . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ...... ...... ...... ...... 26 29 31 31
4
4.1 4.2 4.3
Archive components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Stations with online archive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Station with centralized archive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 External archive devices. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
5
5.1 5.1.1 5.1.2 5.2 5.2.1 5.2.2 5.2.3 5.2.4
5.2.5
6 7 8 9
Size monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 Evaluation of archived trend data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 Archiving in redundancy mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43 Consistency of the archive - Recovery mechanisms . . . . . . . . . . . . . . . . . . . . . . . . . 44
Page 2
30/72-3780-0 EN
07/1999
1 Introduction
Archiving in Maestro UX is used to save the data and data structures in the system on a secure backup medium for a long period of time. The archived data can be loaded back into the system, for example to carry out subsequent evaluations or to be able to re-establish the last saved status quickly and reliably after a malfunction. A basic distinction is made in the archive data between trend and file histories. Trends are process values of functions collected and archived over time. Sources of trends may be various signal types. Trends can be analyzed with the aid of various applications. It is, for example, possible to display the process values in the curve display, to represent them in the matrix log as value strings, or to pass them on to the control level for more detailed analysis (e.g. characteristic value calculation, lifetimes monitoring). File histories are data stored in the form of files. These are object-related system configuration data (data of the central object list), graphics, data from subsystems, messages, logs (configuration and result data), recipe data (configuration and result data) and data of BLE applications. File histories are used by various functions, such as to represent the message history on the historical message page. A general distinction is made between automatic and user-controlled archiving. Functions for which data can be automatically archived must be configured appropriately. Trends, logs, recipe results and messages are automatically archived. The user-controlled archive data types include Maestro UX configuration data, graphics, data of subsystems (e.g. Contronic P), BLE applications (configuration data and results), and the recipe configuration data. The archive of a Maestro UX system consists of one or more online archives and a centralized archive component. The number of online archives is dictated by the number of workstations in the system. The online archive of a Maestro UX system is scalable, and can be expanded by suitable choice of hardware components (hard disks/number of workstations). There is one centralized archive in a Maestro-UX system. It is responsible for management of the external archive and the external archive devices, and communication with the external archive devices. The external archive devices must be connected to the workstation on which the centralized archive is installed. The external archive comprises an unlimited sequence of external data carriers, and so can be scaled in any way desired. DAT tape drives and magneto-optical drives can be used as external archive devices.
07/1999
30/72-3780-0 EN
Page 3
Dialog with the archive is by way of the message page. There all activities, such as archiving and dearchiving of data and actions with the archive devices (insert data carrier, remove data carrier etc.), can be depicted. The additional information on the message always contains the complete name of the data carrier which is to be accessed. The message contains the data carrier reference by way of the data carrier type, the serial number of the type, the archive channel, and the number of archiving and dearchiving jobs waiting for the data carrier type. The general data carrier entrya is: (<data carrier type>|[<ser. no. of data carrier type>]|[<no. of archive channel>])_[<no. of archiving, dearchiving jobs>] Examples: (0|3) (0|3)_4 (0|3|2) Requirements for the data carrier (DC type 0| serial no. 3) Four archiving jobs are waiting for the data carrier (DC type 0 | serial no. 3). A data carrier has been inserted into/removed from the archive device on archive channel 2 (DC type 0 | serial no. 3| archive channel 2). A newly initialized data carrier (-) with no data yet written to it has been inserted into/removed from the archive device (DC type 6 | - | archive channel 1); The serial number is automatically issued for DC type 6 the next time an archiving job is received.
(6|-|1)
Note: When executing actions with the external archive devices it should always be ensured that the correct data carrier is inserted, or that a data carrier is inserted at all. Select "Control Level / Archive" from the menu in the system dialog to move into the Archiving start menu. The system dialog is started by selecting the "wrench" icon from the dialog box. The start menu is shown in Figure 1. The top section is termed the "action window" and is used by all actions which can be executed by the buttons on display (Load, Save, Media Init,...). The action window is initially empty. The bottom section is called the "job window". The job window is used to display all archive jobs. It uses a scrollbar when there are more entries than can be displayed at once due to the size of the window. Any job entered in the list can then be reached by scrolling up and down using the slider. From the system dialog choose: Control Level -> Archive
Page 4
30/72-3780-0 EN
07/1999
Description of fields, Figure 1: Archiving start menu Field A B C D E Return Load Save Media Init Media Import Example of entry Explanation Quit archive dialog and return to system dialog Load archive data Archive and save archiving data Initialize a medium Enter a data carrier in the external archive management table. Function not yet implemented. The entry is made automatically when a Maestro UX data carrier not yet known to the archive is detected in an archive device. Export a data carrier from the management table of the external archive. Function not yet implemented. The export is executed automatically as soon as the maximum number of entries in the management table of an external archive is exceeded. Forced change of medium. In execution of the commande the old medium is disconnected and a new medium of the same data carrier type is entered as the current write data carrier. A new, initialized data carrier of the same data type must have been inserted into the device. Delete all entries in the job window except the active jobs Cancel a selected job. Function not yet implemented. Output of information on the media inserted in the devices 15.01.1997, 11:45:00 COL total Save active User1 Streamer COL Date and start time of the archive job Information text on the job (entered by the user) Type of job to be executed Job status Name of user who executed job Name of archive device used Processed archive data type For display of confi prompts and dialog errors. The button has a dark red background if error messages are waitingn. Select the button to open up the error window and acknowledge the error.
Media Export
Tape change
H I J K L M N O P Q R
Export Cancel job Device Info Time Info text Jobs Status User Device Archive type Error
All actions during ongoing operation which the user can and must execute in connection with the archive are integrated into the system dialog. The functions concerned are: Initialization of data carriers Forced change of write data carriers
30/72-3780-0 EN Page 5
07/1999
Notifying the external archive of data carriers Deleting data carrier index from external archive manager Overview of status of archive devices Archiving/backup of data
The following data types can be archived from the system dialog: BLE application (ARC_BLE_APPL) Graphical objects (ARC_GRAPHICS) Maestro UX objects (ARC_OBJDIR) Contronic P subsystem (ARC_SUBSYSTEM/CP) Recipe confi data (ARC_BATCH/CONFIG)
Dearchiving of data The following data types can be dearchived from the system dialog: BLE application (ARC_BLE_APPL) Graphical objects (ARC_GRAPHICS) Logs (ARC_LOGGING) Maestro UX objects (ARC_OBJDIR) Contronic P subsystem (ARC_SUBSYSTEM/CP) Recipe confi data (ARC_BATCH/CONFIG) Recipe results (ARC_BATC/RESULT)
When archive data are first written to an initialized data carrier, the carrier is assigned a serial number which is marked on the carrier. The complete data carrier ID can be ascertained by way of the Device Info function in the system dialog, and should be marked on the data carrier label (see 'Archive/data carrier management').
Page 6
30/72-3780-0 EN
07/1999
Description of fields, Figure 2: Initialization of data carriers Field A B Device Data carrier OK Cancel Example of entry Dev1: Storage medium Type 0 Explanation Display/selection box containing connected archive devices Display/selection box containing the available data carrier types (see 'Archive/data carrier management'); For allocation of data carrier types and data types, refer to 'Configuration of the archive object') Confirm selection and execute action Cancel the action and return to the last menu
C D
The system dialog starts the job and flags it as "active" in the job window. As soon as it is flagged as "finished" in the job window, initialization is complete. If an error has occurred, a detailed description of the error can be displayed in the error window of the dialog box. Also, an operator message is sent which can be viewed on the message page.
07/1999
30/72-3780-0 EN
Page 7
Field description, Figure 3: Forced change of data carriers Field A B C Data carrier OK Cancel Example of entry Storage medium Type 0 Explanation Display/selection box containing the available data carrier types (see 'Archive/data carrier management') Confirm selection and execute action Cancel the action and return to the last menu
Page 8
30/72-3780-0 EN
07/1999
Field description, Figure 4: Device information Field A B C D Device Data carrier OK Cancel Example of entry Dev1: hgr93_2013412624/ 6/0 Explanation Display box containing the available archive devices Display box containing the data carriers inserted in the corresponding archive device The button cannot be selected in this dialog box Cancel the action and return to the last menu
The archiving of data is defined on configuration of the objects concerned (see 'Configuration of archiving').
From the system dialog choose: Control Level -> Archive -> Save Choose 'Save' to open up a window (Figure 5) in which the data type to be archived or saved can be selected. The 'Archiving' button is active by default. Saving data differs from archiving of data in that the user can write data of any data type to a data carrier of any type. The allocation is not checked by the archive software. If an error has occurred in the save operation, the job is canceled and - in contrast to the archiving function - is not automatically repeated. It is the responsibility of the user to check whether the archiving job has been properly completed. Archiving: When the 'Archiving' function is selected the data of the selected type are archived onto the current write data carrier of the assigned data carrier type. Archiving of the data and export to the data carrier are registered by relevant messages on the message page. If the necessary data carrier is not inserted, the user is prompted to insert it with the message "Insert data carrier". The system dialog starts the job and flags it as active in the
07/1999
30/72-3780-0 EN
Page 9
job window. A mark in the job window flagging the job as finished indicates that archiving onto the external data carrier has been executed. If the archiving job could not be executed due to an error (e.g. no data carrier inserted), the job is automatically repeated, by cyclical restarts, until it can be processed. Errors are displayed in the error window of the dialog box. The archiving function also sends operator messages which are then available on the message page. If a data carrier is to be produced with a complete backup of the selected data type, the user should check correct execution of the job. This is indicated by the message "Archiving to DC OK", which contains the information text as an item of additional information. Save: Choose the 'Save' function to write the data of the selected data type to to the data carrier inserted in the selected device. The procedure is the same as the manual archiving procedure. But here the option is available to save data of different types on one medium. The system dialog starts the job and marks it as active in the job window. When it is flagged as finished in the job window, the save operation to the external data carrier is executed. If the save operation has been executed successfully the message "Archiving to DC OK" appears, containing the text entered with the job as additional information. The backup data of the selected type are written to the data carrier inserted in the selected archive device. If no device is inserted in the data carrier, or if another job is active for the device in question, the backup operation is canceled with the error message "Backup not OK". Regardless of the data type and mode of archiving, the generated archive files are always saved first to the online archive on the source station and then exported to a data carrier in the external archive. A distinction must be made in this process between data with and without an implicit reference to a station. Data with an implicit station reference are allocated to a specific workstation in the system. They are present only once in non-redundant systems. When archiving these data the data source must be entered and, when dearchiving, the data destination. Data with implicit station references are: Object-specific COL data Graphical objects (M1 models) Recipe configuration data
For data types with no implicit station reference (e.g. BLE data), the source and destination stations must always be entered when archiving and dearchiving. Data without implicit station references are: BLE data Contronic-P data
The dialog is basically identical for all data types. Choose the data type and mode of saving and confirm with 'OK' to activate a filter in which the search criteria for the archive objects can be entered.
Description of fields, Figure 5: Archiving and backup Field A B Archive type Save Example of entry Graphical objects Explanation Display/selection box containing manually archivable data types When the button is selected the selected data can be archived to any desired data carrier.
Page 10
30/72-3780-0 EN
07/1999
Description of fields, Figure 5: Archiving and backup C D E F Archiving Device OK Cancel When the button is selected the selected data are archived to a data carrier of the assigned data carrier type. Display/selection box containing the connected archive devices Confirm and execute the action Cancel the action and return to the last menu
After confirmation with 'OK' another window (Figure 6) opens up. An information text can be entered in it and saved together with the archive data.
Description of fields, Figure 6: Info text Field A Info text Example of entry Explanation Option to enter an information text to be saved together with the archive data. This text is displayed in the archive browser when the data are reimported. Confirm and execute the action Cancel the action and return to the last menu
B C
Save Cancel
07/1999
30/72-3780-0 EN
Page 11
Description of fields, Figure 8: COL archiving, filtered COL data Field A B C D E F G Return Filter Save Cancel job Init COL Example of entry Explanation Cancel the action and return to the last menu Call up the selection filter for the COL browser Confirm and execute the action Cancel the action and return to the last menu Initialize the COL; This function should not be used. Browser window with display of the selected COL data Job window; For explanation see Fig. 1, fields H-R
All COL data have an implicit station reference. Choose 'Save' to open up another window (Figure 9). This window offers the possibility of entering an information text on the archive data. Choose 'COL Complete' to archive all the functions in the COL. Choose 'Filtered Functions' to archive the objects displayed in the browser. By choosing the 'Selected Functions' button, individual objects displayed in the browser can be selected and selectively archived.
Page 12
30/72-3780-0 EN
07/1999
Description of fields, Figure 9: Archiving COL objects Field A Info text COL Complete Filtered Functions Selected Functions C D Cancel Save Example of entry Explanation Option to enter an information text to be saved together with the archive data. This text is displayed in the archive browser when the data are reimported. Selection of the COL data to be archived Archiving of the functions displayed in the browser Archiving of selected functions Cancel the action and return to the last menu Confirm and execute the action
07/1999
30/72-3780-0 EN
Page 13
Description of fields, Figure 10: Archiving of BLE data Field A B Archive type Info text Example of entry hgr93 Explanation Display/selection box containing the workstations in the system Option to enter an information text to be saved together with the archive data. This text is displayed in the browser when the data are re-imported. Cancel the action and return to the last menu Confirm and execute the action
C D
Cancel Save
Page 14
30/72-3780-0 EN
07/1999
Description of fields, Figure 11: Archiving, filtered Contronic P data Field A B C D E F G H I J K L M Return Save Delete Workstation Track CP files All CP files Latest CP files Selected CP files Selected CP files Export Single Export All hgz1 1 Example of entry Explanation Cancel the action and return to the last menu Confirm and execute the action Delete the selected files Display/selection box containing the workstations in the system coupled to the Contronic P system External archive channel of a Contronic P system Display/selection box containing all Contronic P files of the selected track on the selected workstation Filter button for selection of all Contronic P files Filter button for selection of the latest versions of the Contronic P files Filter button for manual selection of Contronic P data. The archive data are selected by clicking on them with the left-hand mouse button. Display of all selected Contronic P files. Only the data displayed in this window are archived. When the button is selected single files can be excluded from archiving Choose the button to deselect all selected files Job window; For explanation see Fig.1, fields H-R
07/1999
30/72-3780-0 EN
Page 15
The search for archived data can be executed either via the management table of the external archive or by direct accessing of an external data carrier (Figure 12). When accessing the management table the search can be narrowed down by specifying the data type and entering time criteria. When accessing the external data carrier the complete index of contents is always displayed. In both cases the search results are displayed in a browser (Figure 13). If there are more than 1000 entries on the data carrier or in the management table of the external archive, the browser can only display a total figure for the data set. In this case the search must be restricted by way of the data type and the period of time. The browser indicates whether the data are still in the online archive, or on which data carrier they are stored. After selecting the required data, the user can insert the relevant data carrier to dearchive the data. If the data are still in the online archive or in the online cache of the external archive, no further action is necessary. One file can be dearchived with one job. Where several files are to be dearchived, the process must be repeated as often as necessary. From the system dialog choose: Control Level -> Archive -> Load -> [selection of archive device/online history], [selection of period], [selection of data type]
Page 16
30/72-3780-0 EN
07/1999
Description of fields, Figure 12: Dearchiving Field A B C D E F G H Read device Device Read directory Start time Duration Archive type Cancel OK 23.03.1997 06:48:18.832 720:00:00.000 Logs Dev1 Example of entry Explanation Read the index of the inserted external data carrier Display/selection box containing the available archive devices Read the contents of the management table of the external archive Start time of search period. Input in format dd.mm.yyyy HH:MM:SS.sss Duration of the search period. Input in format DD:HH:MM:SS.sss Display/selection box containing the data types for dearchiving Cancel the action and return to the last menu Confirm and execute the action
07/1999
30/72-3780-0 EN
Page 17
Description of fields, Figure 13: Dearchiving, browser Field A B C D Return Load Filter Media Export Example of entry Explanation Return to last menu Dearchiving of the selected file Call up the filter for the archive browser Export a data carrier from the management table of the external archive. Function not yet implemented. The exsport is executed automatically as soon as the maximum number of entries in the management table of the external archive is exceeded. Search result of the archive browser. List of archived data with indication of data type, information text, time of archiving and localization of the archive data Job window; For explanation see Fig.1, fields H-R
The system dialog start the job for dearchiving of the selected file and flags it in the job window as active. When it is flagged as finished in the job window, dearchiving is completed. If an error has occurred, it is displayed in the error window of the dialog box. The archiving function also sends operator messages which are then available on the message page. If the archive data are no longer available online, and the required data carrier is not inserted, the user is prompted to insert the data carrier with the message "Insert data carrier". Only one file can ever be dearchived at once by one dearchiving job. Where several files are to be dearchived, the loading process must be repeated as often as necessary.
Page 18
30/72-3780-0 EN
07/1999
Description of fields, Figure 14: Dearchiving Field A Ignore old versions Example of entry Explanation Only the data not yet present in the system are included in the dearchiving operation. If data already exist under the same name, older versions are ignored. Regardless of their date of creation, the current data in the system are replaced by the archived data version. Confirm and execute the action Cancel the action and return to the last menu Archive browser; For explanation see Fig. 13, fields A-E Selected data (COL objects) to be dearchived Job window; for explanation see Fig. 1, fields H-R
07/1999
30/72-3780-0 EN
Page 19
Description of fields, Figure 15: Dearchiving of graphical object data Field A B C D E Cancel Load Example of entry Explanation Archive browser; for explanation see Fig. 13, fields A-E Selected data (graphical objects) to be dearchived Cancel the action and return to the last menu Load the selected archive data Job window; for explanation see Fig. 1, fields H-R
Page 20
30/72-3780-0 EN
07/1999
Description of fields, Figure 16: Dearchiving of BLE data Field A B C Archive type Cancel Load Example of entry hgz1 Explanation Display/selection box containing the workstations in the system Cancel the action and return to the last menu Confirm and execute the action
07/1999
30/72-3780-0 EN
Page 21
Description of fields, Figure 17: Dearchiving of logs Field A B C D E Load Cancel Example of entry Explanation Archive browser; for explanation see Fig. 13, fields A-E Selected log to be dearchived Job window; for explanation see Fig. 1, fields H-R Confirm and execute the action Cancel the action and return to the last menu
Page 22
30/72-3780-0 EN
07/1999
Description of fields, Figure 18: Dearchiving of Contronic P data Field A B C D E F Archive type Load Cancel hgz1 Example of entry Explanation Archive browser; for explanation see Fig. 13, fields A-E Selected Contronic P data to be dearchived Job window; for explanation see Fig. 1, fields H-R Display/selection box containing the workstations in the system Confirm and execute the action Cancel the action and return to the last menu
07/1999
30/72-3780-0 EN
Page 23
For the duration of the search the message page from which the inquiry was started is blocked. If the archive data cannot be delivered within 15 minutes, the inquiry is rejected, and must be repeated as necessary. The following reasons may cause an inquiry to be rejected: Archiving inquiries which cannot be processed within a pre-set time as a result of high system load. In this case no error message is delivered. The inquiry must be repeated as necessary. The required data carrier has not been inserted in the archive device. In this case no error lmessage is delivered. The inquiry must be repeated as necessary when the required data carrier has been inserted. The data carrier is specified in an operator message which appears on the alarm page. An error occurs during accessing of the archive device (e.g. because an archive device is defective). In this case an error message is delivered on the alarm page. The possible causes of error, and the associated remedial action, are described in the TI 'System Error Messages'. An error occurs during accessing of the archive device (e.g. archive station unreachable due to network error). In this case an error message is delivered on the alarm page. The possiblei causes of error, and the associated remedial action, are described in the TI 'System Error Messages'.
Page 24
30/72-3780-0 EN
07/1999
message page) are automatically executed. As historical messages are stored in files, the archiving function searches for the file containing the required time. All the messages stored in that file are always dearchived. The number of messages contained in a file is configured in the message database object (STD_MDB). The data are loadeda from the external data carrier onto the archive station and then passed on to the central message server. On successful import of the data, the message "Dearchiving OK" appears on the message page. Any error which may have occurred is likewise displayed on the message page. Possible causes of error, and the associated remedial action, are described in the TI 'Systemh Error Messages'.
07/1999
30/72-3780-0 EN
Page 25
3 Configuration of archiving
To make the archiving function usable for the system, it must be configured in accordance with the system structure. The archiving function must also know which data are to be archived. This information is defined on configuration of the individual objects.
Description of fields, Figure 19: Archiving configuration editor Field A B C D E F G H I J K Return Delete Save Print object COL browser Object editor Object header Data types Devices Access rights Error Example of entry Explanation Cancel the action and return to the last menu Delete the archive object _ARCHIVE and return to the last menu. The user is not allowed to delete the archive object! Save the current object configuration and return to the last menu Create a printout or an ASCII file containing all selectors belonging to the archive object Activate the COL browser (see also TI 'Configuration - Objects') Activate the object editor for the archive object. Use of the object editor is intended only for service purposes! Activate the menu to set the basic object parameters Activate the menu to allocate data carrier types to the Maestro UX data types Activate the menu to allocate archive devices to the archive channels Activate the menu to define access rights to the archive object For display of confi prompts and dialog errors. The button has a dark red background if error messages are waiting. Select the button to open up the error window and acknowledge the error. Information on the object currently in the configuration editor
Info line
The archive object is called up by way of the system dialog. Most entries relate to the external archive. Key parameters include the RHOST entry (WS name) and the hardware constellation of the respective subsystem (Figure 20). If the RHOST entry is not configured, for example, the system has no way of displaying the status of the archiving processes in the relevant subsystem, or to archive the desired data at all.
Page 26
30/72-3780-0 EN
07/1999
Description of fields, Figure 20: Archiving configuration editor, object header Field A B CH I WS name Plant area Redundancy status NoReDd hgr93 Example of entry Explanation Start dialog for archive configuration; for explanation see Fig. Abb. 19, fields A-K Name of the workstation installed in the central archive Opportunity to enter various information texts (see also TI 'Configuration - Objects') Entry of parameter for the redundancy mode. Since the external archive is not capable of redundant operation, 'NoRed' must always be entered here. The value is entered automatically and must not be changed.
In the 'Data Types' menu (Figure 21) the data carrier types can be allocated to the non-default data types (see 'Archive/data carrier management').
07/1999
30/72-3780-0 EN
Page 27
Description of fields, Figure 21: Archiving configuration editor, data types Field A B Max. entries in DB Data types External devices Buffer time 10000 Example of entry Explanation Start dialog for archive configuration; for explanation see Fig. 19, fields A-K Number of entries in the management table of the external archive. An entry includes a cross-reference to an archive file, the name of the archived function and the archived period. List of data types in the Maestro UX Allocation of data carrier types to the Maestro UX data types. The data carrier type is chosen by selecting a type from the pull-down menu using the mouse. Delay time indicating for how long export data are collected in the online cache of the external archive before being exported. Input in format HH:MM:SS.sss
C D
The archive devices are allocated to the archive channels in the 'Devices' menu (Figure 22). A maximum of four archive devices can be connected to the archive station.
Page 28
30/72-3780-0 EN
07/1999
Description of fields, Figure 22: Archiving configuration editor, archive devices Field A B Archive channels C Archive devices Archive channel 1 DDS streamer with SCSI target ID 3 Example of entry Explanation Start dialog for archive configuration; for explanation see Fig. Abb. 19, fields A-K List of max. configurable archive channels Allocation of the connected archive devices to the archive channels. The archive device is chosen by selecting one of the connected devices from the pull-down menu using the mouse
07/1999
30/72-3780-0 EN
Page 29
Description of fields, Figure 23: Configuration of trend archiving Field A B Inscan TRUE Example of entry Explanation Start dialog for archive configuration; for explanation see Fig. 19, fields A-K 'TRUE' signifies that archiving is active for the selected signal. The value cannot be changed explicitly, but only in conjunction with a selector. Selector (subselector) to be archived. When a selector is entered the value in the 'Inscan' field is automatically set to 'TRUE'. In function-oriented subsystems such as Contronic P, the entries for archiving of the individual selectors must be made at this point. In signal-oriented subsystems such as Contronic E, Melody or Freelance 2000, archiving of the individual selectors can be activated by way of the signal allocation dialog 'Signals'. The time constant describes the average time interval after which a signal is archived. This value is required for calculation of the ring memories. It is closely related to the dynamic of the signal and should be adapted to it as far as possible (see 'The online archive'). Input in forrmat HH:MM:SS.sss Minimum time between two successive archiving values. If the values are received more quickly than shown here the interim values are ignored (see 'The Online archive'). Input in format HH:MM:SS.sss Maximum time between two successive archiving values. If no new value meeting the condition of the input filter (mainly time maximum and tolerance band) is received within this time the last archived value is duplicated and archived again. Input in format HH:MM:SS.sss
Selector
VXA
Time constant
00:00:01.000
Time minimum
00:00:01.000
Time maximum
00:10:00.000
Page 30
30/72-3780-0 EN
07/1999
Description of fields, Figure 23: Configuration of trend archiving G Tolerance 0.000000e+00 Tolerance band indicating the percentage by which a value must deviate from the last archived value in order also to be archived. Input as a percentage of the measuring range. Time indicating for how long the chosen selector is to be stored in the online archive. If the volume of data is so low that no archive file could be created, the data are held for longer in the online archive. They are only deleted from the online archive when an archive file has been terminated and the configured period of time has elapsed. With sufficient disk space, the values may very possibly remain in the online cache of the external archive for a long time (see also 'Size monitoring'). Input in format HH:MM:SS.sss Parameter indicating whether the chosen selector is to be transferred to the external archive
Stored online
08:00:00.000
Ext. archive
FALSE
07/1999
30/72-3780-0 EN
Page 31
4 Archive components
4.1 Stations with online archive
Every workstation in a Maestro UX system which is to store data has an online archive. All archive data created in a workstation are stored in the online archive of the station concerned. The data comprise trends and files. The number of trends which can be recorded by a station is limited, for reasons of workloading. The station workload is likewise heavily influenced by the dynamic of the signals. A workstation with an online archive must be designed for adequate performance on the basis of the Maestro UX project design guidelines.
The standard storage media used for magneto-optical drives are magneto-optical disks with a total capacity of 2.6 GB (double-sided, i.e. 1.3 GB per side). The magneto-optical media are written to with the HP-UX file system, and are treated like an additional hard disk. The archive devices are notified to the archiving function by way of the archive object. When a certain device has been entered, then that device is reserved exclusively for archiving use. If the device is required for other use, it must be explicitly removed from the archive object for the duration of the other use. If more archiving jobs are awaiting processing when the device is removed, the current job being executed is first completed. The remaining jobs are retained in the job queue - provided they are export jobs - until the archive device, including the required data carrier type, is entered again (see Figure 22). Waiting dearchiving jobs which cannot be processed within a timeout period of 15 minutes are rejected. In the case of the DAT tape drives, an ongoing archiving job can be canceled by removing the data carrier. The archiving function flags the job as not properly completed, and retains it in its job queue until the original data carrier is inserted again. The archiving function cyclically addresses the device to check whether the data carrier has been re-inserted.
07/1999
30/72-3780-0 EN
Page 32
In the case of the magneto-optical drives used, it is not possible to remove the data carrier during ongoing archiving. When the job is started the data carrier, that is to say the file system on it, is incorporated into the UNIX file system. The data carrier can not be removed until the archiving job has been completed and the data carrier, or the file system on it, has been removed from the UNIX file system and released.
Page 33
30/72-3780-0 EN
07/1999
Note: The ASCII and packed binary signal types cannot currently be archived. If a function is designated for archiving, criteria must be defined for the function to enable the archiving system to decide whether a value is to be stored or not (see Figure 23). Based on those parameters, the archiving system then orders the updating service to deliver the next current value and assesses whether the value is recorded. In normal mode the current values are written to the RAM buffer, and then to the archive files as soon as the RAM buffer overflows. The RAM buffer is dimensioned to enable it to store the incoming values for a few minutes.
07/1999
30/72-3780-0 EN
Page 34
The defining parameter for this is the time constant 'Z Minimum' (see Figure 23). With a memory requirement of 32 bytes per value and an update cycle of 1 second, the RAM buffer is able to take approximately 140 values (140 x 32 bytes => approx. 4.3 KB memory requirement for one signal). A reduction of 'Z Minimum' to 100 ms thus means a memory requirement increased by a factor of 10. To prevent the process environment and the load generated by the archiving from becoming too large, the following restriction is made for safety reasons: If 'Z Minimum' is selected so low that a signal requires RAM for more than 1000 values, the memory space is automatically defined as the space required for 1000 values. As a result the period over which a signal can be buffered in the RAM is reduced. The reservation of memory for 1000 values is subject to the condition that not more than 1500 signals are acquired on one workstation. If the number of signals is exceeded, the maximum available RAM requirement per signal, dependent on the number of signals, is reduced in stages. When the data are entered in the archive files the signal values are compressed by means of a virtually zero-loss process. Normally in this process, when two successive values are received only the difference (value, status, time) to the preceding value is stored. A complete value is stored on the basis of specific change criteria and in a cyclical rhythm. The average disk space requirement, using the compression algorithms, is approx. 5 bytes per measured value. However, this value depends on the dynamic of the acquired signal. The calculations were based on a rate of change of 1 value per second. The compression error which can be achieved with this method is < 0.005 per thousand. All archive files are distributed evenly over a directory structure reserved for the archive, based on an internal software name key. The size of the terminated archive files depends on the 'time constant' parameter set in the configuration dialog (see Figure 23). The 'time constant' parameter determines the average time interval between two measured values being archived, and logically should be adapted to the dynamic of the respective signal. According to various system situations, the size of the created archive files may fluctuate between 75 KB (minimum) and 500 KB (maximum). Archive files intended for the external archive are normally 500 KB in size. The number of archive files relating to one trend depends on the 'Stored online' parameter set in the configuration dialog, and on the remaining available hard disk space. If the existing history exceeds the specified value, or if the available hard disk space falls below a specific reserve, the oldest archives are automatically deleted, unless they are designated for the external archive and have not yet been able to be exported to it. If the transfer to the archive station fails due to an error, the online archive prevents data being lost. If the archive station is reachable again after a certain period of time, the data are transferred from the online archive to the archive station, according to the failure duration, and if possible are exported directly onto the external medium. The system then returns to normal operating mode. The data are available to applications requesting them (e.g. the curve display) for as long as they are in the online archive. If the data have already been exported and are no longer in the online archive, the inquiry is passed on to the archive station which manages the external archive. The archive station then initiates all activities necessary to reinstate the data online.
Page 35
30/72-3780-0 EN
07/1999
From the point of view of archiving, the contents of the individual files are irrelevant. As a result, the methods of handling all data are identical. File histories are always stored permanently, and so are always exported to the external archive. A maximum of 20 files are held online for each data type. If there are more than 20 files of a specific data type, the oldest files are automatically deleted, unless they have not yet been able to be exported to the external archive. If the transfer to the archive station fails due to an error, the online archive prevents data being lost. If the archive station is reachable again after a certain period of time, the data are transferred from the online archive to the archive station, according to the failure duration, and if possible are exported directly onto the external medium. The system then returns to normal operating mode. The files are available to applications requesting them (e.g. message history) for as long as they are in the online archive. If the files have already been exported and are no longer in the online archive, the inquiry is passed to the archive station and so on to the external archive. The archive station then initiates all activities necessary to reinstate the files online.
07/1999
30/72-3780-0 EN
Page 36
the external data carrier. This mechanism is applied only when the relevant data carrier is not inserted. Otherwise the data are transferred directly into the external archive. If the required data carrier is not inserted, the user is prompted to insert it at the end of the delay time. The following defaults are set for the various archive data types with regard to data type and delay time: Archive data types Trends Messages Graphic Logs Maestro UX objects Subsystem BLE applications Recipe Sub-archive name Trend history (ARC_Trends) Message history (ARC_EVENTS) Graphics confi data (ARC_GRAPHICS) Logs (ARC_LOGGINGS) Maestro UX configuration data (ARC_OBJDIR) Configuration data of the subsystem, e.g. Contronic P (ARC_SUBSYSTEM) Data of the BLE applications (ARC_BLE_APPL) Recipe data (ARC_BATCH) DTyp DTyp 0 DTyp 4 DTyp 8 DTyp 4 DTyp 8 DTyp 8 DTyp 8 DTyp 4 VZ 1h 8h 0h 8h 0h 0h 0h 8h
Example: The system name is "Kunde31", the archive station name is "ArcWS" and its hardware ID is 33445566; the data carrier type is 0 (this means, if the default has not been changed, the data carrier contains trends) and the serial number is 9. The data carrier ID is then: Kunde31@ArcWS_33445566|0|9 The archiving function generates a string of data carriers for each data carrier type, numbered beginning at 1. The data carrier with the highest number is the current write data carrier. The archiving function writes archive data as standard to the current write data carrier of the corresponding data carrier type. New data carriers as well as data carriers already containing archive data - provided they are not current data carriers - can be initialized. If the data carrier already contained archive data, any cross-references on the carrier are removed from the management system of the external archive. An attempt to initialize a current write data carrier is rejected with an error message. The user is informed of successful completion of initialization by a message containing the data carrier ID. The archiving system requests initialization of a data carrier if a specific archive data type (or a combination of archive data types to be stored together on one data carrier) has not yet been archived, or if the current data carrier is full and terminated. The data carrier type is only assigned the next serial number when the old data carrier is terminated and the first data packet is being written to the new data carrier. This new carrier then becomes the current write data carrier for the type in question. A data carrier may be terminated on the basis of one of the following events: The data carrier is full The maximum permissible number of 1000 files (DAT tapes) or 10000 files (MOs) on the data carrier has been reached. Data can no longer be written to the data carrier due to an error.
Page 37
30/72-3780-0 EN
07/1999
By a "Forced data carrier change" command the user causes a switch to the next data carrier. In the system dialog this is done by choosing "Change Medium".
Important: The user must make sure that the data carrier ID notified in the message is noted on the data carrier label, to ensure that data carriers can be located. To locate the archived data on the data carrier, a management table is created on the data carrier for the external archive, containing a detailed listing of which archive file is stored on which data carrier. This management table is designed as a ring memory. Its size is currently pre-set to 10000 entries. It can be modified by configuration dialog by way of the system object _ARCHIVE (see 'Configuration of the archive object').
The archiving function generates a string of data carriers for each data carrier type, numbered beginning at 1. The data carrier of a type with the highest number, which is not terminated, is the current write medium. The archiving system always writes archive data to the current medium of the relevant data carrier type. Read archive data:
Based on the entries in the management table, the archiving system knows all the data carriers it has generated and knows which archive data are stored on which data carriers. When data no longer present online are accessed the archiving function delivers an operator message to prompt the user to insert the necessary data carrier. Data carriers for which a cross-reference no longer exists in the management table are made known again when inserted into the archive device; that is, the index of the data carrier is re-entered in the management table. Enter data carrier:
Data carriers or non-system data carriers (data carriers from another Maestro UX system) for which cross-references no longer exist in the management table are automatically made known to the system when inserted into the archive device; that is, the index of the data carrier is entered in the management table. Initialize data carrier:
The initialization prepares the data carrier for archiving of the Maestro UX data. The data carrier is assigned one of the 16 data carrier types. As well as this assignment, the system ID is also noted on the data carrier. The data carrier type is only assigned the next serial number when the old data carrier is terminated and the first data pakket is being written to the new data carrier.
07/1999
30/72-3780-0 EN
Page 38
6 Size monitoring
The archiving processes manage the total actual consumption of disk space according to the total capacity of the hard disks. The online archives for the trend and file archives, and the external archive, monitor the consumed disk space on the hard disk on which their data are located independently of each other. Various delete operations are activated depending on the fullness of the hard disks. But as a matter of principle, archive data designated for the external archive which have not yet been able to be exported to it are never deleted. The table below outlines the response to pre-defined levels of fullness: Remaining capacity of hard disk Reserve > 175 MB Trend archive File archive External archive
Normal mode, Message with priority 8, outgoing: 'Disk space reserve for archive OK' Normal mode,
Normal mode, Message with priority 8, outgoing: 'Disk space reserve for archive OK' Message with priority 8, incoming: 'Archive detects disk overflow' File archive deletes already exported data from the online archive until the 225MB reserve is reinstated Message with priority 4, incoming: 'Archive detects disk overflow' Continued deletion of already exported data New archiving operations are rejected Message with priority 1, incoming: 'Archive detects disk overflow' Continued deletion of already exported data New exports are no longer accepted
Normal mode, Message with priority 8, outgoing: 'Disk space reserve for archive OK' Message with priority 8, incoming: 'Archive detects disk overflow' The external archive deletes already exported data from the online cache until the 225MB reserve is reinstated Message with priority 4, incoming: 'Archive detects disk overflow' Continued deletion of already exported data from the online cache of the external archive Message with priority 1, incoming: 'Archive detects disk overflow' Continued deletion of already exported data New exports are no longer accepted
Message with priority 4, incoming: 'Archive detects disk overflow' Trend archive deletes already exported data from the online archive until the 225MB reserve is reinstated Message with priority 1, incoming: 'Archive detects disk overflow' Continued deletion of already exported data Continued archiving of trends is stopped
Page 39
30/72-3780-0 EN
07/1999
The archive management searches through the archive files on the basis of the specified criteria, decompresses the values it finds, and prepares them using the selected evaluation algorithm so that they can be processed directly by the application. Using a specific evaluation algorithm, a specific view of the archived data is thus produced. In this way, a value string with non-equidistant time intervals is mapped into a value string with equidistant time intervals. The evaluation algorithms are not applied to ASCII, binary and packed binary type signals. The following evaluation algorithms are available: First value: The "first value" method delivers the value at the beginning of the resolution interval. If there are no values in the display or resolution interval as a result of the non-equidistant original archive data, the archive management searches back until a value is found. This value is then replicated according to the resolution in the display interval. fn(x) = x(T1); k=T1, ... ,Tm fn(x) T1 Tn m n Maximum: The "Maximum" method delivers the maximum value from the resolution interval. If there are no values in the display or resolution interval as a result of the non-equidistant original archive data, the archive management searches back until a value is found. This value is then replicated according to the resolution in the display interval. First value in n-th resolution interval Start of resolution interval End of resolution interval Number of values in resolution interval n-th resolution interval
07/1999
30/72-3780-0 EN
Page 40
Calculation formula: fn(x) = max(x(k)); k=T1,...,Tm fn(x) T1 Tn m n Minimum: The "Minimum" method delivers the minimum value from the resolution interval. If there are no values in the display or resolution interval as a result of the non-equidistant original archive data, the archive management searches back until a value is found. This value is then replicated according to the resolution in the display interval. Calculation formula: fn(x) = min(x(k)); k=T1, ... ,Tm fn(x) T1 Tn m n Mean value: The "Mean value" method delivers the mean value from the resolution interval. If there are no values in the display or resolution interval as a result of the non-equidistant original archive data, the archive management searches back until a value is found. This value is then replicated according to the resolution in the display interval. Calculation formula: fn(x) = [sum(x(k))]/m; k=T1, ... ,Tm fn(x) T1 Tn m n Tendenz (1 - 5): The "Trend" method delivers the trend behavior of the signal in the resolution interval. The individual trends (1 5) are differentiated by a scaling factor. If there are no values in the display or resolution interval as a result of the non-equidistant original archive data, the archive management searches back until a value is found. This value is then replicated according to the resolution in the display interval. Mean value in n-th resolution interval Start of resolution interval End of resolution interval Number of values in resolution interval n-th resolution interval Minimum in n-th resolution interval Start of resolution interval End of resolution interval Number of values in resolution interval n-th resolution interval Maximum in n-th resolution interval Start of resolution interval End of resolution interval Number of values in resolution interval n-th resolution interval
Page 41
30/72-3780-0 EN
07/1999
Calculation formula: fn(xk) = fn-1(xk) + ([sum(x(k))]/n - fn-1(xk))/y; if (fn-1(xk) > fn-1(xk)) then
fn(xk) = max(x(k)) else fn(xk) = min(x(k)); k=T1, ... ,Tm sum()/n fn-1(xk) fn(xk) T1 Tn n m y Mean value in n-th resolution interval Trend in (n-1)-th resolution interval Trend in n-th resolution interval Start of resolution interval End of resolution interval n-th resolution interval Number of values in resolution interval Factor (T1: 1; T2: 2; T3: 4 T4; 8 T5: 16)
07/1999
30/72-3780-0 EN
Page 42
If the application itself is capable of redundant operation, the generated data are automatically present in redundant form if the application runs in a redundant environment. If the application is not capable of redundant operation, but its data are to be held in redundant storage, the application must be installed in a redundant environment. The archiving software will redundantly archive all the data it receives, including the data from the application not capable of redundant operation. If the Maestro UX software is restarted on a redundant station on which an error has occurred, on restart a system correction is performed between the active and the passive stations (see TI 'Redundancy'). Since in the course of archiving most data must be corrected - an operation which can take up to 14 hours with a total storage capacity of 5 KB - the archive is corrected as the last system component. The trend archive is processed first, and then the file archive. The correction is performed in such a way that only data for the periods not overlapping on both stations are transferred from the active to the passive station. The bases for correction are the management tables of the online archives for trends and for files. Data on the passive station not present or no longer present on the active station are also deleted by the passive station in the course of the correction.
Page 43
30/72-3780-0 EN
07/1999
The contents of these management tables consist of cross-references to the archive files. The consistency check ensures, firstly, that the management tables and archive files themselves are consistent and, secondly, that the references in the management tables to the stored archive data are also consistent. If a malfunction (e.g. hardware defect, software crash) causes a workstation to crash, data in the Unix file system may be damaged or lost. This particularly affects data accessed by write operations shortly before the crash. As a result of the buffer mechanisms of Unix, the probability is then high that the changed data had not be written to disk when the crash occurred. By its recovery mechanisms Unix ensures that an operational file system is available on boot-up. The loss of other data is accepted as the price. As a result the status of the user data in the file system, in particular of the data changed prior to the crash, cannot be predicted. For Maestro UX this may mean that a) data may be missing or inconsistent b) Maestro UX processes may crash when they have to work with data which no longer have the expected structure following a malfunction To safeguard the integrity of the archive data in such cases, a so-called 'logical recover' operation is executed when the system is rebooted. This procedure determines whether the consistency of the archive data present is safeguarded. Trend archives of which the consistency cannot be guaranteed are deleted. This ensures that Maestro UX processes which need to access the archive will not crash when the system is rebooted. The check takes around 0.5s per file (7200 files per hour). Assuming an average of 1.5 files per trend, 4800 trends can be checked in one hour. To do so, the following steps are executed in sequence: Regeneration of the trend management table from the remaining trend files Consistency check of the trend files in the online archive; inconsistent files are deleted Regeneration of the file management table from the remaining files Consistency check of the files in the online archive Check that the management software of the external archive was terminated properly. If it was not, the existing management table of the external archive is deleted and a new, empty management table is created. If no online backup of the management table is found, the table remains empty; otherwise the backup is loaded
Handling of the system in conjunction with recovery mechanisms, and their mode of functioning, is described in the TI 'System Administration'.