D1-2-1 ECHO User Requirement

ECHO: IST-1999-11994 Deliverable 1.2.
User Requirement Report
Project Number: IST-1999-11994 Project Title: European Chronicles On-Line (ECHO) Deliverable Type: RP*
Deliverable Number: D1.2.1 Contractual Date of Delivery: 30 April 2000 Actual Date of Delivery: 22 June 2000 Title of Deliverable: ECHO User Requirement Report Work-Package contributing to the Deliverable: WP1 Nature of the Deliverable: RE Author(s): Annemieke de Jong, Netherlands Audiovisual Archive (NAA) Johan Oomen, Netherlands Audiovisual Archive (NAA) Pasquale Savino and Paola Venerosi, Istituto di Elaborazione della Informazione - Consiglio Nazionale delle Ricerche (IEI-CNR) Hanneke Smulders, Infomare consultancy Version: 1 (13 June 2000)
Abstract: Five relevant user communities were identified, along with three user types per user community. To collect user requirements in these user communities two questionnaires were constructed and used to interview 58 representatives. All content providers (Institut National de l'Audiovisuel, Stichting Nedelands Audiovisueel Archief, Istituto Luce S.p.A., Memoriav), as well as the IEI-CNR, cooperated in this collecting process. The completed questionnaires have been processed into Excel spreadsheets and summarised in an overview of functionality (appendix 5). This also forms useful input for WP2 and WP4. The final user requirements were derived after a thorough analysis of these data. The technical state of the art is taken into account, so that the final user requirement list reported also indicates the desirable future development of ECHO. Keyword List: ECHO user requirements; research on end-user information needs; digital video library; automated indexing; speech recognition; audio visual archives. *Type: PU-public, LI-limited, RP-restricted **Nature: PR-Prototype, RE-Report, SP-Specification, TO-Tool, OT-Other
Originator: NAA Version 1
13 June 2000
ECHO: IST-1999-11994 Deliverable 1.2.1
Table of Contents
Introduction Chapter 2 The process of capturing user requirements 2.1 Capturing user requirements 2.1.1 Selection of user types 2.1.2 The group of interviewees 2.1.3 Using ECHO for different goals 2.1.4 Construction of questionnaires 2.1.5 Collecting the user requirements 2.2 Analysing the questionnaires Chapter 3 Results of the analysis 3.1 Formulating user requirements 3.2 User Requirements List 3.2.1 Data entry management 3.2.2 Interface and related databases 3.2.3 Administration 3.2.4 Cross-linguality 3.2.5 Retrieval 3.2.6 Presentation of search results 3.2.7 Visual abstract 3.2.8 Browse copy 3.2.9 Storyboard 2.2.10 Cross document viewing 3.2.11 Reuse of content Appendix 1: Choice of user types Appendix 2: User communities and user types Appendix 3: Questionnaire for documentalists and archivists Appendix 4: Schedule of the completed questionnaires Appendix 5: Overview of functionality Appendix 6: Types of usage of ECHO Appendix 7: Number of interviewees related to type of usage Appendix 8: Usage A - data entry for archiving Appendix 9: Usage B - retrieval for reference searching Appendix 10: Usage C: retrieval and viewing the content for general public Appendix 11: Usage D - scientific study of the content Appendix 12: Usage E - reuse of the content Glossary 3 4 4 4 4 5 5 7 7 9 9 10 10 11 11 12 12 13 13 13 14 14 14 15 18 19 55 57 70 73 74 76 78 80 84 88
13 June 2000
Introduction
The ECHO Project aims at developing a reusable software infrastructure to support audio visual digital libraries, and to provide Web-based access to collections of historical documentary films. The project will build on the existing Informedia (developed by the Carnegie Mellon University) and Media Archive (developed by Tecmath) technologies. These two technologies have been developed in order to handle digital video data. The project will, moreover, extend them in order to be able to handle digital film data and will integrate them so as to build a basic, open infrastructure supporting digital film services. On top of this open architecture, the project will build the following innovative features: (i) a new film metadata format, (ii) full-content and knowledge-based retrieval (iii) monolingual query and retrieval for each collection language; (iv) multilingual query and cross-language retrieval capabilities for topics and story content, (v) integration of speech recognition engine(s) (for each collection language) for content-based indexing, (vi) a mechanism supporting collections (vi) a film summarisation/abstracting tool and (vii) an authentication and accounting mechanism. The list of new features included in ECHO has been defined by taking into account the functionality provided by existing commecial systems, including Informedia and Media Archive. In addition, the experience of ECHO content providers was taken into consideration. However, given the unique characteristics of ECHO's audio-visual material and the specific characteristics of potential users of ECHO, we concluded that it was important to collect user requirements for the ECHO system. These requirements will be used to validate the functionality listed above by adding - if needed - new functionality that could emerge from the analysis of user needs. In addition, the requirements will be used to specify in more detail the system functionality. The user requirements will be used to as a guide in the definition of the metadata model and system architecture. In order to collect the user requirements we have prepared an extensive questionnaire (see Appendix 3). The questionnaire has been submitted to approximately 15 users per participating country (giving a total of 58 users). Given that the questionnaire is quite complex, and that the ECHO system functionality are particularly innovative, we preferred to directly interview most of the users. Users belonging to different categories have been selected. A detailed description of the approach used for user requirement collection and analysis is given in Chapter 2. The results of the analysis, together with a synthetic list of requirements, is reported in Chapter 3.
13 June 2000
Chapter 2 The process of capturing user requirements
2.1
Capturing user requirements
2.1.1 Selection of user types In order to fulfil tasks T1.1 and T1.2, the participating partners agreed on the identified Target Markets (See: ECHO-Project N. 11994 Revision 2.1 15/12/99, page 11-12.). These include: Educational Environment, Film and Entertainment Industry (broadcasting companies), Cultural Heritage Institutions, Audio Visual Industry and Large Audio Visual Archives. For various reasons, three different user types were identified per target market or user community. Each identified user type was expected to have different interests in the ECHO system and to use ECHO in different ways. Furthermore, the user types identified had different levels and special focuses of experience in searching traditional film archives catalogues. See also: appendix 1 for an explanation of the choice of user types. 2.1.2 The group of interviewees In order to collect the user requirements, the content providers selected a total of 58 representatives of the identified user types. The selection of interviewees was very thorough. The sample of interviewees represent the four national archives and the customers of these national archives. Experts on indexing video, on information retrieval, on film making and film history, and on scientific historical research were chosen because they were expected to provide interesting comments on the functionality of ECHO and because they were identified as potential future users of ECHO. See appendix 2: Overview of interviewees per user type. The interviewees all work with AV media or are interested in AV media for their work: - 10% of the interviewees are working in an educational environment - 26% are doing scientific studies on either (contemporary or film) history or on AV media - 24% are working in different functions in an AV archiving environment - 33% are concerned with making new AV products - 7% are concerned with the marketing of AV media. The interviewees themselves indicated their expected future use of ECHO in the questionnaire as follows (in decreasing order): - research on historical film material (24%) - browsing historical film material (20%) - reuse of historical film material in new AV products (19%) - data entry in ECHO (6%) - reuse of historical film material for teaching (3%). The experience of the interviewees in searching online databases differs: - 29% use online databases on a daily basis - 36% on a weekly basis - 18% on a monthly basis - 18% hardly at all.
13 June 2000
2.1.3 Using ECHO for different goals From an application point of view, the ECHO project aims at developing a digital library service for historical films belonging to large, national audiovisual archives. The system will allow a user to see an event that is recorded and documented in the country of origin and compare it with the way the same event has been registered in other countries to see how different countries have interpreted a particular historical period, etc. ECHO can be used for different purposes. The project team distinguished the following types of usage: A Data entry for archiving B Retrieval for reference searching, without interest in viewing the content C Retrieval and viewing the content for the general public D Professional retrieval and viewing the content for scientific study (history or film science) E Professional retrieval, viewing and (non-)profit reuse of the content E+ Educational usage Each type of usage refers to a specific goal for which someone might want to use ECHO. Of the five types of usage that are identified, each has, technically speaking, specific consequences for the system building of ECHO. In appendix 6 the differences in usage of ECHO are explained per type of usage. These differences in usage and demands were derived from an analysis of the global trends that became clear during the collection of user requirements via the 58 interviews. Consequences for the metadata model were not taken into account. In the graph of appendix 7, the distribution of the interviewees over the types of usage defined by the project team is presented. This graph makes it clear that professional retrieval for either reuse or scientific study is very important for the future users of ECHO. 2.1.4 Construction of questionnaires
NAA constructed, in cooperation with the content providers and CNR, two different questionnaires (see appendix 3). The design and content of the questionnaires was based on: the !" experience of the NAA ECHO project team and the other content providers in analysing end-users' information needs, information retrieval and (digital) video archives in general, and specifically with full-text retrieval and subject indexing of video. the !" knowledge of the functionality of Mediasite and MediaArchive1 the !" knowledge of what end-users might expect of a digital video archive (from several previous projects in the same area, external as well as internal) the !" general process of information retrieval (from data entry, via indexing and retrieval to output/viewing/export) IEEE Standard 830-1984 Guide to Software Requirements Specifications and !" Standard P1233-1992 Guide for Developing System Requirements Specification2
1 2
See also the overview of functionality related to the questions in the questionnaire in appendix 5. In particular, the division of the Yes-answers into Mandatory, Desirable and Optional was based on these standards. In this way interviewees could indicate the relative importance of the requirement for their work. 13 June 2000
the !" following quote from the ECHO project plan: "The project will integrate these two technologies (the Informedia and the MediaArchive technologies) and extend them by adding other important functionalities: full !" Web-based interface metadata editor !" integration of Italian, French, and Dutch speech recognisers !" query language on multiple languages !" collection metadata !" film summarisation." !" The questionnaire has a systematic and hierarchical structure. The main categories of questions correspond with the main steps of the general process of information retrieval. While the project team had the opportunity of direct contact with potential future customers of the ECHO system, a series of questions on possible interesting themes (category 6) was added to the questionnaire. The answers to these questions were analysed and proved a valuable input for Workpackage 2 on Content Selection. 0 1 1.1 1.2 1.3 2 3 3.1 3.2 3.3 4 5 6 7 7.1 7.2 7.3 Data entry management Indexing Textual features incl. Multilinguality Visual features Audio features Retrieval process and Searching techniques Output Presentation of Search Result Viewing functionality Printing functionality Export and Reuse Billing and account Content Usage in general Interface Security Information retrieval in general.
The decision to use two different questionnaires for the collection of user requirements was based on the fact that the group of interviewees could be split up into two major groups. Group 1: those who were professionally concerned with the database creation process. Group 2: those who were concerned with database consultation, possibly leading towards reuse of the retrieved content. Questionnaire 1 (appendix 3) was used to interview Group 1 archivists and documentalists working for audiovisual archives and broadcasting companies. Questionnaire 2 was used to interview Group 2. Questionnaire 2 did not include the questions on Data entry management (Category 0) and on Security (Subcategory 7.2). The primary purpose of the questionnaire was to capture major functional aspects of ECHO, resulting in the user requirements list (see: chapter 3). Moreover, the questionnaire was
13 June 2000
constructed extensively enough to give as good an idea as possible on what the interviewees think about using a digital video archive like ECHO. The completed questionnaires were expected to form a valuable source of information for the entire ECHO project, not solely for Workpackage 1. The completed questionnaires are at the disposal of, via the ECHO FTP site, the technical partners and the ECHO partners cooperating in the Workpackages Content Selection and Metadata, and will be so throughout the entire duration of the project. 2.1.5 Collecting the user requirements To actually collect the user requirements, NAA has translated the questionnaires into Dutch and sent them around to the interviewees. Only those interviewees that asked for assistance were contacted personally. In this way, NAA was able to contact almost 20 interviewees. The other partners did not choose to translate the questionnaires into their native language, but instead conducted interviews orally and directly noted down the answers on the English version of the questionnaire. See also: Appendix 4 for all the names of the interviewees, the unique ID's of the completed questionnaires and the names of the ECHO partner' contact persons.
2.2
Analysing the questionnaires
The questionnaire was analysed using a numerical approach. To gain a quantitative insight into the results, all answers were put into Excel sheets, divided into five groups of possible usages of the ECHO-system (see also par. 2.1.3). The answers of all completed questionnaires were collected into one spreadsheet per category of questions (see ECHO website: http://pc-erato2.iei.pi.cnr.it/echo/Workpackage1/Excel_sheets). The percentage spread per answer option was then calculated for the non-open questions. Chapter 3 presents the list of the user requirements that were eventually extracted from these results. To be able to formulate these macro level user requirements, the analysis has been performed in an inductive manner, in three steps: from the detailed level of the questionnaire to the level of functionality, and finally to the list of general, global user requirements. In order to be able to retrace the data that led to a specific user requirement, the overview of functionality (appendix 5) contains references to the questions in the questionnaire as well as to the user requirements in Chapter 3.
13 June 2000
The method of analysis was carried out in different steps. 1 Quantitative aspects: thorough analysis of the spreading of the percentages over the answers. The contact persons had the strong impression that the choice in answering Yes, mandatory or Yes, desirable depended more on the character of the interviewee than on the actual necessity of the functionality concerned. It was therefore decided to analyse these answers together. 1.1 The total answers Yes, mandatory and Yes, desirable were important, as well as the total of No-answers. The spreading over the group of Yes-answers (Yes, mandatory / desirable / optional) and the group of No-answers (No and Not applicable) was also taken into account. 1.2 Differentiation into three possible Yes-answers offered the possibility of prioritising the user requirements. 1.3 When the total Yes, mandatory and Yes, desirable answers was more than 55%, the functionality concerned was transformed into a user requirement, either direct or indirect, to a more global user requirement. 2 Qualitative aspects: in the case of a rather equal spreading of the percentages over the answers or when a relatively large number of interviewees answered No or Yes, optional to a functionality that is generally regarded as essential to a digital video-archive, the following was taken into account: 2.1 the type of usage of ECHO for which that functionality is relevant (see appendix 5) 2.2 the type of usage of ECHO that can be expected of the interviewees (see paragraph 2.2.3) 2.3 the spreading of the answers of the interviewees interested in the types of usage concerned (this implied an extra calculation in the Excel sheets). The macro-level of the user requirements could be obtained, while: the !" answers to the open questions that were added, to give as good an idea as possible on what the interviewees think about using a digital video archive like ECHO, were not always suitable for transformation into directly related user requirements those questions in the questionnaire which asked for a detail of the same major functional !" aspects of ECHO were analysed together the !" questions concerning the content (category 6) were left out of the analysis for this user requirements report. This category is analysed in Workpackage 2: Content Selection. only those questions referring to automatically created metadata were analysed. All other !" questions that might have an impact on the metadata model of ECHO, concerning manual formal and subject indexing, were not analysed for the general user requirements list of ECHO. The results concerning the manual formal and subject indexing will be discussed and decided upon in the context of Workpackage 3 on Metadata.
13 June 2000
Chapter 3 Results of the analysis

3.1 Formulating user requirements
In this chapter the final user requirements list is presented. The user requirements list contains requirements for the ECHO system from the end-users point of view. End-users can either be professional and non-professional searchers or professional staff of national archives, responsible for database construction. The formulation of user requirements therefore has the following characteristics: in business terms, it is without concrete technical implications and in global terms, it is without details that would blur the overall view on the requirements. The answers to the questions from the questionnaire were first grouped into an overview of functionality. See appendix 5. This was the first step towards lifting the sometimes detailed aspects of a digital video archive to a more global level. In this overview, we have also indicated, according to each type of usage made of the ECHO system, which aspects are of importance. The next step was to formulate the main issues that are important for information retrieval in general and, specifically, for the ECHO project, namely: Data entry management Interface and related databases Administration Cross-linguality Retrieval Presentation of search results Visual abstract Browse copy Storyboard Cross document viewing Reuse of content. For each of these issues, the user requirements are presented here below. The entire user requirements' list was discussed with the technical partners. This gave an insight into the requirements that concern functionality that are still in the domain of research or that are technically too complex to be realised within the timeframe of the ECHO project. For each user requirement, which type of usage it is mandatory is indicated. See appendices 8-12 for the user requirements' lists per type of usage. All those aspects where more than 60% of the interviewees for the type of usage concerned answered Yes, mandatory or Yes, desirable were transformed into a user requirement. Sometimes, several answers to questions dealing with one aspect were combined into a more globally formulated user requirement. There were several issues that could thus be transformed into a user requirement, but were not, because of the obviousness of the requirement: Everyone would like the highest possible quality of all parts of ECHO. Nevertheless, it is obviously preferable to have e.g. a transcript of speech in a degraded form than to have none at all.
Originator: NAA Version 1 13 June 2000
The general performance of ECHO should be as good as possible, according to presently existing technical standards. Efficiency and userfriendliness is important for all parts of ECHO, the cataloguing environment as well as the (account, ordering and billing) administration or the layout of the query interface. Also, some trends could be derived from the questionnaires that may have an impact on the functioning of ECHO: The general impression which was given by the future users of ECHO was that the visual content is more important than the audio content. This means that visual content will not be neglected if the corresponding speech is not understandable or is irrelevant. It is important to keep in mind that the visual content may be totally different from the subject of a speech (e.g. someone is talking about politics while shots of Amsterdam are shown). This implies, for example, that full-text retrieval on the transcript of speech is not always the best way of finding interesting shots for reuse by program makers or marketing & sales people. However, annotations on shot sequence level or similarity search with a known shot can be a very important way of finding relevant visual content. Analysing the questionnaires sometimes led to useful information that is not included in this user requirements list. This was the case when the subject belonged to the Workpackage Metadata or Content Selection. Other reasons were that: it !" was not clear enough what the majority wanted (less than 50% responded with a yes mandatory or yes desirable) many open questions were suitable in getting an impression of the global attitude towards !" digital video libraries in general, but not applicable for transformation into a user requirement an !" issue was too specific, so that it was included within a requirement on a broader level.
3.2
User Requirements List
3.2.1 Data entry management Manually added metadata as well as semi-automatic metadata extraction from digital film information are distinct features of ECHO. 1 ECHO should have a cataloguing environment, or metadata editor, in order to provide the documentalists with the opportunity to control, correct and index all formats of the content as well as the complete catalogue description. (usage A) ECHO should provide an environment for control and correction of the automatic scene detection (usage A) ECHO should provide an environment for control and correction of the automatic transcript of speech (usage A) ECHO should provide a precataloguing aid, like automatic keyword extraction. (usage A) ECHO should provide the means to add keywords or annotations on the program level as well as on sequence or shot levels. (usage A) The ECHO cataloguing environment should facilitate offline as well as real-time cataloguing. (usage A)
13 June 2000
1.1 1.2 1.3 1.4 1.5
10
The existing thesaurus modules of the national archives should be connected to the ECHO cataloguing environment as well as to the query interface. (usage A, B, D) 2.1 It should be possible to link automatically extracted keywords to a national thesaurus. (usage A) 3.2.2 Interface and related databases To provide for retrieval in ECHO, independently from actually visiting a national archive, a full Web-based interface is planned. Also, ECHO will provide the opportunity to search in multiple archives of one or more countries in different languages. 1. Use of colour is important to distinguish between different concept areas on the graphical interface. (usage A-E) 2. The graphical interface should be as consistent with well-known applications as possible. E.g. icons used in MS-Office. (usage A-E) 3. ECHO should provide a choice of language for the query interface. (usage A-E) 4. The ECHO query interface should contain a simple query interface with just a free text box and some filters, plus categories to browse within a theme. (usage C, D, E) 4.1. The ECHO query interface should also provide, on demand, a query form for structured searching on the most frequently used metadata in combination with the free text box (usage D, E) 4.2. plus, on demand, additional metadata. (usage D, E) 5. ECHO should provide for the possibility of saving and changing personal preferences concerning the interface and the presentation of search results. (usage A, B, D, E) 6. ECHO should alert the user if there is additional content on the query subject at the cooperating national archives that is not in the ECHO database itself.3 (usage D, E) 7. ECHO should provide for the possibility of searching the traditional catalogues of the ECHO content providers. (usage D, E)4 7.1. ECHO should provide for the possibility of searching multiple archives of other institutions via the ECHO query interface. (usage D, E) 5 3.2.3 Administration ECHO will have pricing and billing mechanisms in order to take care of access control, authentication, privacy, and accounting. 1 2 3 A login procedure for internal and for external users should look after the control of the read and write rights and accounts. (usage A-E) ECHO should always indicate if the material is copyrighted. (usage B, C, D, E) If part of the ECHO material is not for reuse, then this should be clearly indicated. (usage D, E)
Long-term requirement because the techniques concerned are still in the domain of research or too complex to be realised withing the timeframe of the ECHO project. 4 Long-term requirement because the techniques concerned are too complex to be realised withing the timeframe of the ECHO project. Although any possibility, like presenting the links to the websites of the national archives, will be welcome. 5 Long-term requirement because the techniques concerned are too complex to be realised withing the timeframe of the ECHO project. Although any possibility, like presenting the links to the websites of the national archives, will be welcome. Originator: NAA Version 1 13 June 2000
11
The administration of ECHO should comprise information on copyrights and licenses, e.g. transmission rights, re-use rights, image copyrights, literary copyrights, music rights, exploitation rights and license period. (usage A-E) 5 The accounting mechanism of ECHO should be based on subscription. (usage C, D, E) 5.1 Price differentiation for different service levels (e.g. catalogue description, transcript of speech, visual abstract, browse copy, copy of original material) is expected. (usage C, D, E) 3.2.4 Cross-linguality To make full-text retrieval and automatic keyword extraction possible, the original speech of the ECHO content will be converted into text via Dutch, French, German and Italian speech recognisers. 1 2 A query in language X should find catalogue descriptions in language X, Y and Z. (usage AE) Presentation of the search results, i.e. catalogue descriptions as well as the textual abstract and the transcript of speech, should be done in the same language as the query. (usage A-E).
6
The original texts should be presented on demand. (usage C, D, E)
3.2.5 Retrieval ECHO will provide content-based searching and film-sequence retrieval. As the content is conveyed in both narrative (speech and language) and image form, a collaborative interaction of image, speech and language technology will be adopted in order to search the diverse film collections with satisfactory recall and precision. 1. ECHO should provide tools for natural language and concept searching. (usage C, D, E) 2. ECHO should provide for the possibility of literal searching or exact matching. (usage A-E) 3. ECHO should provide for the possibility of structured searching, Boolean filters and exclusion. (usage A-E) 4. ECHO should provide a combination of free text and structured searching. (usage C, D, E) 5. ECHO should provide for the opportunity of browsing through the database by theme or by class of object on the basis of manually added metadata. (usage C, D, E) 6. ECHO should provide similarity search on the visual content with one known keyframe or with a known sequence of still keyframes. (usage C, D, E)7 7. ECHO should provide similarity search with an audio fragment of speech. (usage C, D, E) 8 8. ECHO should be able to prolong the searching process by searching within the first result set. (usage A-E)
This requirement as a whole is a long-term requirement because the techniques concerned are still in the domain of research. In the future, online translation of nouns from the textual abstract or from the transcript of speech might become feasible. Translation of those parts of the catalogue description that consist of controlled vocabulary, e.g. the genre attribute, is feasible within the timeframe of the ECHO project. 7 It is not required that a moving sequence of keyframes could be used as a query. That can only be expected in the far future. 8 Long-term requirement because the techniques concerned are still in the domain of research. The architecture of ECHO will enable integration of these software tools as soon as this content can be indexed. Originator: NAA Version 1 13 June 2000
12
8.1
The user should be able to pinpoint the subject of interest by marking relevant hits or by marking search terms suggested by ECHO and then starting the next query. (usage C, D, E) 8.2 The user should be able to let the system interpret the query in a fuzzy way, on demand. (usage C, D, E) 9 ECHO should provide for specific tools to retrace content that was retrieved earlier. (usage D, E) 9.1 ECHO should provide for the possibility of creating a virtual collection or project folder with a selection of ECHO material. (usage D, E) 9.2 ECHO should provide for the possibility of creating bookmarks to specific parts (e.g. keyframe in storyboard or browse copy of program) of the ECHO content. (usage D, E)9 3.2.6 Presentation of search results To be able to evaluate the retrieved content, ECHO will provide several presentations either at the document level or at the level of the search result (cross document viewing). 1 The first presentation of search results should be a list presentation in decreasing order of relevance. (usage A-E) 2 ECHO should provide for the possibility of personally deciding on the items of the catalogue description and other ECHO items (e.g. the first keyframe of the storyboard, the storyboard itself, the transcript of speech or the visual abstract) that should be presented in the list presentation on the screen or that should be printed. (usage A, B, D, E) 2.1 These preferences should be either saved as personal preferences or just used for the actual session. (usage D, E) 3 After a Boolean structured search, ECHO should provide for the possibility of resorting the hitlist in a different order than relevancy. (usage A-E) 3.2.7 Visual abstract A visual abstract is an automatically created (moving) visual summary that can be viewed in the same way as the browse copy. It should capture the content and structure of the underlying documentary film for intuitive understanding. In essence, a visual abstract should give a good overview of the entire documentary. 1. It should be possible for a user to change the length of the visual abstract by himself/herself. (usage D, E) 2. The audio content should be included with the visual abstract. (usage C, D, E) 3. The visual abstract should summarise the semantic content of the full film, while preserving the chronological order. (usage C, D, E) 3.2.8 Browse copy To be able to view the content of ECHO via computer networks and via the internet, the original historical films will be converted into a browse copy (after digitisation of the original material).
According to the interviewees that would like to use ECHO according to usage D or E, the possibility of adding personal annotations to (parts of) the storyboard is very important. However, this requirement is left out of the user requirements list because it is undesirable that end-users edit the ECHO metadata. However, known users are free to name bookmarks with or without any comment. 13 June 2000
13
ECHO should provide for as many manipulation functionality of the length of the browse copy as possible (e.g. (fast) back, (fast) forward, zoom, freeze). (usage C, D, E) 2 The audio content should be included with the browse copy. (usage C, D, E) 2.1 It should be possible to see the transcript of speech time-aligned while viewing the browse copy. (usage C, D, E) 3.2.9 Storyboard In order to have a quick overview of the visual content of a retrieved program and to be able to start the browse copy at any point, a storyboard will be made of each item in ECHO. 1 2 3 4 The storyboard should be shown on demand. (usage D, E) On demand, it should be possible that only the query-related keyframes of the storyboard are presented. (usage D, E) It should be possible for a user to ask for the keyframes surrounding the query-related keyframes as a next step towards the viewing of the whole storyboard. (usage D, E) The storyboard should represent the pictorial content of the full film, on demand together with some metadata or text of the transcript of speech. (usage D, E)
2.2.10 Cross document viewing The visualisation and summarisation of the content across all the stories in a retrieval result set is a viewing functionality that can help the user to understand the chronological, geographical and/or subject (personality, event) context of the retrieved content. 1 2 3 4 5 ECHO should provide for subject clustering of the search result. (usage D, E) ECHO should provide for a chronological view of the search result. (usage D, E) ECHO should provide for a personality view of the search result. (usage D, E) ECHO should provide for a geographical view of the search result. (usage D, E) ECHO should provide for combinations of the possible views of the search result, on demand. (usage D, E)
3.2.11 Reuse of content The (non-)profit reuse of the content, either the browse copy or a digital copy of the original material, is expected in several planned user communities that are active in: public and commercial broadcasting, historical studies, teaching or creating new AV products. 1 ECHO should provide for the possibility of exporting specific parts separately, namely: 1.1 (part of) the catalogue description (usage A, B, D, E) 1.2 the visual abstract (usage D, E) 1.3 (part of) the storyboard (usage D, E) 1.4 (part of) the browse copy (usage D, E) 1.5 the audio (speech or music separately) (usage D, E) 1.6 the transcript of speech (usage D, E) 1.7 a specific view on a specific search result (usage D, E) 2 ECHO should provide for the possibility of exporting ECHO material in file formats that can be used in office or editing software, or in other software that is applicable. (usage E) 2.1 ECHO should provide for tools to create an Editing Decision List on the basis of the Browse copy. (usage E)
14
Appendix 1: Choice of user types

Overview of user types per user community A 1 2 3 B 4 5 6 C 7 8 9 D 10 11 12 E 13 14 15 Educational Environment teachers (film/television/new media) students(history and/or film..) researchers Film and Entertainment Industry (broadcasting companies) documentary makers news editors/journalists librarians/documentalists Cultural Heritage Institutions keepers/custodians employees of the educational department exhibition organizers Audio Visual Industry product developers news media/application designers researchers Large Audio Visual Archives archivists marketing and sales managers researchers
13 June 2000
15
Choice of user types explained For each user type, we briefly explain here why they were chosen as representative user types for that target market and why they are interesting people to collect user requirements from. 1 Educational Environment User types: 1.1 teachers (film/television/new media) Teachers can use the low res material in courses. Teachers from this domain know a lot about video and film, therefore we expect that they will be able to contribute seriously to the collection of user requirements. 1.2 students (history, film) History students could use ECHO for research of the themes chosen. They could also research the differences in description (i.e. registration and subject indexing) of the same event within different countries. Film students could be interested in researching the way in which films were made in the 20s 60s. Both could comment on ways of retrieval. 1.3 researchers Researchers have the same interests as students, but they have far more experience with retrieval. Useful contributions expected. 2 Film and Entertainment Industry (broadcasting companies) User types: All user types interested in copyrights 2.1 documentary makers Important target, reuse of documentary material in ECHO is expected. Used to retrieval and viewing video for decisions on its usefulness. 2.2 news editors/journalists Same usage of ECHO expected. This user type is different from the previous one because of different retrieval demands: fast result is important => fast retrieval & export facilities. 2.3 librarians/documentalists Very important user type: they know a lot about the sort of questions program makers would ask ECHO. They can make sound judgements on what the important search criteria will be. 3 Cultural Heritage Institutions User types: 3.1 keepers/custodians Custodians with video or film in their collection will have ideas on how to bring that part of the collection to the public, in a public system like ECHO. 3.2 employees of the educational department These employees can make judgements on the usefulness of ECHO for educational purposes. 3.3 exhibition organizers These employees might have special requirements as to the export and reusage of ECHOmaterial. 4 Audio Visual Industry User types: All probably have a great interest in copyright matters. 4.1 product developers (e.g. They might decide to publish a DVD on Daily life in the 30s) They will have requirements as to the content, the export formats and copyright matters. 4.2 application designers (They design applications for DVD's or other digital video products)
13 June 2000
16
They will have requirements on the viewing and export functionality. They are used to digital video and the possibilities around it. 4.3 researchers These researchers have different goals and therefore have different retrieval requirements to researchers from an educational or archival environment. Possibly also commercial aspects of the content. 5 Large Audio Visual Archives User types: 5.1 archivists Archivists will have specific requirements on metadata, viewing functionality and indexing strategies. 5.2 marketing and sales managers They will be interested in the way ECHO could be brought to market (web), copyright matters, content. They will be interested in the visual abstracts and other facilities in ECHO to use for promotion purposes. 5.3 researchers (= power users) These researchers have a lot of experience with retrieval on the collection. They will have concrete wishes as to viewing and exporting functionality.
13 June 2000
17
Appendix 2: User communities and user types

with the numbers and names of the planned interviews
user community
A Educ. Env.
user type
1
teachers
2
students
3
academic researchers
B Film & Ent. Ind. 4

documentary makers
C Cult. Her. Inst. 5

news editors/ journalists
D Audio Visual Ind. 8

educational department
6
librarians
7
custodians
9
exhibitionars
10
product developers
11
12
E Large Audio Visual Arch. 13 14

archivists
Total nr of int's per partner 15
CNR NAA IL INA MEM Total per user type Total per user community
1 1 2 0 1
0 1 0 0 1
4 0 0 2 3
0 0 1 1 1
0 1 1 0 1
0 2 0 2 3
0 0 2 0 0
0 2 0 0 0
0 2 0 1 0
0 3 1 1 0
0 1 0 2 0
0 0 0 1 0
0 3 2 2 1
0 1 0 2 0
sales managers researchers 0 0 1 1 0
application designers researchers
5 17 10 15 11 58 58
5 16
3 13
2 7
5 9
8 13
13 June 2000
18
ECHO: IST-1999-11994 Delivereable D1.2.1
Appendix 3: Questionnaire for documentalists and archivists European Chronicles On line (ECHO)
The ECHO project aims at developing a digital library service for historical films belonging to large the National Audiovisual Archives of France, Italy, The Netherlands and Switzerland. Questionnaire 1
Name: Function or educational grade: Organisation: Could you give us an indication of the frequency of you using online catalogues?: daily / weekly / monthly / hardly at all. Could you tell us why or how you would like to use ECHO?: data entry / browsing historical film material / reference / research / scientific studying / reuse of historical film material in new products / other, namely.. Please indicate you linguistic skills concerning the following languages: !"spoken Dutch [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"written Dutch [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"spoken English [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"written English [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"spoken French [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"written French [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"spoken German [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"written German [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"spoken Italian [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all !"written Italian [ ] very well, [ ] reasonably, [ ] not so well, [ ] not at all ECHO partner: Contact person:
13 June 2000
19
Instructions
If the meaning of a specific term isn't clear to you, please look in the glossary at the end of this questionnaire. Before starting to fill in this questionnaire, you could take a look at the images at the end of this document. The questionnaire contains yes-or-no questions and open questions. Please answer to the yes-or-no questions by ticking one of the following answers: [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Feel free to add an explanation if applicable. Whenever you find a question is not applicable for your situation, please tick 'No comment'. Please give your opinion as clear as possible on the open questions. Please, keep the reference numbers of the questions attached to the answers concerned.
Table of contents
0 1 2 3 4 5 6 7 DATA ENTRY MANAGEMENT INDEXING RETRIEVAL PROCESS AND SEARCHING TECHNIQUES OUTPUT EXPORT AND REUSE BILLING AND ACCOUNT CONTENT USAGE IN GENERAL
13 June 2000
20
Questions 0
0.1
Data entry management
ECHO will be offering functionality like automated keyword extraction and automated textual annotation on the basis of speech and film content. Do you think that human control is necessary on the time-aligned automated (this means you expect that the speech and the texts in the film won't be enough): 0.1.1 Geographical coding?
0.1.2 Time coding?
0.1.3 People coding?
0.1.4 Affiliation coding?
0.1.5 Event assignment?
0.1.6 And topic assignment?
0.1.7 Do you expect the thesauri of the national archives could be useful input for the automated assignment of geographical keywords, period keywords, person names, affiliations, events and topics? 0.1.8 Do you think that term normalisation and validation of
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question
[ ] Yes, mandatory 21
the automatically assigned keywords (of all kinds) is important?
0.1.8.1 Do you think it is important that, even though you are making a film description in your own language, the users will be able to search it with their own language via the multilingual thesauri? 0.1.9 Do you think human control on the automatic scene recognition is necessary?
0.1.10 Do you think human control on the automatic transcript of speech is necessary?
Can you name the metadata that should be added manually? 0.2.1 How would you want to be assisted during the manual fulfilling the film description? 0.2.2 Do you think that it is important to be able to browse through a systematical representation of thesauri, so that the right terms, with the right meanings are assigned to the film description? 0.2 0.2.3 Do you want to browse the thesaurus in your own language?
[ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question Open question [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question
0.3
0.4
0.5
Can you imagine what role an automatically created visual abstract of a documentary can play in comparison with the textual abstract of the content you write for the catalogue description today? What consequences do you expect the visual additions (visual abstract and storyboard) to a film description will have for construction of the textual description as you make them today? Do you expect an automated index on the transcript of speech of the historical films will be useful for full-text retrieval?
Open question
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 22
13 June 2000
0.5.1 Or do you expect that a humanly constructed annotation in todays language will be more useful?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 0.5.2 How many historical terms (period 1920 1960) do you Open question think the thesaurus of your national archive contains at the moment? 0.6 Would you prefer distributed manual data entry, meaning [ ] Yes, mandatory that different persons from different locations can edit the [ ] Yes, desirable metadata they are specialised in? [ ] Yes, optional [ ] No [ ] Not applicable. 0.6.1 And if so, is it necessary that different persons can edit [ ] Yes, mandatory the metadata of the same film simultaneously? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 0.6.2 Or would you prefer a certain procedure where every [ ] Yes, mandatory step of indexing a film, including the correction of [ ] Yes, desirable automated indexing and the manual indexing, has a [ ] Yes, optional logical place? [ ] No [ ] Not applicable. 0.7 At the moment the only time-related metadata you are Open question probably familiar with is the timecode. As we explained (See 0.1) there will be a lot more time-aligned metadata in ECHO, mostly automatically created. An annotation of the content could be manually entered and coupled directly to the scenes concerned. What other metadata would you like to add manually that should be timealigned? 0.8 What do you expect of future video cataloguing in Open question general? 0.8.1 What do you expect concerning the balance in Open question automated and manual video cataloguing? 0.8.2 What improvements of the indexing depth of videofiles Open question can you imagine compared to today's cataloguing traditions?
13 June 2000
23
Indexing
(See Library Creation in Workflow figure at the end of this document) Textual features 1.1 1.1.1 Is it important for you that you can search a high quality [ ] Yes, mandatory translation of the original transcript to your own [ ] Yes, desirable language? [ ] Yes, optional [ ] No [ ] Not applicable. 1.1.2 Or would a degraded text or just some keywords do? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.1.3 Do you want to have keywords extracted from the [ ] Yes, mandatory closed captions, speech etc.? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.1.4 Should there be relations between the extracted [ ] Yes, mandatory keywords as in a thesaurus? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.1.5 Multilinguality 1.1.5.1 Is cross-language querying important for your work? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.1.5.2 Do you think cross-language querying is as [ ] Yes, mandatory important for searching the transcript of speech as [ ] Yes, desirable for searching the film descriptions? [ ] Yes, optional [ ] No [ ] Not applicable. 1.1.5.3 Do you want to restrict the search result to a given [ ] Yes, mandatory set of one or more languages? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.1.5.3.1 If so, to which language(s)? Open question 1.1.5.4 How important is it for you, to be able to read the [ ] Yes, mandatory transcript and the metadata in your own language? [ ] Yes, desirable [ ] Yes, optional [ ] No
24
1.1.5.5
Would it be helpful if you heard the original spoken text and at the same moment saw the transcript on the screen, especially when the original speech is not your own language? (Image 1) Do you want to be able to retrieve contradictory citations of the same person (in other words: find films where the same person says different things on the same subject)?
1.1.5.6
[ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
1.1.6 Are the following automatically generated parameters (grouping criteria) on subject important to you?: 1.1.6.1 Persons (descriptors on VIPs and their affiliation)?
1.1.6.2
object (classes, e.g. animals, cars, landscapes, buildings)?
1.1.6.3
Environment (more precisely: outdoor/indoor; season; weather; other settings like interior, forest, park, mountain scenery)?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
1.2 Visual features 1.2.1 Visual abstracts 1.2.1.1 Would visual abstracts (short video clips characterising the content of a full-size film) be useful for your work?
1.2.1.2
Do you want to be able to change the length of a visual abstract yourself?
1.2.1.3
Should the audio track be included with the visual abstract?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No 25
13 June 2000
[ ] Not applicable. 1.2.1.4 Are the following properties of the abstract important for your work? 1.2.1.4.1 Summarise the content (semantics) of the full film [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.1.4.2 Summarises the content of the film in relation to [ ] Yes, mandatory your query (See Image 3)? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.1.4.3 Summarise the visual content (objects shown in the [ ] Yes, mandatory video, e.g. cars, flowers) [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.1.4.4 Summarise the mood of the video (colour, motion [ ] Yes, mandatory intensity) [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.1.4.5 Concentrate on people (faces) [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.1.4.6 Concentrate on appearance of text (scene text and [ ] Yes, mandatory text generated by title machines). [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.1.5 Do you think it is important that the visual abstract [ ] Yes, mandatory keeps the chronology of the film? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.2 Browse copy 1.2.2.1 Would a browse copy of the film in keyframes / clips [ ] Yes, mandatory / both be useful for your work? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.2.2 Question left out 1.2.2.3 What sensibility in the parsing of keyframes is Open question
26
1.2.2.4
important to you (e.g. camera movement, cut detection)? Would the audio track have to be included with browse copy?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
1.2.3 Storyboard (Image 1 + 2) 1.2.3.1 Do you want to be able to specify the default length of a storyboard as a percentage of the whole film?
1.2.3.2
Do you want to be able to zoom in on the storyboard, i.e. ask for more keyframes to be shown?
1.2.3.3
Are the following properties of the storyboard important for your work: 1.2.3.3.1 Represent the content (semantics) of the full film?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.3.3.2 Represent the visual objects shown in the film, e.g. [ ] Yes, mandatory cars, flowers? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.3.3.3 Represent the mood of the video (colour, motion [ ] Yes, mandatory intensity)? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.3.3.4 Concentrate on people (faces)? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.3.3.5 Concentrate on appearance of text (with storyboard [ ] Yes, mandatory facilities)? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 1.2.4 Is the following descriptive information important for
27
your work: 1.2.4.1 on the videofile itself
1.2.4.1.1 Producer
1.2.4.1.2 Format
1.2.4.1.3 Length
1.2.4.1.4 Other, namely 1.2.4.2 on the technical quality
1.2.4.2.1 Of the film itself
1.2.4.2.2 Available formats
1.2.4.2.3 Camera-systems
1.2.4.2.4 Clean feed
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No
13 June 2000
28
1.2.4.2.5 Aspect-ratio
1.2.4.2.6 Other, namely..
1.2.4.3
on camera movement
1.2.4.3.1 Camera moves right/left
1.2.4.3.2 Pan
1.2.4.3.3 Zoom in/out
1.2.4.3.4 Other, namely 1.2.4.4 on aesthetic quality
1.2.4.4.1 Light
1.2.4.4.2 Brightness
[ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No
13 June 2000
29
1.2.4.4.3 Colours
1.2.4.4.4 Framing (close-up, medium shot, etc.)
1.2.4.4.5 Other, namely.. 1.2.4.5 on movement in general
1.2.4.5.1 Walking
1.2.4.5.2 Running
1.2.4.5.3 Turmoil
1.2.4.5.4 Other, namely.. 1.2.4.6 on the actual movement (e.g. car from left to right, landing plane)?
1.2.4.7
on the genre (e.g. news reel, documentary, entertainment)
[ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
Audio features 1.3 1.3.1 Is it important that you can distinguish between film
[ ] Yes, mandatory 30
fragments with sound or speech AND soundless fragments?
1.3.2 Is it important for you that you can distinguish between the source of the sound (e.g. studio, telephone, voice over)?
[ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
1.3.3 Is the following descriptive information important for your work: 1.3.3.1 Timbre
1.3.3.2
Pitch
1.3.3.3
Original soundtrack
1.3.3.4
Samplefrequency (quality)
1.3.3.5
Other, namely..
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question
13 June 2000
31
2 Retrieval process and searching techniques

2.1 Is it important for you, that you can ask for a concrete [ ] Yes, mandatory aspect of the content (structured search on the selection [ ] Yes, desirable criteria we mentioned at category 1)? [ ] Yes, optional [ ] No [ ] Not applicable. 2.1.1 Do you prefer a free query entrybox (See Image 2) [ ] Yes, mandatory more than a query form in which you can enter period [ ] Yes, desirable or keyword or title or producer name on the appropriate [ ] Yes, optional lines? [ ] No [ ] Not applicable. 2.1.2 If you look for specific criteria (e.g. a person or an [ ] Yes, mandatory affiliation), would you like assistance like an index [ ] Yes, desirable lookup list (an alphabetical list of the index entries for [ ] Yes, optional those criteria)? [ ] No [ ] Not applicable. 2.2 Is it important for you to be able to do a natural language, [ ] Yes, mandatory so a freely formulated search: [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.1 on all possible information strata at once? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.2 on a selected stratum, e.g. transcript of speech, only? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.3 Is it important for you that you can exclude certain [ ] Yes, mandatory criteria (e.g. no films from the thirties or no politicians) [ ] Yes, desirable while formulating your query? [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.4 Do you expect that the system, in the background, [ ] Yes, mandatory interprets your question literally or conceptually? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.5 Do you need the possibility to search literally, e.g. for a [ ] Yes, mandatory citation? [ ] Yes, desirable
32
[ ] Yes, optional [ ] No [ ] Not applicable. 2.2.6 Do you expect that the system can interpret your [ ] Yes, mandatory question in a fuzzy way instead of answering with 'No [ ] Yes, desirable hits found' when you typed a persons name wrongly? [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.7 Do you like to formulate your first question in full detail? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.7.1 Or do you prefer to start with a global question and [ ] Yes, mandatory then search more specific or browse associatively [ ] Yes, desirable within the collection? [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.7.2 Do you want to be able to refine a (first) search result? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.8 Is it important for you to be able to search for the [ ] Yes, mandatory abstract or theoretical subject of the content (e.g. [ ] Yes, desirable jealousy, loneliness, love, hate, happiness)? [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.9 Is it important for you to be able to search for [ ] Yes, mandatory descriptors like 'typical, clich, iconic; normal, every[ ] Yes, desirable day-related, common' versus 'untypical, unusualness, [ ] Yes, optional curious'? [ ] No [ ] Not applicable. 2.2.10 Is it useful for you to be able to make a distinction [ ] Yes, mandatory between voice over and original speech? Give [ ] Yes, desirable examples of the situation, e.g. search for citations. [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.11 Do you want to be able to save a query for reuse? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.2.12 What do you miss now in the possibilities of query Open question formulation? 2.3 Do you think that a table of content (hierarchical
33
presentation with zoom functionality) is an important navigation tool: 2.3.1 For the whole collection?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.3.2 For a part of the ECHO collection according to the [ ] Yes, mandatory source (French collection etc.)? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.3.3 For each film? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.3.4 Would you like to be able to directly select a part of the [ ] Yes, mandatory ECHO collection from different points of view, and start [ ] Yes, desirable with browsing such a selection? [ ] Yes, optional [ ] No [ ] Not applicable. 2.3.5 If yes, which points of view are important for you: 2.3.5.1 Period [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.3.5.2 Theme [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.3.5.3 National archive [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.3.5.4 Other, namely.? Open question 2.4 Is it important for you that you can search with a visual [ ] Yes, mandatory example for similar frames: [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.4.1 One known keyframe? [ ] Yes, mandatory [ ] Yes, desirable
34
2.4.2 a known shot or sequence of keyframes (e.g. 2 before and 2 after the relevant keyframe)?
[ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
2.5
Is it important for you that you can search with an audio example: 2.5.1 With a selected fragment of music?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.5.2 With a selected fragment of speech? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.6 Is it important that you can search for objects or themes [ ] Yes, mandatory via browsing? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.6.1 Would you like to browse within a category e.g. [ ] Yes, mandatory Emigration movements after W.O. II? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.6.2 Would you find it helpful to browse through a thesaurus [ ] Yes, mandatory or semantical network to help you formulate your query [ ] Yes, desirable subject more accurate? [ ] Yes, optional [ ] No [ ] Not applicable. 2.6.2.1 Must the thesaurus be in your own language? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.7 System feedback 2.7.1 Do you expect a dialogue output in case of zero hits or [ ] Yes, mandatory too many hits or do you want to see the most relevant [ ] Yes, desirable search results anyway? [ ] Yes, optional [ ] No [ ] Not applicable.
35
2.7.2 Do you expect the system to present possible topics related to your query and in your own query language?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.7.3 Do you expect the system to calculate the relevancy [ ] Yes, mandatory per hit? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.7.4 Do you expect the system to group the search results [ ] Yes, mandatory into thematic aspects of your question on demand? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 2.7.5 Do you expect the possibility to indicate that some of [ ] Yes, mandatory the films found by the system are very relevant in your [ ] Yes, desirable opinion? (More like this-button) [ ] Yes, optional [ ] No [ ] Not applicable. 2.8 Would a hypertext structure be important for you, so that [ ] Yes, mandatory you can browse from one film to related [ ] Yes, desirable scenes/videofiles (or: for series: browse to next [ ] Yes, optional episode)? [ ] No [ ] Not applicable. 2.8.1 Please, give an example of when you would find Open question hyperlinks very useful. 2.8.2 What meanings of a link would be important to you? Open question 2.8.3 Do you need to see the meaning of a link beforehand? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
13 June 2000
36
3 Output
3.1 Presentation of Search Result 3.1.1 Film description 3.1.1.1 Do you expect a short presentation per hit in a list view?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.1.2 Do you expect relevance ranking as a first [ ] Yes, mandatory presentation? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.1.3 Do you want to be able to resort the search result on a [ ] Yes, mandatory given item, e.g. period? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.1.4 How many hits would you like to see at least per Open question screen, to get an overview? 3.1.1.5 Do you want to see directly in the first list presentation [ ] Yes, mandatory from which archive a film originates? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.1.6 What do you think are other essential elements of the Open question short presentation? 3.1.1.7 Would you like to be able to indicate yourself which [ ] Yes, mandatory elements of the description should be shown? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.1.8 Would you like to receive results for all films matching [ ] Yes, mandatory your query to be presented in the original language of [ ] Yes, desirable the film description? [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.1.8.1 Or would you like to see the film descriptions [ ] Yes, mandatory concerned translated to the language you used to [ ] Yes, desirable formulate your query? [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.1.8.2 Would you ignore films that are relevant to your [ ] Yes, mandatory query, but are spoken in a language you don't [ ] Yes, desirable
37
[ ] Yes, optional [ ] No [ ] Not applicable. 3.1.1.8.3 Or would you take a look at the visual abstract or the [ ] Yes, mandatory visual content anyway, irrespective of the spoken [ ] Yes, desirable language? [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.2 How would you like to see: 3.1.2.1 The visual abstract: immediately in the first [ ] Immediately presentation / on demand together with the large [ ] On demand presentation? 3.1.2.2 The first keyframe: immediately / on demand? [ ] Immediately [ ] On demand 3.1.2.3 The start of the storyboard : immediately / on [ ] Immediately demand? [ ] On demand 3.1.2.4 The transcript of the speech: on demand together with [ ] Immediately the large presentation / together with the storyboard / [ ] On demand together with the viewing of the browse copy. 3.1.3 Do you expect a textual abstract of the content of a [ ] Yes, mandatory video file to be useful while judging the search result? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.3.1 At what point would you like to see it: immediately / on [ ] Immediately demand? [ ] On demand 3.1.3.2 Is it important for you that it is properly formulated? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.3.2.1 Or would degraded text do? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.3.3 Is it important for you that the textual abstract is in [ ] Yes, mandatory your own language? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.4 The following question is only applicable if you have [ ] Yes, mandatory experience with Boolean searching. Can you agree [ ] Yes, desirable with it that the search result will always be sorted on the [ ] Yes, optional relevancy of the found items compared with the query? [ ] No And that to calculate the relevancy of an item the [ ] Not applicable.
understand?
38
relation between the search terms of the query will automatically be an OR-relation? 3.1.5 Do you want to be able to decide which aspects (or fields or metadata) are shown in the search result list?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.5.1 Do you want to save those preferences as your [ ] Yes, mandatory personal settings? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.5.2 Do you want to be able to change those preferences [ ] Yes, mandatory per query? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.6 Do you want to be able to sort the search result on a [ ] Yes, mandatory specific aspect, other than the relevancy? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.1.7 Are you prepared to wait for the presentation of the [ ] Yes, mandatory search result to be built up, taking into account the size [ ] Yes, desirable of the digital library and assuming that the quality of the [ ] Yes, optional retrieval result will be good enough? [ ] No [ ] Not applicable. 3.1.7.1 How many seconds? Open question 3.2 Viewing functionality 3.2.1 Cross document viewing: what collages or personal profiles would you like to create on demand 3.2.1.1 by time for a chronological view of the search result? [ ] Yes, mandatory (See Image 5) [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.2.1.2 by location for a geographical view of the search [ ] Yes, mandatory result? (See Image 4, 6 and 7) [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.2.1.3 by personality (See image 5)? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
39
3.2.1.4 by event?
3.2.1.5 In what combinations of the above would you like the search result to be summarised (see screendumps as an example)? 3.2.2 Is it important for you that you can first view the keyframes that are relevant to your query; then expand the storyboard to more keyframes; if wanted then starting the low res videofile from each keyframe? (Image 3) 3.2.3 Is it important to you that you can listen to the audio track without the aligned images?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question
3.2.4 Is it important to you that you can view the transcript together with listening to the audio track only?
3.2.5 Do you want to see the full textual description of a film by clicking on the title for instance?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
3.2.6 What is important for you when playing a video file: 3.2.6.1 Including/excluding sound?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.2.6.2 Manipulation of film: zoom, fast forward, fast backward [ ] Yes, mandatory etc.? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.2.6.3 Other, namely. Open question 3.3 Printing functionality 3.3.1 Would you like an order form to order a copy of the [ ] Yes, mandatory original film? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
40
3.3.2 Do you want the timecodes of requested sequence that [ ] Yes, mandatory correspond with the original film, to be already filled in [ ] Yes, desirable this order form? [ ] Yes, optional [ ] No [ ] Not applicable. 3.3.3 Would you like to be able to print a list with a certain [ ] Yes, mandatory selection of the description? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.3.4 Would you like to be able to print the whole transcript? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 3.3.5 Please, mention if there is other printing functionality Open question that is important for you:
13 June 2000
41
4
4.1
Export and Reuse

Do you want to export X to your [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder [ ] Other, namely [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder [ ] Other, namely [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder [ ] Other, namely [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder [ ] Other, namely [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder [ ] Other, namely [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder [ ] Other, namely [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder [ ] Other, namely [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder [ ] Other, namely [ ] editing suite [ ] presentation software [ ] office software [ ] personal project folder 42
4.1.1 Textual description to your
4.1.2 Transcript of speech to your
4.1.3 Speech track to your
4.1.4 Sound track to your
4.1.5 Visual abstract to your
4.1.6 Storyboard to your
4.1.7 Browse copy version of the whole film to your
4.1.8 Parts of the browse copy to your
13 June 2000
[ ] Other, namely 4.2 Is it important for you to be able to export the browse [ ] Yes, mandatory copy of the film without the audio track, but with the time- [ ] Yes, desirable aligned transcript of speech [ ] Yes, optional [ ] No [ ] Not applicable. 4.3 Retracing relevant fragments. Would you like to be able to retrace relevant fragments by: 4.3.1 keeping them in a shopping cart? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 4.3.2 Adding them to a virtual collection or storing them in a [ ] Yes, mandatory project folder? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 4.3.2.1 If so, please describe what you expect of a virtual Open question collection (personal metadata, create it on demand e.g. 'the first 10 years of fascism', create it as a personal collection, e.g. defined for working on a thesis, possibility to make a personal collection public). 4.3.3 Downloading them as they are (low res format)? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 4.3.4 Bookmarking them? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 4.3.5 Creating an editing decision list, so that later in an [ ] Yes, mandatory editing application you can quickly find the keyframes [ ] Yes, desirable you want via the timecodes? [ ] Yes, optional [ ] No [ ] Not applicable. 4.3.6 Annotating relevant scenes with your own remarks? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 4.3.6.1 Do you want to be able to annotate the scenes online [ ] Yes, mandatory [ ] Yes, desirable while the browse copy is being played in a separate
43
window?
4.3.7 Copy them as clips or files to another server or mail them to someone else?
[ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
13 June 2000
44
5 Billing and account

5.1 Is it important for you that the systems informs you that: 5.1.1 Copyright must be paid? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 5.1.2 the material is not recently used? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 5.1.3 the material is not for reuse (e.g. indicated by the owner [ ] Yes, mandatory or by the persons in the film)? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 5.1.4 the material is rare/new; recent/latest or [ ] Yes, mandatory nostalgic/oldest? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 5.2 What do you expect in ECHO on billing mechanisms in Open question general? 5.2.1 Are you willing to pay per view? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 5.2.2 Are you willing to subscribe to ECHO as an [ ] Yes, mandatory organisation or personal? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 5.2.3 Do you expect a price differentiation for different service [ ] Yes, mandatory levels (e.g. textual description only, transcript of [ ] Yes, desirable speech, visual abstract, storyboard in different sizes, [ ] Yes, optional browse copy, copy of original film)? [ ] No [ ] Not applicable. 5.3 What do you expect to be able to administrate in relation Open question to copyright matters: 5.3.1 The sort of rights: Transmission rights, Re-use rights, [ ] Yes, mandatory Image copyrights, Photo copyrights, Literary [ ] Yes, desirable copyrights, Music Rights, Art Copyrights, Exploitation [ ] Yes, optional
45
rights? 5.3.1.1 Which rights do you miss? 5.3.2 Number of transmission rights
5.3.3 Rights Conditions
5.3.4 Rights Territory
5.3.5 Rights Jurisdiction
5.3.6 Rights type
5.3.7 Rights ID
5.3.8 Other copyright matters, namely?
[ ] No [ ] Not applicable. Open question [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. Open question
13 June 2000
46
6 Content
At the end of the project, the ECHO application will contain 200 hours of film from the period 1920-1960.The following themes are likely to be covered by the ECHO digital library. Please indicate per theme and per sub-theme if it is interesting for you or not.
Theme 1 Post war Reconstruction Marshallplan Continuing life in the city Babyboom Emigration movements Rebuilding the military forces
Yes, very interesting / Yes, moderate / No / Not applicable yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable
13 June 2000
Theme 2 Youth culture in the 50s and 60-s Fashion, clothing, life-style developments Student revolts Sexual revolution Television and radio The arts
Theme 3 Sports in the 20th Century Sociological developments National Sports Mass-events European contests
47
Sponsoring
Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable
Theme 4 Celebrating in Europe National anniversaries Religious feasts Folklore (fairs, carnival) Birth, marriage, funerals Europeans on holiday
Theme 5 Pre-war Europe The gay twenties Theatre, cabaret Movie industry Pre-war state & politics Financial crises
Theme 6 The World Wars
Yes, very interesting / Yes, moderate / No / Not applicable Aftermath World War 1 Yes, very interesting / Yes, moderate / No / Not applicable The Interbellum Yes, very interesting / Yes, moderate / No / Not applicable 1940-45 Propaganda Yes, very interesting / Yes, moderate / No / Not applicable 1940-45 Major events and daily life Yes, very interesting / Yes, moderate / No / Not applicable 1940-45 Aftermath Yes, very interesting / Yes, moderate / No / Not applicable Theme 7 Daily Life 1. Work and leisure Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable
13 June 2000
48
2. 3. 4. 5.
The European family Education Food & drink Sickness & health
Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / No applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable Yes, very interesting / Yes, moderate / No / Not applicable
13 June 2000
Theme 8 Women in Europe 1. Emancipation movements 2. Women and children 3. Women in politics 4. Woman in wartime 5. The arts
Theme 9 The European Community Traffic & transport The European borders Predecessors EC The environment Language & Culture
Theme 10 The Colonies Daily life in the colonies Social, political and economical issues De-colonisation processes Native culture Religious life and mission work
49
6.2
6.3
Please arrange the themes (not the sub-themes) from most important to less important: Which themes do you really miss?
13 June 2000
50
7 Usage in general
7.1 Interface 7.1.1 Is important for you that the query interface is in your own native language? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 7.1.2 Would an English query interface be useful for you? [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 7.1.3 Do you want to have the possibility to choose your own [ ] Yes, mandatory interface language (Dutch, English, French, German or [ ] Yes, desirable Italian)? [ ] Yes, optional [ ] No [ ] Not applicable. 7.1.4 Do you want the simple query interface to contain only [ ] Yes, mandatory a text box where you can enter your free textual query? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 7.1.5 Do you want to be able to choose a browsing option in [ ] Yes, mandatory the simple query interface? [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. 7.1.6 Do you want an advanced query interface with a free [ ] Yes, mandatory search box and the possibility of looking for specific [ ] Yes, desirable information (e.g. period, title, language)? [ ] Yes, optional [ ] No [ ] Not applicable. 7.1.7 Do you want to be able to save your personal settings [ ] Yes, mandatory of ECHO (e.g. for query interface, query language, [ ] Yes, desirable viewing parameters)? [ ] Yes, optional [ ] No [ ] Not applicable. 7.1.8 Concerning the graphical appearance of the interface, can you indicate how important (1) or annoying (5) the following presentation tools would be to you: 7.1.8.1 Different colours for different concept areas in the [ ] Very important interface [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying
51
7.1.8.2 Blinking parts of the screen?
7.1.8.3 Visual clues / graphics for different actions?
7.1.8.4 Audio feedback?
7.1.8.5 Consistency with well-known applications ?
7.1.8.5.1 Toolbar icons from MS Office?
7.1.8.5.2 Fancy graphics for special tasks and operations?
7.1.8.6 Animated clues (e.g. "<- Click here to begin" sweeps over your taskbar)?
7.1.8.7 Icons asking for understanding the reaction time needed for building up the interface (consider the "Starting Java applet. Please wait..." or the
[ ] Not applicable [ ] Very important [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying [ ] Not applicable [ ] Very important [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying [ ] Not applicable [ ] Very important [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying [ ] Not applicable [ ] Very important [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying [ ] Not applicable [ ] Very important [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying [ ] Not applicable [ ] Very important [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying [ ] Not applicable [ ] Very important [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying [ ] Not applicable [ ] Very important [ ] Important [ ] Of average importance 52
hourglass)?
[ ] Not so important [ ] Annoying [ ] Not applicable Open question Open question Open question Open question
7.2 Security 7.2.1 Do you expect a lot of external unknown users (accessing via internet) to be interested in ECHO? 7.2.2 Is there now a login procedure for external users accessing the catalogue of your (national) film archive? 7.2.3 Is there now a login procedure for internal users accessing the catalogue of your (national) film archive? 7.2.4 Do you expect a login procedure to take care of the authorisation to search, view, edit metadata, listen, select and export relevant filmmaterial? 7.3 Information retrieval 7.3.1 What are your expectations of the usability of the enhanced search facilities of ECHO? 7.3.2 How important will it be for your work to be able to query a digital library that contains films on subjects of your interest in multiple languages?
Open question [ ] Very important [ ] Important [ ] Of average importance [ ] Not so important [ ] Annoying [ ] Not applicable [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes [ ] No [ ] Not applicable. [ ] Yes [ ] No [ ] Not applicable.
7.3.3 Do you want to have profiles for current awareness service on newly indexed (!) films?
7.3.4 Would you like to join a user group of ECHO?
7.3.4.1 for a special theme?
7.3.4.2 for a specific profession?
7.3.5 Concerning the relation of ECHO with the outside world: 7.3.5.1 Would you like to be informed on other relevant items [ ] Yes, mandatory from the content of the national archives involved that [ ] Yes, desirable cannot be viewed in ECHO (yet)? [ ] Yes, optional [ ] No [ ] Not applicable.
53
7.3.5.2 Would you like to be able to search in the original online catalogues of the national archives from within ECHO, even though these catalogues contain mostly textual descriptions? 7.3.5.3 Is it important for you to be able to search, at the same time, multiple archives?
7.3.5.3.1 In the same country?
7.3.5.3.2 In different countries?
7.3.5.3.3 In different languages?
[ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable. [ ] Yes, mandatory [ ] Yes, desirable [ ] Yes, optional [ ] No [ ] Not applicable.
You have reached the end of the questionnaire, Thank you very much for your time and effort!
13 June 2000
54
Appendix 4: Schedule of the completed questionnaires

Unique ID for each Q C01 C02 C03 C04 C05 *********** IL01 IL02 IL03 IL04 IL05 IL06 IL07 IL08 IL09 IL10 *********** I01 I02 I03 I04 I05 I06 I07 I08 I09 I10 I11 I12 I13 I14 I15 *********** M01 M02 M03 ECHO partner CNR-IEI CNR-IEI CNR-IEI CNR-IEI CNR-IEI ************ IL IL IL IL IL IL IL IL IL IL ************ INA INA INA INA INA INA INA INA INA INA INA INA INA INA INA ************ Memoriav Memoriav Memoriav Contactperson Name of interviewee
Michele Battini Marcella Binchi Lorenzo Cuccu Alessandra Lischi Paolo Pezzino
User type
Received d.d.
Paola Venerosi Paola Venerosi Paola Venerosi Paola Venerosi Paola Venerosi
A3 A1 A3 A3 A3 ********************** ************************ ******* Gabriele D'Autilia, Antonella Pagliarulo E13

Marco Rendina Gabriele D'Autilia Gabriele D'Autilia Gabriele D'Autilia, Marco Rendina Gabriele D'Autilia Gabriele D'Autilia Marco Rendina, Enrico Rendina Gabriele D'Autilia Gabriele D'Autilia Gabriele D'Autilia Francesco Aquilanti Giampiero Brunetta Nicola Caracciolo Giovanni De Luna Cristina D'Osualdo Gigliola Fioravanti Andrea Minucci Renato Parascandolo
24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 ************* 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 03-04-00 ************* 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 24-03-00 ************* 23-03-2000 23-03-2000 23-03-2000 55
C7 A1 B4 A1 E15 C7
B5 D10 Giannarelli E13 ********************** ************************ ******* Laurent Vinet Michle Wautelet E 13 Laurent Vinet Liane Willemont B4 Laurent Vinet Micheline Poure B6 Laurent Vinet Olivier Maurice D 11 Laurent Vinet Xavier Lemarchand D 11 Laurent Vinet Liliane Leclerc B6 Laurent Vinet Gisle Bertrand A3 Laurent Vinet Michel Dauzats E 13 Laurent Vinet Claude Longrinas D 10 Laurent Vinet Aurlie Neau A3 Laurent Vinet Jolle Olivier E 14 Laurent Vinet Philippe Raynaud D 12 Laurent Vinet Monique Ageron E 14 Laurent Vinet Olivier Lescurieux C9 Laurent Vinet Philippe Poncin E 15 ********************** ************************ ******* Elena Spoerl Guido Ghiesi B6 Elena Spoerl Gianluca Grossi B5 Elena Spoerl Theo Musli A3
13 June 2000
Unique ID for each Q M04 M05 M06 M07 M08 M09 M10
ECHO partner
Contactperson
Name of interviewee Michel Dind

Jrg Hut
User type E13 B6 A1 B6 A2 A3 A3
Received d.d.
Memoriav Kurt Deggeller, Memoriav Memoriav Memoriav Memoriav Memoriav Memoriav

Catherine Cormon Kurt Deggeller, Felix Rauh Kurt Deggeller, Catherine Cormon Kurt Deggeller Kurt Deggeller Kurt Deggeller
27-03-00 27-03-00 27-03-00
Yves Collart Denise Barcella Monika Iten
27-03-00 27-03-00 Mercedes Matas 27-03-00 Lewinski 29-03-00 on paper M11 Memoriav May Broda B4 on paper *********** ************ ********************** ************************ ******* ************* N01 NAA Johan Oomen Henk Verheul E13 Received N02 NAA Johan Oomen Nellien Goslinga E13 Received N03 NAA Cancelled N04 NAA Cancelled N05 NAA Johan Oomen Sandra Buijel B6 Received N06 Cancelled N07 NAA Johan Oomen Nick Ceton D10 Received N08 NAA Johan Oomen Pierre Tuning B5 Received N09 NAA Johan Oomen W.J. Doff E14 Received N10 NAA Johan Oomen Harco Gijsbers A2 Received N11 NAA Johan Oomen Irene Vermeij B6 Received N12 NAA Johan Oomen Karl Mulder D10 Received N13 NAA Johan Oomen D.W. Blanchetta D11 Received N14 NAA Johan Oomen Pim Slot C8 Received N15 NAA Johan Oomen Bert Hogenkamp A1 Received N16 NAA Johan Oomen Pieter van der C9 Received Heijden N17 NAA Johan Oomen Carine Hekker C9 Received N18 NAA Johan Oomen Annemiek Iking D10 Received N19 NAA Johan Oomen Edward Schenk1 C8 Received N20 NAA Johan Oomen Annemieke de Jong E13 Received
Questionnaire completed together with Pim Slot N14.
13 June 2000
56
Appendix 5: Overview of functionality

including search results, linked to questions in the ECHO questionnaire, to types of usage and to user requirements. The relevant functionality, where the questions in the questionnaire refer to, are grouped as follows: Data entry, encoding & indexing Research & retrieval Search with text Search with image Search with audio Cross-linguality Presentation of search results: evaluating the retrieved content A Document viewing A1 Presentation metadata per document A2 Textual abstract A3 Visual abstract A4 Browse copy A5 Storyboard A6 Audio, speech B Cross document viewing (per search result) B1 Chronological view B2 Geographical view B3 Personality view B4 Event/subject view B5 Combination of those views Reuse of content Billing, account & user administration Interface in general ECHO can be used for different purposes, we distinguish the following types of usage: A Data entry for offline archiving1 B Retrieval for reference C Retrieval and viewing the content for the general public D Professional retrieval and viewing the content for scientific study (history or film science) E Professional retrieval, viewing and (non-)profit reuse of the content E+ Teachers
Data entry for "real time"archiving, so that editing metadata while the encoded video is streaming in can be a possible future usage of ECHO.
13 June 2000
57
Functionality
Related questions
Relevant for specific usage
Result from questionnaire and comment
Related to User Require ment
Data entry, encoding & indexing General opinion regarding data entry in digital video archiving Assistance for manual data entry
Cat. 0 +1 0.8, 0.8.1, 0.8.2
A A Various opinions: a lot of faith as well as a lack of faith in the system 0.6: No special demands on distributed data entry needed. During data entry it should be possible to copy from either a controlled lookup list or an index lookup list. Query assistance in the form of index lookup-lists for a specific field/metadata is very important (95% yes 3x). Every documentalist is in favor of using the thesauri, though there is a large difference in size of the thesauri of the national archives concerned. During data entry it should be possible to browse in the systematical representation of the thesaurus or classification scheme in ones own native language (0.1.8.1: 92% of documentalists think that searching with a thesaurus in ones own native language through the database is mandatory). Thesaurus browsing for a free text: subject query is helpful for 81% Yes 2x1. Automatic keyword extraction (from transcript of speech and film content into several types of keywords) is agreed upon ( 91% Yes), but human control is desired. Automatically extracted keywords should be related to thesaurus-keywords. not included DE12 DE1 DE2 DE2
0.2.1 A 0.2.2, 0.2.3 0.1.8.1 2.1.2 0.1.7, 0.1.8, 0.5.2
Automatic keyword extraction
2.6.2 0.1.1 0.1.6, 1.1.3 1.1.4
A, C, D, E
DE2 DE1.3
DE2.1
Yes 2x means: total of answers Yes mandatory and Yes desirable. Yes or Yes 3x means: total of answers Yes mandatory, Yes desirable and Yes optional.
DE= Data entry management; I=Interface; R=Retrieval; Pr=Presentation; A=Administration; C=Cross-linguality; S=Storyboard; Visual abstract=Visual abstract; Bc=Browse copy; Ru=Reuse; Cdv=Cross document viewing. 13 June 2000
58
Human control on automatic 0.1.9, 0.1.2 A encoding 0.1.10, 0.1.1/.6
Manual entry of timealigned subject annotation.
0.7 4.3.6
A, D, E
Transcript of speech
0.5, 0.5.1
C, D, E
1.1.1, 1.1.2 E
ECHO should provide for control and correction of the automatic scene detection. There is no agreement on the necessity of human control of automatic time coding (55-45). ECHO should provide for control and correction of the automatic transcript of speech. The metadata editor should provide the means to control and correct: automatically generated keywords for subject indexing, e.g. geographical, people, affilliation, event and topic of the film as a whole. The metadata editor should provide the means to add subject indexing and annotations to specific scenes (readable time-aligned with storyboard). Moreover, it seems desirable to be able to annotate specific scenes with personal remarks, especially for usage E: total: 61% Yes 2x , E: 71% Yes 2x. 71% are in favor of full-text indexing of transcript of speech. There is a strong belief in the usefulness of t.o.speech in combination with manual annotation. The transcript of speech should be of a rather high quality (64% Yes, 18% No; E: 54% Yes 2x, 21% No) rather than in a degraded form (58% Yes, 42% No; E: 54% Yes 2x, 29% No).
DE1.1 DE1.2 DE1.3
DE1.4
R9.2 not included
13 June 2000
59
Metadata
1.2.4. 1.3.3
All subquestions of 1.2.4 asked about the importance of metadata. In deciding on the metadata model these answers can be relevant input. It is not yet clear which metadata can be created automatically in ECHO. Most important are keywords on persons (VIPs and affilliation) (1.1.6.1) Also important are keywords on the objects in the film (1.1.6.2) Keywords on the environment seem a bit less important, but still rather desirable (1.1.6.3) 5.1.2: Not recently used: 59% Yes 2x; E: 69% Yes 2x 5.1.4: Alert on rareness, recentness, nostalgic: 53% Yes 2x; E: 62% Yes 2x Metadata on genre are mandatory (1.2.4.7) Also important are metadata on the abstract subject of the film (2.2.8) Metadata to select typical or untypical scenes seem less important (2.2.9) Metadata on technical quality seem very important The metadata on camera-systems and aspect-ratio seem less crucial (1.2.4.2 tot.) Metadata on black-and-white and color are desirable. Metadata on camera movement are more desirable than mandatory (1.2.4.3 tot.) In decreasing order of importance: zoom in/out pan - camera moves right or left The aesthetic quality seems unimportant for about 40% of the interviewees (1.2.4.4 with subquestions) In decreasing order of importance: colours - light framing brightness If the metadata on movement in general cannot be generated automatically, it seems unimportant for about 50% of the interviewees who answered No or n.a. Quantative analysis will be necessary because many answered Yes, optional (1.2.4.5 tot.) Metadata on actual movement seems important for 22% (1.2.4.6) Language of the film is an important metadata. Concerning Audio, the following seems important: the distinction between - voice over and original speech (2.2.10: 75% Yes 2x); - soundless fragments or not (1.3.1: 85% Yes 2x ); - source of the sound (1.3.2: 66% Yes 2x). - original soundtrack or not (1.3.3.3: 50% Yes 2x).
not included
13 June 2000
60
Research & retrieval3 Search with text Free, associative, natural language, concept query
Cat. 2 + 7.3.2/3 2.1.1, 2.2, C, D, E 2.2.1/2, 2.2.4, 3.1.4
7.3.1: open question on General expectations of ECHO. 2.2.7: Start a broad search and then refine: 40% yes 2x Interviewees have great interest in: - free text query box (59% (Yes 2x) prefer it over Query by Form). (2.1.1) - natural language search (69% Yes 2x; 87% Yes 3x) (2.2) - searching through all strata at once or through a selected stratum only (2.2.1/2) - concept searching (2.2.4) Marking highly relevant hits to use as a new query: 75% yes 2x Great interest in best match searching (74% Yes 2x), although 20% replied No. (3.1.4) Without proper natural language and concept searching it will be impossible to retrieve contradictory or similar citations of the same person. 74% Yes; Usage D: 15,4% Yes mandatory and 15% No 38,5%: desirable; 23,1% optional Literal search/Exact match is mandatory: 88% yes 2x 2.1: Structured query is expected: 78% Yes 2x. Query assistance in the form of index lookup-lists for a specific field/metadata is very important (95% yes). Excluding certain criteria (NOT) is mandatory (88% Yes 2x). (2.2.3) Distinction of national archive/source is very important: 83% yes 2x ; 79% yes 2x The most simple interface should contain filtering functionality (81% Yes 2x).
2.7.5 1.1.5.6
C, D, E D, E
I4 R1 R4 R1 R8.1 Pr1 not included
Exact matching Structured querying and filtering on metadata
2.2.5 2.1, 2.1.1/2, 2.2.3 2.3.5.3, 2.3.2 7.1.6
A, B, C, D, E A, B, C, D, E
A, B, C, D, E D, E C
R2 R3 not included R3 R3 R3
The utility of the digital film library can be judged by the ability of the users to get the information they need from the library easily and efficiently. Information retrieval is an increasingly complex process due to digital integration of video, audio, and text resources. The project will provide content-based searching and film-sequence retrieval. As the content is conveyed in both narrative (speech and language) and image forms, a collaborative interaction of image, speech and language technology will be adopted in order to search the diverse film collections with satisfactory recall and precision. Four speech recognisers (Italian, French, Dutch, and German) will be built and integrated into the system architecture.
13 June 2000
61
1.1.5.3, 1.3.1, 1.3.2, 2.2.3,
A, B, C, D, E
2.2.2 2.2.10 2.3.5.1 2.3.5.2, 1.1.6.1 1.1.6.2, 2.6 1.1.6.3 Browsing through database 2.3 (totally) C, D, E 2.6, 2.6.1, 7.1.5 2.8 (totally) C, D, E
Boolean filtering on metadata is mandatory, e.g: - filtering on language (65% Yes 2x; 1.1.5.3) - filtering on film fragments with or without sound, with or without speech (85,5% Yes 2x) - filtering on source of sound (66% Yes 2x) - excluding certain criteria (NOT) is mandatory (88% Yes 2x). (2.2.3). - distinction of stratum (74% Yes 2x) - Distinction of voice over / original speech (75% Yes 2x) - Distinction of period (99% Yes 2x) - Distinction of theme (96% yes 2x) - Distinction of VIPs (people) (87% yes 2x)\ - Distinction of object (70%; browse within a class of objects 79% yes 2x) - Distinction of environments (49% yes 2x; especially interesting for broadcasters and program makers) Large majority in favor of browsing in a certain selection of the database, answers to specific examples of browsing 75 99% yes 2x. 68% yes 2x in favor of browsing options in simple query interface; browse within a theme: 79% + 83% yes 2x ; 7.1.5: 69% Yes 2x. 2.8: 74% yes 2x Answers given: Scenes within a film, context surrounding the film, rest of the documentation about a film; A link must express a relation like "see also" between two objects (people, events, etc.); Links to geo-historical context; Conceptual relations between objects; Table of Contents; In pointing out relationship between objects/persons in different AV docs; The same event if described on video within different countries. searching with one known keyframe: 61% yes 2x searching with a sequence of keyframes: 55% yes 2x Cinema historians, besides a need for similarity search, expressed also a demand for methodologies and systems able to automatically detect particular features of video, improving non-manual analysis of the forms, and film language recognition (styles).
R3; details not included
R5 I4; R5
not included
Search with image
2.4 (totally) C, D, E
R6 R6
13 June 2000
62
Search with audio Cross-linguality Cross-language querying
2.5 (totally) C, D, E
searching with a known fragment of music: C,D,E: 46% yes 2x searching with a known fragment of speech: C,D,E: 54% yes 2x 70% yes 2x 76% yes 2x, For the work of 59% it is (very) important to be able to query a digital film library in multiple languages. 65% Yes 2x 27% mandatory; 53% desirable A large part of the interviewees indicated having difficulties in reading Dutch, German and Italian. CNR: " Users had laid special stress on multilingual capabilities They consider the translation of the transcript and metadata in the native language of users a chance improving archives exploitation. At the same time appreciation was expressed on the opportunity to have at their disposal the audiofile in the source language, enabling to verify the interpretation in detail." Original language of film description is unacceptable for 28%. Mandatory 9%. Film descriptions translated into query language in presentation of results: 20% mand., 32% desirable, 25% No. (3.1.1.8.1) If spoken language is not understandable, then film is ignored: 41% Yes 3x, 57% No. If spoken language is not understandable, then visual abstract or visual content will be viewed anyway: 77% Yes 2x Conclusion: visual content is often more important than audio content.
R7 R7 C1
1.1.5.1, 1.1.5.2, 7.3.2
A, B, C, D, E
Limit search to one or more 1.1.5.3(.1) languages Transcript of original 1.1.5.4 speech and metadata should be translated to native language
C, D, E C, D, E
R3 C2
3.1.6 3.1.1.8 (tot.)
C, D, E C, D, E
C3 C3
Presentation of search results: evaluating the retrieved content
Cat. 2.7, 3 +4 2.7.3, B, C,D,E 3.1.1.2, 3.1.4 3.2.2
relevancy per hit is expected by 55% yes 2x; relevance ranking / best match is expected 74% Yes 2x For most interviewees (26% mand., 47% desirable) this seems a logical order: first view the keyframes in context, next the rest of the storyboard and then start browse copy 63
Pr1 Pr1 not incl. S2
13 June 2000
System feedback
2.7.1, 2.2.6 C, D, E 2.7.2
76% yes 2x would like the system to repeat the query with a fuzzy search in case of R8.2 no hits. Suggestions for new search terms: 67% yes 2x R8.1
A Document viewing A1 Presentation metadata per document Short presentation per hit 3.1.1 (totally) 3.1.1.1
C, D, E B, C, D, E A, B, C, D, E 83% Yes 2x. Should contain source of film (3.1.1.5): 67% Yes 2x. Other important metadata will be decided upon in WP 4 because the answers are too diverse. 3.1.1.6 Answers given: title, nr. of hits, owner of rights, broadcaster, date, origin, quality, availability, costs, year of production, producer, language, color/B&W, length, person, geographic location, abstract, genre. It is very desirable to be able to open the full description by clicking on the titlehyperlink: 59% desirable, 71% Yes 2x. (3.2.5) Only 13% are not prepared to wait; 81% Yes 3x. Seconds mentioned vary from 5 10 30 50 60. One answered: depends on how important the question is for me. 10% expect less than 10; 50% expect 10; 30% expect 15-20; 10% expect 25-30 hits per screen. Resorting the hitlist seems very important to all: 95% Yes 2x, 82% Yes 2x. Very desirable. 3.1.1.7: 53% (19% mandatory, so 72% Yes 2x), 3.1.5: 56% (24% mand., so 80% Yes 2x). Change presentation settings per query: 51% mandatory. 80% Yes 2x. 91% Yes 2x A textual abstract is seen as very useful: 86% Yes 2x, but it does not need to be part of the short presentation (62% want to read/see it on demand). It would be best if the abstract is properly formulated (80% Yes 2x), 48% are against degraded text. Note: On the other hand, how experienced are the interviewees with reading degraded text, and do we have budgets for manually constructed abstracts? Almost everyone would like the abstract in their own language (75% Yes 2x), so online translation is welcome.. Pr1 not included
Waiting for search result list 3.1.7/.1 Minimum number of hits 3.1.1.4 per screen Resort hitlist Decide personally on short presentation - for printing A2 Textual abstract 3.1.1.3 3.1.1.7, 3.1.5(.2) 3.3.3 3.1.3 (tot.) A, B A, B, D, E D, E D, E C, D, E
Pr3 Pr2.1 Pr2.3 Pr2.2 not included
C2
13 June 2000
64
Construction manually or automatically
0.5.1 3.1.3.2/.1
A, C, D, E C, D, E
A3 Visual abstract
0.3, 0.4, 1.2.1.1, 3.1.2.1, 4.1.5 1.2.1.2 1.2.1.5
specifications on Visual abstract
D, E
A4 Browse copy
1.2.2.1 3.1.2.2 4.1.7, 4.1.8
C, D, E
64% of the interviewed documentalists (=7) find a manually constructed abstract necessary, 36% don't. It is preferred that the abstract is properly formulated (80% Yes 2x), 48% are against degraded text. 3.1.2.1: 21% want to see the visual abstract immediately with the short presentation, 77% want to see the visual abstract on demand when asking for the large presentation. 4.1.5: Most interviewees would like to export the visual abstract to office software (64%). Change the length of the visual abstract yourself D: 23% Yes 2x E: 61% Yes 2x Audio track included with v. abstract D: 46% Yes 2x E: 79% Yes 2x The visual abstract should summarise: - the semantic content of the full film D: 85% Yes 2x E: 100% Yes 2x It is desirable that the visual abstract: - concentrates on the mood of the film D: 46% Yes 2x E: 38% Yes 2x - concentrates on people D: 46% Yes 2x E: 58% Yes 2x - concentrates on text in film D: 38% Yes 2x E: 41% Yes 2x V. abstract should keep chronology of film: D: 92% Yes 2x E: 88% Yes 2x A browse copy is very important: D: 92% Yes 2x, E: 86% Yes 2x.
not included
Pr2.1
Ru1.2 Va1 Va2 Va3 #sema ntic content Va3
Preference for seeing the first keyframe on demand: 80%. Pr2 Exporting browse copy is very desirable (35 answers): 48% to office software, 20% Ru1.4 to editing suite, 17% to presentation software, 14% to personal project folder. If interviewees want to export parts of the browse copy, they prefer office software / Exporting parts of the browse copy should be possible (33 answers): 45% to office software, 18% to editing suite/ presentation software/ personal project folder. Export the browse copy without audio track, but with time-aligned transcript of Ru1 speech (4.2): doesn't seem very necessary for everyone: 26,5% optional; 57% No or n.a., D: 20% Yes 2x, 30% optional; E: 20% Yes 2x, 36% optional.
4.2
13 June 2000
65
specifications on Browse copy
1.2.2.3 1.2.2.4 3.2.6 (totally)
C, D, E
D, E C, D, E C, D, E
Hear the original speech and 1.1.5.5 at the same time see the time-aligned transcript of speech with the browse copy. 3.1.2.4
1.2.2.3: sensitive parsing of keyframes seems important (Note: this was an open question!): 70% Yes 2x. The audio track should be included in the browse copy (68% Yes 2x; D: 58% Yes 2x, E: 73% Yes 2x) Including/excluding sound is desirable: 43% des., 24% optional. Manipulation of film (back, forward, fast forward, zoom, freeze/standstill) is very important: 38% mand., 41% desirable. To hear the original speech and at the same time see the time-aligned transcript of speech with the video is not equally important for C, D and E: C: 14% mand., 43% desirable; D: 23% mand. , 61% desir.; E: 29% mand., 50% desir. Preference to see the transcript of speech on demand together with: - large presentation 53% - storyboard 28% - browse copy 19% Note: it seems as if there is some confusion about the terms. The storyboard should be on demand (79%) Exporting the storyboard: 73% to office software, 13% to presentation software, 13% to personal project folders. Change the default length of storyboard yourself D: 62% desir. E: 38% mand., 50% des. Zoom in on storyboard D: 39% mand. 62% desir. E: 30% mand., 61% des. Storyboard should: - represent the semantic content of the full film - represent the mood of the film - concentrate on people It is desirable that the storyboard: - represents objects in the film
Bc2 not included Bc1 Bc2.1
Pr2.1
A5 Storyboard
3.1.2.3, 4.1.6
D, E
S1 Ru1.3 S3 S3
specifications on Storyboard 1.2.3.1 1.2.3.3
D, E
S4 D: 85% Yes 2x E: 87% Yes 2x D: 77% Yes 2x E: 52% Yes 2x D: 62% Yes 2x E: 68% Yes 2x D: 46% Yes 2x D: 67% Yes 2x E: 54% Yes 2x E: 83% Yes 2x 66 not included S2
1.2.4.1.2
D, E
13 June 2000
See storyboards in context of the query
A6 Audio, speech details
3.2.3 3.2.4 4.1.3
C, D, E
4.1.4
3.1.2.4, C, D, E 3.3.4, 4.1.2 B Cross document viewing (per search result) B1 Chronological view B2 Geographical view B3 Personality view B4 Event/subject view B5 Combination of those views Reuse of content 3.2.1 (tot.) 2.7.4 3.2.1.1 3.2.1.2 3.2.1.3 3.2.1.4 3.2.1.5 D, E4 D, E D, E D, E D, E D, E
Listening to the audio without the images is mandatory for 19% and desir. for 34%. Viewing the transcript while listening to audio track is mandatory for 13% and desir. for 36%. Those who would want to export the speech track (28 answers): 43% to office s., 28% to editing suite, 18% to presentation s., 10% to personal project folder. Those who would want to export the audio track (29 answers): 45% to office s., 27% to editing suite, 17% to presentation s., 10% to personal project folder. Those who would want to export the transcript of speech (35 answers): 57% to office s., 14% to editing suite, 17% to presentation s., 11% to personal project folder. Subject clustering of search result: 67% Yes 2x 78% Yes 2x 52% Yes 2x 57% Yes 2x 66% Yes 2x Answers given: Time, events, personality; Personality/time (location); Events/time (location), Time, geographic; Time. Export to / Reuse in office software is most popular. N.B.: Export to "personal project folder" is only answered by 8 NAA-interviewees (very different user types) and 1 documentalist from a Swiss broadcasting company. Most interviewees want to be able to export (a selection of) the textual description. (51% to Office software). Downloading the browse copy is very important: E: 75% Yes 2x, E: 67% Yes 2x
Bc2 Bc2.1 Ru1.5
Ru1.5
Ru1.6
Cdv1 Cdv2 Cdv4 Cdv3 Cdv1 Cdv5
4.1 (totally) E
Ru2
4.1.1 4.3.3, 4.3.7 E
Ru1.1 Ru1.4
The results may indicate that a specific view is more relevant to D than to E.
13 June 2000
67
Tools for retracing relevant content

Shopping cart Virtual collection or project folder Bookmarks Create an editing decision list
4.3 (tot.) 4.3.1 4.3.2, 4.3.2.1 4.3.4 4.3.5 Cat. 5 + 7
D, E D, E D, E D, E E C, D, E6
These tools seem indeed mandatory or desirable for the interviewees of whom usage D and E is expected. E: 76% Yes 2x E: 77% Yes 2x E: 81% Yes 2x E: 67% Yes 2x
R9 A5.1 R9.1 R9.2 Ru2.1
Billing, account & user administration 5 Access control
7.2 (totally) A, B, C, D, E
Copyright administration
5.1.1, 5.1.3, 5.3 (tot.) 5.2.1 5.2.2 5.2.3 5.2
B, C, D, E D, E
Billing mechanisms
C, D, E
User groups for ECHO
3.3.1, 3.3.2 E 7.3.4 C, D, E 7.3.4.1 7.3.4.2
A login procedure for internal and for external users will be necessary to control the rights and accounts. For the current catalogues of the national archives this is not always the case; mostly online public catalogues are accessible without a password. Alert on copyright: 94% Yes 2x; E: 96% Yes 2x Indication if material is not for reuse: 92% Yes 2x; E: 92% Yes 2x The majority want to see the transmission rights, re-use rights, image copyrights, literary copyrights, music rights and exploitation rights in ECHO. Willing to pay per view: 54% No, 23% Yes 2x. Willing to subscribe: 15% No, 58% Yes 2x Price differentiation for different service levels: 16% No, 54% Yes 2x Answers to open question (5.2): Indication of costs and usage during the session. Try to avoid paperwork. Creditcard payment. One place for every transaction. Billing by email. Special prices for subscribers. An order form for a copy of the original film is necessary: 83% Yes 2x; 74% Yes2x A lot of interviewees would like to join an ECHO user group: 40% Yes 2x, 22% No for a special theme: 91% Yes 2x for a specific profession: 77% Yes 2x
A2 A3 A4 A5 A5.1
not included
5 6
At the end of the project each Archive partner will be able to set up a commercial activity providing Web-based access to its collection. Depending on the agreements for pricing mechanisms, this issue is important for every potential ECHO user, but especially for marketing & sales manager's + product developers. So here we will also look at the specific user types.
13 June 2000
68
Relation between ECHO and the outside world
7.3.5 7.3.5.1 7.3.5.2 7.3.5.3
D, E - alert on relevant content from content providers that is not in ECHO: 71% Yes 2x I6 I7 - search traditional catalogues of ECHO content providers: 74% Yes 2x I7.1 - search in multiple archives:72% Yes 2x in one country: 76% Yes 2x ; in more countries: 88% Yes 2x ; in different languages: 77% Yes 2x A, B, C, D, E
Interface in general Graphical appearance of interface in general
7.1.8 (tot.) 7.1.8.1 7.1.8.2 7.1.8.3 7.1.8.4 7.1.8.5 7.1.8.5.1 7.1.8.5.2 7.1.8.6 7.1.8.7
- different colours for diff. concept interface areas: 65% (very) imp., 5% annoy. - blinking parts of the screen: 24% (very) important, 44% annoying - visual clues / graphics for different actions: 39% (very) important, 20% annoying
I1
- audio feedback: 24% (very) important, 30% annoying - consistency with well-known applications: 67% (very) important, 12% annoying - toolbar icons from MS Office: 55% (very) important, 14% annoying - fancy graphics for special tasks and operations: 28% (very) imp., 15% annoy. - animated clues: 24% (very) important, 29% annoying - icons asking for understanding the reaction time needed for building up the interface: 54% (very) important, 23% annoying D, E A, B, D, E A, B, C, D, E Save general personal presentation preferences: 48% mandatory! 78% Yes 2x. 79% Yes 2x Many interviewees indicated having difficulties in reading Dutch, German and Italian. 79% Yes 2x 60% Yes 2x 73% Yes 2x 72% Yes 2x 68% Yes 2x 81% Yes 2x 69
I2
Save personal presentation preferences other personal preferences

Query interface must be in: native language English language of choice
3.1.5.1 7.1.7 7.1.1 7.1.2 7.1.3
I5 I5 I3
Simple query interface with only a free text box with browsing options with filtering functionality
I4 7.1.4 7.1.5 7.1.6 C C C

13 June 2000
Appendix 6: Types of usage of ECHO linked to interviewees

Interviewees related to types of usage (results of discussion in Hilversum, combined with the input of Laurent Vinet, INA, and of Johan Oomen, NAA) Each type of usage refers to a specific goal for which people might want to use ECHO. The five types of usage that are identified each have specific consequences for the system building of ECHO, technically speaking. Consequences for the metadata model are not taken into account. Type of usage
Database construction A Data entry for offline 3 archiving
Short explanation
Special demands1
!"Special display of the content and of the metadata !"Metadata editor !"Thesaurus building and management
Interviewee ID2
I01, I06, I08 IL01, IL10 M01, M04, M05, M07 N01, N02, N20
Items of special demands mentioned here are based on the first analysis of the interviewees per ECHO partner. The final overview might change as a result of further analysis of the questionnaires. 2 Indication of expected usage of ECHO by the ECHO partners' contact persons, on the basis of their function and user type. 3 Data entry for "real time"archiving, such that editing metadata while the encoded video is streaming in can be a possible future usage of ECHO. Although it wasn't appropriate to ask the interviewees for this, it is still a point of interest for the future owners of ECHO and can therefore influence the user requirements list.
70
Type of usage
Database consultation B Retrieval for reference
Short explanation
Structured consultation of database to check on a specific item within the catalogue description. No need to view the content. Non-professional consultation of database with viewing of content. No need for reuse. Professional consultation of database, with interest in full content (images, and speech). Reuse of browse copy.
Special demands4
!"Query by form for direct, structured and monolingual searching.
Interviewee ID5
I01, I03, I10,I11, I12, 6 [I15] M09 N02, N05, N07, N12, N13, N18
C Retrieval and viewing the content for general public (schools, museums, internet)
D Professional retrieval and viewing the content for scientific study (history or film science)
!"Simple query interface for free text, crosslingual, conceptual and fuzzy searching. !"Browsing through database by theme. !"Straight forward display of content (document viewing). !"Advanced query interface for free text, crosslingual, conceptual and fuzzy searching plus filtering on specific issues. !"Browsing through database by theme. !"Cross document viewing. !"Personal settings of interface, presentation, annotations and collections. !"Advanced display of content (in context and with personal annotations) !"Downloading the browse copy => account/user administration plus rights administration; if billing, then not "pay per view". !"Connection with the catalogues of the national archives of the ECHO partners and other archives.
IL02, IL07 N10, N14, N19, N16, N17
C01, C03, C04, C05 [I01], I06, I07, I09, [I10], I13, I15 IL06 M08, M10 N15
Items of special demands mentioned here are based on the first analysis of the interviewees per ECHO partner. The final overview might change as a result of further analysis of the questionnaires. 5 Indication of expected usage of ECHO by the ECHO partners' contact persons, on the basis of their function and user type.
6
Although some interviewees could like to use ECHO for different types of usage, for the purposes of analysis their answers to the questionnaire are only considered for one type of usage per interviewee. Of course, the interviewees that will do data entry in ECHO are also likely to use ECHO in another way (type of usage B, C, D or E). 13 June 2000
71
Type of usage
E Professional retrieval, viewing and (non-)profit reuse of the content: public and commercial broadcasting, historical study, teaching etc.
Short explanation
Professional consultation of database with main interest in visual content. Reuse of browse copy and/or original material.
Special demands4
!"Advanced query interface for free text, crosslingual, conceptual and fuzzy searching plus filtering on specific issues. !"Browsing through database by theme. !"Cross document viewing. !"Advanced display of content (in context and with personal annotations) !"Personal settings of interface, presentation, annotations and collections. !"Downloading parts of the browse copy => account & billing administration / rights administration. !"Tools for making an Editing Decision List and ordering a copy of the original material. (technical info) !"Connection with the catalogues of the national archives of the ECHO partners and other archives. !"Tools for constructing a new video in browse quality with the selected sequences. (extra supply)
Interviewee ID5
I02, I04, I05, [I09], I14 IL01, IL04, IL08, IL09, IL10 M01, M02, M03, M04, M05, M07, M11 N01, N08, N09, N11, N20
E+ Teachers (a special group within category E)
One extra demand:
C02, IL03, IL05, M06
13 June 2000
72
Appendix 7: Number of interviewees related to type of usage

Number of interviewees related to type of usage
25 25
20 13
15 Number of interviewees 10
12
12
0 1 Type of usage A Data entry for archiving B Reference searching C Retrieval and viewing the content for general public D Professional retrieval and viewing the content for scientific study (history or film science) E Professional retrieval, viewing and (non-)profit reuse of the content
13 June 2000
73
Appendix 8: Usage A - data entry for archiving

This appendix presents the user requirements that are relevant for type of usage A: cataloguing and data entry management. The complete user requirements list of ECHO is presented in Chapter 3. Data entry management 1 ECHO should have a cataloguing environment, or metadata editor, in order to provide the documentalists with the opportunity to control, correct and index all formats of the content as well as the complete catalogue description. ECHO should provide an environment for control and correction of the automatic scene detection. ECHO should provide an environment for control and correction of the automatic transcript of speech. ECHO should provide a precataloguing aid, like automatic keyword extraction. ECHO should provide the means to add keywords or annotations on the program level as well as on sequence or shot levels. The ECHO cataloguing environment should facilitate offline as well as realtime cataloguing. The existing thesaurus modules of the national archives should be connected to the ECHO cataloguing environment as well as to the query interface. It should be possible to link automatically extracted keywords to a national thesaurus.
1.1 1.2 1.3 1.4 1.5 2 2.1
Interface and related databases 1 2 3 4 Use of colour is important to distinguish between different concept areas on the graphical interface. The graphical interface should be as consistent with well-known applications as possible. E.g. icons used in MS-Office. ECHO should provide a choice of language for the query interface. ECHO should provide for the possibility of saving and changing personal preferences concerning the interface and the presentation of search results.
Administration 1 2 A login procedure for internal and for external users should look after the control of the read and write rights and accounts. The administration of ECHO should comprise information on copyrights and licenses, e.g. transmission rights, re-use rights, image copyrights, literary copyrights, music rights, exploitation rights and license period.
13 June 2000
74
Cross-linguality 1 2 A query in language X should find catalogue descriptions in language X, Y and Z. Presentation of the search results, i.e. catalogue descriptions as well as the textual abstract and the transcript of speech, should be done in the same language as the query.1
Retrieval 1 2 3 ECHO should provide for the possibility of literal searching or exact matching. ECHO should provide for the possibility of structured searching, Boolean filters and exclusion. ECHO should be able to prolong the searching process by searching within the first result set.
Presentation of search results 1 2 The first presentation of search results should be a list presentation in decreasing order of relevance. ECHO should provide for the possibility of personally deciding on the items of the catalogue description and other ECHO items (e.g. the first keyframe of the storyboard, the storyboard itself, the transcript of speech or the visual abstract) that should be presented in the list presentation on the screen or that should be printed. After a Boolean structured search, ECHO should provide for the possibility of resorting the hitlist in a different order than relevancy.
Reuse of content 1 ECHO should provide for the possibility of exporting specific parts separately, namely: (part of) the catalogue description
This requirement as a whole is a long-term requirement because the techniques concerned are still in the domain of research. In the future, online translation of nouns from the textual abstract or from the transcript of speech might become feasible. Translation of those parts of the catalogue description that consist of controlled vocabulary, e.g. the genre attribute, is feasible within the timeframe of the ECHO project.
13 June 2000
75
Appendix 9: Usage B - retrieval for reference searching This appendix presents the user requirements that are relevant for type of usage B: retrieval for reference searching, without interest in viewing the content. The complete user requirements list of ECHO is presented in Chapter 3. Data entry management 1 The existing thesaurus modules of the national archives should be connected to the ECHO cataloguing environment as well as to the query interface.
Interface and related databases 1 2 3 4 Use of colour is important to distinguish between different concept areas on the graphical interface. The graphical interface should be as consistent with well-known applications as possible. E.g. icons used in MS-Office. ECHO should provide a choice of language for the query interface. ECHO should provide for the possibility of saving and changing personal preferences concerning the interface and the presentation of search results.
Administration 1 2 3 A login procedure for internal and for external users should look after the control of the read and write rights and accounts. ECHO should always indicate if the material is copyrighted. The administration of ECHO should comprise information on copyrights and licenses, e.g. transmission rights, re-use rights, image copyrights, literary copyrights, music rights, exploitation rights and license period.
Cross-linguality 1 2 A query in language X should find catalogue descriptions in language X, Y and Z. Presentation of the search results, i.e. catalogue descriptions as well as the textual abstract and the transcript of speech, should be done in the same language as the query.1
Retrieval 1 2 3 ECHO should provide for the possibility of literal searching or exact matching. ECHO should provide for the possibility of structured searching, Boolean filters and exclusion. ECHO should be able to prolong the searching process by searching within the first result set.
This requirement as a whole is a long-term requirement because the techniques concerned are still in the domain of research. In the future, online translation of nouns from the textual abstract or from the transcript of speech might become feasible. Translation of those parts of the catalogue description that consist of controlled vocabulary, e.g. the genre attribute, is feasible within the timeframe of the ECHO project. 13 June 2000
76
Presentation of search results 1 2 The first presentation of search results should be a list presentation in decreasing order of relevance. ECHO should provide for the possibility of personally deciding on the items of the catalogue description and other ECHO items (e.g. the first keyframe of the storyboard, the storyboard itself, the transcript of speech or the visual abstract) that should be presented in the list presentation on the screen or that should be printed. After a Boolean structured search, ECHO should provide for the possibility of resorting the hitlist in a different order than relevancy.
Reuse of content 1 ECHO should provide for the possibility of exporting specific parts separately, namely: (part of) the catalogue description.
13 June 2000
77
Appendix 10: Usage C: retrieval and viewing the content for general public This appendix presents the user requirements that are relevant for type of usage C: retrieval and viewing the content for the general public. The complete user requirements list of ECHO is presented in Chapter 3.
Interface and related databases 1 2 3 4 Use of colour is important to distinguish between different concept areas on the graphical interface. The graphical interface should be as consistent with well-known applications as possible. E.g. icons used in MS-Office. ECHO should provide a choice of language for the query interface. The ECHO query interface should contain a simple query interface with just a free text box and some filters, plus categories to browse within a theme.
Administration 1 A login procedure for internal and for external users should look after the control of the read and write rights and accounts. 2 ECHO should always indicate if the material is copyrighted. 3 The administration of ECHO should comprise information on copyrights and licenses, e.g. transmission rights, re-use rights, image copyrights, literary copyrights, music rights, exploitation rights and license period. 4 The accounting mechanism of ECHO should be based on subscription. 4.1 Price differentiation for different service levels (e.g. catalogue description, transcript of speech, visual abstract, browse copy, copy of original material) is expected. Cross-linguality 1 2 3 A query in language X should find catalogue descriptions in language X, Y and Z. Presentation of the search results, i.e. catalogue descriptions as well as the textual abstract and the transcript of speech, should be done in the same language as the query.1 The original texts should be presented on demand.
Retrieval 1 2 3 4 5 ECHO should provide tools for natural language and concept searching. ECHO should provide for the possibility of literal searching or exact matching. ECHO should provide for the possibility of structured searching, Boolean filters and exclusion. ECHO should provide a combination of free text and structured searching. ECHO should provide the opportunity of browsing through the database by theme or by class of object, on the basis of manually added metadata.
This requirement as a whole is a long term requirement because the techniques concerned are still in the domain of research. In the future, online translation of nouns from the textual abstract or from the transcript of speech might become feasible. Translation of those parts of the catalogue description that consist of controlled vocabulary, e.g. the genre attribute, is feasible within the timeframe of the ECHO project. 13 June 2000
78
ECHO should provide similarity search on the visual content with one known keyframe or with a known sequence of still keyframes. 2 7 ECHO should provide similarity search with an audio fragment of speech.3 8 ECHO should be able to prolong the searching process by searching within the first result set. 8.1 The user should be able to pinpoint the subject of interest by marking relevant hits or by marking search terms suggested by ECHO and then start the next query. 8.2 The user should be able to let the system interpret the query in a fuzzy way, on demand. Presentation of search results 1 2 The first presentation of search results should be a list presentation in decreasing order of relevance. ECHO should provide for the possibility of resorting the hitlist in a different order than relevancy, after a Boolean structured search.
Visual abstract 1 2 The audio content should be included with the visual abstract. The visual abstract should summarise the semantic content of the full film, while preserving the chronological order.
Browse copy 1 ECHO should provide for as many manipulation functionality for the browse copy as possible (e.g. (fast) back, (fast) forward, zoom, freeze). 2 The audio content should be included with the browse copy. 2.1 It should be possible to see the transcript of speech time-aligned while viewing the browse copy.
It is not required that a moving sequence of keyframes could be used as a query. That can only be expected in the far future. 3 Long term requirement because the techniques concerned are still in the domain of research. The architecture of ECHO will enable integration of these software tools as soon as this content can be indexed.
13 June 2000
79
Appendix 11: Usage D - scientific study of the content This appendix presents the user requirements that are relevant for type of usage D: professional retrieval and viewing the content for scientific study, e.g. history or film science. The complete user requirements list of ECHO is presented in Chapter 3. Data entry management 1 The existing thesaurus modules of the national archives should be connected to the ECHO cataloguing environment as well as to the query interface.
Interface and related databases Use of colour is important to distinguish between different concept areas on the graphical interface. 2 The graphical interface should be as consistent with well-known applications as possible. E.g. icons used in MS-Office. 3 ECHO should provide a choice of language for the query interface. 4 The ECHO query interface should contain a simple query interface with just a free text box and some filters, plus categories to browse within a theme. 4.1 The ECHO query interface should also provide, on demand, a query form for structured searching on the most frequently used metadata in combination with the free text box 4.2 plus, on demand, additional metadata. 5 ECHO should provide for the possibility of saving and changing personal preferences concerning the interface and the presentation of search results. 6 ECHO should alert the user if there is additional content on the query subject at the cooperating national archives, which is not in the ECHO database itself.1 7 ECHO should provide for the possibility of searching the traditional catalogues of the ECHO content providers.2 7.1 ECHO should provide for the possibility of searching multiple archives of other institutions via the ECHO query interface.3 Administration 1 2 3 4 A login procedure for internal and for external users should look after the control of the read and write rights and accounts. ECHO should always indicate if the material is copyrighted. If part of the ECHO material is not for reuse, then this should be clearly indicated. The administration of ECHO should comprise information on copyrights and licenses, e.g. transmission rights, re-use rights, image copyrights, literary copyrights, music rights, exploitation rights and license period. 1
Long-term requirement because the techniques concerned are still in the domain of research or too complex to be realised within the timeframe of the ECHO project. 2 Long-term requirement because the techniques concerned are too complex to be realised within the timeframe of the ECHO project. Although any possibility, like presenting the links to the websites of the national archives, will be welcome. 3 Long-term requirement because the techniques concerned are too complex to be realised within the timeframe of the ECHO project. Although any possibility, like presenting the links to the websites of the national archives, will be welcome. Originator: NAA Version 1 13 June 2000
80
5 The accounting mechanism of ECHO should be based on subscription. 5.1 Price differentiation for different service levels (e.g. catalogue description, transcript of speech, visual abstract, browse copy, copy of original material) is expected.
Cross-linguality 1 2 3 A query in language X should find catalogue descriptions in language X, Y and Z. Presentation of the search results, i.e. catalogue descriptions as well as the textual abstract and the transcript of speech, should be done in the same language as the query. 4 The original texts should be presented on demand.
Retrieval 1 2 3 4 5 6 7 8 8.1 8.2 9 9.1 9.2 ECHO should provide tools for natural language and concept searching. ECHO should provide for the possibility of literal searching or exact matching. ECHO should provide for the possibility of structured searching, Boolean filters and exclusion. ECHO should provide a combination of free text and structured searching. ECHO should provide for the opportunity of browsing through the database by theme or by class of object on the basis of manually added metadata. ECHO should provide similarity search on the visual content with one known keyframe or with a known sequence of still keyframes. 5 ECHO should provide similarity search with an audio fragment of speech. 6 ECHO should be able to prolong the searching process by searching within the first result set. The user should be able to pinpoint the subject of interest by marking relevant hits or by marking search terms suggested by ECHO and then starting the next query. The user should be able to let the system interpret the query in a fuzzy way, on demand. ECHO should provide for specific tools to retrace content that was retrieved earlier. ECHO should provide for the possibility of creating a virtual collection or project folder with a selection of ECHO material. ECHO should provide for the possibility of creating bookmarks to specific parts (e.g. keyframe in storyboard or browse copy of program) of the ECHO content.7
This requirement as a whole is a long-term requirement because the techniques concerned are still in the domain of research. In the future, online translation of nouns from the textual abstract or from the transcript of speech might become feasible. Translation of those parts of the catalogue description that consist of controlled vocabulary, e.g. the genre attribute, is feasible within the timeframe of the ECHO project. 5 It is not required that a moving sequence of keyframes could be used as a query. That can only be expected in the far future. 6 Long-term requirement because the techniques concerned are still in the domain of research. The architecture of ECHO will enable integration of these software tools as soon as this content can be indexed. 7 According to the interviewees that would like to use ECHO according to usage D or E, the possibility of adding personal annotations to (parts of) the storyboard is very important. However, this requirement is left out of the user requirements list because it is undesirable that end-users edit the ECHO metadata. However, known users are free to name bookmarks with or without any comment. Originator: NAA Version 1 13 June 2000
81
Presentation of search results 1 The first presentation of search results should be a list presentation in decreasing order of relevance. 2 ECHO should provide for the possibility of personally deciding on the items of the catalogue description and other ECHO items (e.g. the first keyframe of the storyboard, the storyboard itself, the transcript of speech or the visual abstract) that should be presented in the list presentation on the screen or that should be printed. 2.1 These preferences should be either saved as personal preferences or just used for the actual session. 3 After a Boolean structured search, ECHO should provide for the possibility of resorting the hitlist in a different order than relevancy. Visual abstract 1 2 3 It should be possible for a user to change the length of the visual abstract himself/herself. The audio content should be included with the visual abstract. The visual abstract should summarise the semantic content of the full film, while preserving the chronological order.
Browse copy 1 ECHO should provide for as many manipulation functionality for the browse copy as possible (e.g. (fast) back, (fast) forward, zoom, freeze). 2 The audio content should be included with the browse copy. 2.1 It should be possible to see the transcript of speech time-aligned while viewing the browse copy. Storyboard 1 2 3 4 The storyboard should be shown on demand. On demand, it should be possible that only the query-related keyframes of the storyboard are presented. It should be possible for a user to ask for the keyframes surrounding the query-related keyframes, as a next step towards the viewing of the whole storyboard. The storyboard should represent the pictorial content of the full film, on demand together with some metadata or text of the transcript of speech.
Cross document viewing 1 2 3 4 5 ECHO should provide for subject clustering of the search result. ECHO should provide for a chronological view of the search result. ECHO should provide for a personality view of the search result. ECHO should provide for a geographical view of the search result. ECHO should provide for combinations of the possible views of the search result, on demand.
13 June 2000
82
Reuse of content 1 ECHO should provide for the possibility of exporting specific parts separately, namely: 1.1 (part of) the catalogue description 1.2 the visual abstract 1.3 (part of) the storyboard 1.4 (part of) the browse copy 1.5 the audio (speech or music separately) 1.6 the transcript of speech 1.7 a specific view on a specific search result.
13 June 2000
83
Appendix 12: Usage E - reuse of the content This appendix presents the user requirements that are relevant for type of usage E: professional retrieval, viewing and (non)profit reuse of the content for teaching, broadcasting or production of new AV products. The complete user requirements list of ECHO is presented in Chapter 3. Interface and related databases Use of colour is important to distinguish between different concept areas on the graphical interface. 2 The graphical interface should be as consistent with well-known applications as possible. E.g. icons used in MS-Office. 3 ECHO should provide a choice of language for the query interface. 4 The ECHO query interface should contain a simple query interface with just a free text box and some filters, plus categories to browse within a theme. 4.1 The ECHO query interface should also provide, on demand, a query form for structured searching on the most frequently used metadata in combination with the free text box 4.2 plus, on demand, additional metadata. 5 ECHO should provide for the possibility of saving and changing personal preferences concerning the interface and the presentation of search results. 6 ECHO should alert the user if there is additional content on the query subject at the cooperating national archives, that is not in the ECHO database itself.1 7 ECHO should provide for the possibility of searching the traditional catalogues of the ECHO content providers.2 7.1 ECHO should provide for the possibility of searching multiple archives of other institutions via the ECHO query interface.3 Administration ECHO will have pricing and billing mechanisms in order to take care of access control, authentication, privacy, and accounting. 1 2 3 4 A login procedure for internal and for external users should look after the control of the read and write rights and accounts. ECHO should always indicate if the material is copyrighted. If part of the ECHO material is not for reuse, then this should be clearly indicated. The administration of ECHO should comprise information on copyrights and licenses, e.g. transmission rights, re-use rights, image copyrights, literary copyrights, music rights, exploitation rights and license period. The accounting mechanism of ECHO should be based on subscription. 1
Long-term requirement because the techniques concerned are still in the domain of research or too complex to be realised within the timeframe of the ECHO project. 2 Long-term requirement because the techniques concerned are too complex to be realised within the timeframe of the ECHO project. Although any possibility, like presenting the links to the websites of the national archives, will be welcome. 3 Long-term requirement because the techniques concerned are too complex to be realised within the timeframe of the ECHO project. Although any possibility, like presenting the links to the websites of the national archives, will be welcome. Originator: NAA Version 1 13 June 2000
84
5.1
Price differentiation for different service levels (e.g. catalogue description, transcript of speech, visual abstract, browse copy, copy of original material) is expected.
Cross-linguality 1 2 3 A query in language X should find catalogue descriptions in language X, Y and Z. Presentation of the search results, i.e. catalogue descriptions as well as the textual abstract and the transcript of speech, should be done in the same language as the query. 4 The original texts should be presented on demand.
Retrieval 1 2 3 4 5 6 7 8 8.1 8.2 9 9.1 9.2 ECHO should provide tools for natural language and concept searching. ECHO should provide for the possibility of literal searching or exact matching. ECHO should provide for the possibility of structured searching, Boolean filters and exclusion. ECHO should provide a combination of free text and structured searching. ECHO should provide for the opportunity of browsing through the database by theme or by class of object on the basis of manually added metadata. ECHO should provide similarity search on the visual content with one known keyframe or with a known sequence of still keyframes. 5 ECHO should provide similarity search with an audio fragment of speech. 6 ECHO should be able to prolong the searching process by searching within the first result set. The user should be able to pinpoint the subject of interest by marking relevant hits or by marking search terms suggested by ECHO and then starting the next query. The user should be able to let the system interpret the query in a fuzzy way, on demand. ECHO should provide for specific tools to retrace content that was retrieved earlier. ECHO should provide for the possibility of creating a virtual collection or project folder with a selection of ECHO material. ECHO should provide for the possibility of creating bookmarks to specific parts (e.g. keyframe in storyboard or browse copy of program) of the ECHO content.7
This requirement as a whole is a long-term requirement because the techniques concerned are still in the domain of research. In the future, online translation of nouns from the textual abstract or from the transcript of speech might become feasible. Translation of those parts of the catalogue description that consist of controlled vocabulary, e.g. the genre attribute, is feasible within the timeframe of the ECHO project. 5 It is not required that a moving sequence of keyframes could be used as a query. That can only be expected in the far future. 6 Long-term requirement because the techniques concerned are still in the domain of research. The architecture of ECHO will enable integration of these software tools as soon as this content can be indexed. 7 According to the interviewees that would like to use ECHO according to usage D or E, the possibility of adding personal annotations to (parts of) the storyboard is very important. However, this requirement is left out of the user requirements list because it is undesirable that end-users edit the ECHO metadata. However, known users are free to name bookmarks with or without any comment. Originator: NAA Version 1 13 June 2000
85
Presentation of search results 1 The first presentation of search results should be a list presentation in decreasing order of relevance. 2 ECHO should provide for the possibility of personally deciding on the items of the catalogue description and other ECHO items (e.g. the first keyframe of the storyboard, the storyboard itself, the transcript of speech or the visual abstract) that should be presented in the list presentation on the screen or that should be printed. 2.1 These preferences should be either saved as personal preferences or just used for the actual session. 3 After a Boolean structured search, ECHO should provide for the possibility of resorting the hitlist in a different order than relevancy. Visual abstract 1 2 3 It should be possible for a user to change the length of the visual abstract himself/herself. The audio content should be included with the visual abstract. The visual abstract should summarise the semantic content of the full film, while preserving the chronological order.
Browse copy 1 ECHO should provide for as many manipulation functionality for the browse copy as possible (e.g. (fast) back, (fast) forward, zoom, freeze). 2 The audio content should be included with the browse copy. 2.1 It should be possible to see the transcript of speech time-aligned while viewing the browse copy. Storyboard To have a quick overview of the visual content of a retrieved program and to be able to start the browse copy at any point, a storyboard will be made of each item in ECHO. 1 2 3 4 The storyboard should be shown on demand. On demand, it should be possible that only the query-related keyframes of the storyboard are presented. It should be possible for a user to ask for the keyframes surrounding the query-related keyframes, as a next step towards the viewing of the whole storyboard. The storyboard should represent the pictorial content of the full film, on demand together with some metadata or text of the transcript of speech.
Cross document viewing 1 2 3 4 5 ECHO should provide for subject clustering of the search result. ECHO should provide for a chronological view of the search result. ECHO should provide for a personality view of the search result. ECHO should provide for a geographical view of the search result. ECHO should provide for combinations of the possible views of the search result, on demand.
13 June 2000
86
Reuse of content 1 ECHO should provide for the possibility of exporing specific parts separately, namely: 1.1 (part of) the catalogue description 1.2 the visual abstract 1.3 (part of) the storyboard 1.4 (part of) the browse copy 1.5 the audio (speech or music separately) 1.6 the transcript of speech 1.7 a specific view on a specific search result 2 ECHO should provide for the possibility of exporting ECHO material in file formats that can be used in office or editing software, or in other software that is applicable. 2.1 ECHO should provide for tools to create an Editing Decision List on the basis of the Browse copy.
13 June 2000
87
Glossary
Annotation Freely formulated remarks on the subject, made by an individual and linked to a media object. Best match query Contrary to 'exact match query', the search terms that are typed in as a query don't have to be found exactly as they are in the database, nor do they all have to be found in the same document. So this way of searching gives a search result where the first hits are supposed to be the most relevant (the best match). >>> See also: Exact match query Bookmark An electronic marker placed on a page of the ECHO system to function as a pointer to that piece of information and retrace it quickly. Boolean searching Using so-called Boolean logic to formulate a query. The AND-operator is used to indicate that the search terms should be found in the collection. The OR-operator is used to indicate that not all of the search terms should be found within one object of the collection. Finally, the NOT-operator is used to exclude certain parts of the collection. Browse copy A copy of the original film material in low resolution, so that it is more easily handled by the computer(network). Captions / closed captions All textual information that appears on-screen, such as subtitles, signboards etc. Catalogue description Clean feed Concept search >>> See: Film description Original material, without logo's or subtitles. This makes it ideal for reuse. A search for the typed in search terms expanded with semantically and/or morphologically related terms that together form a concept rather than a single word. Content Summary term for text, graphics, images, video and audio. Content is subdivided into essence and metadata. >>> See also: Essence >>> See also: Metadata Cross-language query A query formulated in a certain language used to search the textual content of the film (film description, transcript and texts in the images) in other languages. This way the users of ECHO can find relevant film material
13 June 2000
88
irrespective of the original spoken language in the film. Cut Degraded text An instantaneous change from one shot to another. Morphologically and/or syntactically imperfect text produced using machine translation or information extraction techniques. Although the text is not perfect, it still retains much (if not all) of the semantic value. Dissolve A transition between two shots during which the first image gradually disappears while the second gradually appears. For a moment the two images blend in superimposition. Essence The content without the metadata. Essence can be audio, video, graphics or stills. Exact match query Only the documents that contain the exact words that you typed in the query box should be presented in the search result. Fade out A shot gradually darkens as the screen goes black. Occasionally fade- outs brighten to pure white or to a colour. Film description The textual description of the formal characteristics (e.g. title, producer, length) and of the subject (e.g. different kinds of keywords, annotation) of a film. Framing The use of the edges of the film frame to select and compose what will be visible on screen. Free text searching Full-text retrieval >>> See: Full-text retrieval Conducting a textual query, freely formulated in natural language or nouns only, in all the searchfields at once, including e.g. title, abstract, annotations, transcript of speech. Fuzzy search If you conduct a fuzzy search, the search terms of the query may vary morphologically or via spelling. E.g. a fuzzy search for Gorbatsjov will also present documents or films that contain words like Gorbatzow or Gorbatsjow. Geographical view Geographic references are automatically extracted from the video, audio and image content allowing visualisation of results that emphasise time and space perspectives. The interface spontaneously generates and displays the geographic entities addressed in a given story, highlighting the regions discussed at any point in the video through a map display synchronised with the video playback.
13 June 2000
89
Group search result
Grouping objects within a search result on their common content, on a specific characteristic (e.g. the topic assigned to it or the national archive it comes from). These parts of the search result can be graphically presented in separate folders.
Hypertext / Hyperlinks
A method to organise information in texts, images or sound in a nonlinear way. Hyperlinks are used to relate specific information within one document or object and they could be used to present an associative browsing path through a collection.
Interface
The interconnections that allow a device, a program, or a person to interact. Hardware interfaces are the cables that connect the device to its power source and to other devices. Software interfaces allow the program to communicate with other programs (such as the operating system), and user interfaces allow the user to communicate with the program (e.g., via mouse, menu commands, icons, voice commands, etc.).
Keyframe
Still images of video material derived by specific software on the basis of parameters like: shot transition or camera motion.
Keyword extraction
Extracting words that describe the subject of the film in one way or another from the spoken text. In ECHO, this is done on the basis of recognising people and objects in the film and from the texts that appear in the film, with the help of dictionaries and thesauri.
Literally search Literary copyrights
>>> See: Exact match query Copyrights concerned with printed literature, if there is a connection between a book and the film.
Media object
Digital data object containing essence plus metadata and being processable on a computer.
Metadata Mood Natural language search
Data describing other data (objects). Within ECHO: the colour, motion and intensity of a film. Conducting a query in a natural manner, using complete sentences in the query formulation, either by speech or by typing it.
Pan
A camera movement with the camera body turning to the right or left. On the screen, it produces a mobile framing which scans the space horizontally.
13 June 2000
90
Scene
A segment in a narrative film that takes place in one time and space or that uses crosscutting to show two or more simultaneous actions.
Semantic content
The content arising from the different meanings of words or other symbols.
Semantical network
A semantical network is a collection of related words and terms, with weights on how close the relationship is. This can be useful in searching for a specified meaning of a term (to avoid disambiguity) or in searching for synonyms only (like with a thesaurus).
Shot Similarity search
One uninterrupted image with a single static or mobile frame. There are three ways of conducting a similarity search: 1 searching with keyframes or a set of keyframes as a query for similar keyframes; 2 using an audio-fragment as a query for similar audio-fragments; 3 using a textual document as a query for similar texts.
Storyboard
The on-screen presentation of the keyframes of a film. In any case every first keyframe of a new scene and, for every detected scene, a number of keyframes.
Stratum (Information strata)
A stratum is a certain documentation level, so it forms a part of the metadata that belongs together. E.g. the manual annotation of the scenes, the transcript of a speech, the subtitles in a film, other texts appearing on screen in the film, the film description as a whole.
Structured searching Thesaurus
Conducting a query in one or more selected fields. A systematically ordered vocabulary consisting of keywords and the, mostly hierarchical, relations between them. Frequently used relations are: Broader Term, Narrower Term, Synonym, Related Term. Another possible relation could be: French for....
Tilt
A camera movement with the camera body swivelling upward or downward on a stationary support. It produces a mobile framing that scans the space vertically.
Time-aligned
Time-aligned information is related to certain keyframes or scenes in the film. This information can be viewed together with those keyframes. Usually the timecode of the original film is used to relate this information.
13 June 2000
91
Transcript Visual abstract
The textual version of the original spoken words in the film. Collages that summarise documents from text corpora, images, audio and video in one single abstraction. Given multiple, near-duplicate or overlapping units of information, the proposed work will combine them into one unit, a synthetic story or video magazine that summarises all the salient information.
Web based interface
Web-based interfaces are interfaces based on HTML (Hypertext Mark-up Language). >>> See also: Interface
Wipe
A transition between shots in which a line passes across the screen, eliminating the first shot as it goes and replacing it with the next one.
Zoom
Camera work; closing-in to (zoom in) or retreating from (zoom out) the image centre.
13 June 2000
92

D1-2-1 ECHO User Requirement

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

D1-2-1 ECHO User Requirement

Uploaded by

Copyright:

Available Formats

ECHO: IST-1999-11994 Deliverable 1.2.

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Chapter 2 The process of capturing user requirements

Capturing user requirements

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Analysing the questionnaires

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Chapter 3 Results of the analysis

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

User Requirements List

1.1 1.2 1.3 1.4 1.5

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

The original texts should be presented on demand. (usage C, D, E)

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Appendix 1: Choice of user types

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Originator: NAA Version 1

ECHO: IST-1999-11994 Deliverable 1.2.1

User Requirement Report

Appendix 2: User communities and user types

B Film & Ent. Ind. 4

C Cult. Her. Inst. 5

D Audio Visual Ind. 8

E Large Audio Visual Arch. 13 14

Total nr of int's per partner 15