Paper

prototype 2: Evaluation
The second prototype has been tested on 10 different people, all between the ages of 20 and 23. 4 of them study computer science, 3 are studying another form of engineering and the others are university students as well. One woman, 9 men. This isn't a very diverse test audience, but it represents a considerable part of the iPhone users (young adults, well educated). I asked the test persons about their experience with smartphones. As you can see in figure one, 80% of the tested users either own an iPhone or have at least used an iPhone. This was important to me because the application will be created for the iPhone, and some basic iOS knowledge is preferred. 2 people had never used a smartphone, so I would also get a perspective on how difficult it is for inexperienced people to work with the app.

Figure 1: iPhone experience

Next I polled for their experience with augmented reality applications. This can be seen in figure 2. 50% had never used an AR app, so some explaining needed to be done in advance. The AR experience was not required, but preferred, since people with experience could compare my app with the ones theyve tested.

Figure 2: Augmented reality experience

Then, I asked which social networks they use. This statistic is interesting to know the priority of the networks that Ill build in. However, slideshare and mendeley were never selected, because the audience did not include faculty members or academics. These networks are not popular with students, but phd students,

professors or other academics might be more interested in these networks. I will test the app with academics in the next iteration, so this will provide me with more results. The other network filled in on the questionnaire was foursquare, used by 1 (10%) of the test persons. Facebook is a clear winner, and it will definitively be implemented because the face recognition will require it. Twitter

Figure 3: Social networks

Notes during the testing The think aloud technique was applied during all the tests and tasks were given to the users. Some opinions were asked of things that I was not yet sure about. I noted how many of the users tapped on the name of a recognized person or on the face itself: 3 tapped the name, 7 the face. The relevance of this will be explained later. Questionnaire answers The answers to the questionnaire can be found in appendix A. The questionnaire itself is the standard USE questionnaire. I will discuss the different categories of the form. 1. Usefulness: The app scored great on questions 1, 3, 6 and 8. People think it is useful and it does what they expect it to do. It does not make the things they want to accomplish easier (5), nor does gives them more control about the activities in their lives (4). This is normal, because it isnt a life-changing product. The answers to whether it meets the needs of the user (7) were divided, because some users just did not have a need for this application. 2. Ease of use: The ease of use was in general good to very good. Its user friendly, easy to use, consistent Question 12 however does not have a great score. This is because, due to the lack of a home button on a lot of views, users needed to go back a few pages to get to the home screen. This will be adapted in prototype 3. Using the application effortless depended on the iOS experience of the user, because the app uses the standard way of navigating through views most of the time. 3. Ease of learning: None of these questions had a score below 5. This is very positive. This is due to the iOS way of navigating, as described above. 4. Satisfaction: The users were divided about whether they feel the need to have it (29). The iPhone owners would really want it, but the people that

do not have a smartphone were less interested. This is basically because they have but little interest in applications in general. Aside from this, the application seems to be fun to use, and everybody was satisfied. Positive/ negative points I asked the users to list the positive and negative aspects of the app. The positive points were mostly the concept (the face recognition and accumulation of social networks), the clean UI and the iOS style of working. The negative points are much more interesting, because theyll have to be improved for the next iteration. One remark that I had from 9 out of 10 users was that there was only one button going to the home view, and it was on the camera view. So nowhere in the network overview of a person or in the specific network of a person was there a link to the home. This way, it takes 3-4 clicks to get to the home screen, which is too much. The next prototype will have more home buttons. Another remark that was made by 6 out of 10 users was that the contact info- button could have been clearer. At the moment, its like in figure 4, but with the @-symbol, it makes users think that it refers to emailing the recognized person. So a different icon will need to be found. This will probably be the iOS contacts icon, shown in figure 5.

Figure 4: Old contact info button left, and the new one on the right

A big issue was the Not him/her?-button. This button was shown in the person overview view. So when a person is recognized wrongly, and the user looks at his info, it will fetch all the info about the wrong person before the user gets the opportunity to correct the recognition. Everybody agreed that this was too late. The incorrectly-tagged-button should be placed on the camera view. However, the opinions were divided amongst the users. Some of them (2) wanted an incorrect button under the tag frame, others (4) wanted it hidden from the view but it would become visible upon tapping the name of the person. This is why the statistic described 2 sections above is useful. 70% tapped the persons face, 30% his name. So it is a possibility to hide the incorrect button under the name, and I will go for this option in the next iteration. The remaining 4 users all had different suggestions, but they stood alone in their opinion. Only one person complained about the binary system of displaying networks. He wanted more control about the accessible information. I will not do this for now, because 1 out of 10 isnt enough to revise this system. One other person wanted to be able to follow recognized twitter users from inside the app. This isnt a big change, and actually a good idea, so I will add this and evaluate this in the next iteration.

Appendix A: Questionnaire answers

Usefulness questions

1) The application helps me be more effective.

Strongly disagree 2) The application helps me be more productive.

Strongly agree

Strongly disagree 3) The application is useful

Strongly agree

Strongly disagree

Strongly agree

4) The application gives me more control over the activities in my life.

Strongly disagree

Strongly agree

5) The application makes the things I want to accomplish easier to get done.

Strongly disagree 6) The application saves me time when I use it.

Strongly agree

Strongly disagree 7) The application meets my needs

Strongly agree

Strongly disagree

Strongly agree

8) The application does everything I would expect it to do.

Strongly disagree

Strongly agree

Ease of use questions

9) The application is easy to use

Strongly disagree 10) The application is simple to use

Strongly agree

Strongly disagree 11) The application is user friendly

Strongly agree

Strongly disagree

Strongly agree

12) The application requires the fewest steps possible to accomplish what I want to do with it

Strongly disagree 13) The application is flexible

Strongly agree

Strongly disagree 14) Using the application is effortless

Strongly agree

Strongly disagree 15) I can use the application without written instructions

Strongly agree

Strongly disagree

Strongly agree

16) I don't notice any inconsistencies as I use the application

Strongly disagree

Strongly agree

17) Both occasional and regular users would like the application

Strongly disagree 18) I can recover from mistakes quickly and easily

Strongly agree

Strongly disagree 19) I can use the application successfully every time

Strongly agree

Strongly disagree

Strongly agree

Ease of learning questions

20) I learned to use the application quickly

Strongly disagree 21) I easily remember how to use the application

Strongly agree

Strongly disagree 22) It is easy to learn to use the application.

Strongly agree

Strongly disagree 23) I quickly became skillful with the application.

Strongly agree

Strongly disagree

Strongly agree

Satisfaction questions
24) I am satisfied with the application

Strongly disagree 25) I would recommend the application to a friend

Strongly agree

Strongly disagree 26) The application is fun to use

Strongly agree

Strongly disagree 27) The application works the way I want it to work.

Strongly agree

Strongly disagree 28) The application is wonderful

Strongly agree

Strongly disagree 29) I feel I need to have it

Strongly agree

Strongly disagree 30) It is pleasant to use

Strongly agree

Strongly disagree

Strongly agree