TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND...

16
TESTING GRID SOFTWARE: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY RECORDER TO ENABLE FRONT END AND USABILITY TESTING TESTING Florian Urmetzer, Gareth J Florian Urmetzer, Gareth J Lewis and Lewis and Vassil N Alexandrov Vassil N Alexandrov Advanced Computing & Emergent Advanced Computing & Emergent Technologies Centre Technologies Centre University of Reading University of Reading Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Transcript of TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND...

Page 1: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

TESTING GRID SOFTWARE: TESTING GRID SOFTWARE:

THE DEVELOPMENT OF A DISTRIBUTED SCREEN THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND RECORDER TO ENABLE FRONT END AND

USABILITY TESTINGUSABILITY TESTING

Florian Urmetzer, Gareth J Lewis and Florian Urmetzer, Gareth J Lewis and Vassil N AlexandrovVassil N Alexandrov

Advanced Computing & Emergent Advanced Computing & Emergent Technologies CentreTechnologies Centre

University of Reading University of Reading

Florian Urmetzer, Gareth J Lewis and Florian Urmetzer, Gareth J Lewis and Vassil N AlexandrovVassil N Alexandrov

Advanced Computing & Emergent Advanced Computing & Emergent Technologies CentreTechnologies Centre

University of Reading University of Reading

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Page 2: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

Roadmap:Roadmap:

- IntroductionIntroduction

- Background and problemBackground and problem

- SolutionSolution

- Implementation Implementation

- DiscussionDiscussion

Copyrigh, 2005 © ACET http://www.acet.reading.ac.uk

Page 3: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

Example: Example: The Collaborative P-Grade The Collaborative P-Grade

Grid PortalGrid Portal

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Page 4: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

DefinitionDefinition

• Software TestingSoftware Testing– The purpose of software testing is the The purpose of software testing is the

determination of error absence in software. An determination of error absence in software. An ideal test would therefore only succeed when ideal test would therefore only succeed when software is free of errors.software is free of errors.

• Usability TestingUsability Testing– Usability testing is a means for measuring how Usability testing is a means for measuring how

well people can use something…well people can use something…

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Page 5: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

Problem DescriptionProblem DescriptionDistributed Collaborative Software Distributed Collaborative Software

DevelopmentDevelopment

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

TESTINGTESTING USABILITYUSABILITYLimitation of Limitation of automatic testing automatic testing methodsmethods

Distribution – Distribution – Multiple locations Multiple locations of clientsof clients

Test bed Test bed implementations implementations often not realisticoften not realistic

Collaboration – Collaboration – Multiple users Multiple users working on one working on one tasktask

Reconstruction of Reconstruction of errorserrors

Page 6: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

SolutionSolution

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

n… User Computer Recording Computer

Optional:1. Screen2. State info3. Camera/Audio

Page 7: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

Solution – Usability testingSolution – Usability testing

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

n… User Computer Recording Computer

1. Screen2. Camera/Audio

User

Page 8: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

Solution – DebuggingSolution – Debugging

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

n… User Computer Recording Computer

1. Screen2. State info

Page 9: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

FrameworkFramework

Network

Recording ComputerUsability testing

Debugging

Computer ...n Computer 2Computer 3 Computer 1

Tester - Developer

Test Computers Running- Application- ScRaDD

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Page 10: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

NetworkingNetworking

Network

Recording Computer

Computer ...n Computer 2Computer 3 Computer 1

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

• Video compressionVideo compression

• RTP (Real Time Protocol)RTP (Real Time Protocol)

• Master Slave approachMaster Slave approach

Page 11: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

Networking - ProblemsNetworking - Problems

Network

Recording Computer

Computer ...n Computer 2Computer 3 Computer 1

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

• Flooding of networkFlooding of network

• PC vs Server as masterPC vs Server as master

• File sizesFile sizes

Page 12: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

RecordingRecording

• Custom written recorderCustom written recorder

• Size of project (number of Size of project (number of participants) determines participants) determines hardwarehardware

• Further tests neededFurther tests needed

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Page 13: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

NetworkingNetworking

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Network 3

Network 4

Network 1

Network 2

Recording Computer

collaboration collaboration

collaboration

colla

bora

tion

Usability testingDebugging

Page 14: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

… … in the near Futurein the near Future

• Production and test with projectsProduction and test with projects

• Test architecture independenceTest architecture independence

• Firewall testingFirewall testing

• Upscale test usersUpscale test users

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Page 15: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

Conclusion:Conclusion:

• Prove of conceptProve of concept

• Further implementationFurther implementation

Copyright, 2005 © ACET http://www.acet.reading.ac.uk

Page 16: TESTING GRID SOFTWARE: THE DEVELOPMENT OF A DISTRIBUTED SCREEN RECORDER TO ENABLE FRONT END AND USABILITY TESTING Florian Urmetzer, Gareth J Lewis and.

Thank you !Thank you !

• Questions ? ?Questions ? ?

Copyright, 2005 © ACET http://www.acet.reading.ac.uk