Testing New

Technologies
Skill Category 10
Risks Associated with New
Technology
 Questions we must ask
 Is new technology utilized on the project being
tested?
 If so, what are the concerns and risks
associated with using that technology?
 If significant risks exist how will the testing
process address those risks?
Risks Associated with New
Technology
1. Unproven technology
 There is not enough experience to back up marketing data
2. Technology is defective
 It doesn’t work like it should
3. Inefficient technology
 It fails to achieve the productivity gains associated with it.
4. Technology incompatible with other implemented
technologies
 It might not be useful if you can’t incorporate it with existing
technologies
5. New technology obsoletes existing implemented
technologies
 We should assume that because of the new technology, some
old technology will probably be classified as obsolete
Risks (cont)
1. Variance between documentation and technology execution
 The documentation may be inaccurate leading to believing
that the technology is inefficient.
2. Staff not competent to use new technology
 Training may be required and deployment processes will most
likely need to be updated
3. Lack of understanding how to optimize the new technology
 Not all aspects of it may be used, therefore the company is
missing something
4. Technology not incorporated into the organization’s work
processes
 It may be hit or miss. Typical at technology maturity Level 1
5. Obsolete testing tools
 New testing tools and new methodologies may be required
6. Inadequate vendor support
 The vendor may not be as helpful as IT would like
Newer IT Technologies that
Impact Software Testing
 Web-Based Applications
 Distributed Application Architecture
 Wireless Technologies
 New Application Business Models
 New Communication Methods
 Wireless Local Area Networks
 New Testing Tools
 And more…
Web-Based Applications
 Consists of hardware, software, and users
 Having an understanding of its components leads
to better testing
 Understanding the interaction between the components
offers a different perspective than that of the developers

 Client based components are the front end

 Web browsers, plug-ins, and embedded objects
 Server Side components are on the back end
 Application server components, database applications,
third-party modules, and cross-component
communication
Distributed Application
Architecture
 Components are grouped into clusters of related services

 Traditional Client-Server Systems

 UI, Business logic code, Data-access service code, Data
Storage
 Thin-client system
 Majority of processing is done on the server
 UI is usually the only part that runs on the client
 Testing should focus on server and network performance
 Thick-client system
 Majority of processing is done on the client
 ActiveX and Java applets run on the client, instead of the
server
 Testing should focus on client performance and compatibility
Wireless Technologies
 Common Issues
 Electromagnetic interference and physical obstacles that
limit coverage of wireless network
 Specific Issue:
 Standards
 Multiple standards exist especially in the US
 Data security
 Scanning devices may be used against you…
 WLANs use different authentication and encryption
methods
 Throughput or Coverage
 The farther you get from a transmitter or access point, the
throughput of the network decreases
 Ease of use
New Application Business
Models
 E-commerce
 Conducting business communication and
transactions over networks and through
computers
 E-business
 The conduct of business on the Internet
 Can be a part of a brick and mortar operation
or a virtual business
 Web sites that are elaborate brochures
New Communication
Methods
 Voice and Messaging
 Cell-phones, pagers, and commercial two-way business radios
 Analog standard is AMPS
 Digital standards are GSM, TDMA, CDMA
 FCC allots different carriers different frequencies
 Current rates are 16 Kbps. 3G will provide 30-times faster
transfer rates
 Interoperability issues galore
 Hand-Held and Internet-Enabled Devices
 Internet-enabled cell phones and PDAs
 Limitations include: Low bandwidth, low quality of service,
high cost, the need for additional equipment, and high
utilization of devices’ battery power
 Data Networking
 WLANs and broadband wireless
Wireless Local Area
Networks
 Consists of
 Access Points
 Wireless Client Adapter

 Broadband Wireless
 Costly equipment and infrastructures
 Bluetooth
 Beware of interference and interoperability
New Testing Tools – Test
Automation
 Test Automation is the use of software to control
the execution of tests, the comparison of actual
outcomes to predicted outcomes, the setting up
of test preconditions, and other test control and
test reporting functions
 Often seen as a time saver
 Testing frameworks are also used
 JUnit and NUnit
 Helped to drive test driven development
 Partial automation tools are useful as well
 Product installation, test data creation, GUI interaction,
problem detection, defect logging
Testing the Effectiveness of
Integrating New Technologies
 Determine the Process Maturity Level of
the Technology
 Test the Controls over Implementing the
New Technology
 Test the Adequacy of Staff Skills to Use
the Technology
Determine the Process
Maturity Level of the
Technology
1. People-Dependent Technology
 The technology is available to use by individuals at their
discretion
2. Use Description-Dependent Technology Processes
 There are processes in place for the technologies use, but
projects can vary from those processes if desired
3. Use of Technology
 The processes are determined to be effective and compliance
to those processes are required
4. Quantitatively Measured Technology
 Once the processes are determined to be effecting, they
should be measured – need to make sure that the data
collected is reliable before optimizing processes
5. Optimized Use of Technology
 The data from level 4 will enable the optimization of the use
of technology
Test the Controls over
Implementing the New
Technology
 Testing actual performance vs. Stated
performance
 Does the technology accomplish its stated benefits?
 Assumptions about new technology don’t have the
experience behind them that older technologies have

 Documentation represents actual technology execution

 Training courses transfer the needed knowledge to use
the technology
 New technology is compatible with existing technology
 Stated performance criteria represent actual
performance criteria
 Promised vendor support equals actual vendor support
 Expected test processes and tools are effective in testing
new technologies
Test the Controls over
Implementing the New
Technology
 Test the Adequacy of the Current Processes to
Control the Technology
 Do implemented work processes assure the technology
will be used in an effective and efficient manner?
 Process – Standards, Procedure, and Quality Control
 Compliance – Management’s desires that workers follow
the procedures
 Enforcement – What happens when procedures aren’t
followed

 If testers determine that processes are not adequate

 Identify risk and report it
 Identify potentially ineffective parts of the process
 Conduct tests to identify specific problems and assessing
the potential impact on the end product
Test the Adequacy of Staff
Skills to Use the Technology
 Professional processes have two parts
 Process itself
 Competency of the process user to use that process
effectively

As we work up the maturity level there is a transfer of

knowledge – from the user to the process

 Should look into:

 Technological process maturity level
 Training available in the new technology
 The performance evaluation of individuals to use the new
technology
Review Questions part 1
 What are the risks of new technology?
1. Unproven technology
2. Technology is defective
3. Inefficient technology
4. Technology incompatible with other implemented
technologies
5. New technology obsoletes existing implemented technologies
6. Variance between documentation and technology execution
7. Staff not competent to use new technology
8. Lack of understanding how to optimize the new technology
9. Technology not incorporated into the organization’s work
processes
10. Obsolete testing tools
11. Inadequate vendor support
Review Questions part 2
 What technologies can impact testing?
 Web-Based Applications
 Distributed Application Architecture
 Wireless Technologies
 New Application Business Models
 New Communication Methods
 Wireless Local Area Networks
 New Testing Tools
Review Questions part 3
 What are the 5 process maturity levels of
the technology?
1. People-Dependent Technology
2. Use Description-Dependent Technology
Processes
3. Use of Technology
4. Quantitatively Measured Technology
5. Optimized Use of Technology
 Moving up the maturity level means a
transfer of knowledge from user
____ to
process?
______?