Using Shiny for User Testing
    
It’s So Shiny!
- RStudio package to write interactive web applets in R
 
 
- Extremely simple to set up applets that can be used for data collection
 
 
- Paired with other packages (gridSVG, animint, ggvis), could be used to allow direct interaction with graphs
 
 
- User interactions can be recorded to a database for analysis
Using Shiny to Get Data

Using Shiny to Get Data
- Users can adjust the graphic until it looks “right”
 
 
- Time stamps are collected along with graph parameters, window resolution, etc.
 
 
- Additional javascript extensions provide user data (IP Address and corresponding geolocation) and a “fingerprint” composed of browser characteristics, screen resolution, etc. hashed for user privacy
 
 
- Backend: MySQL database; each user interaction results in a new entry
Advantages of Web Applets for Useability Studies
- Wider population for testing (the entire internet vs. undergraduates)
 
 
- Easier scheduling
 
 
- Data is available faster (users do the data entry themselves)
 
 
- Services like Amazon Turk make it easier to get reliable users
Disadvantages
- Users may not be statistically literate or familiar with statistical graphics
 
 
- Verification questions (or other data controls) are essential to ensure participants are taking the task seriously
 
 
- Some users have multiple accounts, others are malicious
 
 
- Studies are vulnerable to network issues or software bugs
 
 
- Greater variability in computer hardware may cause unpredictable bugs (differences in screen resolution, Mac vs. PC, Internet Explorer vs. Chrome/Firefox)