Thank you for volunteering to participate in our study. We believe that this task will take 20 minutes.
In this document, you will read about the design and data collection of an experiment that was performed by Jansen et al. We will describe a Bayesian model which can be used to analyse the data for that experiment. Your goal is to set the priors probability distribution for each parameter in this model.
This study is divided into three parts: Instructions, Task/Experiment, Post Task Survey
In the next part, you will be presented with the visualizations again. Here, you will submit your choice of priors
Finally, we will ask you a set of open-ended questions about the visualization.
Jansen et al. performed an experiment to examine the effect of different incidental power poses on risk-taking behavior. They used the Balloon Analogous Risk Task (BART), which is a standard test in Psychology, to measure people’s risk-taking behavior in the form of a game. The task was administered through a digital interface.
Participants were placed in either the constrictive or expansive condition. The expansive and constrictive conditions were created by manipulating the location of the buttons on a table-top interface. In the constrictive condition the buttons were placed around a small (0.15m2); in the expansive condition, the buttons were placed around a large (0.6m2) interface (the Figure below shows what the posture looks like; buttons are not shown in this image).
The basic task in BART is to pump up a virtual balloon using on-screen buttons. With each pump, the balloon grows a bit and the player gains a point, which are linked to monetary rewards — the more the players pump up the balloons, the higher their payoff. The maximum size of a balloon is reached after 128 pumps. The risk is introduced through a random, uniformly distributed, point of explosion for each balloon with the average and median explosion point at 64 pumps. The optimal strategy to maximise payoff is to perform 64 pumps. Each participant repeats this 30 times.
BART tasks have been commonly used in psychology research to assess risk-taking behavior. A meta-analysis of 22 studies which used the BART task found that the average number of pumps (averaged across conditions) to vary between 24.60 to 44.10 (out of 128 total possible pumps), with a weighted standard deviation of 5.93. This means that based on prior studies, on average, participants in the BART task are most likely to be risk-averse.
One way of analysing this data is to use a poisson regression model: the outcome variable will be the number of pumps by the participant, and the predictor will be a (categorical) dummy variable indicating which condition the participant is in.
\[ pumps_i \sim Poisson(\lambda_i) \\ log(\lambda_i) \sim \alpha + \beta \times condition_i \] where, \(condition_i\) has two levels: 0 for the constrictive condition, and 1 for the expansive condition.
Bayesian analysis requires specification of prior distributions for \(\alpha\) and \(\beta\). The prior distributions indicate the probability mass that will be assigned to different values for that parameter, and express the best prior information, before seeing any data, of reasonable values for the model parameters.
Your goal is to identify the best possible priors for \(\alpha\) and \(\beta\). In the interactive visualization, you can change the mean and standard deviation of the distribution, and see how this affects probability density of the parameter on the response scale.
You can choose priors from any reasonable family of distributions. In this study, we let you choose between:
In models which use a non-linear transformation, such as Poisson models (which uses a log transformation), the outcome variable (here, \(pumps_i\)) and the predictors are on different scales. Thus a one unit change in the predictor variable will have a non-linear effect on the outcome variable. Transforming the parameters to the response scale (i.e. by performing the same non-linear transformation), tells you the effect of a one unit change of the parameter on the outcome variable.
There are different ways to set a prior:
Below are previews of the visualizations you will encounter during this task.
(where, \(\nu\) indicates the degrees of freedom)
Interact with the visualization by dragging the black dot in the box. This changes the prior distribution and shows how the probability density of the prior changes as the parameters of the prior distribution change, on the response scale.
(where, \(\nu\) indicates the degrees of freedom)
Now that you’ve interacted with the visualizations, you’ll need to choose one prior distribution for each parameter. Please proceed to the next page.