Selecting a sample size for studies with repeated measures

C O R R E S P O N D E N C E

Open Access

Selecting a sample size for studies with repeated

measures

Yi Guo

, Henrietta L Logan

, Deborah H Glueck

and Keith E Muller

Abstract

Many researchers favor repeated measures designs because they allow the detection of within-person change over time and typically have higher statistical power than cross-sectional designs. However, the plethora of inputs needed for repeated measures designs can make sample size selection, a critical step in designing a successful study, difficult. Using a dental pain study as a driving example, we provide guidance for selecting an appropriate sample size for testing a time by treatment interaction for studies with repeated measures. We describe how to (1) gather the required inputs for the sample size calculation, (2) choose appropriate software to perform the calculation, and (3) address practical considerations such as missing data, multiple aims, and continuous covariates.

Keywords:Sample size selection, Repeated measures, Interaction

Correspondence

Selecting an appropriate sample size is a crucial step in designing a successful study. A study with an insufficient sample size may not have sufficient statistical power to detect meaningful effects and may produce unreliable answers to important research questions. On the other hand, a study with an excessive sample size wastes re-sources and may unnecessarily expose study participants to potential harm. Choosing the right sample size in-creases the chance of detecting an effect, and ensures that the study is both ethical and cost-effective.

Repeated measures designs are widely used because they have advantages over cross-sectional designs. For instance, collecting repeated measurements of key variables can provide a more definitive evaluation of within-person change across time. Moreover, collecting repeated measurements can simultaneously increase stat-istical power for detecting changes while reducing the costs of conducting a study. In spite of the advantages over cross-sectional designs, repeated measures designs complicate the crucial process of selecting a sample size. Unlike studies with independent observations, re-peated measurements taken from the same participant

are correlated, and the correlations must be accounted for in calculating the appropriate sample size. Some current software packages used for sample size calcula-tions are based on oversimplified assumpcalcula-tions about correlation patterns. As discussed later in the paper, oversimplified assumptions can give investigators false confidence in the chosen sample size. In addition, some current software may require programming skills that are beyond the resources available to many researchers.

In the present article, we describe methods for gather-ing the information required for selectgather-ing a sample size for studies with repeated measurements of normally distributed continuous responses. We also illustrate the process of sample size selection by working through an example with repeated measurements of pain memory, using the web-based power and sample size program GLIMMPSE.

Tasks for selecting a sample size

Select a data analysis method

For the sake of brevity, we will not elaborate on the fun-damental question of choosing a data analysis method. Although statistical consulting will have value at any stage of research, the earlier stages of planning a study profit most from consulting. We assume the iterative process of choosing and refining the research goals, the primary outcomes, and the sampling plan has succeeded. In turn, we also assume that an appropriate analysis plan * Correspondence:[email protected]

1

Department of Health Outcomes and Policy, College of Medicine, University of Florida, Gainesville, FL, USA

2

Southeast Center for Research to Reduce Disparities in Oral Health, University of Florida, Gainesville, FL, USA

Full list of author information is available at the end of the article

has been selected, which sets the stage for sample size selection.

Select a power analysis method

One of the first steps in computing a sample size is to select a power analysis method that adequately aligns with the data analysis method [1]. As an example, con-sider a study in which a researcher plans to test whether veterans and non-veterans respond similarly to a drug. The researcher plans to control for both gender and age. The planned data analysis is an analysis of covariance (ANCOVA), with age as the covariate. In this case, a sample size calculation based on a two-group t-test would be inappropriate, since the planned data analysis is not a t-test. Misalignment between the design used for sample size calculations and the design used for data analysis can lead to a sample size that is either too large or too small [1], contributing to inconclusive findings.

In practice, mixed models have become the most popular method for analyzing repeated measures and longitudinal data. However, validated power and sample size methods exist only for a limited class of mixed models [2]. In addition, most of these methods are based on approximations, and make simple assumptions about the study design. In some cases, the planned data ana-lysis has no published power anaana-lysis methods aligned with the data analysis. One possible method for finding reliable power or sample size when no power formulas are available is to conduct a computer simulation study. We recommend using appropriate software that has been tested and validated whenever it is available. Pack-aged software has the advantages of requiring less programming and less statistical sophistication.

Based on the current state of knowledge, we recom-mend using power methods developed for multivariate models to calculate sample size for studies using com-mon mixed models for data analysis. For carefully built mixed models [3,4], power methods developed for multi-variate models provide the best available power analysis. Technical background can be found in Muller et al. [1], Muller et al. [5], and Johnson et al. [6]. Another option is to use the large sample approximation for power described by Liu and Liang. They proposed a method to compute sample sizes for studies with correlated obser-vations based on the generalized estimating equation (GEE1) approach [7].

Model complex variance and correlation patterns

When planning a study with repeated measures, scientists must specify variance and correlation patterns among the repeated measurements. Failing to specify variance and correlation patterns aligned with the ones that will be seen in the proposed study can lead to incorrect power analysis [1].

The simplest variance pattern assumes equal variance among the repeated measurements. For example, meas-uring children’s mathematical achievement within a classroom makes it reasonable to assume equal variabil-ity across children, on average. In contrast, measuring mathematical achievement from the same children in grades 6, 7, and 8 could plausibly lead to increasing variability, decreasing variability, or stable variability. Variability in performance on a test of a certain skill could decrease across the grades due to a stable acquisi-tion of the skill. On the other hand, variability of stan-dardized test scores could remain unchanged due to careful test construction by the test developers. Re-peated measurements of some variables may have any possible pattern of variance. For example, depending on the experimental condition, the metabolite concentra-tions in blood might increase, decrease, or remain un-changed across time.

Regarding correlation patterns, it is useful to think of them as having four types, in increasing complexity: (1) zero correlations (independent observations), (2) equal correlations, (3) rule-based patterns, and (4) unstructured correlations (no specific pattern).

The simplest model of correlations assumes a constant correlation, often referred to as an intra-class correlation, among all observations. If each observation records some aspect of a child’s performance within a classroom, then assuming a common correlation among any two children seems reasonable. In contrast, if the same child is mea-sured in grades 6, 7, and 8, we expect the correlation be-tween grades 6 and 8 to be lower than the correlation between grades 6 and 7. Correlations among the re-peated measures from a single participant usually vary across time in a smooth and orderly fashion. Measure-ments taken close in time are usually more correlated than measurements taken farther apart in time.

Many rule-based patterns of correlation have been de-veloped in the context of time series models. One com-mon example of a rule-based pattern is the first-order autoregressive (AR1), a special case of the linear expo-nent first-order autoregressive (LEAR) family [8]. The AR1 and the more general LEAR patterns assume that correlations among repeated measures decline exponen-tially with time or distance. For example, in pain studies that examine the effects of interventions on patients’ memory of pain after treatment, the correlations among the measurements of pain memory from the same patient normally decrease over time. The relationship between memory of pain and passage of time can be modeled using the LEAR structure.

requires knowing p × (p−1)/2 distinct correlations, with p being the number of repeated measures.

It is usually assumed that all participants in a study show the same pattern of correlation. Statistical methods are available to allow different correlation patterns among study participants. Although rarely used, a conscientious data analysis should include a meaningful evaluation of the validity of homogeneity of correlation pattern across groups of participants.

Each of the correlation patterns has limitations. Struc-tured correlation patterns reflect special assumptions about the correlations among the repeated measures. The assumptions introduce the risk of choosing a pattern that is too simple, which can falsely inflate the type I error rate [3]. For example, the equal correlation pattern assumes that any pair of observations has the same correlation, no matter how far apart in time they fall. On the other hand, choosing an unstructured cor-relation pattern can be impractical because it requires estimating more parameters than the data support, which leads to a failure to converge. A flexible structure, such as the LEAR pattern, often provides the best com-promise between too little complexity (equal correl-ation) and too much (unstructured correlcorrel-ation).

Find valid inputs for sample size calculation

We illustrate how to find valid inputs for sample size calculations with an example drawn from a clinical study that used repeated measures of dental pain as the out-comes. The investigator plans to randomize the study participants to one of two groups, either control or treatment. Knowledge of the pain scale makes it reason-able to assume the data follow a normal distribution. The inputs needed to compute a sample size are (1) α, the Type I error rate, (2) the predictors implied by the design, (3) the target hypothesis being tested, (4) the dif-ference in the pattern of means for which good power is being sought, (5) the variances of the response variables, and (6) the correlations among the response variables (Table 1). Finding the last three items in the list requires most of the effort.

Scientists designing a study usually know the Type I error rate, the predictors, and the target hypothesis. The type I error rate (α), chosen by the scientists, is the prob-ability of claiming that an effect exists while in fact there is no effect (usually set at 0.01 or 0.05). Based on the sci-entific question at hand, scientists choose the best set of predictors and the target hypothesis to test.

Scientists must specify the smallest scientifically import-ant difference. For the dental pain example, scientists must specify the minimum difference in the mean pain values they find important. The investigators designing the study need to make an educated choice for the mean difference of interest. For pain measured on a 0–5 continuous scale,

a 0.5 change in pain level may not be clinically important, whereas a 1.0 change may be deemed important by the investigators.

Scientists must also specify the variance of each of the repeated measurements. Several strategies can be used to choose a variance value: (1) it may be estimated with data from previous studies, (2) it may be estimated with data from a pilot study, or (3) it may be an educated speculation based on experience. In the best case, it is possible to obtain a good estimate of a variance from a previous study. Researchers may have collected similar data on the response variable of interest in their previous studies. In other cases, published data on the response variable of interest may be available in the literature.

When using an estimate from a previous study, it is important to note that the variance needed for sample size calculation is the residual variance. The residual variance is the variance not explained by the predictors. An unadjusted variance of the response variable contains variation due to predictor variables included in the previ-ous study. The same predictors may not be included in the study being planned. Suppose a new study will include a response variable from a relatively age-homogeneous population (e.g., college students at a large upper Midwest public university). The investigator needs to estimate a variance from a previous study in which the response variable was measured from people of all ages. Hence, only the residual variance can be used for sample size calcula-tion, since the unadjusted variance of the response variable contains variability due to age.

Power analysis for repeated measures requires not just one but a set of variance values. As discussed earlier, the scientific context may provide a reasonable expectation for a pattern of change in variance. In practice, it is often

Table 1 Inputs for power analysis for repeated measures design

Source Explanation

Type I error rate (α) The probability of claiming that an effect exists when in fact there is no effect; usually set at 0.01 or 0.05.

Predictor variables The best set of predictors needs to be chosen; the categories of each predictor need to be specified.

Primary hypothesis The primary hypothesis of interest needs to be specified. GUI power programs usually provide a list of possible hypotheses after all information is specified.

Smallest scientifically important difference

The minimum difference in the mean values of the response variable the investigators find important.

Variances of repeated measurements

Variance of each of the repeated measurements needs to be specified.

Correlations among repeated measurements

possible to estimate one variance value based on data, and then specify the other variances based on the expected variance trend. Scientific context often pro-vides a reasonable model. In general, growth, learning, and other developmental processes typically lead to monotonically decreasing variance, while aging, disease, and other patterns of degradation often create monoton-ically increasing variance.

Scientists must also specify the correlations among pairs of measurements. The same basic strategies for choosing a variance apply for choosing a correlation. It is often possible to estimate one correlation value based on data and then specify the other correlations based on the correlation pattern. When educated guesses are needed, a researcher’s experience and scientific restrictions guide the choice of a correlation. For example, behavioral scientists may expect to see survey reliabilities ranging from 0.25 to 0.75, while a biomedical engineer may expect instrument reliabilities of at least 0.90. As with variances, a chosen correlation must be a residual correlation, which is the correlation among the residuals for the repeated measures.

Choose the right software

Many software packages and internet-based programs are available to perform sample size calculation for t-tests, a variety of ANOVA, and regression models. A small number of programs cover a limited range of re-peated measures designs. Some of the programs are free and easy to install and use, but lack the ability to handle complex designs. For example, Java applets developed by Lenth (http://www.stat.uiowa.edu/~rlenth/Power/) pro-vide power estimations for certain linear models such as t-tests, ANOVA, and linear regression studies [9]. Some programs are commercial products that can be used for a wide range of study designs, but can be prohibitively expensive and may also require great knowledge in statistical theories and strong computer programming skills. For example, POWERLIB is a free SAS/IML mod-ule that computes sample size and power for a wide var-iety of general linear univariate and multivariate models [6]. However, using this program requires a SAS soft-ware license, a strong knowledge of statistical theories, and SAS programming skills. Power Analysis and Sam-ple Size (PASS, NCSS) computes samSam-ple size for a range of multivariate models (both linear and nonlinear), but it is a commercial product that needs to be purchased and installed on one’s computer. Some programs make simple statistical assumptions, and these assumptions limit their usefulness. For example, Optimal Design (OD) is a free sample size program with a graphical user interface (GUI) that allows users to compute sample size for longitudinal studies with multilevel designs [10]. However, the calculations for repeated measures

use the over-simplifying assumptions of equal variances and correlations. In our experience, although variance may remain stable in longitudinal data in some cases, correlation never does.

Some programs from major software packages have built-in options for sample size calculation, but for uni-variate designs only. During the writing of the present manuscript, these programs include nQuery (nQuery Advisor, Statistical Solutions), SAS (GLMpower, SAS Institute Inc.), and SPSS (SamplePower, IBM Corporation). Given the continuing evolution of software, we urge the reader to be sure that the selected software has the abilities and features needed and meets professional standards for statistical methods and programming accuracy.

In general, software packages with a GUI interface are easier to use than those with a command line interface. However, one advantage of using command line interfaces is that they allow easy documentation and sharing of the whole power analysis process. Developed computer code can easily be shared with collaborators for review and re-used on other datasets. For reproducible research, it is good practice to document the whole power and data analysis process no matter what software package is used.

We recommend the program GLIMMPSE (URL: http://glimmpse.samplesizeshop.org/) for computing sample size for repeated measures and longitudinal de-signs. GLIMMPSE is a free, internet-based program that has two modes: Matrix Study Design Mode and Guided Study Design Mode. Matrix Study Design mode is designed for users with advanced statistical training and Guided Study Design mode is designed for applied re-searchers. GLIMMPSE requires no previous programming experience and provides a step-by-step, user-friendly inter-face to guide researchers through sample size and power calculations. In addition, GLIMMPSE allows saving the provided study design for future references. GLIMMPSE supports linear models with fixed predictor variables and linear models with fixed predictor variables plus one Gaussian covariate [11-13]. GLIMMPSE offers a host of variance and correlation patterns. The program has been extensively tested, with validation results available at the web site.

Sample size calculation for a dental pain study

Overview of the pain study

In a previous study on therapeutic interventions for acute pain, Logan et al. discovered that an intervention instructing patients to pay attention only to the physical sensations in their mouth could greatly reduce sensory pain intensity during root canal therapy for patients who had both a high desire for control and low perceived control [14]. Since prior work shows that avoidance be-havior builds as a result of the amount of pain recalled [15-18], the investigators are now planning to further examine the long-term effects of sensory focus on the perception of pain. A new set of participants will be recruited and tracked over time. The change in each participant’s memory of pain will be examined in the new study.

Step 1: Specify the goal of the study

The effectiveness of therapeutic intervention for acute pain is often determined by measuring and comparing the amount of pain experienced and remembered by a patient. However, prior research has shown that short-term (hours to days) and long-short-term (months) memory of pain could be affected by different factors [18]. It has been argued that short-term memory of pain is an ac-curate reflection of the amount of pain experienced dur-ing the stimulus, since the recall and experience are temporally linked. On the other hand, long-term mem-ory of pain may be influenced more by both temporal factors and cognitive and affective factors, many of which may be marginally related to the initial pain event. Therefore, for the new study, the primary goal proposed by the investigators is to determine if patients who are instructed to use a sensory focus have a different pattern of long-term memory of pain than patients who are not.

Step 2: Specify the hypothesis

With a repeated measures design we can test the main effect of intervention, by which the mean intervention effects averaged across the repeated measures are com-pared. We can also test trends across time. In this study, the investigators are interested in knowing if the trend of change is different between the intervention group and the non-intervention group. Therefore, the primary hypothesis of the study can be formally stated as a test of whether there is a time × intervention interaction. The hypothetical trends of pain memory for both groups are shown in Figure 1.

Step 3: Specify the response variables

The main response variable of interest is memory of pain. It is a continuous variable that ranges from 0 to 5.0, with 0 meaning no pain remembered and 5.0 meaning maximum pain remembered [14]. Memory of pain will be assessed immediately after the dental procedure (Pain0),

one week later (Pain1), six months later (Pain2), and twelve

months later (Pain3). Pain0will be measured in the clinic.

Pain1, Pain2, and Pain3 will be measured through

tele-phone interviews. The spacing in repeated measures is chosen based on the investigators’knowledge of how pain memory changes over time.

Step 4: Specify the predictor variables

The primary predictor of interest is the intervention (i.e., the audio instruction for participants to use a sensory focus during their respective dental procedures). In the new study, the Iowa Dental Control Index (IDCI) will be used to categorize and select patients [19]. Only patients with a high desire for control and low felt control will be recruited. Patients in this group will be selected and ran-domly assigned to either intervention or no intervention. Those in the intervention group will listen to automated audio instructions, in which they are told to pay close at-tention only to the physical sensations in their mouth [14]. Patients in the no-intervention group will listen to automated audio instructions on a neutral topic to con-trol for media and attention effects. As in earlier studies, appropriate manipulation checks will be used [14].

Step 5: Identify the variance and correlation patterns Once the goals and the variables are specified, the next step is to specify the variance and correlation patterns among the repeated measures. In our case, the variance of difference between Pain0was 0.96 in a previous study

conducted by the investigators [14]. This variance of difference can be directly used as an estimate for the variances of the pain memory measures, Var(Paini). As

for the required correlations, 6 correlation values need to be estimated since there are 4 repeated measurements (Table 2). Prior research reports that the correlation between experienced pain and 1-week memory of pain is 0.60, and the correlation between experienced pain and

Pain

1.0

1.5

2.0

2.5

3.0

Months

0

No intervention

Intervention

6

12

18-month memory of pain is 0.39 [18]. Therefore, it is reasonable to believe that the correlation between Pain0

and Pain1is 0.60. In addition, since the investigators

be-lieve that the correlations decay smoothly across time, it is reasonable to assume the Pain0- Pain1, Pain0- Pain2,

and Pain0 - Pain3 correlations are all larger than 0.39.

Based on the trend of decay and the restrictive lower bound of 0.39, the investigators estimate that the Pain0

-Pain1, Pain0 - Pain2, and Pain0 - Pain3 correlations are

approximately 0.6, 0.5, and 0.4, respectively (second column in Table 2). Following a similar thought process, the investigators estimate that the Pain1- Pain2, Pain1

-Pain3, and Pain2- Pain3 correlations are approximately

0.45, 0.40, and 0.45, respectively (Table 2).

Step 6: Generate a power curve and select an appropriate sample size

In GLIMMPSE, the user is prompted to enter the de-sired power values, type I error rates, study design vari-ables, variances, and correlations. After these inputs have been made, GLIMMPSE will show a menu of pos-sible hypotheses for the entered study design (Figure 2). For a repeated measures design, possible hypotheses include testing intervention main effect, trends across time, and time × intervention interaction. For our pain

study, the hypothesis testing the interaction of time × intervention is chosen in GLIMMPSE.

Results from the power analysis are summarized in Figure 3. The y-axis is the power and the x-axis is the mean difference among the Paini measurements (e.g.,

Pain2 - Pain1). As seen in Figure 3, for a given desired

power, the minimum detectable mean difference decreases as sample size increases. The investigators specified a min-imal change in pain that they deem clinically important as a difference of 1.2 between the pain measures. A sample size of 40 patients per group, or a total of 80 patients, would give a power of at least 0.8 for testing the hypoth-esis of whether there is a time × intervention interaction.

Additional practical considerations

Power analysis for studies with repeated measures can be complicated. It often involves solving a problem with many possible answers, such as specifying the variance and correlation patterns among the repeated measure-ments. Therefore, we recommend consulting with a stat-istician, if possible, when there are any unclear issues. The online sample size tool Glimmpse is designed such that it guides scientists through power analysis by asking questions about the study design. In the rest of this section, we provide additional practical advice on issues related to power analysis.

Missing data

One limitation of the power analysis method based on general linear multivariate models is that it is a calcula-tion for complete cases. In a complete case analysis, all repeated measurements on the same participant must be available. However, in longitudinal studies involving human participants, investigators often end up with missing data due to missed visits. One simple strategy to

Table 2 Estimated correlations among the pain memory measurements

Pain0 Pain1 Pain2 Pain3

Pain0 - - -

-Pain1 0.60 - -

-Pain2 0.50 0.45 -

-Pain3 0.40 0.40 0.45

account for expected missing data is to propose an expected attrition rate, and then recruit more people accordingly. In our driving example, the investigators ex-pect a maximum of 20% attrition for the one-year-long study, based on previous experiences with similar re-search projects. Therefore, they need to collect data for 20% more participants in order to achieve the desired power. On the other hand, this method does not con-sider partial information that might be obtained from participants with missing visits or dropout participants. There are sample size methods developed for these scenarios, but discussing them is out of the scope of this article [20]. Furthermore, as always, the possibility of non-randomly missing data must be carefully examined by checking the study design and data collection proce-dures once the data have been collected.

Power for more than one primary hypothesis

Due to cost and ethical issues, scientists often want to test more than one hypothesis in a study. Each power analysis must be based on one specific hypothesis using a pre-planned data analysis method. With a modest number of primary analyses, a simple Bonferroni correc-tion is typically applied to help control the Type I error rate. For example, with 4 primary hypotheses, a Type I error rate ofα= 0.05 ÷ 4 = 0.0125 would be used. Having conducted 4 power analyses leads to 4 different power values or ideal sample sizes. In the absence of time, cost, and ethical concerns, the scientist may choose the largest sample size to guarantee power for all 4 tests.

Covariates

In addition to categorical variables, continuous variables are sometimes included in studies as predictors or baseline covariates. A baseline covariate is the first measurement (before treatment) of a continuous response measured repeatedly over time. It is included as a predictor vari-able to control for differences in the starting values of the response. Using a baseline covariate that controls a large proportion of the variance of the response in-creases the statistical power of the data analysis, but also complicates the calculation of sample size. How-ever, current knowledge of the closed form approxima-tion covers only sample size and power calculaapproxima-tion in

general linear multivariate models with a single, con-tinuous, normally distributed predictor variable [13]. Glueck and Muller reviewed the limited approximate power methods that are available for adjusting for covariates [13].

Conclusions

Using a repeated measures design improves efficiency and allows testing a time × treatment interaction. In practice, the critical task of selecting a sample size for studies with repeated measures can be daunting. In this article, we described a practical method for selecting a sample size for repeated measures designs and provided an example. In addition, we gave practical advice for addressing poten-tial problems and complications.

Competing interests

In previous years, Dr. Muller has briefly served as a paid consultant to SAS Institute.

Authors’contributions

YG and KM were responsible for the conception and writing of the manuscript. HL designed the example dental study and assisted with writing. DG assisted with the conception and writing. All authors read and approved the final manuscript.

Acknowledgements

Yi Guo, Henrietta Logan, and Keith Muller’s support included NIH/NIDCR 1R01DE020832-01A1 and NIH/NIDCR U54-DE019261. Deborah Glueck’ support included NIH/NIDCR 1R01DE020832-01A1.

Author details

1_{Department of Health Outcomes and Policy, College of Medicine, University}

of Florida, Gainesville, FL, USA.2Southeast Center for Research to Reduce Disparities in Oral Health, University of Florida, Gainesville, FL, USA.

3

Department of Community Dentistry and Behavioral Science, College of Dentistry, University of Florida, Gainesville, FL, USA.4_{Department of}

Biostatistics and Informatics, Colorado School of Public Health, University of Colorado Denver, Aurora, CO, USA.

Received: 4 April 2013 Accepted: 29 July 2013 Published: 31 July 2013

References

1. Muller KE, Lavange LM, Ramey SL, Ramey CT:Power Calculations for General Linear Multivariate Models Including Repeated Measures Applications.J Am Stat Assoc1992,87(420):1209–1226.

2. Muller K, Stewart P:Sample size for linear mixed models. InLinear model theory: Univariate, multivariate and mixed models.New York, NY: Wiley; 2006:385–386.

3. Gurka MJ, Edwards LJ, Muller KE:Avoiding bias in mixed model inference for fixed effects.Stat Med2011,30(22):2696–2707.

N=40 N=20

N=10

4. Cheng J, Edwards LJ, Maldonado-Molina MM, Komro KA, Muller KE:Real longitudinal data analysis for real people: Building a good enough mixed model.Stat Med2010,29(4):504–520.

5. Muller KE, Edwards LJ, Simpson SL, Taylor DJ:Statistical tests with accurate size and power for balanced linear mixed models.Stat Med2007,

26(19):3639–3660.

6. Johnson JL, Muller KE, Slaughter JC, Gurka MJ, Gribbin MJ, Simpson SL:

POWERLIB: SAS/IML Software for Computing Power in Multivariate Linear Models.J Stat Softw2009,30(5):1–27.

7. Liu G, Liang KY:Sample size calculations for studies with correlated observations.Biometrics1997,53(3):937–947.

8. Simpson SL, Edwards LJ, Muller KE, Sen PK, Styner MA:A linear exponent AR(1) family of correlation structures.Stat Med2010,29(17):1825–1838. 9. Lenth RV:Some Practical Guidelines for Effective Sample Size

Determination.Am Stat2001,55(3):187–193.

10. Raudenbush SW, Liu X:Statistical power and optimal design for multisite randomized trials.Psychol Methods2000,5(2):199–213.

11. Sampson AR:A tale of two regressions.J Am Stat Assoc1974,

69(347):682–689.

12. Gatsonis C, Sampson AR:Multiple Correlation - Exact Power and Sample-Size Calculations.Psychol Bull1989,106(3):516–524.

13. Glueck DH, Muller KE:Adjusting power for a baseline covariate in linear models.Stat Med2003,22(16):2535–2551.

14. Logan H, Baron RS, Kohout F:Sensory focus as therapeutic treatments for acute pain.Psych Med1995,57(5):475–484.

15. Gedney JJ, Logan H:Memory for stress-associated acute pain.J Pain2004,

5(2):83–91.

16. Logan HL, Gedney JJ:Sex differences in the long-term stability of forehead cold pressor pain.J Pain2004,5(7):406–412.

17. Logan HL, Gedney JJ, Sheffield D, Xiang YW, Starrenburg E:Stress influences the level of negative affectivity after forehead cold pressor pain.J Pain2003,4(9):520–529.

18. Gedney JJ, Logan H, Baron RS:Predictors of short-term and long-term memory of sensory and affective dimensions of pain.J Pain2003,

4(2):47–55.

19. Logan HL, Baron RS, Keeley K, Law A, Stein S:Desired control and felt control as mediators of stress in a dental setting.Health Psychol1991,

10(5):352–359.

20. Lu K, Luo X, Chen PY:Sample size estimation for repeated measures analysis in randomized clinical trials with missing data.Int J Biostat2008,

4(1):Article 9.

doi:10.1186/1471-2288-13-100

Cite this article as:Guoet al.:Selecting a sample size for studies with

repeated measures.BMC Medical Research Methodology201313:100.

Submit your next manuscript to BioMed Central and take full advantage of:

• Convenient online submission

• Thorough peer review

• No space constraints or color figure charges

• Immediate publication on acceptance

• Inclusion in PubMed, CAS, Scopus and Google Scholar

• Research which is freely available for redistribution