Reproduce Statistical Analyses and Meta-Analyses

Documentation for package ‘reproducer’ version 0.4.2

DESCRIPTION file.

Help Pages

aggregateIndividualDocumentStatistics	aggregateIndividualDocumentStatistics
boxplotAndDensityCurveOnHistogram	boxplotAndDensityCurveOnHistogram
boxplotHV	boxplotHV
Calc4GroupNPStats	Calc4GroupNPStats
calculateBasicStatistics	calculateBasicStatistics
calculateGroupSummaryStatistics	calculateGroupSummaryStatistics
calculateHg	calculateHg
CalculateLevel2ExperimentRData	CalculateLevel2ExperimentRData
calculatePhat	calculatePhat
CalculateRLevel1	CalculateRLevel1
calculateSmallSampleSizeAdjustment	calculateSmallSampleSizeAdjustment
CalculateTheoreticalEffectSizes	CalculateTheoreticalEffectSizes
Ciolkowski09ESEM.MetaAnalysis.PBRvsCBRorAR	Ciolkowski09ESEM.MetaAnalysis.PBRvsCBRorAR data form a set of primary studies on reading methods for software inspections. They were reported and analysed by M. Ciolkowski ("What do we know about perspective-based reading? an approach for quantitative aggregation in software engineering", in Proceedings of the 3rd International Symposium on Empirical Software Engineering and Measurement, ESEM'09, pp. 133-144, IEEE Computer Society, 2009), corrected and re-analysed by Madeyski and Kitchenham ("How variations in experimental designs impact the construction of comparable effect sizes for meta-analysis" (to be submitted)).
Cliffd	Cliffd
constructEffectSizes	constructEffectSizes
ConstructLevel1ExperimentRData	ConstructLevel1ExperimentRData
densityCurveOnHistogram	densityCurveOnHistogram
effectSizeCI	effectSizeCI
ExtractExperimentData	ExtractExperimentData
ExtractGroupSizeData	ExtractGroupSizeData
ExtractMAStatistics	ExtractMAStatistics
ExtractSummaryStatisticsRandomizedExp	ExtractSummaryStatisticsRandomizedExp
fmt	fmt
getEffectSizesABBA	getEffectSizesABBA
getEffectSizesABBAIgnoringPeriodEffect	getEffectSizesABBAIgnoringPeriodEffect
getSimulationData	getSimulationData
getTheoreticalEffectSizeVariancesABBA	getTheoreticalEffectSizeVariancesABBA
Kendalltaupb	Kendalltaupb
KitchenhamEtAl.CorrelationsAmongParticipants.Abrahao13TSE	KitchenhamEtAl.CorrelationsAmongParticipants.Abrahao13TSE data illustrate correlations between results from individual participants in a family of five cross-over experiments conducted by Abrahao et al: [1] S. Abrahao, C. Gravino, E. Insfran Pelozo, G. Scanniello, and G. Tortora, "Assessing the effectiveness of sequence diagrams in the comprehension of functional requirements: Results from a family of five experiments," IEEE Transactions on Software Engineering, vol. 39, no. 3, pp. 327–342, March 2013 The five experiments assess whether the comprehensibility of function requirements improve when software models include UML sequence diagrams. If you use this data set please cite: [1] S. Abrahao, C. Gravino, E. Insfran Pelozo, G. Scanniello, and G. Tortora, "Assessing the effectiveness of sequence diagrams in the comprehension of functional requirements: Results from a family of five experiments," IEEE Transactions on Software Engineering, vol. 39, no. 3, pp. 327–342, March 2013 [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Gravino15JVLC	KitchenhamEtAl.CorrelationsAmongParticipants.Gravino15JVLC data illustrate correlations between results from individual participants in a family of 2 cross-over experiments conducted by Gravino et al.: [1] C. Gravino, G. Scanniello, and G. Tortora, "Source-code comprehension tasks supported by UML design models: Results from a controlled experiment and a differentiated replication," Journal of Visual Languages and Computing, vol. 28, pp. 23–38, 2015. The experiments assess whether the comprehension of object oriented source-code increases used with UML class and sequence diagrams produced in the software design phase. If you use this data set please cite: [1] C. Gravino, G. Scanniello, and G. Tortora, "Source-code comprehension tasks supported by UML design models: Results from a controlled experiment and a differentiated replication," Journal of Visual Languages and Computing, vol. 28, pp. 23–38, 2015. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Madeyski10	KitchenhamEtAl.CorrelationsAmongParticipants.Madeyski10 data illustrate correlations between results from individual participants in cross-over experiment P2007 (Smell&Library) conducted by Madeyski, see: [1] Lech Madeyski, Test-Driven Development: An Empirical Evaluation of Agile Practice. (Heidelberg, London, New York): Springer, 2010. Foreword by Prof. Claes Wohlin. If you use this data set please cite: [1] Lech Madeyski, Test-Driven Development: An Empirical Evaluation of Agile Practice. (Heidelberg, London, New York): Springer, 2010. Foreword by Prof. Claes Wohlin. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Reggio15SSM	KitchenhamEtAl.CorrelationsAmongParticipants.Reggio15SSM data illustrate correlations between results from individual participants in a family of two cross-over experiments conducted by Reggio et al: [1] G. Reggio, F. Ricca, G. Scanniello, F. D. Cerbo, and G. Dodero,"On the comprehension of workflows modeled with a precise style: results from a family of controlled experiments". Software and Systems Modeling, vol. 14, pp. 1481–1504, 2015. The experiments assess whether the level of formality/precision in workflow model influences comprehension. If you use this data set please cite: [1] G. Reggio, F. Ricca, G. Scanniello, F. D. Cerbo, and G. Dodero, "On the comprehension of workflows modeled with a precise style: results from a family of controlled experiments". Software and Systems Modeling, vol. 14, pp. 1481–1504, 2015. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The Importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Ricca10TSE	KitchenhamEtAl.CorrelationsAmongParticipants.Ricca10TSE data illustrate correlations between results from individual participants in a family of four cross-over experiments conducted by Ricca et al.: [1] F. Ricca, M. D. Penta, M. Torchiano, P. Tonella, and M. Ceccato "How developers’ experience and ability influence web application comprehension tasks supported by uml stereotypes: A series of four experiments", IEEE Transactions on Software Engineering, vol. 36, no. 1, pp. 96-118, 2010. Although we present the full data set, only the first two experiments were used in the correlation study, because many of the observations in the final two studies were unpaired. The experiments assess whether participants performance comprehension tasks better when using source code complemented by standard UML diagrams (UML) or by diagrams stereotyped using the Conallen notation (Conallen). If you use this data set please cite: [1] F. Ricca, M. D. Penta, M. Torchiano, P. Tonella, and M. Ceccato "How developers’ experience and ability influence web application comprehension tasks supported by uml stereotypes: A series of four experiments", IEEE Transactions on Software Engineering, vol. 36, no. 1, pp. 96—118, 2010. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The Importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Ricca14TOSEM	KitchenhamEtAl.CorrelationsAmongParticipants.Ricca14TOSEM data illustrate correlations between results from individual participants in a family of three of four cross-over experiments conducted by Ricca et al: [1] F. Ricca, G. Scanniello, M. Torchiano, G. Reggio, and E. Astesiano, "Assessing the effect of screen mockups on the comprehension of functional requirements," ACM Transactions on Software Engineering and Methodology, vol. 24, no. 1, pp. 1:1–1:38, Oct. 2014. The goal of the study was to assess whether stakeholders benefit from the presence of screen mock-ups in the comprehension of functional requirements represented with use cases. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Romano18ESEM	KitchenhamEtAl.CorrelationsAmongParticipants.Romano18ESEM data illustrate correlations between results from individual participants in a cross-over experiment conducted by Romano et al.: [1] S. Romano, G. Scanniello, D. Fucci, N. Juristo, and B. Turhan, "The effect of noise on software engineers’ performance", in Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ser. ESEM'18, 2018. The experiments assess whether noise has an impact on the performance of software engineers. If you use this data set please cite: [1] S. Romano, G. Scanniello, D. Fucci, N. Juristo, and B. Turhan, "The effect of noise on software engineers’ performance", in Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ser. ESEM'18, 2018. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The Importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020). The experiment had two parts but Kitchenham et al. only use the data from the first part of the experiment.
KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello14EASE	KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello14EASE data illustrate correlations between results from individual participants in a family of two cross-over experiments conducted by Scanniello et al: [1] G. Scanniello, M. Staron, H. Burden, and R. Heldal, "On the effect of using SysML requirement diagrams to comprehend requirements: results from two controlled experiments," in Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, EASE. ACM, 2014. The two experiments investigate whether requirements specified as SysML requirement diagrams improve the comprehensibility of requirements. If you use this data set please cite: [1] G. Scanniello, M. Staron, H. Burden, and R. Heldal, "On the effect of using SysML requirement diagrams to comprehend requirements: results from two controlled experiments", in Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, EASE. ACM, 2014. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello14JVLC	KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello14JVLC data illustrate correlations between results from individual participants in a cross-over experiment conducted by Scanniello and Erra: [1] G. Scanniello and U. Erra, "Distributed modeling of use case diagrams with a method based on think-pair-square: Results from two controlled experiments", Journal of Visual Languages and Computing, vol. 25, no. 4, pp. 494–517, 2014. The experiment investigated whether a new method based on think-pair-square and its implementation in a integrated communication/modeling environment (TPS approach) is as effective as traditional face-to-face (F2F approach) for requirements elicitation. The experiment was performed in two stages using different software systems. If you use this data set please cite: [1] G. Scanniello and U. Erra, "Distributed modeling of use case diagrams with a method based on think-pair-square: Results from two controlled experiments,” Journal of Visual Languages and Computing, vol. 25, no. 4, pp. 494–517, 2014. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The Importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello14TOSEM	KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello14TOSEM data illustrate correlations between results from individual participants in a family of four cross-over experiments conducted by Scanniello et al: [1] G. Scanniello, C. Gravino, M. Genero, J.A. Cruz-Lemus, and G. Tortora, "On the Impact of UML Analysis Models on Source-Code Comprehensibility and Modifiability", ACM Transactions on Software Engineering and Methodlogy, vol. 23, no. 2, pp. 13:1-13:26, 2014 The family of experiments investigated whether the availability of analysis models in addition to the source code made the code easier to understand and modify. If you use this data set please cite: [1] G. G. Scanniello, C. Gravino, M. Genero, J.A. Cruz-Lemus, and G. Tortora, "On the Impact of UML Analysis Models on Source-Code Comprehensibility and Modifiability", ACM Transactions on Software Engineering and Methodology, vol. 23, no. 2, pp. 13:1-13:26, 2014 [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "The importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).
KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello15EMSE	KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello15EMSE data illustrate correlations between results from individual participants in cross-over experiment usb2 conducted by Scanniello et al: [1] G. Scanniello, A. Marcus, and D. Pascale, "Link analysis algorithms for static concept location: an empirical assessment", Empirical Software Engineering, vol. 20, no. 6, pp. 1666–1720, 2015. The goal of the experiment is to assess whether a new technique (implemented as an Eclipse plug-in) for static concept location (proposed by the authors) supports users in identifying the places in the code where changes are to be made.
KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello17TOSEM	KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello17TOSEM data illustrate correlations between results from individual participants in a family of four cross-over experiments conducted by Scanniello et al.: [1] G. Scanniello, M. Risi, P. Tramontana, and S. Romano, "Fixing faults in C and Java source code: Abbreviated vs. full-word identifier names", ACM Transactions on Software Engineering Methodology, vol. 26, no. 2, 2017. The experiments assess whether whether the use of abbreviated identifier names (ABBR), impacts the effectiveness of fault fixing in C and Java source code in comparison with full-word identifier names (FULL). If you use this data set please cite: [1] G. Scanniello, M. Risi, P. Tramontana, and S. Romano, “Fixing faults in C and Java source code: Abbreviated vs. full-word identifier names", ACM Transactions on Software Engineering Methodology, vol. 26, no. 2, 2017. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, "On the Importance of the Correlation between Results from Individual Participants in Crossover Experiments" (to be submitted as of 2020).