Proposal for a Measurement Model for Software Tests with a Focus on the Management of Outsourced Services

Angelica Toffano Seidel Calazans, Ricardo Ajax Dias Kosloski, Luiz Carlos Miyadaira Ribeiro Junior

Abstract


The need for outsourcing IT services has shown a significant growth over the past few years. This article presents a proposal for a measurement model for Software Tests with a focus on the management of these outsourced services by governmental organizations. The following specific goals were defined: to identify and analyze the test process; to identify and analyze the existing standards that govern the hiring of IT services and to propose a Measurement Model for outsourced services of this type. As to the analysis of the data collected (documentary research and semi-structured interviews), content analysis was adopted, and in order to prepare the metrics, the GQM – Goal, Questions, Metrics – approach was used. The result was confirmed by semi-structured interviews. Here is what the research identifies as possible: to establish objective and measurable criteria for a measurement size as the input to evaluate the efforts and deadlines involved; to follow up the test sub-processes and to evaluate the service quality. Therefore, the management of this type of service hiring can be done more efficiently.

Keywords


Test process; hiring management; outsourcing; metrics; and measurements

Full Text:

PDF

References


ALBARELLO, Luc; DIGNEFFE, Françoise; HIERNAUX, Jean-Pierre; MAROY, Christian, RUQUOY, Danielle; SAINT-GEORGES, Pierre de. Prática e Métodos de Investigação em Ciências Socias. Portugal: Gradiva, 1995.

ARANHA, Eduardo, BORBA, Paulo An Estimation Model for Test Execution Effort. First International Symposium on Empirical Software Engineering and Measurement – IEEE computer society,2007.

BASILI, V. e ROMBACH, H. “Goal question metric paradigm”, Encyclopedia of software engineering – 2, 1994

BRASIL. Lei n° 8.666, de 21 de junho de 1993. Regulamenta o art. 37, inciso XXI, da Constituição Federal, institui normas para licitações e contratos da Administração Pública e dá outras providências. 1993. Disponível em:. Acesso em: 16 ago. 2011.

BRASIL. Instrução Normativa SLTI n° 4, de 19 de maio de 2008. Dispõe sobre o processo de contratação de serviços de Tecnologia da Informação pela Administração Pública Federal direta, autárquica e fundacional. 2008b. Disponível em:. Acesso em: 16 ago. 2011.

CAETANO, Cristiano. Gestão de defeitos. Engenharia de Software, ano 1, 1ª. Edição. 2008

CRISTIANO, Caetano Gestão de Testes Ferramentas Open Source e melhores práticas na gestão de testes , Engenharia de software. Ano 1 - 3ª Edição 2008

CRUZ, C. S.; ANDRADE, E. L. P.; FIGUEIREDO, R. M. C. PCSSCEG - Processo de contratação de serviços de Tecnologia da Informação para Organizações Públicas. DF: MCT, 2011.

FENTON, N; PFLEEGER, S. Software Metrics: A Rigorous and Practical Approach. 2.ed. Boston: PWS Publishing Company, 1997.

IEEE - Standard for Software & System. Test Documentation. IEEE 829-2008, 2008

IFPUG, International Function Point Users Group, Manual de Práticas de Contagens de Pontos de Função, versão 4.3.1, Janeiro/201º

INFORMATION TECHNOLOGY GOVERNANCE INSTITUTE - ITGI.. COBIT - Control Objectives for Information and related Technology. 4.1. ed. Rolling Meadows: ITGI, 2007a. Disponível em: . Acesso em: 16 ago. 2011.

ISO/IEC - International Organization for Standardization and International Electrotechnical Commission. ISO/IEC 9126:2002 Software quality, 2002

ITSqc - Information Technology Services Qualification Center (2009a), eSourcing Capability Model for Client Organizations (eSCM-CL) v1.1 – parte 1. Disponível em: http://www.itsqc.org/downloads/documents/eSCM-CL_Part1_V1dot1.html. Acessado em fevereiro/2011.

ITSqc - Information Technology Services Qualification Center (2009b), eSourcing Capability Model for Client Organizations (eSCM-CL) v1.1 – parte 2. Disponível em: http://www.itsqc.org/downloads/documents/eSCM-CL_Part2_V1dot1.html. Acessado em fevereiro/2011.

JONES, C. Software Estimating Rules of Thumb. Relatório Técnico. 2007.

JURISTO, N.; MORENO, A. M.; VEGAS, S. Reviewing 25 years of testing technique experiments. Empirical Softw. Eng., v. 9, n. 1-2, p. 7-44, 2004.

KAUR,.Arvinder, SURI, Bharti, SHARMA, Abhilasha. Software Testing Product Metrics - A Survey. Proceedings of National Conference on Challenges & Opportunities in Information Technology (COIT-2007) RIMT-IET, MandiGobindgarh. March 23, 2007.

KUSHWAHA, Dharmender Singh; MISRA, A.K. Software Test Effort Estimation. ACM SIGSOFT Software Engineering, Volume 33, Number 3,May 2008

KVALE, Steinar. Interviews: an introduction to qualitative research interviewing. California: Sage publications, 1996.

LAZIC,Ljubomir ; MASTORAKIS, Nikos .Cost Effective Software Test Metrics. WSEAS TRANSACTIONS on COMPUTERS. Issue 6, Volume 7, June 2008.

NAGESWARAN, S. Test effort estimation using use case points. Technology, (June), 2001. Quality Week 2001, San Francisco, California, USA, June 2001

NIRPAL,Premal B. ; KALE,K. V..A Brief Overview Of Software Testing Metrics.International Journal on Computer Science and Engineering (IJCSE), Vol. 3 No. 1 Jan 2011.

PATEL, N, GOVINDRAJAN, M, MAHARANA, S., RANDAS, S. Test Case Point Analysis - Cognizant Technology Solutions, 2001. Disponível em www.stickyminds.com/getfile.asp?ot=XML&id=2566&fn=XUS373692file1.pdf. Acesso em 15/03/2011.

PFLEEGER, ,Shari L. Engenharia de software: teoria e prática. 2ª. Ed. São Paulo: Prentice Hall,2004.

PRESSMAN, Roger.Engenharia de Software. Sao Paulo : MCGRAW-HILL , 2006 , 6.ed

PUSALA, Ramesh. Operational Excellence through efficient software testing metrics. Point view –Infosys, 2006.

SANTRA, Arupratan.A New approach for estimation of software testing process based on software requirements.Journal of scientific & industrial research, vol 69, October 2010. Pp.746-749

SEI – Software Engineering Institute (2007), CMMI for Acquisition (CMMI-ACQ) - Version 1.2. Disponível em: www.sei.cmu.edu/cmmi/tools/acq/download.cfm

SILVA, Marco Aurélio da Silva ; DUARTE, Roberto Gonzalez ;CASTRO,José Márcio de . OUTSOURCING DE TI E REDEFINIÇÃO DO PAPEL DA SUBSIDIÁRIA: UM ESTUDO COMPARATIVO ENTRE AS SUBSIDIÁRIAS BRASILEIRAS E INDIANA DE UMA MULTINACIONAL AMERICANA. Revista de Gestão da Tecnologia e Sistemas de Informação Journal of Information Systems and Technology Management Vol. 6, No. 2, 2009, p. 173-202.

SOFTEX – Associação para Promoção da Excelência do Software Brasileiro (2009b). MPS.BR – Melhoria de Processo do Software Brasileiro: Guia de Aquisição. Disponível em www.softex.br/mpsbr. Acessado em janeiro de 2011.

SOMMERVILLE,Ian. Engenharia de software. 8ª. Ed. São Paulo: Pearson Addison-Wesley, 2007.

TRIVINOS, Augusto N.S. Introdução à pesquisa em ciências sociais: a pesquisa qualitativa na educação.São Paulo: Atlas, 1987.175 p.

VEENENDAAL, E, DEKKERS, T. Test point analysis: a method for test estimation, Project Control for Software Quality, Editors, Rob Kusters, Adrian Cowderoy, Fred Heemstra and Erik van Veenendaal. Shaker Publishing, 1999.

VENKATASUBRAMANIAN, A. ; VINOLINE, V. Software Test Factory (A proposal of a process model to create a Test Factory). International Journal of Computational Intelligence Techniques, ISSN: 0976–0466 & E-ISSN: 0976–0474,Volume 1, Issue 1, 2010, PP-14-19




DOI: http://dx.doi.org/10.4301/s1807-17752012000200004

Copyright (c)

Licensed under