Search

You must create a non-member user account or become an ICE member to purchase items.
Create an account using the buttons below or log in to an existing account.
If you receive ICE emails, you already have an account. Click Login in the top right corner and retrieve your password using the "Username and/or Password Help" link.

Create a non-member account

Become a member

 

WP14 Best Practices for Preparing Your RFPs and RFIs
WP14 Best Practices for Preparing  Your RFPs and RFIs

Sponsors of credentialing programs often seek assistance from contractors and vendors. To obtain the best set of responses and select the most qualified provider to assist you, your organization is obligated to develop and disseminate a clear request for proposal (RFP) or request for information (RFI). Although it sounds quite easy, it is critical that you take the time and the effort to organize your needs into a well-delineated set of business requirements: this way, your organization can ensure that it will receive comparable responses from providers. This paper provides tips for the development of clear and concise RFPs, including how to describe the goods and services your organization is seeking and the criteria for judging the responses.Just as important, this paper will provide examples of pitfalls likely to confuse contractors and vendors, resulting in proposals that are difficult to judge. The content of this paper is designed to be applicable to the wide variety of RFPs you might develop, from requests for strategic consulting to specific research investigations, from examination planning and development to administration and scoring, and from auditing to validating your program’s requirements, to name just a few.

Meet the Authors

Sandra Greenberg, PhD is Vice President for Research & Advisory Services at Professional Examination Service (ProExam) where her responsibilities include strategic planning; serving as a liaison to key clients and stakeholders; developing business relationships and expanding client engagements in new sectors; and coaching and mentoring colleagues.  Dr. Greenberg has conducted large-scale studies of professions; standard setting, feasibility, and recertification studies; and developed observational scales, portfolio-based assessments, and practical examinations for nationally- and internationally-recognized credentialing programs. She has been an active participant at the Institute for Credentialing Excellence (ICE), the Council on Licensure, Enforcement and Regulation (CLEAR), where she currently serves on the Board of Directors, and the Association of Test Publishers (ATP). With regard to ICE, Dr. Greenberg has served on the Program Committee, the Nominating Committee, the Publications Committee (chair), the Governmental Affairs Committee, and the Marketing and Communications Committee, and has presented numerous times at the ICE annual conference.

Carla M. Caro, MA is a Research Director at Professional Examination Service, where she is responsible for conducting large-scale engagements such as job/practice analyses and the development of competency frameworks; feasibility studies; validation projects involving a range of complementary data collection initiatives; value proposition studies; and standard setting, for a range of nationally- and internationally-recognized credentialing programs.  Ms. Caro has previously worked as a public policy analyst and in the area of educational advocacy.  Her volunteer activities with ICE include serving on the NCCA Standards Revision project in the Technical Advisory Group for Psychometrics, and on the Publications Committee. She is a frequent presenter at the ICE annual conference.

Member Price: FREE; Non-member Price: $50

WP11 Beyond Multiple Choice: Strategies for Planning and Implementing an Innovative Item Initiative
WP11 Beyond Multiple Choice: Strategies for Planning and Implementing an Innovative Item Initiative

In recent years, a number of certification testing programs have extended item writing efforts to include innovative, objective item formats alternative to the multiple-choice question (MCQ). Several of these item types, including multiple correct response (MCR), short answer/calculation, hotspot, and drag-and-drop (matching or ordering), have been available for several years and are starting to see wider use. However, the lack of fundamental research establishing the value of these item types led us to conduct this investigation in the hope of advancing a delineation of best practice. This 2011 white paper, authored by Timothy Muckle, PhD, will explore a number of facets of the foray into the development of innovative item formats by one credentialing organization (National Board of Certification and Recertification for Nurse Anesthetists, or NBCRNA).

In addition to summarizing the implementation of alternative item types, the paper will discuss overall benefits of the project, with a particular focus on value added to the credential, as well as lessons learned and recommendations for decision-making for other organizations.

Meet the Author

Dr. Timothy Muckle is currently employed as the Director of Testing Services at the National Board of Certification and Recertification for Nurse Anesthetists. While employed there, he has been responsible for managing test development and psychometric quality of the National Certification Examination, the development of innovative item types, and spearheading an exam-related research agenda. He has also served as a psychometrician on the National Commission for Certifying Agencies (NCCA) Commission since 2010. He received his B.S. degree in Mathematics from the University of Notre Dame, and received his Ph.D. in Educational Psychology (Measurement, Evaluation, Statistics, and Assessment) from the University of Illinois at Chicago. His research interests include computerized adaptive testing (CAT), alternative item types, and performance-based assessments using simulation. Dr. Muckle resides in Michigan with his wife and four children.

Member Price: FREE, Non-Member Price: $50.00

RSRCH15 Executive Summary: Certification Industry Compensation & Benefits Survey 2015 Report
RSRCH15 Executive Summary: Certification Industry Compensation & Benefits Survey 2015 Report

Member Exclusive

Download the Executive Summary for ICE's Certification Industry Compensation & Benefits Report for free! This Executive summary provides an overview of the method used to conduct the survey, identifies general profiles of the responding organizations, lists the type of data categories reported for each position, and provides a few highlights of the data in the report. 

Member Price: $0.00

This Executive Summary is a member exclusive. The full report is available for purchase

RSRCH15 Continuing Competence Framework Document
RSRCH15 Continuing Competence Framework Document

Member Exclusive

In 2013, ICE had a unique opportunity to consider the future of credible, valuable, and meaningful continuing competence programs through its Continuing Competence Framework project. With the funding and support of our Research & Development (R&D) contributors and the hard work of the Continuing Competence Working Group, ICE is pleased to release this ongoing project as its latest member exclusive: Utilizing a Process Framework to Build an Effective Continuing Competence Program for Certification. 

Whether you are looking to select, build, or revise your continuing competence program, ICE has gathered suggested assessment measures in this Process Framework document for organizations that wish to explore the relevance of their continuing competence programs to the credibility of their certification credential.

ICE would like to thank all of the Continuing Competence Working Group members for their time, energy, and vision on this ongoing project. This product would not have been possible were it not for the generous contributions of the Research & Development (R&D) donors and the thoughtful participation of the Working Group members.

Utilizing a Process Framework to Build an Effective Continuing Competence Program for Certification. (c) July 2015. 40 pages. Download the table of contents

Member Price: $0.00
This is a member exclusive. 

TERM07 Defining Features of Quality Certification and Assessment-Based Certificate Programs
TERM07 Defining Features of Quality Certification and Assessment-Based Certificate Programs

In January 2007, the Institute for Credentialing Excellence (ICE) Board of Directors established a Certificate Task Force to identify characteristics of quality certification and assessment-based certificate programs and outline the distinguishing features of each. This defining features document served as the basis for ICE 1100 - Standard for Assessment-Based Certificate Programs. © 2008 ICE

Member & Non-Member Price: FREE

WEB15-3 Exam Results & Score Reports: Do's and Don'ts
WEB15-3 Exam Results & Score Reports: Do's and Don'ts

Brian Bontempo, PhD
Founder and Principal Consultant, Mountain Measurement, Inc.

During this webinar, participants will learn about the basics of score reporting. The session will commence with a description of the essential elements of a successful score report for passing candidates and separately for failing candidates. Following that, the various standards that pertain to score reporting for certification examinations will be provided along with some guidance and commentary about their relevancy and meaning. The third part will focus on best practices for score reporting. Topics that will be covered include score metrics (e.g., raw, percent, or scaled scores), the reporting of subscores, error metrics, other potentially useful metrics (such as number of items), the use of graphics, and when/how to provide score reports.

Webinar Learning Objectives

  • identify the essential elements of a score report for passing and for failing candidates
  • recognize the NCCA, AERA, APA, NCME standards that apply to certification examination score reporting
  • examine when/how to report subscore information on score reports

Please note: This on-demand webcast is pre-recorded and available for unlimited viewings for a 30-calendar day period, beginning the date of purchase. You will be able to immediately access the recording, and access instructions will be provided in your automated purchase confirmation. If you choose to pay by check, access will not be granted until the check payment has been received and deposited.

Member price: FREE; Non-member price: $135

 

WP16 Five of the Most Frequent Problem Areas with NCCA Applications
WP16 Five of the Most Frequent Problem Areas with NCCA Applications

This Institute for Credentialing Excellence (ICE) white paper is written to help certifying bodies preparing applications for accreditation by the National Commission for Certifying Agencies (NCCA) understand the requirements of the 2014 Standards for the Accreditation of Certification Programs (Standards). Five of the most frequent problem areas with applications for NCCA accreditation are discussed. Suggestions are made to clarify the requirements for compliance with the Standards. However, this white paper does not provide an authoritative interpretation of the Standards. Download the Table of Contents.

Meet the Authors

Donald A. Balasa, JD, MBA, has served as Chief Executive Officer and Legal Counsel of the American Association of Medical Assistants (AAMA) since 1990. He served previously as Staff Attorney for the American Dental Assistants Association. Don received both his baccalaureate and law degrees from Northwestern University, and his Master of Business Administration in economics from the University of Chicago.  He earned his Certified Association Executive (CAE) designation from the American Society of Association Executives in 1985. He served on the National Commission for Certifying Agencies from 2007 to 2013, and as Chair from 2010 to 2013.

James Robert Fidler is Director of Testing and Competency Assurance at American Medical Technologists in Rosemont, Illinois.  As a methodologist, his areas of concentration include psychometrics, professional certification, research design, data analysis, and applications of Rasch measurement methodology.  He received his doctorate from Loyola University of Chicago. During his past three decades working in psychometrics and credentialing, Dr. Fidler has provided input into a number of health and non-health related national certification programs, has authored articles in certification testing, and has been responsible for all aspects of examining certification candidates across various disciplines. Most recently, Dr. Fidler was honored to have participated in the National Commission for Certifying Agencies (NCCA) accreditation standards revision project, serving as a member of a team reviewing standards related to psychometrics.

Member Price: FREE; Non-member Price: $50

ST10 ICE 1100 Standard - ACAP Standard for Assessment-Based Certificate Programs
ST10 ICE 1100 Standard - ACAP Standard for Assessment-Based Certificate Programs

ICE is proud to publish the first American National Standard for certificate programs, ICE 1100 2010(E) – Standard for Assessment-Based Certificate Programs (2009). The Standard specifies essential requirements for certificate programs and provides guidance to program providers, consumers, and others on what defines a high-quality program.

Member Price: FREE, Non-Member Price: $75.00 

TERM06 ICE's Basic Guide to Credentialing Terminology
TERM06 ICE's Basic Guide to Credentialing Terminology

This 2006 useful guide combines the glossary from the National Commission for Certifying Agencies Standards for the Accreditation of Certification Programs and The ICE Guide to Understanding Credentialing Concepts. The intent of this document is to clarify terms that are used in relation to programs that grant formal recognition to individuals or entities during the credentialing process. (c) 2006 ICE

Member & Non-Member Price: FREE

TERM05 ICE's Guide to Understanding Credentialing Concepts
TERM05 ICE's Guide to Understanding Credentialing Concepts

Despite the widespread use of professional designations, credentialing terms are often misused and general concepts often misunderstood. ICE developed The ICE Guide to Understanding Credentialing Concepts (2005) to assist its stakeholders, including legislators, educators, employers, credentialing agencies, professionals and the public, in understanding and correctly using credentialing terms and concepts. (c) 2005 ICE

Member & Non-Member Price: FREE

WP08 Interfaces Between Professional Certification and Academic Accreditation
WP08 Interfaces Between Professional Certification and Academic Accreditation

This 2008 white paper, authored by Donald Balasa, JD, MBA, presents a discussion of the legal issues that should be taken into consideration by: (1) professional certifying bodies when determining eligibility pathways for their examinations; and (2) academic accrediting bodies when determining which certification examinations are acceptable for measuring graduate achievement from the programs they accredit.  It presents a non-technical, layperson’s treatment of the legal issues and does not discuss the technicalities of antitrust and other applicable areas of law.

Meet the Author

Donald A. Balasa, JD, MBA, has served as the Executive Director and Legal Counsel of the American Association of Medical Assistants since 1990. He received both his baccalaureate and law degrees from Northwestern University, and his Master of Business Administration in economics from the University of Chicago. He earned his Certified Association Executive (CAE) designation from the American Society of Association Executives in 1985. He has served on the National Commission for Certifying Agencies since 2007, and as chair since 2010.

Member Price: FREE; Non-Member Price: $50

REC15 2016 NCCA Standards Training
REC15 2016 NCCA Standards Training

A free on-demand training on the NCCA Standards for Certification Programs.  The training highlights the application process and summarizes the intent and requirements of each Standard.

Please note: this was recorded in 2015, application prices may vary.

Price: $0.00

ST Retired NCCA Standards for the Accreditation of Certification
ST Retired NCCA Standards for the Accreditation of Certification

For those organizations wishing to seek accreditation for one or more of their certification programs in 2015, download your copy of the NCCA Standards to understand the requirements for accreditation. © 2005

Members: Free, Non-members: $75.00

ST NCCA Standards for the Accreditation of Certification
ST NCCA Standards for the Accreditation of Certification

The 2016 Standards have been adopted and will be in effect beginning January 1, 2016. For those organizations wishing to seek accreditation for one or more of their certification programs in 2016 or later, download your copy of the NCCA Standards to understand the requirements for accreditation. © 2014

Members: Free, Non-members: $75.00

 

WP15 Score Reporting: Where Policy Meets Psychometrics
WP15 Score Reporting: Where Policy Meets Psychometrics

Developing score reports for credentialing programs requires balancing various stakeholders’ needs for information and professional standards for reporting examination results. It is imperative that these reports appropriately communicate the results of an examination in a way that encourages proper interpretation and minimizes the likelihood of misinterpretation. The purpose of this white paper is to offer practitioners guidance on designing and evaluating score reports along with examples of various practices from programs within the industry.

The first section of the paper discusses the expectations of each major stakeholder group that represents a key interest in the outcomes of the credentialing program, including candidates, employers, educators/training programs, and credential program staff. This review highlights the various potential uses and interpretations of the information provided on the score reports, including expectations dictated by professional standards and guidelines.

The second section of the paper provides guidance on the design of the score report, including both the content to incorporate and its presentation format at the test and section (e.g., content area and subarea) levels. Each option will be presented in the context of professional guidance and applicability to various intended uses of test results.

Finally, the third section of the paper includes guidance on planning for score reporting. Programs should discuss these plans at the outset of the test development process to ensure the test is designed to facilitate the intended interpretation of test scores. 

Meet the Authors

Dr. Davis-Becker is a Senior Psychometrician and the Director of Professional Credentialing at Alpine Testing Solutions. Susan is responsible for providing psychometric advice and consultation to a variety of testing programs and her areas of expertise include test design, standard setting and validity research. Susan received her doctoral degree in assessment and measurement from James Madison University and has published numerous journal articles, book chapters and presented research at regional, national, and international conferences.

Jeff Kelley completed a PhD in educational measurement at the University of Kansas in 2004.  He joined the National Center for Competency Testing in 2012 as Vice President of Psychometrics, charged with development, validation and security for seven allied health certification tests.  Before joining NCCT, Doctor Kelley worked as Director of Psychometrics for six years at Ascend Learning dealing with nursing education and allied health certification testing.  Prior to that, he worked for nine years in licensure and certification testing as a research associate and as a program director with Applied Measurement Professionals.  His research interests include item writing, test security, and test score reliability.  

Member Price: FREE; Non-member Price: $50

WP09 Succeeding in the Business of Certification
WP09 Succeeding in the Business of Certification

This 2009 white paper, authored by Joan Knapp, PhD and Paul Grace, MS, CAE, describes the nature of the certification business and identifies the antecedents for having a successful program. These are the fundamental business tools and approaches that we all know (e.g., market and competitive analyses, business strategy and planning); however, in this paper they are applied to the certification enterprise. The paper is targeted to certification staff or Board members who are considering starting a program, adding credentials to an existing program, changing key program features, discontinuing a program, or wishing to maintain or enhance the success of an existing program. (c) 2009

Member Price: FREE; Non-Member Price: $50

WP15 Value of Certification: An Exploration of Concept and Research Process
WP15 Value of Certification: An Exploration of Concept and Research Process

Why should credential holders and those who employ them care about your credential? Said differently, what’s in it for them? This is the focus of value of certification (VoC).

VoC seeks to understand the various stakeholder audiences for the credentialing organization, explore the factors important to them, and communicate these messages to the market and promote the credential. This white paper will explore the concept of VoC and its various intrinsic and extrinsic forms through the existing academic and professional literature. In addition, this paper will present examples from various credentialing bodies to demonstrate how organizations prioritize VoC factors and communicate them to credential holders, hiring managers, HR professionals, and executives.

The white paper will be most useful for credential managers or executives who are new to the concept of VoC or who have not previously researched and organized value indicators for a credential. This paper will serve as a guide for understanding what VoC is, how you can use it, and how to start your own VoC study, regardless of whether you use ICE’s Value of Certification Toolkit or engage an external consultant.

Meet the Author

Rory is the Vice President of Certification Services for PSI. In this role, he serves certification clients by leading a team of business development, client services, and test development/psychometric professionals. During his career, Rory has worked with over 80 associations, including well-known licensure programs and globally renowned certifications. Previously, Rory served as the President of International Credentialing Associates (ICA), providing test development, market research, and program management consulting for credentialing organizations. He also worked as a Product Manager of Credentials at the Project Management Institute (PMI), growing their flagship Project Management Professional (PMP)® credential through critical business changes and marketing. He also worked at Prometric, providing exam development and program design consulting.

Rory serves extensively throughout the certification community, including as the Vice Chair, Program Committee, for ATP’s Innovations Conference in 2016. In addition, Rory serves as Treasurer on the Board of Directors for the Credentialing Network Group (CNG) and the Chair of the Education Committee for ICE. He is also the current Co-Chair of the ATP Security Committee.

Rory received a Ph.D. in Organizational Leadership from The Chicago School of Professional Psychology. He also holds an MBA from Drexel University and B.A. in Psychology from Millersville University.

He is certified as a Certified Association Executive (CAE), Senior Professional in Human Resources (SPHR), and New Product Development Professional (NPDP). 

Member Price: FREE; Non-member Price: $50

WP15 What Is the Optimal Number of Distractors in Exam Items? Case Study
WP15 What Is the Optimal Number of Distractors in Exam Items? Case Study

Multiple choice (MC) items that employ four or more options remain a popular format in standardized college entrance exams and employment selection tests despite the fact that most research supports the use of three-option MC items. The same is true with licensing and credentialing exams. A case study is provided that documents the Chartered Financial Analyst (CFA) exam’s transition to a three-option item format. The CFA program is the gold standard credential among investment professionals globally, with 124,000 CFA charterholders residing in 145 countries. This case study is intended to be of value to other testing programs considering a similar change with respect to understanding the motivation for change, the challenges faced with stakeholders and constituents, and the psychometric impacts of change that align with literature-based expectations.

Meet the Authors

Peter Mackey, CFA is Head, CFA Program and Examination Development at CFA Institute.  In that role, Peter coordinates the major activities supporting the CFA Program and manages the exam development work for all certification and certificate programs offered by CFA Institute.  Before coming to CFA Institute in September 2004, Peter spent five years at the U.S. Treasury Department as Deputy Director at the Office of District of Colombia Pensions where he managed three trust funds on behalf of the District’s defined benefit pension plans.  Peter’s experience also includes 12 years as Director of the Office of Investments for the Federal Retirement Thrift Investment Board, where he established a defined contribution retirement program for US government employees and directed an investment fund of more than US$80 billion on behalf of 2.4 million participants.  Peter has been involved (as a volunteer, consultant and staff member) in all aspects of practice analysis, curriculum development, exam design and development, exam grading and standard setting for the past 20 years.  He holds an MBA in finance from George Washington University and a BA in economics from Manhattan College.

Timothy Konold, PhD is Professor and Director of the Research, Statistics, and Evaluation program at the University of Virginia; and holds faculty affiliations with the Center for the Advanced Study of Teaching and Learning (CASTL) and the Virginia Education Science Training (VEST) program.  He has taught introductory and advanced graduate level courses in psychometric theory and advanced quantitative methods at the University of Virginia for the past 18 years.  He has served as the senior psychometric consultant for the Chartered Financial Analyst (CFA) global testing program for over ten years.  He has authored more than 100 peer-reviewed articles, book chapters, published tests, book/test reviews, and technical reports on topics that seek to infuse contemporary psychometric and quantitative methods into work that has direct implications for large scale test use as it pertains to construction, interpretation, classification and errors of measurement.

Member Price: FREE; Non-member Price: $50

WP10 Why Business Continuity Planning for Certification Program Sponsors?
WP10 Why Business Continuity Planning for Certification Program Sponsors?

This 2010 white paper, authored by Clifford H. Donath and Anthony T. Baratta, provides a practical and operational introduction to good practices in defining the necessary safeguards in obtaining and protecting important program information and intellectual property. This paper can be usefully applied as a checklist and template for gathering the necessary information and explores what should be requested from vendors to supply information and proposals to implement business continuity contracts and how to validate contract compliance. © 2010

Member Price: FREE; Non-Member Price: $50